Skip to content

Optimise dataframe_to_mds for Large-Scale Datasets via intermediate Aggressive Disk Cleanup and Distributed Metadata Handling - #971

Open
AbhishekKumarSingh wants to merge 1 commit into
mosaicml:mainfrom
AbhishekKumarSingh:converter_fix
Open

Optimise dataframe_to_mds for Large-Scale Datasets via intermediate Aggressive Disk Cleanup and Distributed Metadata Handling#971
AbhishekKumarSingh wants to merge 1 commit into
mosaicml:mainfrom
AbhishekKumarSingh:converter_fix

fixed no space left on disk issue when using dataframe_to_mds method …

e9c5025
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs