Model Hub

Browse PQC-verified AI models, datasets, and tools

All Models Datasets Tools
Sort: Most Downloaded Most Liked Recently Updated
Risk: All CRITICAL HIGH MEDIUM LOW
HuggingFaceFW/finetranslations HF Unverified

💬 FineTranslations The world's knowledge in 1+1T tokens of parallel text What is it? This dataset contains over 1 trillion tokens of parallel text in English and 500+ languages. It was obtained by translating data from 🥂 FineWeb2 into English using Gemma3 27B. We relied on datatrove's inference runner to deploy a synthetic data pipeline at scale. Its checkpointing and VLLM lifecycle management features allowed us to use leftover compute from the HF cluster… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceFW/finetranslations.

Task_categories:text-GenerationTask_categories:translationLanguage:abkLanguage:abqLanguage:absLanguage:acm
natgillin/translations-raw HF Unverified

natgillin/translations-raw Frozen, canonical raw bitext consolidated from upstream alvations/mtdata-raw* snapshots (since deleted). This is the read-only source-of-truth for downstream quality-filtering pipelines. 31,663 parquet files (1566.8 GB) 49 language pairs under data/<src-tgt>/ Schema: 5 columns — see below Read-only for downstream pipelines. Do not delete or modify. Schema Each parquet has 5 columns: column type description source string… See the full description on the dataset page: https://huggingface.co/datasets/natgillin/translations-raw.

Language:multilingualSize_categories:1M<n<10MFormat:parquetModality:textLibrary:datasetsLibrary:dask
Showing 2 of 2 items (page 1 of 1)
Prev Next