{"id":232,"slug":"huggingfacefw--fineweb-edu","name":"fineweb-edu","author":"HuggingFaceFW","description":"\n\t\n\t\t\n\t\t📚 FineWeb-Edu\n\t\n\n\n    \n\n\n\n1.3 trillion tokens of the finest educational data the 🌐 web has to offer\n\nPaper: https://arxiv.org/abs/2406.17557\n\n\t\n\t\t\n\t\n\t\n\t\tWhat is it?\n\t\n\n📚 FineWeb-Edu  dataset consists of 1.3T tokens  and  5.4T tokens (FineWeb-Edu-score-2) of educational web pages filtered from 🍷 FineWeb dataset. This is the 1.3 trillion version.\nTo enhance FineWeb's quality, we developed an educational quality classifier using annotations generated by LLama3-70B-Instruct. We then… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu.","tags":"[\"Task_categories:text-Generation\",\"Language:en\",\"Size_categories:1B<n<10B\",\"Format:parquet\",\"Modality:tabular\",\"Modality:text\"]","license":null,"framework":null,"parameters":null,"downloads":536493,"likes":1061,"verified":1,"created_at":"2026-04-20 18:22:10","updated_at":"2026-05-08 14:17:34","source_url":"https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu","source_platform":"huggingface","hf_repo_id":"HuggingFaceFW/fineweb-edu","ollama_name":"","category":"dataset","latest_version":"v1.0.0","version_count":1,"signature_count":2,"risk_level":null,"risk_score":null,"versions":[{"id":231,"model_id":232,"version":"v1.0.0","manifest_hash":"bdb3f16b0b6e0c7c2353aa6276897c4cd5d1c69e98de90173c76d1e7b7d6024c","file_count":0,"total_size":0,"r2_manifest_key":"manifests/datasets/huggingfacefw--fineweb-edu/v1.0.0.json","created_at":"2026-04-20 18:22:10"}],"files":[],"signatures":[{"id":593,"version_id":231,"signer_did":"did:quantamrkt:registry:shield-v1","algorithm":"ML-DSA-65","signature_hex":"24b77a8f30cb305269d8dad245584cea83811fbf608b460fd7acf8aa32b61152","attestation_type":"registry","signed_at":"2026-04-20 18:22:10"},{"id":714,"version_id":231,"signer_did":"did:web:quantamrkt.com:chain:authority","algorithm":"ML-DSA-87","signature_hex":"46271b0cf7b9994581fcf5e47f5ad59d677a0ffd0e04610fb4e803bee16477db970dceb186c2192ec8227f1d6101fca20ce06f6dd475c9419b9eeaa0708f2162abf8d9aa0b4d455e465ba65fa4bf3d954adfdda51ac55c1047fb2d72b82027d39d8b8b96d5abe7894071f2d1e9fb899f4b66fce61593d34d5955accf2ab963e66736ad674c53e40372824f4ce2bbe3c7f4f107c21ab46351587068a19ec26e7df2a5b7793953e670f290aba199a64cb3bc94cd7aecfb4daa794ba1e7a7d15852b30899a9c9952951bb2e2d7bfea9478416674f35c2bad1504c37f42cdfb992b8e79b8842addf41720c01744feb594b5588a9d4f3c71de138eb2c059330ed68f35033e5ecb5465b1c623835a52271e4fe1535abeca7f77dd5e642a5f6bfe3c68db59d4fe07c2456c1b8266e9e26c5aaed0420ce3a4df2d74a268910b82b01f494bebed61b54d16f99823045b18e88a151085b11b1b87fdd83daabcd124404656216aadf1769a5482cc435b33f9d7a47445c42cb86647e0fb27fae5824de0a303575cb11d3db9e4709dae0173f22263f5119cdaa034a4b2658f0590c159761d3aac2f6c7b64472561d602e9c542501e465d5781161c66fc0d64b9d50a94ddbda251782a80feb7788a3dd745692548da906f85c88ad999ca814e33ec9f9997b3f47b196a4076e7566069183f61ef5c202a8c6d444edc20d53492575730d612c18ab6b633c1b83b3801d7fcc0869dcf3cfc49fe63f23c5ee487db21e123e89effe1bd8523de56ed989dd63141c02a02c066d78a3777f7b0c46e21f1acadf158b09257fb95e9a03984a757c9af0a3e7409e150b5a46fed2b7ba064ac5b1b356c6b46a6b75e2a11ac8358687039d99d47f8f35d714d27eddcca6b0afc0818dd1c60870a923983ab810a3c4df4124b1dd17d5aa5572abf91b09caedc701e72632e41f5c05231b1be0af3d463d1424c605cf9dcd3c62b01e7e59c89c12d3de005451e75f25c383d0467aa8f762f1cacf61f8744d4b3595f8e06580e50597fc1e84751cc4face7ec75eeafb45558f84defa18b87d648c4cfcb41d4f037510cb0c82351fd49e5c4857bb8a2a458acbdc663895c7ab388c2f375e1e46b3c4423702c85a03aff209d8b7f5f915562706b2e5fbc0c056c4038381c3713d6a17e3bf4fc1a4f6516779dc8771ad3049f8690316ced5e5b256f92efd71c6fb2c9c25957b96d74a05c31439626d5955d159171c441e2d08066febc85b6fc3f059809e23c9a933800a4397dcea292d2e87b9c528db2c76a0feb87e5e21b31c6ed690adf9b53dae2f3268186fcd5dd064006ca295f92582818a71a4c107ee3f694f7960f1c48c95de43963486a29f7d936cb084ed3693bbb64ce1c12113a2af254948402f7cf740fe938bcbf60cb99b65e05bc949c49dd473bb540a64fdc223a4e98b288f376d88ab665cb326efbe30bca8b8776c7381d349b6a7abc819f7835466bdefdc72eacf37ed72a0a43f3e9cec93c4b245d28900fa00dbf25a7c740e58fb5437adf841b1b9f62a372fff20e5a39e77207e567e043fad3d3cb3cc3b1a3081db5daaee05943882433c3b0af9b4f2d4f743bfbdc5d3c75f37d1b181bbe6145adad576e931c65965dd3fa43f3b32ea1d37cbe986289879db675cbf6d70079c3275f90e370c631999fc81fc236797fea4cfe8b69f6e5216ff9769b730d95e0b13dc28860ca85e0a29b12a5b41e3dde90ffdd8c9131e5fe64d6903263d7e541bd3df6f8e44e290fb74eecd9fa4e140cc8f2f50184525a3cf9c60a1769f04296eb08919018c640534cc3b547a4fe09c541802b084e035e5f9002a309640e2b276b064b3c7c92f7a01182c98ed091ab7ca5be6dac272ba05c9a98ad71c1bc1705bb9c71ad63b7ab036d35772f6e8d816a1d4a7ce24af4255d6a557d7fe94e57730b58a659a43fa891a17f715432534d013ea3870b025b0c940b7b24a3514f6b742880a81ed1f8f46b5e3b5a5e9ffec20190fe77ed0bf7f3ae90eb574b416873c97b178782bdb02b1ed6afd2063e1989e4eaa3d09ae24fb50ad331748978812adda214d3ac7bd13b96fc59900a634f091f925ea7b77b08e2531df3bf2a7f66bc9797b3f5b7a9690fa7b3b3f4d16b20a44996a394fb7edc5f3aa88a09572ed8a83df1468f40ca1aa781f21f4544cdd0f9aa394722c9d9ded8c3ee9b15f20d862d24c550773e1a46f504ba1d1021705d8d2c0531102b9dd31a14f947cfde28b905593655e4cfb3fee94f8424c284a969324885259fd8e9ebad86bbb528542140aa55b71e382743392807b140e1cd2401103b9bbea3ead8f23777064419769f1b2bae2e7747bc882e780c7c635191178773eaf677510c7e32a5b65ca5bc6c4036ea7f465432b66d0b47da1652eb7408769f46cd4edac7f1710ba93419d274c76d6b59d6d3c6c5304f72f5666a8231758722b7ce224a1f73b6312be85f511cdfcecf31e35260bd64c570c8fbdaf556ec0fa1d1671e43f22d389b348f4bba87e68fea15ed74e7c0048733c93c4dfeaf3a277fd0d297c4d664ed4adb9760bffa40c6af984697aef2c66bf5c4f9fa27d2f796a8f706244b799e00985d5b9d2f2af55dc488b574bc122b21549c2a4c424bcfe503f542ed9a96d39027438f56570abb8e823911a5d54912a3413edea4868c5e28d5d717021abb458b0f381d2c47dfe82155dc3cdce2f05207f4d8e6ead6623b41385cef999d336d7d539df1396f24fd843d89efdd1eeadc0f8f4d68e4c90a5d907c8fca7b85fb40a72a7a66eb96772947587a383743b2d42c35720a7bd07267c3df326e43d52fe63234209d1d07a05091846ff020b167b837835f1f60aa5e50e09e4b912124b1e316d19d5ad17a4438e422a46635a8784bc22912b164af2d269a698676293e0fffb3d32ab46ec58e4ce58723e9ee7ca8f2240040e85d52c0a2e8ca62e454c47cba6b844a2ccbdded270f8a0f0b981e4c0f203cce8ec0c51b1e6125cfe7a239bc5a9dfc2b5f4d09927b62a6cff1f6e76d5052efb45c6f1225d93c4b78eb641d7c74e1c5e8e4ce43322b45253d11611867c8c0a5a1194101d7107ae546e9eb1dda9dc1c8978a08c00cb0997eb40cf01dfd2232928acb6c5801c575662481e906e47c5ab317a507c3368ab3c126c4852d4209dc62df605af223efb65c4bbf453c358da8378e5c9a61248b354f119e1393bd1d8be545beadbf6da50343d0ac9af0ed962642909783bf6003572a53ff33ea842a3d3b31bbd313366a2c91f454056b8a9e7e228f29edeaa8fda33f53344fd8d2f82d96a28611166855aa383a67d72c94b672e5a22f6eef342eade0ea9fc7c236fc053617f57774ab23180d1153f14f95497a4445df3f4287c3334bdc8e9823d815ad57ee721af3f8ad37ddd4b0cf2f05235e93e4f2e39158f907469fb6d8068d39ea7400086d49004ab7c6d2f3a65b10d96c55b4e2e4d5ece9d9cea5018f7250af975b98d90a1c03432f9397be626a04d5273b190bfe9e27ee1b35dc69c56e9c1af29b6c8a9a46494152ab0f1088cc1ffd20c44c35c2a9ff742b098c8083f104fd3321236c63c9ee8b8028b9c60196bc074b34d0804999e393216ab7e09a3b5a2ae50e8aacfa94d2f99666a5ff86fec09b01c4651c6a20c06df94d5feb9ef6bd15fa5862478cd0366416579a972e6106883b2932283e0043e773a8dc25cfafac028f8d41d53c31ff866d4681240f6b1d92cca45a11699eda738ca1aea3c4f74e2d8b433264607071609d3f3c674683dea7e6b4bb342070e1fa1d64a4bdca039ea7890ad8cc4e303a5b5f372df400ad5936b22539370fde1a8e326a39a17494726a49fb477de6431d0f6d2e73e18fa74c8516cfeb6d410ec7e7a8afda44d88d91f40e5daa6ea00aa5c7d7b53fbe76f4f92425ecd6b948e6a5b52e20b5f47e5d203d5be811fefe00a5f21ec9697e7cd5c7e87c84121185f902ae58ac6a4fff91fc6a914c64bfe8c867c950df10a59741aa8912e390541b02ac13ce8c9f791fb23c82389312d4f5f35673a65a6d8e5c30e18e16fe04e6027ba3bb447e79de8e8f16cb5a106745c8c2f56361f3abd8735041afa15a43af3ce1a47950ea09c70511317d16dd4f82d35601e8d0cd288047d7411e1120de34a2080e120ddfc322b747f6f63d38921a46f3c188c161e1bced6dfb46d8b1ae6042f5903c3aa5203d2f19a5511d8a4c0d3fea2f51147b257e1ea48816a8c9a7556b41bca5d9cef3b5d03754a8e8f76ad5f6992e6b18564f870b942227f1a0647bd611b9a7df6a39e2aba0b4a8f49ffbb2ef27c33e096a4582d2dd2c84bf04fd0299ed46c0316ad7dbd3ed52f10f7f124c25d87321253b4b30fa59caa4a88d6eb574ada5a4ce7d76c527ab4d8a0cbb36e96c39e053517933a21991deb5db469a17cadd61e17653127d18b173cccec4034dd162c8fa339b4b1d8a718fb6f715f1abe8508e04724437d2b5f652d04bd3ef4adf61dfbe9c9e088795da366448272c8cd9724c4803c6a88d00590f0c1489182d07cc0495e91d1834a1c7b95b2b3b61d951639896c727f829c1dc2a16c811828049fca7633b32c2ce078232a5582b40f4c2e8c8fcc08bc0305d90f3999e40508b2e89650da3732119a1fcfbc15e44c12a018f016689edbc2cc0880ad8d168c6bdb51e187f36a150454042d640fb7d5c6ccbdc9ac03e7c5006441aae13a588fcfcac6329a964785c6ac20df165fe2aeed55e5489c1236c7eed3d8a5ab4865fcbd86c7b641578e30e813727e68ce43ec221bf1e29125a373a454e2db3b1a6902686108f9c120c824a996ccde02ab410aa6903f8da8ac1d88901f3b32dcc6ea3d7f2ce84549e9995a615f442e1a98fb30d74ec99ad2a27183560f7c8a902200f15b563d5cdc60167a10686c9b8e35d3714fdcc20d8114dff5022f55abca83af3b32be53c58853b65212a9837395d1f4ff0ba3418b6306f9d51c8638bd5e0506ffcef759e3f8dfda7449ec862f2c999d0b5de996289c9c8af4561a8202f0f184b3471a37f65a4884225d8c456943f669083f33b79792bfa174e8bdd92feb94b42ea6906e49ffa0386ae189601011e131fe4a862ab14cb3e44b57c3994b7a5efb8e2562e4186c790d6e2e8604b7062f39e4060a30bdc6350f464fd815bb0f0acaed79bbd9983b9fa41665164d764ddbc39ff93567f2c2c026057ccf26913e0d1d6377b9618c10a652dec2446971219f8d6cc1939299f7a45d1863d8790e4abc64b5cf82bb4fe5a4904fe206358149301177be5c99b8abc7a40b9d6f87a8d70a303c6f771fb0302771111a7c95b0a6e057356f38713cc8d560be5d492ea352a760712454c542be8a91ff62769abe536bffb4730a57132faae6728e3cbf76afbe9c212ade992b04e92e8378c194ce822e04aec42827137079e2a44c6d103387cf462f565118954ecccc2a2ddb4a0aefef6a230dbd1ff3983935f5ed1f301290f62b0be33ed3abb765a9b983d841b1e4ec7cd03a64fed028ff927b42a5071cae3d222027866f60a0ebbca3a28cf30ebe7925bb1e79e1ef19971ac46aa8c747e72ead2c801a3d74f1375e167758fe74fcee0fab0a4ca7143efa1094e75c59860718baa71a51c7131e0337cd1459d878cd75db40e5e895d6cfb8f6b8ec6d5ef0726ecaca280932c9e0114834b2e3ea7690d2f255e802b81ba1471a0feb5d094b9aedc9827bd39f417e4819b0090711986782bfaf789a39778879bccb0843f5d90115371fce920fa4771663a7bf5a519bc0dea01bb0bc361a9a760d40021b647b2b28b1674b1f82b5ff55791268ca0a5fda5c1202ad194ab6a4f847537ed13de8d509a19a2163983e7b26cee9c4162b2a2289e40c5af8976fc43d13600d113b8ae50b3df03105066bc99b0857e7df08b3339c77b971f07c9ffc6c0abee9b035dcd291bd70603fd56c8a56236e4e761bfe0e7f715c4b7d5a4935d25b32b43a55199dfe175a714c70627ccbef3274f686dbb30fa08131b428d2ba9d1879fe0d1ce03d528ea532fc93b6aba318359760006e45b6b91f63d7a4cbd0af5be27e76887286384cbb52eb98b47e2a0b8f931b70238cd865467b6f523a714e186f00c8918d50e8511bf3e8962b2aa3857352992b2c9d58e84782acd7aceb2dc58fa2cd62e8897bbc23d144645342d67d1e41dc9cebc9d69290abf1e46262a61b9c890b03d5a56ebe9d1667e044337a6d52020526a95a989eb4ab96fac60d33918bb5cbe08fe23107356c5a678a725559e9bc56ce1f8f33944077a5eab2a272a46a9e5129f002877b828f9381a9ab40ee12b16c34e613c3890805aa4669c3fa00da446f247f8e9882a2fd42a003f7885ccd9cb1646bd87c41321dd662cd97ba5518eff77543c1abe1bc33f12556d5fa34d22b3956200689295c57c4015820f8080805dcb89a9dc604c839802e4f66afe394aa1e4c6a6d6e6f749cbdbed2dc1f3743737d848ca2393d6064cadeecf3f611122e3b69b1d6ebf07783869699a4dd030a54cbfa0000000000000000000000000000000000000507131b242d3439","attestation_type":"pqc_registry","signed_at":"2026-04-20 19:44:50"}],"hndl":null}