MMMU (A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI) π Homepage | π Leaderboard | π€ Dataset | π€ Paper | π arXiv | GitHub πNews π οΈ[2026-04-21]: Fixed option issue in test_Psychology_15. βΌοΈ[2026-02-12]: We have released the answers for the test set! You can now evaluate your models on the test set locally! π π οΈ[2024-05-30]: Fixed duplicate option issues in Materials dataset items (validation_Materials_25;β¦ See the full description on the dataset page: https://huggingface.co/datasets/MMMU/MMMU.
Use this model
Pull with QuantumShield
quantumshield pull MMMU/MMMU Verify integrity
quantumshield verify MMMU/MMMU pip install
pip install quantumshield && quantumshield pull MMMU/MMMU Unverified Model
This model has not been PQC-verified. File integrity cannot be guaranteed against quantum threats.
README.md
MMMU
MMMU (A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI) π Homepage | π Leaderboard | π€ Dataset | π€ Paper | π arXiv | GitHub πNews π οΈ[2026-04-21]: Fixed option issue in test_Psychology_15. βΌοΈ[2026-02-12]: We have released the answers for the test set! You can now evaluate your models on the test set locally! π π οΈ[2024-05-30]: Fixed duplicate option issues in Materials dataset items (validation_Materials_25;β¦ See the full description on the dataset page: https://huggingface.co/datasets/MMMU/MMMU.
Intended Uses
This model is registered on the QuantaMrkt quantum-safe registry. This model has not yet been PQC-verified.
Quick Start
# Install the CLI pip install quantumshield # Pull the model quantumshield pull MMMU/MMMU # Verify file integrity quantumshield verify MMMU/MMMU
About
MMMU (A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI) π Homepage | π Leaderboard | π€ Dataset | π€ Paper | π arXiv | GitHub πNews π οΈ[2026-04-21]: Fixed option issue in test_Psychology_15. βΌοΈ[2026-02-12]: We have released the answers for the test set! You can now evaluate your models on the test set locally! π π οΈ[2024-05-30]: Fixed duplicate option issues in Materials dataset items (validation_Materials_25;β¦ See the full description on the dataset page: https://huggingface.co/datasets/MMMU/MMMU.
Get this model
Pull with QuantumShield
quantumshield pull MMMU/MMMU Verify signatures
quantumshield verify MMMU/MMMU