olmo-eval: An evaluation workbench for the model development loop
• 4
AI & ML interests
Building breatkthrough AI to solve the world's biggest problems.
Recent Activity
View all activity
Papers
EMO: Pretraining Mixture of Experts for Emergent Modularity
MolmoAct2: Action Reasoning Models for Real-world Deployment
Articles
allenai/asta-bench-results
Viewer • Updated • 87 • 143
allenai/asta-bench-submissions
Updated • 67 • 1
allenai/olmoearth-paper-embeddings
Updated • 17.3k • 6
allenai/MolmoAct2-BimanualYAM-Dataset
Viewer • Updated • 76M • 7.69k • 1
allenai/asta-summary-citation-counts
Viewer • Updated • 77M • 1.28k • 9
allenai/molmospaces
Viewer • Updated • 1M • 20.1k • 47
allenai/eval_pi05_pipette_ood
Viewer • Updated • 9.27k • 436
allenai/eval_pi05_cup_stacking_ood
Viewer • Updated • 14k • 503
allenai/eval_cosmos_cup_stacking_ood
Viewer • Updated • 16.8k • 501
allenai/eval_pi05_test_tube_ood
Viewer • Updated • 13.7k • 427
allenai/eval_xvla_test_tube_ood
Viewer • Updated • 15k • 424
allenai/eval_xvla_cup_stacking_ood
Viewer • Updated • 16.1k • 421
allenai/eval_xvla_pipette_ood
Viewer • Updated • 11.5k • 418
allenai/eval_cosmos_pipette_ood
Viewer • Updated • 20.6k • 421
allenai/eval_molmoact_cup_stacking_ood
Viewer • Updated • 20.7k • 427
allenai/eval_molmoact_test_tube_ood
Viewer • Updated • 23.5k • 541
allenai/eval_xvla_candy_sorting_ood
Viewer • Updated • 16k • 415
allenai/eval_pi05_candy_sorting_ood
Viewer • Updated • 15.8k • 406
allenai/eval_molmoact_pipette_ood
Viewer • Updated • 18.6k • 412
allenai/eval_openvla_pipette_ood
Preview • Updated • 508
allenai/eval_openvla_cup_stacking_ood
Viewer • Updated • 30.1k • 459
allenai/eval_molmoact_cup_stacking_in-distribution
Viewer • Updated • 32k • 428
allenai/eval_xvla_cup_stacking_in-distribution
Viewer • Updated • 31.7k • 410
allenai/eval_pi05_pipette_in-distribution
Viewer • Updated • 24k • 416
allenai/eval_xvla_pipette_in-distribution
Viewer • Updated • 24.5k • 426
allenai/eval_xvla_test_tube_in-distribution
Viewer • Updated • 29.5k • 419
allenai/eval_cosmos_test_tube_ood
Viewer • Updated • 30.8k • 415
allenai/eval_pi05_toy_storing_in-distribution
Viewer • Updated • 32.8k • 467
allenai/eval_molmoact_candy_sorting_ood
Viewer • Updated • 29.9k • 515
allenai/eval_pi05_test_tube_in-distribution
Viewer • Updated • 30.8k • 436