Ai2

non-profit

Verified

https://allenai.org/

AI & ML interests

Building breatkthrough AI to solve the world's biggest problems.

Recent Activity

brianhenn updated a collection 2 days ago

brianhenn updated a collection 2 days ago

dirkraft updated a dataset 3 days ago

allenai/asta-bench-submissions

View all activity

Papers

Learning to Solve Hard Problems in RL for LLMs by Never Giving Up

MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction

View all Papers

Articles

BenchMIRT: What are LLM benchmarks actually measuring?

Introducing OlmoEarth embeddings: Custom embedding exports from OlmoEarth Studio for downstream analysis

TutorMoments: Do AI tutors know when to help and when to hold back?

The OlmoEarth Platform: Geospatial inference at planetary scale

What building Shippy taught us about building agents

DiScoFormer: One transformer for density and score, across distributions

Which tokens does a hybrid model predict better?

MolmoMotion: Language-guided 3D motion forecasting

olmo-eval: An evaluation workbench for the model development loop

OlmoEarth v1.1: A more efficient family of Earth observation models

EMO: Pretraining mixture of experts for emergent modularity

View all articles

allenai 's Spaces 20

AstaBench Leaderboard

Explore AstaBench benchmark leaderboards

Molmo-Point Demo

MolmoPoint - Image & Video Pointing & Tracking

MolmoPoint-GUI Demo

MolmoPoint - GUI Image Pointing

Reward Bench Leaderboard

Explore and compare model scores on RewardBench benchmarks

HREF Leaderboard

Browse and search HREF leaderboard data

Zebra Logic Bench

Display model leaderboard and explore sample puzzles

SUPER Leaderboard

Display a static leaderboard from a JSON file

ZeroEval Leaderboard

Explore ZeroEval embedding benchmark online

BaseChat by URIAL (Chat with base, untuned LLMs)

Chat with Base and Aligned LLMs side‑by‑side

AI2 WildBench Leaderboard (V2)

Display LLM performance leaderboards with customizable views

URIAL Bench (Eval Base LLMs on MT-Bench)

Show a static leaderboard of LLM benchmark scores

MolmoMotion

Forecast 3D point trajectories from video and language

VFig Image2SVG Demo

VFig converts any diagram image into editable SVG code.

Dataset Stats

Fetch and view stats for MolmoAct2 datasets

Lerobot Visualizer V3

Visualize LeRobot datasets with interactive charts

AI2 - WildDet3D

Scaling Promptable 3D Detection in the Wild

OLMoASR

Open Models and Data for Training Robust Speech Recognition

README

gradio-theme

Display and interact with a customizable Gradio theme demo

AI2 WildBench Leaderboard (V1 legacy)