benchmark
WebArena
A realistic web environment for evaluating autonomous agents on reproducible tasks.
What it is
WebArena provides self-hostable websites, task definitions, and evaluation criteria for web navigation and interaction agents.
Related records
SWE-benchA benchmark for evaluating language models on real software engineering issues from open-source repositories.Terminal-BenchA benchmark for measuring AI agents on practical tasks completed in terminal environments.AgentBenchA benchmark suite designed to evaluate language models acting as agents across varied environments.BrowserGymA framework and benchmark family for evaluating web agents in browser-based environments.