TTableAI Catalog

app + benchmark

Promptfoo

An open-source command-line and web toolkit for testing prompts, models, agents, and red-team scenarios.

Visit projectView source

What it is

Promptfoo runs configurable evaluation matrices, assertions, comparisons, reports, and adversarial tests in CI or locally.

Related records

SWE-agentA research system that enables language models to resolve software engineering tasks in repositories.BrowserGymA framework and benchmark family for evaluating web agents in browser-based environments.Inspect AIAn open-source framework for building and running language-model evaluations.OpenAI EvalsAn open-source framework and registry for evaluating language models and model systems.