CLI-first evaluation framework

Evals with Promptfoo

Systematic LLM evaluation using YAML-driven test suites. Define prompts, assertions, and expected outputs — then run them from the command line against any provider.

Installation

Promptfoo runs as an npm package. Install globally or as a dev dependency.

npm install -g promptfoo

Verify installation with promptfoo --version

Project scaffold

Initialize a promptfoo project in your repo. This creates the config directory and a starter eval file.

promptfoo init

Generated structure:

promptfooconfig.yaml
prompts/
  prompt1.txt
  prompt2.txt
tests/
  test1.yaml

Next guide

Return to docs

Promptfoo docs →