Homebrew Tool — README

skill-eval

Automated CLI for evaluating AI agent skills

Version: 1.2.0

Binaries: 1

Platforms: 2

License: GPL-3.0

Homepage ↗

Install

brew install matt-riley/tools/skill-eval

README

skill-eval

Eval-driven iteration for AI skills. Define test cases, run an agent with and without a skill, have an LLM grade the output, and benchmark the results.

Install

brew install matt-riley/tools/skill-eval
go install github.com/matt-riley/skill-evaluator@latest

Quick start

cd your-skill/
skill-eval init         # scaffold evals/evals.json
skill-eval loop         # run → grade → benchmark
skill-eval report       # open the HTML report

Docs

Full docs at skilleval.mattriley.tools.