eval-banana
eval-banana logoOpen source · Apache-2.0

Score anything with simple YAML checks.

eval-banana is a lightweight, aspect-based evaluation framework. It auto-discovers YAML check definitions from eval_checks/ directories, runs them, and produces a scored report. Every check is pass/fail — objective assertions run as scripts, qualitative ones are graded by an AI judge.

$ uv add eval-banana