Opens in a new tab

Python + JSON download · Version 1.0

Incident-agent recovery grader

A small Python example that returns pass, fail or unknown from observations gathered separately from the agent being evaluated.

Use this resource

Before you begin
Python 3; standard library only. No model access or infrastructure credentials required.
How to use it
Download both files into one directory. Run python3 incident-agent-grader.py --self-test, then python3 incident-agent-grader.py sample-observation.json. Read the sample observations beside the verdict so you can see which evidence produced it.
Scope
The tests check grading logic only. The sample does not establish production recovery or benchmark an AI model.
All templates & downloads