Python + JSON download · Version 1.0

Incident-agent recovery grader

A small deterministic example that returns pass, fail, or unknown from evaluator-owned observations.

Use this resource

Before you begin
Python 3; standard library only. No model access or infrastructure credentials required.
How to use it
Download both files into one directory. Run python3 incident-agent-grader.py --self-test, then python3 incident-agent-grader.py sample-observation.json.
Scope
The tests check grading logic only. The sample does not establish production recovery or benchmark an AI model.
All templates & downloads