Skip to content

tinker_cookbook.exceptions.EvalGradingError

class tinker_cookbook.exceptions.EvalGradingError(EvalError)

The grading function failed on a model response.

Raised when the grader (programmatic, LLM judge, or execution-based) cannot produce a score — e.g. the judge response is unparseable, the sandbox crashes during test execution, or the answer extractor returns an unexpected format.

The example is scored as a failure (reward=0). Check StoredTrajectory.error for the specific grading failure.