tinker_cookbook.exceptions.EvalError

class tinker_cookbook.exceptions.EvalError(TinkerCookbookError, RuntimeError)

An error during benchmark evaluation.

Base class for eval-related errors. Inherits from RuntimeError because eval errors are operational failures (network, timeout, sandbox) rather than configuration issues.

Eval errors are non-fatal by default: the benchmark runner catches them per-example, records them as scored failures (reward=0), and continues with remaining examples. The error details are preserved in StoredTrajectory.error for post-hoc analysis.