tinker_cookbook.preference.ComparisonRenderer

class tinker_cookbook.preference.ComparisonRenderer()

Abstract renderer for converting Comparisons to model inputs for preference training.

Subclasses must implement build_generation_prompt, to_model_input_weights, and the tokenizer property.

build_generation_prompt(comparison)

Build a model input for generating a preference label.

Parameters:

• comparison (Comparison) – The comparison to render as a prompt.

Returns: types.ModelInput – Token-level model input ready for sampling.

to_model_input_weights(labeled_comparison)

Convert a labeled comparison to model input and per-token loss weights.

Parameters:

• labeled_comparison (LabeledComparison) – A comparison annotated with a preference label.

Returns: A tuple of (model_input, weights) for training.

property tokenizer

The tokenizer associated with this renderer.

Returns: Tokenizer – The tokenizer instance.