tinker_cookbook.preference.ComparisonRendererFromChatRenderer

class tinker_cookbook.preference.ComparisonRendererFromChatRenderer(ComparisonRenderer)

Wraps a chat Renderer to render Comparisons for preference training.

Formats comparisons by concatenating the prompt conversation with labeled sections for Completion A and Completion B, separated by system markers.

build_generation_prompt(comparison)

Build a model input prompt for generating a preference label.

Parameters:

• comparison (Comparison) – The comparison to render.

Returns: types.ModelInput – Token-level model input ending at the "==== Preference ====" marker, ready for sampling.

property tokenizer

The tokenizer from the underlying chat renderer.

Returns: Tokenizer – The tokenizer instance.