tinker.types.ModelInput

class tinker.types.ModelInput(StrictBase)

Fields:

• chunks (List[ModelInputChunk]) – Sequence of input chunks (formerly TokenSequence)

from_ints(tokens)

Create a ModelInput from a list of ints (tokens).

Parameters:

• tokens (List[int])

Returns: ModelInput

to_ints()

Convert the ModelInput to a list of ints (tokens) Throws exception if there are any non-token chunks

Returns: List[int]

property length

Return the total context length used by this ModelInput.

Returns: int

empty()

Create an empty ModelInput.

Returns: ModelInput

append(chunk)

Add a new chunk, return a new ModelInput.

Parameters:

• chunk (ModelInputChunk)

Returns: ModelInput

append_int(token)

Add a new token, return a new ModelInput.

Parameters:

• token (int)

Returns: ModelInput

Referenced by

• SamplingClient.compute_logprobs
• SamplingClient.sample
• tinker.types.Datum
• tinker_cookbook.completers.TinkerTokenCompleter.__call__
• tinker_cookbook.completers.TokenCompleter.__call__
• tinker_cookbook.preference.ComparisonRenderer.build_generation_prompt
• tinker_cookbook.preference.ComparisonRendererFromChatRenderer.build_generation_prompt
• tinker_cookbook.renderers.Renderer.build_generation_prompt
• tinker_cookbook.renderers.Renderer.build_supervised_example
• tinker_cookbook.renderers.Renderer.build_supervised_examples