tinker_cookbook.completers.TinkerTokenCompleter

class tinker_cookbook.completers.TinkerTokenCompleter(TokenCompleter)

Token completer that uses a tinker.SamplingClient to sample actions.

completer = TinkerTokenCompleter(sampling_client, max_tokens=512)
result = await completer(model_input, stop=["<|endoftext|>"])
print(result.tokens, result.logprobs)

Fields:

• sampling_client (tinker.SamplingClient)
• max_tokens (int)
• temperature (float, default: 1.0)
• context_window (int | None, default: None)

__call__(model_input, stop)

Sample an action from the policy given an observation.

Parameters:

• model_input (tinker.ModelInput)
• stop (StopCondition)

Returns: TokensWithLogprobs