tinker.types.SamplingParams

class tinker.types.SamplingParams(BaseModel)

Fields:

• max_tokens (Optional[int]) – Maximum number of tokens to generate
• seed (Optional[int]) – Random seed for reproducible generation
• stop (Union[str, Sequence[str], Sequence[int], None]) – Stop sequences for generation
• temperature (float) – Sampling temperature
• top_k (int) – Top-k sampling parameter (-1 for no limit)
• top_p (float) – Nucleus sampling probability

Referenced by

• SamplingClient.sample