# tinker.types.LoraConfig

*Generated from tinker 0.30.4 at commit [`1e5777e`](https://github.com/thinking-machines-lab/tinker/tree/1e5777ef1e0bb2bae6d9b8d63a6144eec405377d). Source links point at that snapshot.*

## *class* [**tinker.types.LoraConfig**](https://github.com/thinking-machines-lab/tinker/blob/1e5777ef1e0bb2bae6d9b8d63a6144eec405377d/src/tinker/types/lora_config.py#L8)(*[StrictBase](https://github.com/thinking-machines-lab/tinker/blob/1e5777ef1e0bb2bae6d9b8d63a6144eec405377d/src/tinker/_models.py#L76)*)

**Fields:**

- [**rank**](https://github.com/thinking-machines-lab/tinker/blob/1e5777ef1e0bb2bae6d9b8d63a6144eec405377d/src/tinker/types/lora_config.py#L9) (*int*) – LoRA rank (dimension of low-rank matrices)

- [**seed**](https://github.com/thinking-machines-lab/tinker/blob/1e5777ef1e0bb2bae6d9b8d63a6144eec405377d/src/tinker/types/lora_config.py#L12) (*Optional[int]*) – Seed used for initialization of LoRA weights.

  Useful if you need deterministic or reproducible initialization of weights.

- [**train_unembed**](https://github.com/thinking-machines-lab/tinker/blob/1e5777ef1e0bb2bae6d9b8d63a6144eec405377d/src/tinker/types/lora_config.py#L18) (*bool*) – Whether to add lora to the unembedding layer

- [**train_mlp**](https://github.com/thinking-machines-lab/tinker/blob/1e5777ef1e0bb2bae6d9b8d63a6144eec405377d/src/tinker/types/lora_config.py#L21) (*bool*) – Whether to add loras to the MLP layers (including MoE layers)

- [**train_attn**](https://github.com/thinking-machines-lab/tinker/blob/1e5777ef1e0bb2bae6d9b8d63a6144eec405377d/src/tinker/types/lora_config.py#L24) (*bool*) – Whether to add loras to the attention layers