Ternary LLM Optimizer
An optimizer for training large language models that significantly reduces VRAM requirements, enabling training of 27B models on consumer GPUs. It focuses on ternary networks to match full precision quality.
An optimizer for training large language models that significantly reduces VRAM requirements, enabling training of 27B models on consumer GPUs. It focuses on ternary networks to match full precision quality.