Colibri
A hierarchical inference engine designed for frontier Mixture-of-Experts (MoE) models, optimizing expert placement across GPU, RAM, and NVMe for efficient execution on existing hardware.
A hierarchical inference engine designed for frontier Mixture-of-Experts (MoE) models, optimizing expert placement across GPU, RAM, and NVMe for efficient execution on existing hardware.