Saber Engine
A high-performance inference engine built in Rust, supporting models like Qwen 3.8 27b and Flash next. It achieves high token per second rates for LLM serving.
A high-performance inference engine built in Rust, supporting models like Qwen 3.8 27b and Flash next. It achieves high token per second rates for LLM serving.