Skip to content
TechIndexSubmit

Similar tools

  • A high-throughput and memory-efficient inference and serving engine for LLMs

    Models
  • A native macOS lab for teaching tiny language models to think — build the architecture, train the weights, and watch a small LLM emerge from scratch, locally on Apple Silicon with custom data, tokenizers, checkpoints, and MLX acceleration.

    Models
  • learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

    Models
  • Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

    Dev Tools
  • Selfhost modern LLM stacks. Run the whole fleet from your terminal

    Dev Tools
  • EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

    Models