Skip to content
TechIndexSubmit

Similar tools

  • AirLLM 2.8T LLM inference with single 4GB GPU

    Models
  • Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model via kernel fusion, autotuning, and advanced scheduling. Run benchmarks across different GPU types and configurations, track results and share experiments with the community.

    Dev Tools
  • Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

    Dev Tools
  • Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

    Dev Tools
  • Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

    Agents
  • FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)

    Dev Tools