Skip to content
TechIndexSubmit

Similar tools

  • A high-throughput and memory-efficient inference and serving engine for LLMs

    Models
  • EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

    Models
  • A Home Assistant integration & Model to control your smart home using a Local LLM

    Models
  • Universal LLM Deployment Engine with ML Compilation

    Models
  • High-performance In-browser LLM Inference Engine

    Models
  • Nano vLLM

    Models