Skip to content
TechIndexSubmit

Similar tools

  • A high-throughput and memory-efficient inference and serving engine for LLMs

    Models
  • A MCP server allowing LLM agents to easily connect and retrieve data from any database

    Dev Tools
  • LLM inference server with continuous batching & SSD caching for Apple Silicon β€” managed from the macOS menu bar

    Models
  • A multithreaded πŸ•ΈοΈ web crawler that recursively crawls a website and creates a πŸ”½ markdown file for each page, designed for LLM RAG

    Dev Tools
  • Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

    Dev Tools
  • MCP server for quelllm.fr β€” 250+ open-weights LLM catalog. Tools: list/compare/estimate VRAM/estimate cost API vs self-hosted.

    Models