Skip to content
TechIndexSubmit
Back to directory

llm-api-starterkit

Beginner-friendly repository for launching your first LLM API with Python, LangChain and FastAPI, using local models or the OpenAI API.

Similar tools

  • Lightweight unified multi-LLM API gateway, support OpenAI / Gemini, local deployment quick start template

    Models
  • Self-hosted FastAPI gateway exposing OpenAI and Anthropic Messages APIs in front of any open-source LLM runtime (vLLM, Ollama, llama.cpp, TGI, SGLang, LocalAI, LM Studio). Streaming, embeddings, metrics, auth, rate limiting.

    Models
  • Large Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone

    Dev Tools
  • Self-hosted AI/LLM gateway built with Java & Spring Boot for running open-source LLMs locally via llama.cpp, with RAG, AI agents, vision, embeddings, web search, RBAC, and a React playground.

    Models
  • ⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops

    Dev Tools
  • Every front-end GUI client for ChatGPT, Claude, and other LLMs

    AI Apps