Skip to content
TechIndexSubmit

Similar tools

  • Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

    Models
  • 🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

    MCP Servers
  • A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

    Dev Tools
  • Open-source AI agent harness in native Rust — GUI, CLI, headless, and webapp from one binary. Multi-provider, MCP, skills, plugins, agent teams.

    MCP Servers
  • XCrawl gives developers one API for web data. Scrape URLs into Markdown, JSON, HTML or screenshots; crawl sites; map domains; and fetch structured SERP results. Rendering, proxies and retries run server-side. Python/Node SDKs, CLI, MCP server and n8n node are available; new accounts get 1,000 free credits.

    Dev Tools
  • A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

    Models