Skip to content
TechIndexSubmit
Back to directory

XCrawl

XCrawl gives developers one API for web data. Scrape URLs into Markdown, JSON, HTML or screenshots; crawl sites; map domains; and fetch structured SERP results. Rendering, proxies and retries run server-side. Python/Node SDKs, CLI, MCP server and n8n node are available; new accounts get 1,000 free credits.

Similar tools

  • Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

    MCP Servers
  • Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

    Models
  • 🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

    MCP Servers
  • ⚡ The Complete X/Twitter Automation Toolkit — Scrapers, MCP server for AI agents (Claude/GPT), CLI, browser scripts. No API fees. Open source. Unfollow people who don't follow back. Monitor real-time analytics. Auto follow, like, comment, scrape, without API. Follow Bot. Like bot. Grow your account automatically.

    MCP Servers
  • Scrapewise is a pay-as-you-go web data platform: ready data APIs for Amazon, Walmart, Google, YouTube and ChatGPT, AI scrapers that turn other public websites into structured data, and an MCP server so AI agents can run both. Freemium: EUR 0.15 per 1,000 pages, 5 free requests. REST API, MCP, CSV.

    Dev Tools
  • 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

    MCP Servers