XCrawl
Web scraping, crawling and SERP data in one API
Founded by:
PENG JIAFU
This indie product is an alternative to:
About
XCrawl gives developers one API for getting web data into AI apps. Scrape a single URL into Markdown, JSON, HTML or a screenshot; crawl a whole site with depth and scope rules; map every URL on a domain; or pull structured results from Google, Bing, DuckDuckGo and other engines. Rendering, proxy rotation and retries run on XCrawl's side. SDKs for Python and Node.js, a CLI, an MCP server and an n8n node are available. New accounts start with 1,000 free credits.
Key Features
- Scrape API: URL to Markdown, JSON, HTML or screenshot
- Crawl API with scope and depth rules
- Map API: list the URLs on a domain
- Search/SERP API for Google, Bing, DuckDuckGo and more
- Python and Node.js SDKs, CLI, MCP server, n8n node
What Makes It Different
One API for scrape, crawl, map and search, with JS rendering, proxies and retries handled server-side, plus MCP server and agent skills for AI agents.
Pricing
Free plan with 1,000 free credits (no card), then paid monthly/yearly credit plans
Discover More Indie Products
Find amazing alternatives to big SaaS tools built by indie developers