
XCrawl gives developers one API for getting web data into AI apps and automations. Turn a single URL into Markdown, JSON, HTML or a screenshot; crawl a whole site with depth and scope rules; list every URL on a domain; or pull structured search results from Google, Bing, DuckDuckGo and other engines. Rendering, proxy rotation and retries run on XCrawl side.