Focus area

Web scraping APIs and proxies

Doccraft tests how real websites respond to scrapers, from block pages that return a 200 status to robots.txt rules and user agent checks, and writes about it for the companies that build scraping APIs and proxy networks.

Research and guides

Published for clients

Other focus areas