New API Docs for Pausing, Resuming and Checking the Web Crawler, Plus Updated Terms and Privacy Policy
Three new API documents for controlling the web crawler, and a rewrite of the two legal pages.
01 Crawler control, documented
Three documents have been added to the FAQ, each with the endpoint URL, its parameters, and copy-paste examples:
- Pause the Web Crawler. Stop a crawl in progress.
- Resume the Web Crawler. Pick it up again.
- Check if Web Crawler is Running. Ask for the current state before acting on it.
They live under Docs > FAQ > API-Web Crawler.
02 Terms and Privacy Policy updated
The Terms & Conditions and Privacy Policy pages have been updated with clearer language and current compliance standards, and the formatting has been improved so both documents are easier to read and navigate.