Web Crawler Developer Guide: A Full Docs Hub With Index Fields, the Solr API and Code Examples
A full Web Crawler developer documentation hub is now live under Docs > FAQ, in the WEB CRAWLER sections. It is written for people building against the crawler’s index rather than configuring it from the UI.
01 What the guide covers
- Index fields. Every field the crawler writes, documented in the index field reference.
- The Solr API. Every search parameter explained.
- Code examples. Copy-paste examples in JavaScript, PHP, Node.js, Python and curl, with hybrid and vector search built in.
- Search features. Autocomplete and spellcheck, faceted navigation and filtering, and pagination, sorting and freshness boosting.
- A complete search page. An end-to-end worked example rather than isolated snippets.
02 Solr Environment filter now persists
The server filter in the Opensolr Index list is fixed. Selecting a Solr Environment from the dropdown now persists when you search, paginate or refresh the page. It previously reset itself silently to All after every action, which made the filter useless on any list long enough to need it.