Web Crawler Reindex All Button: Re-Queue Every Crawled URL in One Click

· Web Crawler · New Feature · All updates

The Web Crawler panel has a Reindex All button. One click moves all previously crawled URLs back into the crawl queue for a full re-crawl.

01 When you need it

Some changes only take effect on documents written after them. Reindex All is how you apply such a change to everything already indexed, without rediscovering the site from scratch.

  • After a schema change. Existing documents were written against the old schema and need rewriting.
  • After a configuration update. New extraction or mapping settings apply to the whole index rather than only to new pages.
  • On demand. When you simply want the entire index refreshed.
The URLs are the ones already crawled — they are put back in the queue, not rediscovered.
View the full changelog