Web Crawler Pause and Resume Controls, a Three-State Status Badge and Faster Batched Indexing

You can now pause a running crawl without losing its cron schedule, see at a glance whether a crawler is running, paused or stopped, and get pages into the index faster.

01 Pause and Resume

New Pause and Resume controls let you temporarily halt a running crawl without losing your cron schedule. The crawler automatically picks back up on the next scheduled tick, or you can hit Resume to restart it immediately.

The Stop button has been renamed to Stop Cron Schedule, to make it clear that it permanently removes the schedule.

02 A status badge that tells the truth

The crawler status badge now distinguishes between Running (green), Paused (blue) and Stopped (red). When the cron schedule is active but no crawler processes are running, the dashboard shows Paused instead of Running, so you always know the actual state of your crawl.

03 Resuming an empty queue

Clicking Resume when the crawler queue is empty now shows a clear message explaining that there are no more pages to process, instead of silently doing nothing. It suggests stopping the cron schedule and starting a fresh crawl.

04 Faster indexing

Web Crawler indexing is now faster: crawled pages are sent to Solr in larger batches instead of one at a time, which reduces round-trip overhead and significantly speeds up the overall indexing process.