Ingest All Now: Load Your Whole Site

The first load, or a full reload after a reset

Ingest All Now

One click sends every published item of your ticked content types to your Opensolr Index, translations and attached files included. Use it for the first load, or after a reset.

Where: Opensolr Search › Data Ingestion tab › Data Ingestion Settings › Ingest All Now

What happens

  1. Click Ingest All Now and confirm. The module counts your items and creates an ingestion job.
  2. Each Drupal cron run sends the next batch: as many items as your Cron batch size (2000 unless you changed it), in requests of 50.
  3. A progress bar shows the percentage and updates every 5 seconds. You can leave the page: the job goes on in the background.
  4. When it ends, the tab says how many documents were sent and in how many batches. Opensolr then adds meaning, language and sentiment on its servers.
Drupal cron does the sending

The job only moves when Drupal cron runs. If your site runs cron rarely, the load is slow; a cron run every minute keeps it moving.

Stop it, or follow it in your Opensolr account

  • Stop, next to the progress bar, ends the job. Batches already sent are still processed by Opensolr.
  • Manage Ingestion Queue opens your Data Ingestion queue in your Opensolr account, where each job can be paused, resumed, retried or deleted. See The Data Ingestion queue.

Items an anonymous visitor cannot view are skipped, and the result says how many. What Opensolr accepts per document and per request depends on your plan: Limits and refusals.

Data Ingestion