Ingest All Now: Bulk Load Your Site

Ingest All Now sends every published item of the content types you ticked on the Data Ingestion tab to your Opensolr Index, in the background. Use it once after connecting, and again after big changes such as a new category tree or new field mappings.

Steps

1. On the Data Ingestion tab, tick your content types (and Include attached files for documents), then click Save Ingestion Settings.
2. Under Bulk Ingestion, click Ingest All Now and confirm.
3. The tab says "N documents queued for ingestion" and shows the progress: "Ingesting: X / Y (P%)", with the batch number and any errors. It updates every 3 seconds and picks up again if you reload the page.
4. At the end it says how many documents were submitted, in how many batches.

How it runs

• A WordPress cron task runs every minute. Each run handles up to Cron batch size items: from 500 to 5,000, 2,000 by default. Higher values finish sooner and use more memory on your server.
• Items are sent to Opensolr 50 at a time. Each group of 50 becomes one job in your Data Ingestion queue.
• A group that could not be sent is tried again at the next run, up to 5 times. After that the job stops and the tab shows "Last ingestion failed" with the reason.
• Password-protected posts, and products whose catalog visibility is Shop only or Hidden, are never sent.

Keep the cron running

WordPress runs its cron tasks only when someone visits your site. On a quiet site, or for a steady pace, set DISABLE_WP_CRON to true in wp-config.php and have your server call wp-cron.php every minute with a real cron job.

Follow the jobs on Opensolr

Data Ingestion Status, next to the button, opens your queue in the Opensolr Control Panel, where every batch shows its state: The Data Ingestion queue. What your plan allows per document and per batch: Limits and refusals.