The Data Ingestion Tab
Data Ingestion sends your Drupal content straight to your Opensolr Index: each page the moment an editor saves it, and the whole site with one click. No crawl, no firewall rule to open.
/admin/config/search/opensolr/ingestion)Content Types for Ingestion
- Include in Ingestion: tick the content types to send. With Drupal Commerce installed, product types are listed as Product: <type>. Each ticked type shows how many published items it has.
- Include attached files (PDFs, documents): also sends the PDF, Word, Excel and other documents attached to those pages. The module recommends this way for documents: each one keeps the language set in Drupal and stays linked to the page it is attached to.
Data Ingestion Settings
| Setting | Default | What it does |
|---|---|---|
| Enable real-time sync | On | Creating, editing or deleting an item of a ticked type updates your index by itself; unpublishing removes it. Changes show in search within about a minute. |
| Cron batch size | 2000 | How many items each Drupal cron run sends during Ingest All Now, from 500 to 5000. They go to Opensolr in batches of 50. Higher is faster and uses more memory. |
Click Save configuration to keep your choices.
What each item becomes
- Title, description and text: the title; the body summary, or the start of the body; the whole body without its HTML.
- Category and author: the name of the content type, in the item's language, and the author's name.
- Image: the picture of the Image field, used as the result thumbnail.
- Language: every translation is its own document, tagged with its language. See Multilingual search.
- Price: price and currency of Commerce products.
- Your own fields, mapped on the Facet Mapping tab, and your taxonomy tree for hierarchical categories.
Opensolr then adds the rest on its servers: meaning, language and sentiment, and the text read from documents. See What Opensolr adds to every document.
An item an anonymous visitor cannot view (unpublished, or closed by access rules) is never sent. The ingestion reports how many were left out, so a document count lower than your item count is expected.
If the tab shows this warning, your site address is not saved yet, and background runs would write wrong links. On the Settings tab, click Reconfigure Credentials, enter your email and API key, and click Save Credentials: that stores the address.
Data Ingestion
- Data Ingestion
- Ingest All Now