With Data Ingestion, the plugin sends your posts, pages, products and document files straight to your Opensolr Index, through the Opensolr Data Ingestion API. Opensolr does not have to visit your pages, so there is no crawl to wait for and nothing to whitelist. Pushed documents get the same treatment as crawled pages: What Opensolr adds to every document.
The tab
- Content Types for Ingestion: a box for each public post type, with its number of published items and a Total, plus Include attached files (PDF, DOCX, etc.). These boxes are separate from the ones of the Data Crawler tab.
- Real-Time Sync: sends each post the moment you save it. Real-Time Sync
- Cron batch size: how many items each bulk run handles. Ingest All Now
- Save Ingestion Settings, then, under Bulk Ingestion, Ingest All Now and Data Ingestion Status.
What is sent for each post
- The title, the address, a description (the excerpt, or the start of the content) and the full text, with shortcodes and blocks rendered first.
- The featured image, the author, the publish and last modified dates, the locale of the site and the domain.
- The name of the post type, the category paths for hierarchical filters and your Field Mappings.
- For products: price, currency, gallery and attributes. WooCommerce
- For document files: their address. Opensolr fetches the file and reads its text, so the file must be reachable from the internet. Files and documents
Never sent
- Drafts and other unpublished items.
- Password-protected posts.
- Products whose catalog visibility is Shop only or Hidden.
- The search page itself.
Crawl and push together
You can use Data Ingestion alone, or next to the Data Crawler. Opensolr knows each page by its address, so a page that arrives both ways is one document: the last one to arrive wins.
Pages of this tab
- Real-Time Sync: each save goes to your index at once.
- Ingest All Now: send your whole site in the background.
The same API, for your own code: Push your data.