Data Ingestion Queue — Monitor, Pause, Resume, Retry and Manage Your Ingestion Jobs

Account Feature

Ingestion Queue Management

Every document you submit through the Data Ingestion API goes into a processing queue. The Ingestion Queue page in your account gives you full control: monitor progress in real time, pause jobs mid-processing, resume them later, retry failed or completed jobs, edit payloads to fix errors, or delete jobs you no longer need. Only indexes with active or recent jobs appear — no clutter.

How to Access

Log in to your Opensolr account at opensolr.com

Click Account in the top navigation bar

Select Data Ingestion from the dropdown

Or navigate directly to /admin/solr_manager/my_ingestion_queue

What You See

Grouped by Index

Jobs are grouped by index name. Only indexes that have jobs in the queue are shown — if an index has no pending or recent jobs, it won’t appear.

Live Progress

Each job shows a progress bar with the count of processed, successful, and failed documents. The page auto-refreshes every 10 seconds while jobs are processing.

Pause & Resume

Pause a job mid-processing. It remembers where it left off and resumes from the exact same document when you continue.

Retry Jobs

Re-run completed, failed, or stopped jobs from scratch. Retry resets progress to zero and re-processes every document in the payload.

Edit Payload

Fix errors directly in the queue. Click any failed, stopped, or paused job to open its detail view, edit the JSON payload in place, save it, then retry. No need to re-submit via the API.

Error Details

Failed jobs show the error message. Completed jobs with partial failures show per-document success and error counts.

Queue Interface

▶ my_products_index

1 processing 1 failed 2 completed

Job IDStatusProgressDocsActions

a1b2c3d4... processing

60% 30/50 Pause

f9e8d7c6... failed

40% 20/50 Retry Delete

e5f6a7b8... completed

100% 50/50 Retry Delete

Job States

Pending

Waiting in queue

Processing

Enriching & indexing

Completed

All docs processed

Paused

User paused

Stopped

User cancelled

Failed

Error occurred

Available Actions

Action	Available When	What It Does
Pause	Pending, Processing	Pauses the job. Processing stops at the current document. Progress is preserved.
Resume	Paused, Stopped	Re-queues the job. Processing picks up from where it left off.
Stop / Cancel	Pending, Processing	Stops the job permanently. Documents already indexed remain in the index.
Retry	Completed, Failed, Stopped	Resets the job back to Pending and clears all progress counters. The entire payload is re-processed from scratch. Useful after fixing errors in the payload or when you want to re-index all documents.
Edit Payload	Failed, Stopped, Paused	Opens the job detail view where you can directly edit the JSON payload in a full-size editor. Fix field names, correct values, add or remove documents — then save and retry.
Delete	Any state	Removes the job from the queue. Does not remove already-indexed documents from Solr.

Edit Payload & Retry Workflow

When an ingestion job fails — bad field names, malformed data, missing required fields — you don’t have to re-submit the entire request through the API. You can fix the problem directly in the queue:

Fix & Retry in 3 Steps

Click the failed
job row

→

Edit the JSON
payload & Save

→

Click Retry

→

Job re-processes
with fixed data

Open the job detail — click any row in the queue to open the detail modal. For failed, stopped, or paused jobs, the payload section shows an editable text area with a “— editable” label.

Edit the JSON payload — the full JSON array of documents is displayed in a monospace editor. Fix field names, correct values, remove bad documents, or add new ones. Click Save Payload when done. The system validates that the payload is valid JSON and automatically recalculates document IDs from their uri fields and updates the total document count.

Retry the job — click the Retry button. The job is reset to Pending, all progress counters go back to zero, and processing starts fresh with your corrected payload.

Note: Editing the payload is only available for jobs in the Failed, Stopped, or Paused states. Jobs that are currently processing or pending cannot be edited — pause or stop them first. Retry is available for Completed, Failed, and Stopped jobs.

Automatic cleanup. Completed, failed, and stopped jobs are automatically removed from the queue after 7 days. You can delete them manually at any time.

API Queue Management

You can also manage the queue programmatically:

Endpoint	Purpose
`GET /api/ingest_status?job_id=...`	Check progress of a specific job
`GET /api/ingest_queue?core_name=...`	List all jobs for a core
`POST /api/ingest_queue_action`	Send `job_id` + `queue_action`. Available actions: `pause`, `resume`, `stop`, `delete`, `retry`, `save_payload`

For the save_payload action, include a payload parameter with the full JSON array of documents. The system validates it, regenerates document IDs from uri fields, and updates the total document count automatically.

All API endpoints require email and api_key authentication. You can only see and manage your own jobs.

Ready to push documents into your index? Check out the full API reference.

API Documentation