Web Crawler API
Get LIVE Web Crawler Stats
Get real-time statistics for your web crawler: pages crawled, pages queued, errors, traffic used, and more.
Endpoint
GET https://opensolr.com/solr_manager/api/get_crawl_stats
Parameters
| Parameter | Status | Description |
|---|---|---|
email | Required | Your Opensolr registration email address |
api_key | Required | Your Opensolr API key |
core_name | Required | The name of the index you wish to get live crawler stats for |
Code Examples
cURL
curl -s "https://opensolr.com/solr_manager/api/get_crawl_stats?email=YOUR_EMAIL&api_key=YOUR_API_KEY&core_name=my_solr_core"
PHP
$params = http_build_query([ 'email' => 'YOUR_EMAIL', 'api_key' => 'YOUR_API_KEY', 'core_name' => 'my_solr_core', ]); $response = file_get_contents("https://opensolr.com/solr_manager/api/get_crawl_stats?{$params}"); $stats = json_decode($response, true); print_r($stats);
Python
import requests response = requests.get("https://opensolr.com/solr_manager/api/get_crawl_stats", params={ "email": "YOUR_EMAIL", "api_key": "YOUR_API_KEY", "core_name": "my_solr_core", }) stats = response.json() print(stats)
Use this endpoint to monitor crawler progress in real time. It's useful for building dashboards or deciding when to pause/resume the crawler.
Related Documentation
Start CrawlerLaunch the web crawler with full control over mode, threads, and rendering.
Pause CrawlerTemporarily halt crawling while keeping the cron schedule.
Resume CrawlerContinue crawling immediately from where it left off.
Check StatusCheck whether crawler processes are currently active.
Get Live StatsReal-time crawler statistics: pages crawled, queued, errors.
Flush BufferForce pending documents from the crawler buffer into Solr.
Need help with the Opensolr Web Crawler? We are here to help.
Contact Support