KalmiPrep • Switching...
Ingestion Pipeline Active RabbitMQ: global-rabbitmq (5672) Celery: 2 Prefork Workers Daemon PID: 2901657

Exam Question Ingestion Telemetry

Tracking automated multi-engine extraction and verified step-by-step solution ingestion across all 29668 STEM questions (UTME/JAMB, WAEC, NECO).

JSON API
Currently Ingesting Engines
Celery Distributed Workers (RabbitMQ)
3 Active Tasks
Biology Scraping Page 620
Biology Scraping Page 618
Biology Scraping Page 619
Continuous Crawler Daemon
PID 2901657 LIVE
Use of English (Compulsory) Page 1608 / 1883
Overall Database Completion: 27012 / 29668 Questions Ingested (91.05%)
In PostgreSQL
27012
2656 remaining
Verified Solutions
17154
Step-by-step solutions
Extraction Velocity
~155 questions/min
3 parallel workers
Estimated Time (ETA)
17 mins
Dynamic calculation

Subject Breakdown & Ingestion Target

Auto-refreshes every 6s

Use of English (Compulsory)

1877 / 1883 pages completed
Live Crawler Daemon
In PostgreSQL: 9385 / 9413 (99.7%)
Verified Solutions: 5250 (55.9%)

Mathematics

894 / 984 pages completed
In Progress (444 remaining)
In PostgreSQL: 4472 / 4916 (91.0%)
Verified Solutions: 4191 (93.7%)

Physics

1048 / 1048 pages completed
Fully Ingested (100%)
In PostgreSQL: 5315 / 5236 (101.5%)
Verified Solutions: 3844 (72.3%)

Chemistry

943 / 943 pages completed
Fully Ingested (100%)
In PostgreSQL: 4783 / 4711 (101.5%)
Verified Solutions: 3003 (62.8%)

Biology

611 / 1079 pages completed
Live Celery Ingestion
In PostgreSQL: 3057 / 5392 (56.7%)
Verified Solutions: 866 (28.3%)
Unified Pipeline Event Console (Celery Workers & Crawler Daemon)
Streaming Live Activity
> 2026-10-23 00:38:35,111 [INFO] [ENGLISH-LANGUAGE] Page 1599/1883 completed (+5 Qs, Total scraped: 13747)
> 2026-10-23 00:38:39,662 [INFO] [ENGLISH-LANGUAGE] Page 1600/1883 completed (+5 Qs, Total scraped: 13752)
> 2026-10-23 00:38:44,449 [INFO] [ENGLISH-LANGUAGE] Page 1601/1883 completed (+5 Qs, Total scraped: 13757)
> 2026-10-23 00:38:48,311 [INFO] [ENGLISH-LANGUAGE] Page 1602/1883 completed (+5 Qs, Total scraped: 13762)
> 2026-10-23 00:38:52,577 [INFO] [ENGLISH-LANGUAGE] Page 1603/1883 completed (+5 Qs, Total scraped: 13767)
> 2026-10-23 00:38:56,395 [INFO] [ENGLISH-LANGUAGE] Page 1604/1883 completed (+5 Qs, Total scraped: 13772)
> 2026-10-23 00:39:00,529 [INFO] [ENGLISH-LANGUAGE] Page 1605/1883 completed (+5 Qs, Total scraped: 13777)
> 2026-10-23 00:39:04,388 [INFO] >> Running background PostgreSQL DB synchronization...
> 2026-10-23 00:39:04,388 [INFO] [ENGLISH-LANGUAGE] Page 1606/1883 completed (+5 Qs, Total scraped: 13782)
> 2026-10-23 00:39:19,703 [INFO] ✓ PostgreSQL DB synchronization complete.
> 2026-10-23 00:39:25,280 [INFO] [ENGLISH-LANGUAGE] Page 1607/1883 completed (+5 Qs, Total scraped: 13787)
> 2026-10-23 00:39:29,302 [INFO] [ENGLISH-LANGUAGE] Page 1608/1883 completed (+5 Qs, Total scraped: 13792)