Pipeline Status
Acquisition · Processing · Recovery · Catalogue
Updated 2026-11-12 06:03:09 CETRefresh
Total articles · distinct (estimated)
41,965,220
MySQL table estimate; Live + History are deduplicated together.
LiveAcquisition ranges
41,258 done
0 running · 1 pending
Last completed: 2026-11-12 06:03:08 CET
Last 5 min: 130 completed ranges
· 26.0 ranges/min
Completed range jobs, not distinct article counts.
HistoryAcquisition ranges
10,681 done
1 running · 1 pending
Last completed: 2026-11-12 06:02:55 CET
Last 5 min: 37 completed ranges
· 7.4 ranges/min
Completed range jobs, not distinct article counts.
Full pipeline · process status
Database-observed state, not systemd service status
Discovery → Live / History → Interpreter → File Assembler → Post Assembler → Catalogue → WebUI. Recovery supports missing-article acquisition.
Discovery
complete
Provider group discovery
111,526 groups; last finish: 2026-11-11 07:53:29 CET. Last error: none
Live
Active
41,258 ranges done
0 running · 1 pending
130 ranges / 5 min · 26.0 ranges/min
Last completed: 2026-11-12 06:03:08 CET
41,258 completed; 0 running; 0 expired leases. Last completion: 2026-11-12 06:03:08 CET. Completed ranges do not imply the provider is caught up.
History
Active
10,681 ranges done
1 running · 1 pending
37 ranges / 5 min · 7.4 ranges/min
Last completed: 2026-11-12 06:02:55 CET
10,681 completed; 1 running; 0 expired leases. Last completion: 2026-11-12 06:02:55 CET. Completed ranges do not imply the provider is caught up.
Interpreter
Working
903 queued
1 worker metric records
Last batch rate is not rolling throughput
Durable interpreter queue. Last metric update: 2026-11-12 06:03:08 CET. Last batch: 649.0 items/s (not rolling throughput). Cumulative recorded failures: 0 (not necessarily current). State is inferred from DB metrics, not systemd.
File Assembler
Active
20,455 ambiguous
Input backlog not measured
20,455 ambiguous articles; input backlog not measured. Last metric update: 2026-11-12 06:03:08 CET. Last batch: 525.7 items/s (not rolling throughput). Cumulative recorded failures: 0 (not necessarily current). State is inferred from DB metrics, not systemd.
Post Assembler
Working
18 pending notifications
Pending file-change notifications. Last metric update: 2026-11-12 06:03:06 CET. Last batch: 58.2 items/s (not rolling throughput). Cumulative recorded failures: 0 (not necessarily current). State is inferred from DB metrics, not systemd.
Catalogue
Active
0 pending notifications
Pending post-change notifications. Last metric update: 2026-11-12 06:03:06 CET. Last batch: 4.2 items/s (not rolling throughput). Cumulative recorded failures: 0 (not necessarily current). State is inferred from DB metrics, not systemd.
Recovery
Idle
0 outstanding jobs
waiting 0; ready 0; searching 0; verifying 0; recovered 0; exhausted 0; last attempt —. Job counts are not a worker heartbeat.
WebUI
Serving
This status request rendered
This status request succeeded; other routes not tested.
Component overviewInferred from database activity — not systemd health
| Process | State | Pending | Details |
|---|---|---|---|
| Discovery | complete | — | 111,526 groups; last finish: 2026-11-11 07:53:29 CET. Last error: none |
| Live | Active | 1 | 41,258 completed; 0 running; 0 expired leases. Last completion: 2026-11-12 06:03:08 CET. Completed ranges do not imply the provider is caught up. |
| History | Active | 1 | 10,681 completed; 1 running; 0 expired leases. Last completion: 2026-11-12 06:02:55 CET. Completed ranges do not imply the provider is caught up. |
| Interpreter | Working | 903 | Durable interpreter queue. Last metric update: 2026-11-12 06:03:08 CET. Last batch: 649.0 items/s (not rolling throughput). Cumulative recorded failures: 0 (not necessarily current). State is inferred from DB metrics, not systemd. |
| File Assembler | Active | — | 20,455 ambiguous articles; input backlog not measured. Last metric update: 2026-11-12 06:03:08 CET. Last batch: 525.7 items/s (not rolling throughput). Cumulative recorded failures: 0 (not necessarily current). State is inferred from DB metrics, not systemd. |
| Post Assembler | Working | 18 | Pending file-change notifications. Last metric update: 2026-11-12 06:03:06 CET. Last batch: 58.2 items/s (not rolling throughput). Cumulative recorded failures: 0 (not necessarily current). State is inferred from DB metrics, not systemd. |
| Catalogue | Active | 0 | Pending post-change notifications. Last metric update: 2026-11-12 06:03:06 CET. Last batch: 4.2 items/s (not rolling throughput). Cumulative recorded failures: 0 (not necessarily current). State is inferred from DB metrics, not systemd. |
| Recovery | Idle | 0 | waiting 0; ready 0; searching 0; verifying 0; recovered 0; exhausted 0; last attempt —. Job counts are not a worker heartbeat. |
| WebUI | Serving | — | This status request succeeded; other routes not tested. |
Articles
41,965,220
Estimated rowsInterpreted
38,165,067
Estimated rowsAssembled files
164,202
Estimated rowsAssembled posts
4,614
Estimated rowsCatalogue releases
4,568
Estimated rowsPipeline queues
Interpreter
903
2026-11-12 05:03:06.692701File changes → Post Assembler
18
2026-11-12 05:03:06.457503Post changes → Catalogue
0
No pending itemsRecovery ready
0
Scheduled recovery jobsAcquisition overview
Live
0 running
41258 doneHistory
1 running
10681 doneProcessing performance
file-assembler525.7/s
post-assembler58.2/s
catalogue4.2/s
Last completed batch, not a rolling rate.Recovery
| State | Jobs | Attempts | Found | Inserted | Next retry (UTC) |
|---|---|---|---|---|---|
| No recovery jobs recorded | |||||
Acquisition ranges
| Lane | State | Ranges | Oldest created (UTC) |
|---|---|---|---|
| live | pending | 1 | 2026-11-12 05:02:54.302564 |
| live | done | 41,258 | 2026-11-11 06:51:29.121088 |
| history | pending | 1 | 2026-11-12 05:02:55.895588 |
| history | running | 1 | 2026-11-12 05:02:56.220587 |
| history | done | 10,681 | 2026-11-11 06:51:31.578123 |
Processing counters
| Stage | Last seen (UTC) | Processed | Batches | Last batch/s | Failures |
|---|---|---|---|---|---|
| file-assembler | 2026-11-12 05:03:08.194774 | 30,698,549 | 61,736 | 525.7 | 0 |
| post-assembler | 2026-11-12 05:03:06.411390 | 432,845 | 27,882 | 58.2 | 0 |
| catalogue | 2026-11-12 05:03:06.535315 | 41,702 | 19,031 | 4.2 | 0 |
Interpreter workers
Queued: 903 · Oldest: 2026-11-12 05:03:06.692701 · Bootstrap: complete (0 / 0)
| Worker | Last seen (UTC) | Processed | Last batch | Rate/s | Retries | Failures |
|---|---|---|---|---|---|---|
| interpreter-0 | 2026-11-12 05:03:08.218323 | 41,153,771 | 1000 | 649 | 435 | 0 |
Newsgroup cursors (up to 200)
| Newsgroup | Enabled | Provider high | Live cursor | History cursor | History floor |
|---|---|---|---|---|---|
| alt.binaries.blu-ray | Yes | 8104992613 | 8104992113 | 8090719520 | Default |
| alt.binaries.ctw | Yes | 33540419 | 33539919 | 20399009 | Default |
| alt.binaries.kleverig | Yes | 2426308302 | 2426307802 | 2415003279 | Default |
| alt.binaries.x | Yes | 13258455498 | 13258454998 | 13240220011 | Default |
| alt.binaries.x264 | Yes | 4066318639 | 4066318139 | 4052716107 | Default |
| alt.binaries.3d | No | — | — | — | Default |
| alt.binaries.a51 | No | — | — | — | Default |
| alt.binaries.aa | No | — | — | — | Default |
| alt.binaries.anime | No | — | — | — | Default |
| alt.binaries.ath | No | — | — | — | Default |
| alt.binaries.audiobooks | No | — | — | — | Default |
| alt.binaries.b4e.erotica | No | — | — | — | Default |
| alt.binaries.backup | No | — | — | — | Default |
| alt.binaries.big | No | — | — | — | Default |
| alt.binaries.bloaf | No | — | — | — | Default |
| alt.binaries.blue-ray | No | — | — | — | Default |
| alt.binaries.bollywood | No | — | — | — | Default |
| alt.binaries.boneless | No | — | — | — | Default |
| alt.binaries.buttnuggets | No | — | — | — | Default |
| alt.binaries.cavebox | No | — | — | — | Default |
| alt.binaries.cbts | No | — | — | — | Default |
| alt.binaries.cccb | No | — | — | — | Default |
| alt.binaries.cd | No | — | — | — | Default |
| alt.binaries.chakotay | No | — | — | — | Default |
| alt.binaries.chello | No | — | — | — | Default |
| alt.binaries.cinemageddon | No | — | — | — | Default |
| alt.binaries.comics | No | — | — | — | Default |
| alt.binaries.comp | No | — | — | — | Default |
| alt.binaries.cores | No | — | — | — | Default |
| alt.binaries.ctb | No | — | — | — | Default |
| alt.binaries.dc | No | — | — | — | Default |
| alt.binaries.ddf | No | — | — | — | Default |
| alt.binaries.de | No | — | — | — | Default |
| alt.binaries.department | No | — | — | — | Default |
| alt.binaries.department.pron | No | — | — | — | Default |
| alt.binaries.dgma | No | — | — | — | Default |
| alt.binaries.divx | No | — | — | — | Default |
| alt.binaries.documentaries | No | — | — | — | Default |
| alt.binaries.dominion | No | — | — | — | Default |
| alt.binaries.dream | No | — | — | — | Default |
| alt.binaries.drwho | No | — | — | — | Default |
| alt.binaries.dump | No | — | — | — | Default |
| alt.binaries.dvd | No | — | — | — | Default |
| alt.binaries.dvd-r | No | — | — | — | Default |
| alt.binaries.ebook | No | — | — | — | Default |
| alt.binaries.echange-web | No | — | — | — | Default |
| alt.binaries.emulator | No | — | — | — | Default |
| alt.binaries.encrypted | No | — | — | — | Default |
| alt.binaries.epub | No | — | — | — | Default |
| alt.binaries.epub.dutch | No | — | — | — | Default |
| alt.binaries.erotica | No | — | — | — | Default |
| alt.binaries.erotica-underground | No | — | — | — | Default |
| alt.binaries.erotica.divx | No | — | — | — | Default |
| alt.binaries.erotica.pornstars.80s | No | — | — | — | Default |
| alt.binaries.erotiek | No | — | — | — | Default |
| alt.binaries.etc | No | — | — | — | Default |
| alt.binaries.film | No | — | — | — | Default |
| alt.binaries.filmclub | No | — | — | — | Default |
| alt.binaries.fitness | No | — | — | — | Default |
| alt.binaries.freeware | No | — | — | — | Default |
| alt.binaries.french | No | — | — | — | Default |
| alt.binaries.fta | No | — | — | — | Default |
| alt.binaries.ftb | No | — | — | — | Default |
| alt.binaries.ftd | No | — | — | — | Default |
| alt.binaries.ftn | No | — | — | — | Default |
| alt.binaries.ftn.games | No | — | — | — | Default |
| alt.binaries.ftr | No | — | — | — | Default |
| alt.binaries.ftwclub | No | — | — | — | Default |
| alt.binaries.fz | No | — | — | — | Default |
| alt.binaries.games | No | — | — | — | Default |
| alt.binaries.games.adventures | No | — | — | — | Default |
| alt.binaries.games.dox | No | — | — | — | Default |
| alt.binaries.games.kidstuff | No | — | — | — | Default |
| alt.binaries.games.nintendo3ds | No | — | — | — | Default |
| alt.binaries.games.nintendods | No | — | — | — | Default |
| alt.binaries.games.xbox | No | — | — | — | Default |
| alt.binaries.games.xbox360 | No | — | — | — | Default |
| alt.binaries.german | No | — | — | — | Default |
| alt.binaries.german.divx | No | — | — | — | Default |
| alt.binaries.ghosts | No | — | — | — | Default |
| alt.binaries.hdtv | No | — | — | — | Default |
| alt.binaries.hdtv.french | No | — | — | — | Default |
| alt.binaries.hdtv.german | No | — | — | — | Default |
| alt.binaries.hdtv.repost | No | — | — | — | Default |
| alt.binaries.hdtv.x264 | No | — | — | — | Default |
| alt.binaries.hou | No | — | — | — | Default |
| alt.binaries.house-of-porn.clips | No | — | — | — | Default |
| alt.binaries.house-of-porn.erotica | No | — | — | — | Default |
| alt.binaries.hunters | No | — | — | — | Default |
| alt.binaries.ibm-pc | No | — | — | — | Default |
| alt.binaries.ibm-pc.games | No | — | — | — | Default |
| alt.binaries.ibm-pc.warez | No | — | — | — | Default |
| alt.binaries.ijsklontje | No | — | — | — | Default |
| alt.binaries.image | No | — | — | — | Default |
| alt.binaries.image.games | No | — | — | — | Default |
| alt.binaries.images | No | — | — | — | Default |
| alt.binaries.insiderz | No | — | — | — | Default |
| alt.binaries.iso | No | — | — | — | Default |
| alt.binaries.jph | No | — | — | — | Default |
| alt.binaries.just4fun.nl | No | — | — | — | Default |
| alt.binaries.karagarga | No | — | — | — | Default |
| alt.binaries.kenpsx | No | — | — | — | Default |
| alt.binaries.korea | No | — | — | — | Default |
| alt.binaries.laumovie.nl | No | — | — | — | Default |
| alt.binaries.lossless | No | — | — | — | Default |
| alt.binaries.lou | No | — | — | — | Default |
| alt.binaries.mac | No | — | — | — | Default |
| alt.binaries.machnur | No | — | — | — | Default |
| alt.binaries.magic | No | — | — | — | Default |
| alt.binaries.masternzb | No | — | — | — | Default |
| alt.binaries.matrix | No | — | — | — | Default |
| alt.binaries.milo | No | — | — | — | Default |
| alt.binaries.misc | No | — | — | — | Default |
| alt.binaries.misc.xxx | No | — | — | — | Default |
| alt.binaries.mma | No | — | — | — | Default |
| alt.binaries.models | No | — | — | — | Default |
| alt.binaries.mojo | No | — | — | — | Default |
| alt.binaries.mom | No | — | — | — | Default |
| alt.binaries.mom.xxx | No | — | — | — | Default |
| alt.binaries.moovee | No | — | — | — | Default |
| alt.binaries.mou | No | — | — | — | Default |
| alt.binaries.movie | No | — | — | — | Default |
| alt.binaries.movies | No | — | — | — | Default |
| alt.binaries.movies.arthouse | No | — | — | — | Default |
| alt.binaries.movies.divx.german | No | — | — | — | Default |
| alt.binaries.movies.french.xxx | No | — | — | — | Default |
| alt.binaries.movies.german | No | — | — | — | Default |
| alt.binaries.movies.mkv | No | — | — | — | Default |
| alt.binaries.mp3 | No | — | — | — | Default |
| alt.binaries.mpeg | No | — | — | — | Default |
| alt.binaries.ms-windows | No | — | — | — | Default |
| alt.binaries.multimedia | No | — | — | — | Default |
| alt.binaries.multimedia.erotica | No | — | — | — | Default |
| alt.binaries.multimedia.erotica.amateur | No | — | — | — | Default |
| alt.binaries.multimedia.erotica.lesbians | No | — | — | — | Default |
| alt.binaries.multimedia.erotica.voyeurism | No | — | — | — | Default |
| alt.binaries.music | No | — | — | — | Default |
| alt.binaries.mutlimedia | No | — | — | — | Default |
| alt.binaries.nl | No | — | — | — | Default |
| alt.binaries.norge | No | — | — | — | Default |
| alt.binaries.nospam.multimedia.erotica | No | — | — | — | Default |
| alt.binaries.nzb | No | — | — | — | Default |
| alt.binaries.nzm | No | — | — | — | Default |
| alt.binaries.paranormal | No | — | — | — | Default |
| alt.binaries.paxer | No | — | — | — | Default |
| alt.binaries.pictures | No | — | — | — | Default |
| alt.binaries.pictures.nude | No | — | — | — | Default |
| alt.binaries.porn | No | — | — | — | Default |
| alt.binaries.porno | No | — | — | — | Default |
| alt.binaries.pwp | No | — | — | — | Default |
| alt.binaries.residents | No | — | — | — | Default |
| alt.binaries.sex | No | — | — | — | Default |
| alt.binaries.skewed | No | — | — | — | Default |
| alt.binaries.software | No | — | — | — | Default |
| alt.binaries.sounds | No | — | — | — | Default |
| alt.binaries.starwars | No | — | — | — | Default |
| alt.binaries.swe | No | — | — | — | Default |
| alt.binaries.swebinz | No | — | — | — | Default |
| alt.binaries.tatu | No | — | — | — | Default |
| alt.binaries.teevee | No | — | — | — | Default |
| alt.binaries.test | No | — | — | — | Default |
| alt.binaries.thundernews | No | — | — | — | Default |
| alt.binaries.town | No | — | — | — | Default |
| alt.binaries.town.xxx | No | — | — | — | Default |
| alt.binaries.tun | No | — | — | — | Default |
| alt.binaries.tv | No | — | — | — | Default |
| alt.binaries.tvshows | No | — | — | — | Default |
| alt.binaries.u-4all | No | — | — | — | Default |
| alt.binaries.united-forums | No | — | — | — | Default |
| alt.binaries.usc | No | — | — | — | Default |
| alt.binaries.usenet | No | — | — | — | Default |
| alt.binaries.usenet-space-cowboys | No | — | — | — | Default |
| alt.binaries.usenet-world.com | No | — | — | — | Default |
| alt.binaries.usenet2day | No | — | — | — | Default |
| alt.binaries.uzenet | No | — | — | — | Default |
| alt.binaries.vcdz | No | — | — | — | Default |
| alt.binaries.warez | No | — | — | — | Default |
| alt.binaries.wb | No | — | — | — | Default |
| alt.binaries.welovehelix | No | — | — | — | Default |
| alt.binaries.welovelori | No | — | — | — | Default |
| alt.binaries.x-files | No | — | — | — | Default |
| alt.binaries.x2l | No | — | — | — | Default |
| alt.binaries.xxibite | No | — | — | — | Default |
| alt.binaries.xxx | No | — | — | — | Default |
| alt.binaries.xylo | No | — | — | — | Default |
| alt.binaries.zines | No | — | — | — | Default |
| es.binarios.sexo | No | — | — | — | Default |
Provider discovery
complete · 111,526 groups seen · Updated —
Read-only database snapshot. Counts may be approximate. A recent heartbeat does not prove a service is currently running; use
newsx-services.sh status for systemd health.