Last sync: -
Pipeline idle
Total Records
-
across - verticals • - sources
Name Index
-
searchable person records
DuckDB Size
-
columnar database on EBS
Data Sources
-
unique data feeds ingested
Status & Next Steps
Wave 28 Complete (+38.5M records)
Done PA Campaign Finance: 27.0M records (2000-2026)
Done NY Death Index: 4.95M records (1880-2017)
Done IL Campaign Finance: 3.48M records (1994-present)
Done MI Campaign Finance: 1.72M records (via Wayback)
Done NJ Death Index: 1.28M records (2001-2017)
All staging backed up to S3 Glacier. DuckDB rebuild pending. MapGeo API discovered (800+ muni).
Research Queue (Next Wave)
~16M Campaign: NY (10M), OH (3-5M), GA (3.6M) — FREE
~5M Reclaim The Records: MD Vitals (5M+) — FREE
~48M Voter Files: FL (14M free), TX (17M/$75), CA (22M/$100)
~5M Salary: CA Public Pay (3-5M), Transparent CA (2-3M)
~4M GIS: MassGIS (2M), MN (1.5M), MapGeo (800+ muni)
~3M Business: OH SOS (2M), WA SOS (1M) — FREE
Remaining pipeline: ~80M+ verified. MapGeo API discovered for 800+ municipalities.
Data Integrity Report
Source Status Notes Records Lost
FEC API + Bulk (all datasets) Complete All ZIPs extracted then deleted 0
NC Voter Registration Complete Full statewide file (9.1M) 0
Cook County Property Tax Partial Parse killed at 2.8M to free disk space Minimal
NPPES NPI Registry (re-run) Complete Full re-download after EBS expansion: ~7.86M providers 0
Texas TDLR Licenses Complete 921,527 records via updated API URL 0
FAA Airmen Database Complete 965,761 pilots + mechanics from CSV bulk 0
FCC Amateur Radio (ULS) Complete 1,635,720 licenses from pipe-delimited bulk 0
Ohio Voter Registration Complete 7.9M records ingested via Wave 12 0
CA DCA Professional Licenses Complete 2,657,646 records from 15 boards via Box.com bulk download 2,657,646
CA Unclaimed Property In Progress 22GB CSV streaming parse; 10M+ records so far 0
FL DBPR Licenses (23 categories) Complete ~1M records from CSV extracts (RE, contractors, cosmetology, etc.) 0
ATF FFL Monthly Lists Complete 42,388 unique licensees from 59 monthly files via Playwright browser 0
IRS 990-N e-Postcard Complete 1,420,475 nonprofit officers from bulk download 0
USPTO PatentsView Complete 4,243,267 unique inventors from TSV bulk 0
CMS Open Payments Complete 984,034 unique physicians deduped from 16M+ payment rows 0
Echovita + Legacy Obituaries Complete All 51 states (Echovita) + 20 states (Legacy) 0