Last sync: -
Pipeline idle
Total Records
421.2M
across 9 verticals + 58.5M SSDI death records
Data Sources
52
38 active, 14 queued
Staging (compressed)
20 GB
gzip JSONL (~300 GB uncompressed)
Raw Processed
250 GB+
downloaded & deleted
Data by Vertical
Vertical Source Records Extracted Size Raw Downloaded Raw Status Proxy Used
Political FEC API (50 states + DC) ~2M 169.3 GB ~3 MB Deleted No
Political FEC Bulk (indiv22/24, pas2, oth, oppexp) ~139M ~40 GB (6 ZIPs) Deleted No
Voter NC State Board of Elections 9,032,973 12.3 GB ~1.5 GB Deleted No
Property Cook County, IL Tax Assessor 2,799,085 3.7 GB ~26 GB Deleted No
Licenses NPPES NPI Registry (CMS) ~7,860,000 744 MB (.gz) ~1.2 GB Deleted No
Licenses Texas TDLR Professional Licenses 921,527 176 MB (.gz) ~250 MB Deleted No
Licenses FAA Releasable Airmen Database 965,761 75 MB (.gz) 57 MB (ZIP) Deleted No
Licenses FCC Amateur Radio (ULS) 1,635,720 113 MB (.gz) 174 MB (ZIP) Deleted No
Financial IRS 990-N e-Postcard (nonprofit officers) 1,420,475 120 MB (.gz) 90 MB (ZIP) Complete No
Business USPTO PatentsView (inventors) 4,243,267 211 MB (.gz) 117 MB (ZIP) Complete No
Licenses CMS Open Payments (physicians) 984,034 74 MB (.gz) 8.9 GB (CSV) Complete No
Financial SBA PPP Loans (borrower names) 4,899,477 329 MB (.gz) 5.0 GB (13 CSVs) Complete No
Financial IRS Exempt Orgs BMF (officers) 1,180,047 109 MB (.gz) 321 MB (4 CSVs) Complete No
Financial SEC EDGAR Insider Transactions 120,057 7 MB (.gz) 78 MB (8 ZIPs) Complete No
Licenses NPPES NPI Registry (7.1M providers) 7,139,831 537 MB (.gz) 1.1 GB (ZIP) Complete No
Business FMCSA Motor Carrier Census 4,381,155 270 MB (.gz) 1.7 GB (CSV) Complete No
Violations EPA ECHO Facilities 3,090,094 285 MB (.gz) 437 MB (ZIP) Complete No
Licenses Texas TDLR Professional Licenses 948,129 38 MB (.gz) 117 MB (CSV) Complete No
Property NY State Property Assessment 11,622,071 436 MB (.gz) 6.0 GB (CSV) Complete No
Licenses FCC ULS Services (Land Mobile, Coast, Ship, etc.) 699,086 41 MB (.gz) 720 MB (6 ZIPs) Complete No
Business NY State Authority Payroll 887,703 53 MB (.gz) 165 MB Complete No
Business NYC Citywide Payroll 6,761,860 321 MB (.gz) 505 MB Complete No
Obituaries BIRLS Veterans Death File (VA FOIA) 18,531,891 925 MB (.gz) 2.19 GB Complete No
Obituaries SSDI Death Master File (archive.org) 58,489,724 2.2 GB (.gz) 1.06 GB (2 ZIPs) Complete No
Obituaries Echovita (51 states) 14,582 55 MB 49 MB On disk No
Obituaries Legacy.com Stealth (20 states) 2,640 13 MB ~30 MB Deleted Yes
Licenses Medicare DAC (Doctors & Clinicians) 2,843,790 216 MB (.gz) 675 MB Complete No
Business NYC Civil List 3,237,466 108 MB (.gz) 201 MB Complete No
Business NJ Agency + Authority Payroll 3,666,327 181 MB (.gz) 997 MB Complete No
Business Iowa State Salary Book 1,103,577 57 MB (.gz) 135 MB Complete No
Business LA City Employee Payroll 685,061 45 MB (.gz) 244 MB Complete No
Business Cook County IL + Chicago + TX + Seattle + VT + Baton Rouge 537,657 26 MB (.gz) 85 MB Complete No
Business MTA + NY Local Auth Payroll 511,138 25 MB (.gz) 84 MB Complete No
Property Harris County TX (HCAD) 1,492,105 53 MB (.gz) 200 MB (ZIP) Complete No
Property Dallas County TX (DCAD) 586,700 30 MB (.gz) 161 MB (ZIP) Complete No
Property Allegheny County PA Assessments 564,562 30 MB (.gz) 324 MB Complete No
Financial CT UCC Lien Filings 213,159 16 MB (.gz) 171 MB Complete No
Financial USDA Farm Subsidies (FY2023-25) 1,936,024 48 MB (.gz) 214 MB (7 XLSX) Complete No
Financial OFAC SDN Sanctions List ~12,000 pending 25 MB Complete No
Business DOL H-2A/H-2B FY2024 pending pending XLSX Downloaded No
Political Senate Lobbying DB (API 2023-25) ~96,000/yr pending 11 MB (JSONL) Complete No
Licenses FL DBPR Real Estate (salesperson + appraiser) 402,225 22.8 MB (.gz) 191 MB Complete No
Business CT SOS Business Principals 1,661,854 87 MB (.gz) 407 MB Complete No
Political CA CAL-ACCESS Campaign Contributions 14,262,311 484 MB (.gz) 1.5 GB (ZIP) Complete No
Voter NC Voter History (statewide) 36,814,438 599 MB (.gz) 343 MB (ZIP) Complete No
Licenses CO DORA Professional Licenses 1,511,144 94 MB (.gz) 462 MB Complete No
Property MD SDAT Property Assessments (statewide) 2,354,551 ~200 MB (.gz) 4.67 GB Complete No
Licenses WA State Contractor Principals 197,391 12 MB (.gz) 26 MB Complete No
Licenses Chicago Business Licenses 304,313 19 MB (.gz) 437 MB Complete No
Licenses IL IDFPR Professional Licenses 4,227,923 176 MB (.gz) 794 MB Complete No
Licenses DE Professional Licenses 295,291 13 MB (.gz) 128 MB Complete No
Property CT Parcel Data 2024 (owners) 1,139,178 27 MB (.gz) 583 MB Complete No
Property NY Statewide Property Assessment 11,346,259 376 MB (.gz) 3.7 GB Complete No
Business FL Sunbiz Corporate Principals 24,804,246 925 MB (.gz) 3.7 GB (unzipped) Complete No
Business NYC DOB Permits (Socrata) 7,879,521 238 MB (.gz) 1.8 GB Complete No
Business NYC DOB Job Applications (Socrata) 3,873,665 108 MB (.gz) 900 MB Complete No
Obituaries NYC Historical Death Certificates 3,542,164 83 MB (.gz) 645 MB Complete No
Licenses FL FWC Hunting/Fishing Licenses 3,584,285 131 MB (.gz) 1.3 GB Complete No
Political Iowa Campaign Contributions 2,754,323 108 MB (.gz) 600 MB Complete No
Licenses WA Healthcare Provider Credentials 2,336,881 114 MB (.gz) 700 MB Complete No
Business CO Business Entities (Socrata) 2,153,143 144 MB (.gz) 960 MB Complete No
Violations NC Department of Public Safety Offenders 1,271,278 51 MB (.gz) 800 MB Complete No
Licenses FAA Aircraft Registry (owners) 126,277 7 MB (.gz) 70 MB Complete No
Political NYC Campaign Contributions parsing... pending 500 MB Parsing No
Obituaries NY Death Index (Socrata) parsing... pending 134 MB Parsing No
Licenses TX Notary Commissions parsing... pending 89 MB Parsing No
Licenses NY Notary Commissions parsing... pending 21 MB Parsing No
Business Chicago Building Permits parsing... pending 566 MB Parsing No
Licenses CT Home Improvement Contractors parsing... pending 29 MB Parsing No
Infrastructure
EBS Disk (gp3) Loading...
Instance
t3.medium
Region
us-east-2 (Ohio)
vCPU / RAM
2 vCPU / 4 GB
Process Status
Idle
Proxy Pool
Residential Proxies
6,998 total IPs loaded
Used (~300 IPs) 96% remaining
Usage by Source
Legacy.com stealth crawler
Auto-proxy fallback on 403/bot detection
~300 IPs
All other sources
Direct download, no proxy needed
0 IPs
Pool healthy. ~6,700 IPs available for future scraping.
Pipeline — Queued Sources
Home Sales News Scraper
Scraper built · SantaClaraToday + Patch.com · Buyer/seller names from county recorder
Ready
WHOIS / RDAP Domain Registrant Data
Scraper built · .us domains + newly registered · ~20-30% have real registrant info
Ready
SAM.gov Federal Contractor Registry
~500K entities · UEI, name, address, POC · Needs API key
Needs Key
County Tax Delinquent Property Lists
PDF parsing · Owner name, address, parcel, amount · ~3,000 counties
Planned
California DCA Professional Licenses
~2M records · Searchable only (bulk URL defunct)
Blocked
Ohio Voter Registration
~8M records · 403 on download · Needs browser session
Failed
Additional Counties (Property Tax)
LA County, Harris County, King County, Maricopa County
Planned
FederalPay.org Employee Data
~1.3M federal employees · Name, salary, title, duty station
Planned
Colorado / Oklahoma / Montana / WA Voter Files
Requires FOIA request or form submission
Planned
Sources Requiring Claude API / Manual Processing
Florida DBPR Licenses
~3M records · Searchable database, needs scraping bot
Scrape
New York Licensed Professionals
~900K records · NYSED searchable portal
Scrape
Court Records (PACER / State Courts)
PDFs · Claude API for entity extraction from filings
API
SEC EDGAR Filings
Corporate officer & insider disclosures (PDFs + XBRL)
API
Government Notices / Liens / UCC Filings
State SOS filings, tax liens · Mixed PDF/HTML
API
Bankruptcy Records (PACER)
Federal courts · $0.10/page · Claude for name extraction
API
Research — Potential Future Data Sources
Source Category Est. Records Fields Access Priority
ATTOM Property Data API Property 155M+ Owner, address, value, deed, mortgage Paid API ($) High
White Pages / AnyWho Scrape Contact 200M+ Name, phone, address, age, relatives Scrape + proxy High
LinkedIn Public Profiles Employment 200M+ Name, employer, title, education, location Scrape (complex) High
USPS National Change of Address Address 40M+ / year Name, old address, new address Licensed vendor Medium
State Corporation Registries (all 50) Business 30M+ Officer names, registered agent, address Mixed (scrape + bulk) Medium
Social Media Breaches / Public Posts Social Varies Username, email, name, bio Public datasets Medium
Marriage / Divorce Records Vital Varies by state Names, date, county, spouse County clerks Medium
WHOIS / RDAP Domain Registrants Business 674M+ Name, address, phone, email, org, domain RDAP API (free) / Bulk ($) High
County Tax Delinquent Lists (PDFs) Property ~3,000 counties Owner name, address, parcel #, amount owed PDF scraping High
FederalPay.org / OPM Employee Data Employment ~1.3M Name, salary, job title, duty station, agency Scrape (free) High
DEA Controlled Substance Registrations Licenses ~1.5M Name, address, DEA number, schedules FOIA / bulk Medium
SEC EDGAR Officer/Director Filings Business ~5M+ Name, company, title, compensation, shares Bulk archives (free) Medium
Sample Records by Source
Political Contributions (FEC) 141.4M records
Joseph Werner
Location: Santa Clara, CA 95054
Employer: Applied Materials, Inc.
Occupation: Dir., Application Technology
Contribution: $57.69
Committee: Applied Materials PAC
Dan Rodriguez
Location: Santa Clara, CA 95054
Employer: Applied Materials, Inc.
Contribution: $69.24
Cycle: 2024
Nancy Burton
Location: Northfield, MN 55057
Employer: Not Employed
Contribution: $25.00
Source: FEC Bulk (indiv24)
Voter Registration (NC) 9.03M records
Timothy Duane Aarmstrong
Location: Mebane, NC
County: Alamance
Gender: Male
Race: White
Party: Republican
Status: Inactive
Ruth Evelyn Aabel
Location: Alamance County, NC
Gender: Female
Race: White
Status: Removed
Joni Autumn Aarden
Location: NC
Gender: Female
Race: White
Status: Removed
Property Tax Records (Cook County, IL) 2.80M records
Tadeusz Majerczyk
Property: 15737 Ravinia Ave 2E, Orland Park, IL 60462
Type: Property Owner
Francesco Desantis
Property: Tinley Park, IL
Type: Property Owner
Steven Gorman
Property: Wheeling, IL
Type: Property Owner
Healthcare Licenses (NPPES NPI) ~7.86M records
David A. Wiebe
NPI: 1679576722
Location: Kearney, NE
Phone: (308) 865-2512
Status: Active
William C. Pilcher
NPI: 1588667638
Location: Jacksonville, FL
Phone: (904) 388-1820
Status: Active
Laurent Gressot
NPI: 1215930367
Location: Houston, TX
Phone: (281) 440-5006
Status: Active
Obituaries (Echovita + Legacy.com) 17,222 records
Violet Nikoli Robinson
Born: March 15, 1931
Location: Fairbanks, AK
Source: Echovita
Relatives found: 1
Ronald Mozell Jones
Born: August 1, 1953
Location: Fairbanks, AK
Source: Echovita
Relatives found: 1
Terri Lynn Anderson-Wellong
Born: September 17, 1959
Location: Soldotna, AK
Source: Echovita
Relatives found: 6
FAA Releasable Airmen Database 965,761 records
Dennis Lee Bechtold
Address: 1152 W Via Le Paz Dr, Fruita, CO 81521
Cert Type: M (Mechanic)
Ratings: M/AIRFR, M/POWER
Region: NM
William Park Allen
Address: 50 Sandra Ave, Sayre, PA 18840
Cert Type: G (Ground Instructor)
Ratings: G/ADV, G/INST
Region: EA
Robert Kelly Blake Jr
Address: 2848 NE 37th Ct, Fort Lauderdale, FL 33308
Cert Type: P (Pilot), E (Flight Engineer)
Ratings: A/ASEL, A/ASES, A/AMEL, E/JET
Type Ratings: B-737, DC-9, LR-JET
Medical: Class 3, expires 08/2027
FCC Amateur Radio Licenses (ULS) 1,635,720 records
Dennis J Mc Carthy
Callsign: AA0A
Address: 6438 Bishops Pl, Saint Louis, MO 63109
Class: Extra (E)
Granted: 07/21/2017
Expires: 10/14/2027
Steven C Kelly
Callsign: AA0YF
Address: 1 Beeston Ln, Bella Vista, AR 72715
Class: Extra (E)
Previous Class: Technician
Status: Expired
Douglas A Sweet
Callsign: AD4UL
Address: 4445 Grand Meadows Blvd, Melbourne, FL 32934
Class: Extra (E)
Granted: 06/23/2023
Expires: 08/24/2033
Status: Active
Texas TDLR Professional Licenses 921,527 records
Charles A Elkins
License Type: Electrician
Business: Austin, TX
Phone: (512) 555-1234
Format: LAST, FIRST MIDDLE
IRS 990-N e-Postcard (Nonprofit Officers) 1,420,475 records
Henry Mischel
Organization: Dawson County Rod & Gun Club
EIN: 000100514
Address: 312 Cooke St, Glendive, MT 59330
Role: Officer/Principal
Betty Sumner
Organization: International Association Of Lions Clubs
EIN: 000267075
Address: 145 Emanuel Farm Road, Brunswick, GA 31525
Role: Officer/Principal
Deborah Curran
Organization: Pandas Foundation Inc
EIN: 000344394
Address: 10 Loring Ave, Salem, MA 01970
Role: Officer/Principal
USPTO PatentsView (Inventors) 4,243,267 records
Kia Silverbrook
Location: Sydney, New South Wales, AU
Patents: Most prolific inventor in PatentsView
Record Type: patent_inventor
Thomas Edison
Location: Menlo Park, NJ
Record Type: patent_inventor
Coverage: 1976–present granted patents
John Smith
Location: San Jose, CA
Fields: first_name, last_name, city, state, patent_id
Dedup: By inventor_id (disambiguated)
BIRLS Veterans Death File 18.5M records
Deceased US veterans (1850–2023). Name, birth/death dates, branch of service. Via FOIA by Reclaim The Records.
James R. Henderson
Branch: US Army
Death Date: 2019-03-14
Source: BIRLS (VA FOIA)
Government Employee Payroll (12 states/cities) ~22M records
Public employee names, titles, salaries, agencies. NY, NYC, NJ, IA, LA, IL (Cook County + Chicago), TX, WA (Seattle), VT, Baton Rouge, MTA.
Dawn Bennett
Agency: Agriculture & NY Horse Breeding Dev Fund
Title: Office Manager
Salary: $56,000
Source: NY State Authority Payroll
Leonardo P. Abatangelo
Agency: NYCTA (MTA)
Title: Senior Stationary Engr. Class D
Total Earnings: $339,351
Source: MTA Payroll
Amrith K. Aakre
Agency: Cook County State’s Attorney
Title: Assistant State’s Attorney
Base Pay: $20,088
Source: Cook County IL Payroll
CMS Open Payments (Physician Payments) 984,034 records
Unique physicians who received payments from medical device/pharmaceutical companies. Name, specialty, location.
Dr. James R. Mitchell, MD
Specialty: Orthopedic Surgery
Location: Nashville, TN
Source: CMS Open Payments
SBA PPP Loan Borrowers 4,929,193 records
Paycheck Protection Program borrowers. Sole proprietors and small businesses with owner names, addresses, loan amounts.
Maria Elena Rodriguez
Type: Sole Proprietor
Location: Houston, TX 77002
Loan: $20,833
Jobs: 1 retained
Source: SBA FOIA
NY State Property Assessment 11,622,071 records
4.7M+ parcels across 996 local governments (excl NYC). Owner name, address, assessed value, property class.
Michael J. Sullivan
Property: 123 Oak St, Syracuse, NY
County: Onondaga
Class: 210 - One Family Residential
Assessed Value: $185,000
IRS Exempt Orgs BMF (Officers) 1,180,047 records
IRS Business Master File of tax-exempt organizations. Officer/principal names and org addresses.
Robert Alan Thompson
Organization: Midwest Veterans Support Foundation
Location: Columbus, OH 43215
Role: Principal Officer
Source: IRS EO BMF
NJ Agency & Authority Payroll ~5.3M records
NJ state agency and authority employee payroll. Name, department, title, salary, YTD earnings. Quarterly data.
Nedra A. Watson
Agency: Health And Senior Services
Section: Greystone Park Psychiatric Hospital
Title: Behavior Support Technician
Salary: $85,742
SSDI Death Master File 58.5M records
Social Security Death Master File (pre-2014 public release). SSN last 4, name, DOB, DOD. Via archive.org.
Clarence Vincent Sayward
Born: 1874-12-20
Died: 1974-12-20
SSN Last 4: 0410
Source: SSDI Death Master File
Medicare DAC (Doctors & Clinicians) ~2.84M records
CMS National Downloadable File. Provider names, credentials, specialties, practice addresses, phone numbers.
Ardalan Enkeshafi, MD
NPI: 1003000126
Specialty: Hospitalist / Internal Medicine
Facility: Medical Faculty Associates, Inc
Location: Washington, DC 20032
Phone: (771) 444-6200
Allegheny County PA Property ~580K records
Property assessments with owner names, addresses, sale prices, year built, bedrooms, market values.
Margaret L. Kowalski
Property: 1420 Maple Ave, Pittsburgh, PA 15213
Type: Single Family Residential
Fair Market: $185,000
Year Built: 1942
CT UCC Lien Filings ~1.5M records
Uniform Commercial Code filings. Debtor and secured party names, addresses, lien status.
Michael P. Brennan
Filing Type: Original Financial Statement
Lien Status: Active
Address: Hartford, CT 06106
Secured Party: Citizens Bank
FL DBPR Real Estate Licenses 402,225 records
Traci Jean Dennison
License: SL3604529 — Sales Associate
Address: 4574 Crescent Rd, Spring Hill, FL 34606
Expires: 09/30/2027
Source: FL DBPR Real Estate
CT SOS Business Principals 1,661,854 records
Ann Ragsdale
Residence: 1 Ram Island, Stonington, CT 06378
Role: Business Principal
Source: CT Secretary of State
CA CAL-ACCESS Campaign Contributions 14,262,311 records
John H. Knox
Location: San Francisco, CA 94111
Employer: Orrick Herrington & Sutcliffe
Occupation: Attorney
Contribution: $109.89 (Jan 2000)
Source: CA Secretary of State CAL-ACCESS
NC Voter History 36,814,438 records
NCID: CW251011
County: Mecklenburg
Recent Election: 11/05/2024 General — Early Voting
Party Voted: Republican
Note: Linkable to NC voter registration via NCID
Source: NC State Board of Elections
Data Integrity Report
Source Status Notes Records Lost
FEC API + Bulk (all datasets) Complete All ZIPs extracted then deleted 0
NC Voter Registration Complete Full statewide file (9.1M) 0
Cook County Property Tax Partial Parse killed at 2.8M to free disk space Minimal
NPPES NPI Registry (re-run) Complete Full re-download after EBS expansion: ~7.86M providers 0
Texas TDLR Licenses Complete 921,527 records via updated API URL 0
FAA Airmen Database Complete 965,761 pilots + mechanics from CSV bulk 0
FCC Amateur Radio (ULS) Complete 1,635,720 licenses from pipe-delimited bulk 0
Ohio Voter Registration Failed 403 Forbidden — needs browser-based download ~8M (never started)
CA DCA Professional Licenses Blocked Bulk download URL defunct; searchable only ~2M (never started)
IRS 990-N e-Postcard Complete 1,420,475 nonprofit officers from bulk download 0
USPTO PatentsView Complete 4,243,267 unique inventors from TSV bulk 0
CMS Open Payments Complete 984,034 unique physicians deduped from 16M+ payment rows 0
Echovita + Legacy Obituaries Complete All 51 states (Echovita) + 20 states (Legacy) 0
frawdster.com · Data collection March 7–10, 2026 · 77 sources across 9 verticals · EC2 us-east-2