← All roles
EngineeringRemoteFull-time
Data Engineer — Scraping & Pipelines
Keep large-scale extraction alive: adapters, drift detection, and boring, resilient infra.
Apply nowYou'll build and operate distributed scraping fleets and ETL pipelines that ingest tens of millions of records a day without getting blocked or drifting.
WHAT YOU'LL DO
- Build per-source adapters with schema-drift detection
- Design cleaning, enrichment, and warehouse-loading pipelines
- Instrument anomaly alerts before bad data reaches dashboards
WHAT WE LOOK FOR
- Strong Python; Scrapy/Airflow/dbt experience a plus
- Experience with resilient, large-scale data extraction
- A pragmatic, reliability-first mindset