Case study · Lighthouse Sports · 2024 - now

Data ingestion engine

Goal: turn messy data from several providers into one dataset the whole product can trust.

ingest / onboard new league
Source A
Premier Divisionbest match · 0.97
Premier Division U210.61
Source B
Top League (sponsor name)best match · 0.92
Top League Women0.48
Source C
Premier Div.best match · 0.95
Premier Div. Cup0.40
3 sources matched. Check the picks before anything is saved.Confirm mapping
✓ fixtures 380 · ✓ squads 612 · ✓ players merged 1,204 · 14 flagged for review
demo data
188/188matches reconciled correctly on real data
794cross-provider links in one sync run
3 → 1data providers, one confirmation step per league

Pulls fixtures, squads and player data from several providers, matches the same player across sources, and publishes one dataset the rest of the stack trusts. Adding a new league takes one confirmation step.