William Edwards is a Staff Data Engineer at Spotify, working on large-scale systems for serving features and point queries directly from the data lake.
Talks
- Random Access Parquet: Serving Point Queries Straight from the Data Lake
FSS 2026
Look up a single key directly in the Parquet files you already have. An external index turns a lookup into one small ranged read instead of a scan.