Palette Metadata Journey
The Uber team will present their Palette Metadata Journey and how they have evolved the Metadata systems to meet Uber’s business needs.
The Uber team will present their Palette Metadata Journey and how they have evolved the Metadata systems to meet Uber’s business needs.
Palette Metastore is a metadata store of features where users of Palette can create, deprecate, add details about ownership/backfill/scheduling of feature generation pipelines, offline training hdfs location, Cassandra databases that they wanna copy data for online serving along with spark configuration, join keys, feature list along with feature metadata and info about which features should be copied for online serving, sql queries for generating the features from upstream dependencies and maintaining audit of changes. We will be presenting on Palette Metadata Journey and how we have evolved the Metadata systems to meet Uber’s business needs.
