Worked on data flow tracking service used to comply with privacy focused government regulations and avoid billions of dollars in fines
Designed new scalable MySQL schema and topology that supports 5x the existing workload, with pathways for future growth
Designed and implemented new data ingestion process chosen by all nine new lineage producers to send data
Designed and implemented new subsystem to make lineage available offline for privacy use cases that made the data available after just three hours instead of twelve, and with increased reliability
Designed metrics to measure parity of new system against pre-existing system and led #1 team goal of driving these metrics up to 99.9%