The evolution of a data platform
Designing a data platform is no easy task, particularly when there are new technologies, techniques, and approaches appearing every week. At Cox Auto UK we have been on a journey from manually deployed Hadoop clusters to a full platform as a service setup using Azure Databricks. This journey hasn’t always been smooth however and we’ve learned some things along the way! In this talk, we will examine how we have made design choices while evolving our platform, our decision to open source some of our work, and what our past, present, and future look like.
James Fielder, Senior Data Engineer @ Cox Automotive
What is the cost to attend and watch the virtual sessions?
Data Team Summit is always free and open for all to attend.
When is Data Teams Summit 2024?
Data Teams Summit 2024 will take place on January 24, 2024.
What is Data Teams Summit?
Data Teams Summit is an annual peer-to-peer day of empowerment for data teams that reflects our focus on the teams and individuals running, managing, and monitoring data pipelines.
Data Teams Summit is a full-day virtual conference, led by real-world data practitioners and leaders at future-forward organizations about how they're establishing predictability, increasing reliability, and creating economic efficiencies with their data.
Who comes to the Data Teams Summit?
Data professionals and experts including data engineers, administrators, architects, analysts, AI/ML professionals, and relevant data technology leadership.
Join us for sessions on:
- Data teams and the way they work together
- Data pipelines & applications
- Data observability
- Data quality, management & data governance
- Technology that allows teams to move faster and more efficiently
- Data modernization & architecture