The evolution of a data platform
Designing a data platform is no easy task, particularly when there are new technologies, techniques, and approaches appearing every week. At Cox Auto UK we have been on a journey from manually deployed Hadoop clusters to a full platform as a service setup using Azure Databricks. This journey hasn’t always been smooth however and we’ve learned some things along the way! In this talk, we will examine how we have made design choices while evolving our platform, our decision to open source some of our work, and what our past, present, and future look like.
James Fielder, Senior Data Engineer @ Cox Automotive
What is the cost to attend and watch the virtual sessions?
Data Team Summit is always free and open for all to attend.
What is Data Teams Summit?
This year, we've taken the peer-to-peer empowerment of data teams one step further and formally transformed DataOps Unleashed into Data Teams Summit to better reflect our focus on the teams and individuals running, managing, and monitoring data pipelines.
Data Teams Summit is an annual, full-day virtual conference, led by data rockstars at future-forward organizations about how they're establishing predictability, increasing reliability, and creating economic efficiencies with their data pipelines.
Who comes to Data Teams Summit?
Data professionals and experts including data engineers, administrators, architects, analysts, AI/ML professionals, and relevant data technology leadership.
Join us for sessions on:
- Data teams & best practices
- Data pipelines & applications
- DataOps observability
- Data quality & data governance
- Operations observability
- Data modernization & architecture
- Biz/FinOps observability