DataOps for the new data stack
This talk demystifies the new data stack that thousands of companies are deploying to convert data into insights continuously and with high agility. This stack continues to evolve with the emergence of new data roles like analytics engineers and ML engineers as well as new data technologies like lake houses and data validation. A new wave of operational challenges has emerged with this stack that, unless addressed from day one, will derail its success. Shivnath will discuss these DataOps challenges and the best practices to address them. The talk will be accompanied by a brief demonstration.
Shivnath Babu, Co-Founder & CTO @ Unravel
Shivnath Babu is the CTO at Unravel Data Systems and an adjunct professor of computer science at Duke University. His research focuses on ease of use and manageability of data-intensive systems, automated problem diagnosis, and cluster sizing for applications running on cloud platforms. Unravel originated from the Starfish platform built at Duke, which has been downloaded by over 100 companies. Shivnath has won a US National Science Foundation CAREER Award, three IBM Faculty Awards, and an HP Labs Innovation Research Award.