Big Data Spain

17th ~ 18th NOV 2016 MADRID, SPAIN #BDS16

Scaling data engineering

Thursday 17th

from 12:40 to 13:20

Theatre 25



So you've got a Hadoop cluster installed and your data scientists use R and Spark. Great! How about the operational side of things? How do you figure which data pipelines make sense and adapt to the needs of the business owner? In this talk, we will try to come up with some answers for this and related questions. We will discuss methods and best practices to scale data engineering, both from a technical and also from a human perspective.

Michael Hausenblas foto

Michael Hausenblas

MesosphereDeveloper and Cloud Advocate