Back to the program

So you've got a Hadoop cluster installed and your data scientists use R and Spark. Great! How about the operational side of things? How do you figure which data pipelines make sense and adapt to the needs of the business owner? In this talk, we will try to come up with some answers for this and related questions. We will discuss methods and best practices to scale data engineering, both from a technical and also from a human perspective.