Keynote | Technical

Presentation: Boost Hadoop and Spark with in-memory technologies

Friday 17th | 14:40 - 15:10 | Theatre 25

---

One-liner summary:

In this presentation, attendees will see how to speed up existing Hadoop and Spark deployments by just making Apache Ignite responsible for RAM utilization. No code modifications, no new architecture from scratch!

Keywords defining the session:

- Hadoop

- Spark

- Ignite

Hadoop and Spark are fast, but in-memory technologies are blazingly faster. Today, if there is a requirement to speed-up data access it means we need to do something around HDFS, add more nodes to the cluster, purchase more expensive hardware or look for solutions from Hadoop’s ecosystem of technologies. But what if we had some extra RAM in our data warehouse? Could we make use of it? In this presentation, attendees will see how to speed up existing Hadoop and Spark deployments by just making Apache Ignite responsible for RAM utilization. No code modifications, no new architecture from scratch! Specifically, this presentation will cover the following: * Hadoop Accelerator * HDFS compliant In-Memory File System * MapReduce Accelerator * Spark Shared RDDs * Spark SQL boost