Course taught in the CES Data Scientist 2016-2017 program.
This module will present concepts, architectures and algorithms for big data processing and analytics, at a very large scale, in distributed settings. The following topics will be covered:
- Apache Hadoop
- Apache Spark
- Apache Flink
- Apache Beam/Google Cloud DataFlow
- Apache Storm
- Lambda and Kappa Architectures
A strong focus will be given to labs in this class, so that students can gather enough experience with different existing systems, and understand their respective advantages. The architecture of all distributed computing systems will be discussed in detail during lectures.
Evaluation:
- Lab Assignments due May 31, 2017