Course taught in the Data and Knowledge 2nd year Master Program of Université Paris Saclay 2018-2019

This module will present concepts, architectures and algorithms for IoT big data processing and analytics, at a very large scale, in distributed settings. The following topics will be covered:

  • Apache Hadoop
  • Apache Spark
  • Apache Flink
  • Apache Beam/Google Cloud DataFlow
  • Apache Storm
  • Lambda and Kappa Architectures

A strong focus will be given to labs in this class, so that students can gather enough experience with different existing systems, and understand their respective advantages. The architecture of all distributed computing systems will be discussed in detail during lectures.


  • 1/3 Lab Assignments
  • 2/3 Final Test

Lecture Slides