[D&K] IoT Big Data Processing 2017-2018

Course taught in the Data and Knowledge 2nd year Master Program of Université Paris Saclay


This module will present concepts, architectures and algorithms for IoT big data processing and analytics, at a very large scale, in distributed settings. The following topics will be covered:

  • Apache Hadoop
  • Apache Spark
  • Apache Flink
  • Apache Beam/Google Cloud DataFlow
  • Apache Storm
  • Lambda and Kappa Architectures

A strong focus will be given to labs in this class, so that students can gather enough experience with different existing systems, and understand their respective advantages. The architecture of all distributed computing systems will be discussed in detail during lectures.


  • 1/3 Lab Assignments
  • 2/3 Final Test

Lecture Slides