Velamuvi AIAcademy
Data Science & Engineering

Apache Spark

Process data too big for one machine. Learn Spark DataFrames, Spark SQL and distributed thinking with PySpark.

  • Advanced
  • About 12 hours
  • 3 modules
  • 12 lessons
  • Free

This course is not released yet. We publish courses one at a time, each one complete. The full syllabus is below.

What you will learn

  • Distributed ComputingWhy Spark?, Clusters, Drivers and Executors, Your First PySpark Session and more
  • DataFramesSpark DataFrames, Transformations and Actions, Spark SQL and more
  • PerformancePartitions and Shuffles, Caching, Reading a Spark Plan and more

Course syllabus

Not released yet · full syllabus below

  1. 1

    Distributed Computing

    4 lessons
    1. 1Why Spark?Soon
    2. 2Clusters, Drivers and ExecutorsSoon
    3. 3Your First PySpark SessionSoon
    4. 4Lazy EvaluationSoon
  2. 2

    DataFrames

    4 lessons
    1. 5Spark DataFramesSoon
    2. 6Transformations and ActionsSoon
    3. 7Spark SQLSoon
    4. 8Joins at ScaleSoon
  3. 3

    Performance

    4 lessons
    1. 9Partitions and ShufflesSoon
    2. 10CachingSoon
    3. 11Reading a Spark PlanSoon
    4. 12Spark MLlib OverviewSoon

Recommended next