Velamuvi AIAcademy
Deep Learning

Activation Functions

The switch inside each neuron. Compare Sigmoid, Tanh, ReLU, GELU and Softmax and learn which to use where.

  • Intermediate
  • About 3 hours
  • 1 modules
  • 5 lessons
  • Free

This course is not released yet. We publish courses one at a time, each one complete. The full syllabus is below.

What you will learn

  • ActivationsWhy Activations Are Needed, Sigmoid and Tanh, ReLU and Its Variants and more

Course syllabus

Not released yet · full syllabus below

  1. 1

    Activations

    5 lessons
    1. 1Why Activations Are NeededSoon
    2. 2Sigmoid and TanhSoon
    3. 3ReLU and Its VariantsSoon
    4. 4GELU and SwishSoon
    5. 5Softmax for OutputsSoon

Recommended next