Information Theory

Apply entropy, KL divergence, and mutual information to ML problems.

intermediate 🔢 Mathematical Foundations

0%

Confidence · no data yet

Sign in to track

After this skill you can…

Calculate Shannon entropy and cross-entropy loss
Explain KL divergence intuitively
Use mutual information for feature selection

Prerequisites

Probability & Statistics

Learn this skill (6 videos)

PyTorch Tutorial 11 - Softmax and Cross Entropy

Patrick Loeber · beginner

PyTorch Tutorial 12 - Activation Functions

Patrick Loeber · beginner

Loss Functions Explained

Siraj Raval · beginner

Categorical Cross Entropy Loss (Part 2) 🌟 - Deep Learning Beginner 👶 - Topic 078 #ai #ml

deeplizard · beginner

Categorical Cross Entropy Loss Intro 📐 - Deep Learning Beginner 👶 - Topic 077 #ai #ml

deeplizard · beginner

Loss Functions - EXPLAINED!

CodeEmporium · beginner