Foundations

ML Fundamentals

Neural networks, backpropagation, gradient descent — the maths behind AI

11,371
lessons
Skills in this topic
View full skill map →
ML Maths Basics
beginner
Manipulate vectors and matrices
Supervised Learning
beginner
Train decision trees, random forests, and neural nets
Unsupervised Learning
intermediate
Apply k-means and DBSCAN clustering
ML Pipelines
intermediate
Engineer features and handle missing data
Videos 10,629 Reads 742
Level: All Beginner Intermediate Advanced
Any Length Short (<5m) Medium (5-20m) Long (>20m)
Newest Popular Oldest
Gradient Descent For Neural Networks (C1W3L09)
ML Fundamentals ⚡ AI Lesson
Gradient Descent For Neural Networks (C1W3L09)
DeepLearningAI Beginner 8y ago
Neural Network Representations (C1W3L02)
ML Fundamentals
Neural Network Representations (C1W3L02)
DeepLearningAI Beginner 8y ago
Machine Teaching for Better Machine Learning with Mark Hammond - #43
ML Fundamentals
Machine Teaching for Better Machine Learning with Mark Hammond - #43
The TWIML AI Podcast with Sam Charrington Beginner 8y ago
PYTHON && POETRY | 100 Days of Code 16
ML Fundamentals
PYTHON && POETRY | 100 Days of Code 16
Daniel Bourke Beginner 8y ago
[MINI] Recurrent Neural Networks
ML Fundamentals ⚡ AI Lesson
[MINI] Recurrent Neural Networks
Data Skeptic Beginner 8y ago
Pandas Time Series Analysis 5: Period and PeriodIndex
ML Fundamentals
Pandas Time Series Analysis 5: Period and PeriodIndex
codebasics Beginner 8y ago
Graduating From the Udacity Deep Learning Nanodegree | 100 Days of Code 15
ML Fundamentals
Graduating From the Udacity Deep Learning Nanodegree | 100 Days of Code 15
Daniel Bourke Beginner 8y ago
Simple linear regression model. Geometrical representation
ML Fundamentals ⚡ AI Lesson
Simple linear regression model. Geometrical representation
365 Data Science Beginner 8y ago
The linear regression model
ML Fundamentals
The linear regression model
365 Data Science Beginner 8y ago
TensorFlow (C2W3L11)
ML Fundamentals ⚡ AI Lesson
TensorFlow (C2W3L11)
DeepLearningAI Beginner 8y ago
Activation Functions (C1W3L06)
ML Fundamentals
Activation Functions (C1W3L06)
DeepLearningAI Beginner 8y ago
Explanation For Vectorized Implementation (C1W3L05)
ML Fundamentals
Explanation For Vectorized Implementation (C1W3L05)
DeepLearningAI Beginner 8y ago
Getting Matrix Dimensions Right (C1W4L03)
ML Fundamentals
Getting Matrix Dimensions Right (C1W4L03)
DeepLearningAI Beginner 8y ago
Deep Learning Frameworks (C2W3L10)
ML Fundamentals ⚡ AI Lesson
Deep Learning Frameworks (C2W3L10)
DeepLearningAI Beginner 8y ago
Neural Network Overview (C1W3L01)
ML Fundamentals ⚡ AI Lesson
Neural Network Overview (C1W3L01)
DeepLearningAI Beginner 8y ago
Training Softmax Classifier (C2W3L09)
ML Fundamentals
Training Softmax Classifier (C2W3L09)
DeepLearningAI Beginner 8y ago
Softmax Regression (C2W3L08)
ML Fundamentals ⚡ AI Lesson
Softmax Regression (C2W3L08)
DeepLearningAI Beginner 8y ago
Batch Norm At Test Time (C2W3L07)
ML Fundamentals ⚡ AI Lesson
Batch Norm At Test Time (C2W3L07)
DeepLearningAI Beginner 8y ago
Why Does Batch Norm Work? (C2W3L06)
ML Fundamentals
Why Does Batch Norm Work? (C2W3L06)
DeepLearningAI Beginner 8y ago
Adam Optimization Algorithm (C2W2L08)
ML Fundamentals ⚡ AI Lesson
Adam Optimization Algorithm (C2W2L08)
DeepLearningAI Beginner 8y ago
RMSProp (C2W2L07)
ML Fundamentals
RMSProp (C2W2L07)
DeepLearningAI Beginner 8y ago
Fitting Batch Norm Into Neural Networks (C2W3L05)
ML Fundamentals
Fitting Batch Norm Into Neural Networks (C2W3L05)
DeepLearningAI Beginner 8y ago
Gradient Descent With Momentum (C2W2L06)
ML Fundamentals ⚡ AI Lesson
Gradient Descent With Momentum (C2W2L06)
DeepLearningAI Beginner 8y ago
Normalizing Activations in a Network (C2W3L04)
ML Fundamentals
Normalizing Activations in a Network (C2W3L04)
DeepLearningAI Beginner 8y ago
Hyperparameter Tuning in Practice (C2W3L03)
ML Fundamentals
Hyperparameter Tuning in Practice (C2W3L03)
DeepLearningAI Beginner 8y ago
Tuning Process (C2W3L01)
ML Fundamentals ⚡ AI Lesson
Tuning Process (C2W3L01)
DeepLearningAI Beginner 8y ago
Understanding Exponentially Weighted Averages (C2W2L04)
ML Fundamentals
Understanding Exponentially Weighted Averages (C2W2L04)
DeepLearningAI Beginner 8y ago
Bias Correction of Exponentially Weighted Averages (C2W2L05)
ML Fundamentals ⚡ AI Lesson
Bias Correction of Exponentially Weighted Averages (C2W2L05)
DeepLearningAI Beginner 8y ago
Understanding Mini-Batch Gradient Dexcent (C2W2L02)
ML Fundamentals ⚡ AI Lesson
Understanding Mini-Batch Gradient Dexcent (C2W2L02)
DeepLearningAI Beginner 8y ago
Mini Batch Gradient Descent (C2W2L01)
ML Fundamentals ⚡ AI Lesson
Mini Batch Gradient Descent (C2W2L01)
DeepLearningAI Beginner 8y ago
The Problem of Local Optima (C2W3L10)
ML Fundamentals ⚡ AI Lesson
The Problem of Local Optima (C2W3L10)
DeepLearningAI Beginner 8y ago
Exponentially Weighted Averages (C2W2L03)
ML Fundamentals
Exponentially Weighted Averages (C2W2L03)
DeepLearningAI Beginner 8y ago
Gradient Checking Implementation Notes (C2W1L14)
ML Fundamentals ⚡ AI Lesson
Gradient Checking Implementation Notes (C2W1L14)
DeepLearningAI Beginner 8y ago
Learning Rate Decay (C2W2L09)
ML Fundamentals ⚡ AI Lesson
Learning Rate Decay (C2W2L09)
DeepLearningAI Beginner 8y ago
Gradient Checking (C2W1L13)
ML Fundamentals
Gradient Checking (C2W1L13)
DeepLearningAI Beginner 8y ago
Using an Appropriate Scale (C2W3L02)
ML Fundamentals
Using an Appropriate Scale (C2W3L02)
DeepLearningAI Beginner 8y ago
deeplearning.ai's Heroes of Deep Learning: Andrej Karpathy
ML Fundamentals ⚡ AI Lesson
deeplearning.ai's Heroes of Deep Learning: Andrej Karpathy
DeepLearningAI Beginner 8y ago
deeplearning.ai's Heroes of Deep Learning: Pieter Abbeel
ML Fundamentals ⚡ AI Lesson
deeplearning.ai's Heroes of Deep Learning: Pieter Abbeel
DeepLearningAI Beginner 8y ago
deeplearning.ai's Heroes of Deep Learning: Ian Goodfellow
ML Fundamentals
deeplearning.ai's Heroes of Deep Learning: Ian Goodfellow
DeepLearningAI Beginner 8y ago
deeplearning.ai's Heroes of Deep Learning: Ruslan Salakhutdinov
ML Fundamentals ⚡ AI Lesson
deeplearning.ai's Heroes of Deep Learning: Ruslan Salakhutdinov
DeepLearningAI Beginner 8y ago
deeplearning.ai's Heroes of Deep Learning: Yoshua Bengio
ML Fundamentals
deeplearning.ai's Heroes of Deep Learning: Yoshua Bengio
DeepLearningAI Beginner 8y ago
deeplearning.ai's Heroes of Deep Learning: Yuanqing Lin
ML Fundamentals
deeplearning.ai's Heroes of Deep Learning: Yuanqing Lin
DeepLearningAI Beginner 8y ago
Forward and Backward Propagation (C1W4L06)
ML Fundamentals ⚡ AI Lesson
Forward and Backward Propagation (C1W4L06)
DeepLearningAI Beginner 8y ago
Central limit theorem
ML Fundamentals
Central limit theorem
365 Data Science Beginner 8y ago
The Normal Distribution
ML Fundamentals
The Normal Distribution
365 Data Science Beginner 8y ago
What is a distribution?
ML Fundamentals
What is a distribution?
365 Data Science Beginner 8y ago
Skewness
ML Fundamentals
Skewness
365 Data Science Beginner 8y ago
Population vs Sample
ML Fundamentals
Population vs Sample
365 Data Science Beginner 8y ago
📚 Coursera Courses Opens on Coursera · Free to audit
1 / 3 View all →
Java Programming Essentials
📚 Coursera Course ↗
Self-paced
Java Programming Essentials
Opens on Coursera ↗
Salesforce Certified AI Associate Certification
📚 Coursera Course ↗
Self-paced
Salesforce Certified AI Associate Certification
Opens on Coursera ↗
Machine Learning Foundations: A Case Study Approach
📚 Coursera Course ↗
Self-paced
Machine Learning Foundations: A Case Study Approach
Opens on Coursera ↗
Creative AI: Sound, Music and Interaction
📚 Coursera Course ↗
Self-paced
Creative AI: Sound, Music and Interaction
Opens on Coursera ↗
Data Mining in Python
📚 Coursera Course ↗
Self-paced
Data Mining in Python
Opens on Coursera ↗
Introduction to Statistics
📚 Coursera Course ↗
Self-paced
Introduction to Statistics
Opens on Coursera ↗