Foundations

ML Fundamentals

Neural networks, backpropagation, gradient descent — the maths behind AI

11,497
lessons
Skills in this topic
View full skill map →
ML Maths Basics
beginner
Manipulate vectors and matrices
Supervised Learning
beginner
Train decision trees, random forests, and neural nets
Unsupervised Learning
intermediate
Apply k-means and DBSCAN clustering
ML Pipelines
intermediate
Engineer features and handle missing data
Orthogonalization (C3W1L02 )
ML Fundamentals
Orthogonalization (C3W1L02 )
DeepLearningAI Beginner 8y ago
Single Number Evaluation Metric (C3W1L03)
ML Fundamentals ⚡ AI Lesson
Single Number Evaluation Metric (C3W1L03)
DeepLearningAI Beginner 8y ago
Improving Model Performance (C3W1L01)
ML Fundamentals ⚡ AI Lesson
Improving Model Performance (C3W1L01)
DeepLearningAI Beginner 8y ago
Vectorizing Logistic Regression's Gradient Computation (C1W2L14)
ML Fundamentals ⚡ AI Lesson
Vectorizing Logistic Regression's Gradient Computation (C1W2L14)
DeepLearningAI Beginner 8y ago
Derivatives (C1W2L05)
ML Fundamentals
Derivatives (C1W2L05)
DeepLearningAI Beginner 8y ago
Derivatives With Computation Graphs (C1W2L08)
ML Fundamentals
Derivatives With Computation Graphs (C1W2L08)
DeepLearningAI Beginner 8y ago
Vectorizing Logistic Regression (C1W2L13)
ML Fundamentals ⚡ AI Lesson
Vectorizing Logistic Regression (C1W2L13)
DeepLearningAI Beginner 8y ago
Logistic Regression Cost Function (C1W2L03)
ML Fundamentals
Logistic Regression Cost Function (C1W2L03)
DeepLearningAI Beginner 8y ago
Computation Graph (C1W2L07)
ML Fundamentals
Computation Graph (C1W2L07)
DeepLearningAI Beginner 8y ago
Logistic Regression (C1W2L02)
ML Fundamentals ⚡ AI Lesson
Logistic Regression (C1W2L02)
DeepLearningAI Beginner 8y ago
Explanation of Logistic Regression's Cost Function (C1W2L18)
ML Fundamentals
Explanation of Logistic Regression's Cost Function (C1W2L18)
DeepLearningAI Beginner 8y ago
Gradient Descent (C1W2L04)
ML Fundamentals
Gradient Descent (C1W2L04)
DeepLearningAI Beginner 8y ago
Quick Tour of Jupyter/iPython Notebooks (C1W2L17)
ML Fundamentals ⚡ AI Lesson
Quick Tour of Jupyter/iPython Notebooks (C1W2L17)
DeepLearningAI Beginner 8y ago
More Derivative Examples (C1W2L06)
ML Fundamentals
More Derivative Examples (C1W2L06)
DeepLearningAI Beginner 8y ago
Binary Classification (C1W2L01)
ML Fundamentals
Binary Classification (C1W2L01)
DeepLearningAI Beginner 8y ago
More Vectorization Examples (C1W2L12)
ML Fundamentals
More Vectorization Examples (C1W2L12)
DeepLearningAI Beginner 8y ago
Gradient Descent on m Examples (C1W2L10)
ML Fundamentals ⚡ AI Lesson
Gradient Descent on m Examples (C1W2L10)
DeepLearningAI Beginner 8y ago
A Note on Python/Numpy Vectors (C1W2L16)
ML Fundamentals ⚡ AI Lesson
A Note on Python/Numpy Vectors (C1W2L16)
DeepLearningAI Beginner 8y ago
Vectorization (C1W2L11)
ML Fundamentals ⚡ AI Lesson
Vectorization (C1W2L11)
DeepLearningAI Beginner 8y ago
Broadcasting in Python (C1W2L15)
ML Fundamentals
Broadcasting in Python (C1W2L15)
DeepLearningAI Beginner 8y ago
Why is deep learning taking off? (C1W1L04)
ML Fundamentals
Why is deep learning taking off? (C1W1L04)
DeepLearningAI Beginner 8y ago
About This Course (C1W1L05)
ML Fundamentals
About This Course (C1W1L05)
DeepLearningAI Beginner 8y ago
Supervised Learning with a Neural Network (C1W1L03)
ML Fundamentals
Supervised Learning with a Neural Network (C1W1L03)
DeepLearningAI Beginner 8y ago
Logistic Regression Gradient Descent (C1W2L09)
ML Fundamentals
Logistic Regression Gradient Descent (C1W2L09)
DeepLearningAI Beginner 8y ago
What is a Neural Network? (C1W1L02)
ML Fundamentals ⚡ AI Lesson
What is a Neural Network? (C1W1L02)
DeepLearningAI Beginner 8y ago
Welcome (Deep Learning Specialization C1W1L01)
ML Fundamentals
Welcome (Deep Learning Specialization C1W1L01)
DeepLearningAI Beginner 8y ago
Course Resources (C1W1L06)
ML Fundamentals ⚡ AI Lesson
Course Resources (C1W1L06)
DeepLearningAI Beginner 8y ago
Whether to Use End-To-End Deep Learning (C3W2L10)
ML Fundamentals
Whether to Use End-To-End Deep Learning (C3W2L10)
DeepLearningAI Beginner 8y ago
What is end-to-end deep learning? (C3W2L09)
ML Fundamentals ⚡ AI Lesson
What is end-to-end deep learning? (C3W2L09)
DeepLearningAI Beginner 8y ago
Multitask Learning (C3W2L08)
ML Fundamentals ⚡ AI Lesson
Multitask Learning (C3W2L08)
DeepLearningAI Beginner 8y ago
Addressing Data Mismatch (C3W2L06)
ML Fundamentals
Addressing Data Mismatch (C3W2L06)
DeepLearningAI Beginner 8y ago
Transfer Learning (C3W2L07)
ML Fundamentals ⚡ AI Lesson
Transfer Learning (C3W2L07)
DeepLearningAI Beginner 8y ago
Bias and Variance With Mismatched Data (C3W2L05)
ML Fundamentals ⚡ AI Lesson
Bias and Variance With Mismatched Data (C3W2L05)
DeepLearningAI Beginner 8y ago
Regularization (C2W1L04)
ML Fundamentals
Regularization (C2W1L04)
DeepLearningAI Beginner 8y ago
Why Regularization Reduces Overfitting (C2W1L05)
ML Fundamentals
Why Regularization Reduces Overfitting (C2W1L05)
DeepLearningAI Beginner 8y ago
Basic Recipe for Machine Learning (C2W1L03)
ML Fundamentals
Basic Recipe for Machine Learning (C2W1L03)
DeepLearningAI Beginner 8y ago
Bias/Variance (C2W1L02)
ML Fundamentals
Bias/Variance (C2W1L02)
DeepLearningAI Beginner 8y ago
Forward Propagation in a Deep Network (C1W4L02)
ML Fundamentals
Forward Propagation in a Deep Network (C1W4L02)
DeepLearningAI Beginner 8y ago
Weight Initialization in a Deep Network (C2W1L11)
ML Fundamentals
Weight Initialization in a Deep Network (C2W1L11)
DeepLearningAI Beginner 8y ago
Numerical Approximations of Gradients (C2W1L12)
ML Fundamentals
Numerical Approximations of Gradients (C2W1L12)
DeepLearningAI Beginner 8y ago
What does this have to do with the brain? (C1W4L08)
ML Fundamentals
What does this have to do with the brain? (C1W4L08)
DeepLearningAI Beginner 8y ago
Dropout Regularization (C2W1L06)
ML Fundamentals ⚡ AI Lesson
Dropout Regularization (C2W1L06)
DeepLearningAI Beginner 8y ago
Vanishing/Exploding Gradients (C2W1L10)
ML Fundamentals ⚡ AI Lesson
Vanishing/Exploding Gradients (C2W1L10)
DeepLearningAI Beginner 8y ago
Train/Dev/Test Sets (C2W1L01)
ML Fundamentals ⚡ AI Lesson
Train/Dev/Test Sets (C2W1L01)
DeepLearningAI Beginner 8y ago
Deep L-Layer Neural Network (C1W4L01)
ML Fundamentals ⚡ AI Lesson
Deep L-Layer Neural Network (C1W4L01)
DeepLearningAI Beginner 8y ago
Random Initialization (C1W3L11)
ML Fundamentals
Random Initialization (C1W3L11)
DeepLearningAI Beginner 8y ago
Other Regularization Methods (C2W1L08)
ML Fundamentals ⚡ AI Lesson
Other Regularization Methods (C2W1L08)
DeepLearningAI Beginner 8y ago
Normalizing Inputs (C2W1L09)
ML Fundamentals
Normalizing Inputs (C2W1L09)
DeepLearningAI Beginner 8y ago
📚 Coursera Courses Opens on Coursera · Free to audit
1 / 3 View all →
Tools for Data Science
📚 Coursera Course ↗
Self-paced
Tools for Data Science
Opens on Coursera ↗
Production Machine Learning Systems - Français
📚 Coursera Course ↗
Self-paced
Production Machine Learning Systems - Français
Opens on Coursera ↗
AI Foundations with Python: Build & Visualize
📚 Coursera Course ↗
Self-paced
AI Foundations with Python: Build & Visualize
Opens on Coursera ↗
Fundamentals of  CNNs and RNNs
📚 Coursera Course ↗
Self-paced
Fundamentals of CNNs and RNNs
Opens on Coursera ↗
Introduction to Image Generation - Français
📚 Coursera Course ↗
Self-paced
Introduction to Image Generation - Français
Opens on Coursera ↗
Neural Networks and Deep Learning
📚 Coursera Course ↗
Self-paced
Neural Networks and Deep Learning
Opens on Coursera ↗