Foundations

Mathematical Foundations

Linear algebra, calculus, probability, statistics and optimisation — the maths behind ML

3,012
lessons
Skills in this topic
View full skill map →
Maths for ML
beginner
Multiply matrices and compute dot products
Probability & Statistics
beginner
Calculate conditional probability and Bayes' theorem
Optimisation
intermediate
Implement gradient descent from scratch
Information Theory
intermediate
Calculate Shannon entropy and cross-entropy loss
All Reads (350) Articles (162)Blog Posts (99)Tutorials (37)Research Papers (46)News (6)
Medium · LLM 🔢 Mathematical Foundations 2d ago
Linear Algebra: Basics 2# Randomized SVD — Modern Matrix Factorization with speed
Make your Matrix Factorisation faster Continue reading on Medium »
Eigenvalues & Eigenvectors — The Special Directions Hidden Inside a Matrix
Medium · Deep Learning 🔢 Mathematical Foundations 3d ago
Eigenvalues & Eigenvectors — The Special Directions Hidden Inside a Matrix
In the previous articles, we changed the way we look at matrices. Continue reading on Medium »
Medium · Deep Learning 🔢 Mathematical Foundations 3d ago
The Hidden Cost of Turning Neural Networks Into Probability Distributions
Why the normalizing constant exposes the tension between expressive generative models and tractable probability computation. Continue reading on Medium »
What A Matrix Actually Does To Space
Medium · Machine Learning 🔢 Mathematical Foundations 5d ago
What A Matrix Actually Does To Space
If you read the Linear Algebra for AI series, you already know what a vector and a matrix are. This one is about what a matrix actually… Continue reading on Art
What A Matrix Actually Does To Space
Medium · Deep Learning 🔢 Mathematical Foundations 5d ago
What A Matrix Actually Does To Space
If you read the Linear Algebra for AI series, you already know what a vector and a matrix are. This one is about what a matrix actually… Continue reading on Art
Gradients 1: Backprop Is the Chain Rule, and the Chain Rule Has Hypotheses
Medium · Machine Learning 🔢 Mathematical Foundations 5d ago
Gradients 1: Backprop Is the Chain Rule, and the Chain Rule Has Hypotheses
Disclosure: this post was written with the assistance of an AI system (Claude), which wrote the analysis code, ran the experiments and… Continue reading on Medi
Gradients 1: Backprop Is the Chain Rule, and the Chain Rule Has Hypotheses
Medium · Data Science 🔢 Mathematical Foundations 5d ago
Gradients 1: Backprop Is the Chain Rule, and the Chain Rule Has Hypotheses
Disclosure: this post was written with the assistance of an AI system (Claude), which wrote the analysis code, ran the experiments and… Continue reading on Medi
Gradients 1: Backprop Is the Chain Rule, and the Chain Rule Has Hypotheses
Medium · LLM 🔢 Mathematical Foundations 5d ago
Gradients 1: Backprop Is the Chain Rule, and the Chain Rule Has Hypotheses
Disclosure: this post was written with the assistance of an AI system (Claude), which wrote the analysis code, ran the experiments and… Continue reading on Medi
OpenAI News 🔢 Mathematical Foundations ⚡ AI Lesson 1w ago
On the Navier–Stokes Millennium Prize Problem
We’re sharing an AI-generated solution to the Navier–Stokes Millennium Prize Problem, including a writeup and a formal proof in Lean.
How to Optimize Vector Graphics and Heavy Site Banners Without Quality Loss (Core Web Vitals Guide)
Medium · SEO 🔢 Mathematical Foundations 3w ago
How to Optimize Vector Graphics and Heavy Site Banners Without Quality Loss (Core Web Vitals Guide)
The digital footprint of modern graphic optimization acts as the defining line between premium customer conversion and high bounce rates… Continue reading on Me
Reddit r/deeplearning 🔢 Mathematical Foundations 3w ago
Singular Value Decomposition (SVD) Mathematics behind machine learning concepts is Hard!!!! But beautiful.
submitted by /u/Previous_Storage2690 [link] [comments]
Statistics for Data Scientists (Part 3): Probability, Conditional Probability & Bayes’ Theorem
Medium · Machine Learning 🔢 Mathematical Foundations 3w ago
Statistics for Data Scientists (Part 3): Probability, Conditional Probability & Bayes’ Theorem
From a simple percentage to a framework for reasoning under uncertainty. Continue reading on Medium »
Statistics for Data Scientists (Part 3): Probability, Conditional Probability & Bayes’ Theorem
Medium · Data Science 🔢 Mathematical Foundations 3w ago
Statistics for Data Scientists (Part 3): Probability, Conditional Probability & Bayes’ Theorem
From a simple percentage to a framework for reasoning under uncertainty. Continue reading on Medium »
From a String of Words to a Probability Distribution: A Long Read That Actually Opens Up the Math…
Medium · ChatGPT 🔢 Mathematical Foundations 3w ago
From a String of Words to a Probability Distribution: A Long Read That Actually Opens Up the Math…
Transformer Continue reading on JIN System Architect »
Statistics for Data Science: How Robo the Robot Taught Me Mean, Median, Mode, Variance, and…
Medium · Machine Learning 🔢 Mathematical Foundations 3w ago
Statistics for Data Science: How Robo the Robot Taught Me Mean, Median, Mode, Variance, and…
A beginner-friendly journey into the numbers that power AI — told through a fun little adventure with a robot named Robo. Continue reading on Medium »
Statistics for Data Science: How Robo the Robot Taught Me Mean, Median, Mode, Variance, and…
Medium · Python 🔢 Mathematical Foundations 3w ago
Statistics for Data Science: How Robo the Robot Taught Me Mean, Median, Mode, Variance, and…
A beginner-friendly journey into the numbers that power AI — told through a fun little adventure with a robot named Robo. Continue reading on Medium »
Market Vector Auto Regression stock market backtest optimization example
Medium · Python 🔢 Mathematical Foundations 3w ago
Market Vector Auto Regression stock market backtest optimization example
For this test, we take our MVAR Python code and show how to optimize some hyper parameters to achieve a better backtest. For this, we have… Continue reading on
Eigenvalues, Eigenvectors, and SVD: Robo’s Mirror Maze Mystery
Medium · Python 🔢 Mathematical Foundations 3w ago
Eigenvalues, Eigenvectors, and SVD: Robo’s Mirror Maze Mystery
How a glitchy robot tour guide taught me that AI models are secretly obsessed with finding the “true directions” hidden inside data Continue reading on Medium »
The Marie Kondo of Linear Algebra: Compress Images with SVD
Medium · Machine Learning 🔢 Mathematical Foundations 4w ago
The Marie Kondo of Linear Algebra: Compress Images with SVD
Imagine opening your overpacked bedroom closet. Clothes are piled high, rogue socks are floating, and you can barely shut the door. Continue reading on Medium »
Detecting Time Series Stationarity using (Classic Air Passengers) Dataset from Kaggle
Medium · Python 🔢 Mathematical Foundations 4w ago
Detecting Time Series Stationarity using (Classic Air Passengers) Dataset from Kaggle
A stationary time series is one whose statistical properties do not change over time. Its mean, variance, and autocorrelation structure… Continue reading on Med
Medium · LLM 🔢 Mathematical Foundations 4w ago
Prompt Engineering: 7 Advanced Techniques & Frameworks (Master Guide)
The 7 advanced frameworks designed to control LLM probability distributions and eliminate AI hallucinations. Continue reading on Medium »
Why NOT Categorical Cross Entropy?
Medium · Machine Learning 🔢 Mathematical Foundations 4w ago
Why NOT Categorical Cross Entropy?
This article explains why CCE is used for multi-class classification and how it is derived intuitively… Continue reading on Towards AI »
Why NOT Categorical Cross Entropy?
Medium · Deep Learning 🔢 Mathematical Foundations 4w ago
Why NOT Categorical Cross Entropy?
This article explains why CCE is used for multi-class classification and how it is derived intuitively… Continue reading on Towards AI »
The Meeting Where Nobody Cares About Your Convex Optimization
Medium · Data Science 🔢 Mathematical Foundations 4w ago
The Meeting Where Nobody Cares About Your Convex Optimization
Photo by Toni Koraza on Unsplash Continue reading on Medium »
Reddit r/deeplearning 🔢 Mathematical Foundations 4w ago
Need to estimate rank or perform dimensionality reduction on big, messy tabular data? The Entropic Scree is an information-theoretic upgrade to PCA.
Here's a new rank estimation method I've been working on. It's basically an upgraded Principal Component Analysis (PCA) built on information theory instead of l
The Dhahran Probability Density Function: Rethinking Parameter Estimation Beyond Gaussian…
Medium · Machine Learning 🔢 Mathematical Foundations 4w ago
The Dhahran Probability Density Function: Rethinking Parameter Estimation Beyond Gaussian…
What if the probability distribution underlying your parameter estimation algorithm is the reason you’re getting the wrong answer? Continue reading on Medium »
Markov Chain Monte Carlo: Simplified
Medium · Python 🔢 Mathematical Foundations 1mo ago
Markov Chain Monte Carlo: Simplified
In layman terms…complex function…you need stats about it….you think if this was probability distribution…answer would be easy….wrong maths… Continue reading on
Reddit r/deeplearning 🔢 Mathematical Foundations 1mo ago
Ultra‑fast Fourier transform and optical AI realized with a single lens....
Ultra‑fast Fourier transform and optical AI realized with a single lens. Description: It explains the principle that passing light through a convex lens natural
Reddit r/deeplearning 🔢 Mathematical Foundations 1mo ago
What is a overparameterized network?
I got this paragraph from Claude, could someone please explain this and verify if it's a real thing or hallucination: Overparameterization isn't just about fina
Why Binary Cross Entropy?
Medium · Deep Learning 🔢 Mathematical Foundations 1mo ago
Why Binary Cross Entropy?
If you have made your hands dirty in deep learning or perceptron models and similar such things, you would have encountered new loss… Continue reading on Toward
The Hessian: The Matrix That Sees a Function’s Shape
Medium · Machine Learning 🔢 Mathematical Foundations 1mo ago
The Hessian: The Matrix That Sees a Function’s Shape
How a nineteenth-century idea reveals valleys, saddles, optimization problems, and the hidden geometry of modern AI Continue reading on Medium »
The Hessian: The Matrix That Sees a Function’s Shape
Medium · Data Science 🔢 Mathematical Foundations 1mo ago
The Hessian: The Matrix That Sees a Function’s Shape
How a nineteenth-century idea reveals valleys, saddles, optimization problems, and the hidden geometry of modern AI Continue reading on Medium »
Correlation Is Lossy Compression
Medium · Data Science 🔢 Mathematical Foundations 1mo ago
Correlation Is Lossy Compression
There is a point in every sufficiently large data science project where someone produces a correlation matrix. Usually it is enormous… Continue reading on Data
Reddit r/deeplearning 🔢 Mathematical Foundations 1mo ago
Coding Machine Learning Lecture 2
Hello folks, in this code implementation, we walk through not just writing code, but understanding the outputs we obtain, and validating the results in mathemat
Distance Metrics and Similarity Search: Cosine, Euclidean, and Dot Product
Medium · Machine Learning 🔢 Mathematical Foundations 1mo ago
Distance Metrics and Similarity Search: Cosine, Euclidean, and Dot Product
Cosine, dot product, and Euclidean distance collapse into one ranking once vectors are normalized, and diverge dangerously when they aren’t. Continue reading on
Distance Metrics and Similarity Search: Cosine, Euclidean, and Dot Product
Medium · LLM 🔢 Mathematical Foundations 1mo ago
Distance Metrics and Similarity Search: Cosine, Euclidean, and Dot Product
Cosine, dot product, and Euclidean distance collapse into one ranking once vectors are normalized, and diverge dangerously when they aren’t. Continue reading on
ViT/LLM as an Algorithm, Part 2 — No Maths, Just What It Signifies: The Operations
Medium · Deep Learning 🔢 Mathematical Foundations 1mo ago
ViT/LLM as an Algorithm, Part 2 — No Maths, Just What It Signifies: The Operations
Abstract. Part 1 gave us the atoms — a vector, a weight, a dot product. This part snaps them into the handful of operations every model… Continue reading on Med
P-Value in Machine Learning: Understanding Statistical Significance
Medium · Machine Learning 🔢 Mathematical Foundations 1mo ago
P-Value in Machine Learning: Understanding Statistical Significance
The p-value is an important statistical concept used in hypothesis testing and is widely applied in machine learning and data science. It… Continue reading on M
Probability Distribution in Generative Modeling: A Foundation of Generative AI
Medium · Data Science 🔢 Mathematical Foundations 1mo ago
Probability Distribution in Generative Modeling: A Foundation of Generative AI
Generative AI has become one of the most exciting areas of Artificial Intelligence. Tools that generate text, images, music, and code may… Continue reading on M
Probability Distribution in Generative Modeling: A Foundation of Generative AI
Medium · Deep Learning 🔢 Mathematical Foundations 1mo ago
Probability Distribution in Generative Modeling: A Foundation of Generative AI
Generative AI has become one of the most exciting areas of Artificial Intelligence. Tools that generate text, images, music, and code may… Continue reading on M
The Hidden Patterns Behind User Behaviour
Medium · Data Science 🔢 Mathematical Foundations 1mo ago
The Hidden Patterns Behind User Behaviour
When I first encountered eigenvectors, they felt disconnected from real work. There were matrices, arrows, and equations, but no obvious… Continue reading on Me
Bir Yazılımcının Matematik Bilmesi Gerçekten Gerekli mi?
Medium · Data Science 🔢 Mathematical Foundations ⚡ AI Lesson 1mo ago
Bir Yazılımcının Matematik Bilmesi Gerçekten Gerekli mi?
Bir yazılımcının matematik bilmesi gerçekten gerekli mi? Continue reading on Medium »
How √-1 was invented in 16th century Italy
Medium · Data Science 🔢 Mathematical Foundations 1mo ago
How √-1 was invented in 16th century Italy
The Renaissance Italians were the first to discover that allowing √-1 to exist helped solve previously intractable problems Continue reading on Medium »
Hacker News (AI) 🔢 Mathematical Foundations ⚡ AI Lesson 1mo ago
The original URL for this prediction will no longer be available in 11 years (2011)
Comments
4D Conformal Field Theory, 5D Gravity, and Stringy Corrections in Extreme Fields
Medium · Data Science 🔢 Mathematical Foundations 1mo ago
4D Conformal Field Theory, 5D Gravity, and Stringy Corrections in Extreme Fields
by Aditiya Widodo Putra, Expert in Mathematics & Astrophysics. Continue reading on Medium »
How to divide by 19 in your head
Medium · Data Science 🔢 Mathematical Foundations ⚡ AI Lesson 1mo ago
How to divide by 19 in your head
Turn division by 19 into repeated division by 2. Continue reading on ThinkArt »
Hacker News (AI) 🔢 Mathematical Foundations 1mo ago
The Entropy of a Markov Chain
Comments
MIT’s Math Test 2010: Calculate the Value of X.
Medium · Data Science 🔢 Mathematical Foundations ⚡ AI Lesson 1mo ago
MIT’s Math Test 2010: Calculate the Value of X.
Taken from Feb. 2010 Past Papers Continue reading on ThinkArt »