Core AI

Large Language Models

Deep dives into GPT, Claude, Gemini, Llama and the transformers powering modern AI

19768
lessons
Skills in this topic
View full skill map →
LLM Foundations
beginner
Explain how transformers generate text
Prompt Craft
beginner
Write zero-shot and few-shot prompts
LLM Engineering
intermediate
Call LLM APIs with function/tool use
Fine-tuning LLMs
advanced
Prepare fine-tuning datasets
Multimodal LLMs
advanced
Use GPT-4V / Claude Vision for image understanding
Level: All Beginner Intermediate Advanced
Any Length Short (<5m) Medium (5-20m) Long (>20m)
Newest Popular Oldest
No GPU Left Behind: Scaling Online LLM Training With... - Mert Toslali & Yu Chin Fabian Lim
Large Language Models
No GPU Left Behind: Scaling Online LLM Training With... - Mert Toslali & Yu Chin Fabian Lim
PyTorch Advanced 5mo ago
Lightning Talk: FlexCP: FlexAttention for Long Sequence Training... - Xilun Wu & Chien-Chin Huang
Large Language Models
Lightning Talk: FlexCP: FlexAttention for Long Sequence Training... - Xilun Wu & Chien-Chin Huang
PyTorch Advanced 5mo ago
Sponsored Session: Amazingly Fast and Incredibly Scalable Inference... - Harry Kim & Laikh Tewari
Large Language Models
Sponsored Session: Amazingly Fast and Incredibly Scalable Inference... - Harry Kim & Laikh Tewari
PyTorch Advanced 5mo ago
An Open Source Post-Training Stack: Kubernetes + Ray + PyTorch + vLLM - Robert Nishihara, Anyscale
Large Language Models
An Open Source Post-Training Stack: Kubernetes + Ray + PyTorch + vLLM - Robert Nishihara, Anyscale
PyTorch Intermediate 5mo ago
Thunder: Distribute and Optimize Your PyTorch Models With Zero... - Luca Antiga & Thomas Viehmann
Large Language Models
Thunder: Distribute and Optimize Your PyTorch Models With Zero... - Luca Antiga & Thomas Viehmann
PyTorch Advanced 5mo ago
The Four Pillars of Large-Scale Decentralized Pre-Training: Methods, Bottlenecks... - Bowen Peng
Large Language Models
The Four Pillars of Large-Scale Decentralized Pre-Training: Methods, Bottlenecks... - Bowen Peng
PyTorch Advanced 5mo ago
Holistic Evaluation of Language Models (HELM) - Yifan Mai, Stanford University
Large Language Models
Holistic Evaluation of Language Models (HELM) - Yifan Mai, Stanford University
PyTorch Intermediate 5mo ago
Measuring Intelligence in the Wild: Advances in Preference-Based Evaluation -Anastasios Angelopolous
Large Language Models
Measuring Intelligence in the Wild: Advances in Preference-Based Evaluation -Anastasios Angelopolous
PyTorch Intermediate 5mo ago
Accelerating Open-Source RL and Agentic Inference with vLLM - Michael Goin, Red Hat | vLLM
Large Language Models
Accelerating Open-Source RL and Agentic Inference with vLLM - Michael Goin, Red Hat | vLLM
PyTorch Advanced 5mo ago
Scaling Agentic Intelligence from Pre-Training to RL - Aakanksha Chowdery
Large Language Models
Scaling Agentic Intelligence from Pre-Training to RL - Aakanksha Chowdery
PyTorch Advanced 5mo ago
Unlocking Performance: Harnessing LLMs To Streamline GPU Kernel Development in... - Jiannan Wang
Large Language Models
Unlocking Performance: Harnessing LLMs To Streamline GPU Kernel Development in... - Jiannan Wang
PyTorch Intermediate 5mo ago
The Model Context Protocol: Connecting AI to Everything - Adam Jones, Anthropic
Large Language Models
The Model Context Protocol: Connecting AI to Everything - Adam Jones, Anthropic
PyTorch Intermediate 5mo ago
End-to-End Optimizing Multi-Turn RL and High-Performance Inference in Agents with... - Chenyang Zhao
Large Language Models
End-to-End Optimizing Multi-Turn RL and High-Performance Inference in Agents with... - Chenyang Zhao
PyTorch Advanced 5mo ago
Can Reinforcement Learning Lead to AGI? - Daniel Han, Unsloth
Large Language Models
Can Reinforcement Learning Lead to AGI? - Daniel Han, Unsloth
PyTorch Beginner 5mo ago
Panel Discussion: Training and Inference at Planet Scale
Large Language Models
Panel Discussion: Training and Inference at Planet Scale
PyTorch Advanced 5mo ago
Sponsored Session: Everything Everywhere all at Once: vLLM...- Brittany Rockwell & Shireen Kheradpey
Large Language Models
Sponsored Session: Everything Everywhere all at Once: vLLM...- Brittany Rockwell & Shireen Kheradpey
PyTorch Advanced 5mo ago
SkyRL: A Modular RL Library for LLM Agents - Sumanth Hegde, Anyscale & Tyler Griggs, UC Berkeley
Large Language Models
SkyRL: A Modular RL Library for LLM Agents - Sumanth Hegde, Anyscale & Tyler Griggs, UC Berkeley
PyTorch Beginner 5mo ago
Weaver: Shrinking the Generation-Verification Gap with Weak Verifiers - Jon Saad-Falcon
Large Language Models
Weaver: Shrinking the Generation-Verification Gap with Weak Verifiers - Jon Saad-Falcon
PyTorch Intermediate 5mo ago
Lightning Talk: KernelBot: The World's First Competitive GPU Programming Platform - Mark Saroufim
Large Language Models
Lightning Talk: KernelBot: The World's First Competitive GPU Programming Platform - Mark Saroufim
PyTorch Beginner 5mo ago
Sponsored Session: Lightning Talk: Efficient Inference Serving with Kubernetes Gateway... - Lin Sun
Large Language Models
Sponsored Session: Lightning Talk: Efficient Inference Serving with Kubernetes Gateway... - Lin Sun
PyTorch Intermediate 5mo ago
Sponsored Keynote: From Transactions to Transformers: Hardware Built for... - Christian Jacobi
Large Language Models
Sponsored Keynote: From Transactions to Transformers: Hardware Built for... - Christian Jacobi
PyTorch Intermediate 5mo ago
The Building Blocks of Today’s and Tomorrow’s Language Models - Sebastian Raschka, RAIR Lab
Large Language Models
The Building Blocks of Today’s and Tomorrow’s Language Models - Sebastian Raschka, RAIR Lab
PyTorch Advanced 5mo ago
Keynote: vLLM & Deepspeed Updates - Simon Mo & Tunji Ruwase
Large Language Models
Keynote: vLLM & Deepspeed Updates - Simon Mo & Tunji Ruwase
PyTorch Intermediate 5mo ago
PyTorch APIs for High Performance MoE Training and Inference - D. Vega-Myhre; Ke Wen & N. Gimelshein
Large Language Models
PyTorch APIs for High Performance MoE Training and Inference - D. Vega-Myhre; Ke Wen & N. Gimelshein
PyTorch Advanced 5mo ago
Sponsored Session: Beyond the Node: Scaling Inference with Cluster-Wide KVCache... - Alon Yariv
Large Language Models
Sponsored Session: Beyond the Node: Scaling Inference with Cluster-Wide KVCache... - Alon Yariv
PyTorch Advanced 5mo ago
Leveraging PyTorch for Generative AI in Distributed Edge Clouds - Tina Tsou
Large Language Models
Leveraging PyTorch for Generative AI in Distributed Edge Clouds - Tina Tsou
PyTorch Advanced 5mo ago
Lightning Talk: What's New in Torch.onnx - Maanav Dalal & Justin Chu, Microsoft
Large Language Models
Lightning Talk: What's New in Torch.onnx - Maanav Dalal & Justin Chu, Microsoft
PyTorch Beginner 5mo ago
Lightning Talk: Accelerating PyTorch FSDP Via Overlapping Collectives With In... - Nariaki Tateiwa
Large Language Models
Lightning Talk: Accelerating PyTorch FSDP Via Overlapping Collectives With In... - Nariaki Tateiwa
PyTorch Intermediate 5mo ago
Deploying GenAI for Audio Generation on Mobile CPUs With ExecuTorch - Gian Marco Iodice, Arm
Large Language Models
Deploying GenAI for Audio Generation on Mobile CPUs With ExecuTorch - Gian Marco Iodice, Arm
PyTorch Intermediate 5mo ago
Enabling VLLM V1 on AMD GPUs With Triton - Thomas Parnell, IBM Research & Aleksandr Malyshev, AMD
Large Language Models
Enabling VLLM V1 on AMD GPUs With Triton - Thomas Parnell, IBM Research & Aleksandr Malyshev, AMD
PyTorch Advanced 5mo ago
Multi-Accelerator PyTorch Serving With NxD Inference and vLLM - Yahav Biran & Liangfu Chen, Amazon
Large Language Models
Multi-Accelerator PyTorch Serving With NxD Inference and vLLM - Yahav Biran & Liangfu Chen, Amazon
PyTorch Beginner 5mo ago
Lightning Talk: Improved GEMM and SDPA Performance on ROCm With Composable Kernel - Andres Lugo, AMD
Large Language Models
Lightning Talk: Improved GEMM and SDPA Performance on ROCm With Composable Kernel - Andres Lugo, AMD
PyTorch Beginner 5mo ago
Sponsored Session: Lightning Talk: PyTorch in Production: Boosting LLM Training and... - F. Hua
Large Language Models
Sponsored Session: Lightning Talk: PyTorch in Production: Boosting LLM Training and... - F. Hua
PyTorch Intermediate 5mo ago
Lightning Talk: Vllm-triton-backend: How To Get State-of-the-art Performance on... - B. Ringlein
Large Language Models
Lightning Talk: Vllm-triton-backend: How To Get State-of-the-art Performance on... - B. Ringlein
PyTorch Advanced 5mo ago
Transformers: Standardizing Model Definitions Across the PyTorch Ecosystem - L. Debut & A. Zucker
Large Language Models
Transformers: Standardizing Model Definitions Across the PyTorch Ecosystem - L. Debut & A. Zucker
PyTorch Advanced 5mo ago
Enabling Lightweight, High-Performance FSDP With NVIDIA GPU - J. Chang CN, C. Ye, X. Chen & S. Lym
Large Language Models
Enabling Lightweight, High-Performance FSDP With NVIDIA GPU - J. Chang CN, C. Ye, X. Chen & S. Lym
PyTorch Advanced 5mo ago
Blazing Fast GenAI Inference With Torch.compile - Richard Zou, Meta
Large Language Models
Blazing Fast GenAI Inference With Torch.compile - Richard Zou, Meta
PyTorch Intermediate 5mo ago
PyTorch Symmetric Memory: A New Programming Paradigm for Distributed AI - Ke Wen & Chien-Chin Huang
Large Language Models
PyTorch Symmetric Memory: A New Programming Paradigm for Distributed AI - Ke Wen & Chien-Chin Huang
PyTorch Intermediate 5mo ago
Sponsor Session: Low-Precision Inference without Quality Loss... - Pankaj Gupta & Philip Kiely
Large Language Models
Sponsor Session: Low-Precision Inference without Quality Loss... - Pankaj Gupta & Philip Kiely
PyTorch Intermediate 5mo ago
Verl: A Flexible and Efficient RL Framework for LLMs - Hongpeng Guo & Ziheng Jiang, ByteDance Seed
Large Language Models
Verl: A Flexible and Efficient RL Framework for LLMs - Hongpeng Guo & Ziheng Jiang, ByteDance Seed
PyTorch Advanced 5mo ago
Lifecycle of a Parameter - Philip Bontrager, Meta
Large Language Models
Lifecycle of a Parameter - Philip Bontrager, Meta
PyTorch Advanced 5mo ago
Serving PyTorch LLMs at Scale: Disaggregated Inference With Kubernetes and Llm-d - M. Ayoub & C. Liu
Large Language Models
Serving PyTorch LLMs at Scale: Disaggregated Inference With Kubernetes and Llm-d - M. Ayoub & C. Liu
PyTorch Beginner 5mo ago
Rethinking the Transformer: Toward Native Multimodal Architectures - Bowen Peng, Nous Research
Large Language Models
Rethinking the Transformer: Toward Native Multimodal Architectures - Bowen Peng, Nous Research
PyTorch Advanced 5mo ago
Lightning Talk: A Stable Limited LibTorch ABI? How?! (and Why?) - Jane Xu, Meta
Large Language Models
Lightning Talk: A Stable Limited LibTorch ABI? How?! (and Why?) - Jane Xu, Meta
PyTorch Beginner 5mo ago
“Many-model” Time Series Forecasting: Scaling PyTorch Training Across 1000s...- V. Sridhar & S. Chen
Large Language Models
“Many-model” Time Series Forecasting: Scaling PyTorch Training Across 1000s...- V. Sridhar & S. Chen
PyTorch Intermediate 5mo ago
Sponsored Session: Powering PyTorch: Decentralized Training for an Energy-Hungry Future - Greg Osuri
Large Language Models
Sponsored Session: Powering PyTorch: Decentralized Training for an Energy-Hungry Future - Greg Osuri
PyTorch Intermediate 5mo ago
Scaling Inference of O(10K)-length Sequence Recommendation Models Using... - S. Joshi & K. Rajesh
Large Language Models
Scaling Inference of O(10K)-length Sequence Recommendation Models Using... - S. Joshi & K. Rajesh
PyTorch Intermediate 5mo ago
Sponsored Session: Accelerating GenAI Inference: From AWS Deep Learning... - P. Nguyen & A. Zhao
Large Language Models
Sponsored Session: Accelerating GenAI Inference: From AWS Deep Learning... - P. Nguyen & A. Zhao
PyTorch Intermediate 5mo ago
📚 Coursera Courses Opens on Coursera · Free to audit
1 / 3 View all →
¿Cómo construir mi modelo de negocio?
📚 Coursera Course ↗
Self-paced
¿Cómo construir mi modelo de negocio?
Opens on Coursera ↗
Power System Modelling and Fault Analysis
📚 Coursera Course ↗
Self-paced
Power System Modelling and Fault Analysis
Opens on Coursera ↗
ChatGPT for Project Management: Insight, Planning, & Success
📚 Coursera Course ↗
Self-paced
ChatGPT for Project Management: Insight, Planning, & Success
Opens on Coursera ↗
Sales Training: Building Your Sales Career
📚 Coursera Course ↗
Self-paced
Sales Training: Building Your Sales Career
Opens on Coursera ↗
LangChain for LLM Application Development
📚 Coursera Course ↗
Self-paced
LangChain for LLM Application Development
Opens on Coursera ↗
Neo4j: Cypher, GDS, GraphQL, LLM, Knowledge Graphs for RAG
📚 Coursera Course ↗
Self-paced
Neo4j: Cypher, GDS, GraphQL, LLM, Knowledge Graphs for RAG
Opens on Coursera ↗