Core AI

Large Language Models

Deep dives into GPT, Claude, Gemini, Llama and the transformers powering modern AI

24,915
lessons
Skills in this topic
View full skill map →
LLM Foundations
beginner
Explain how transformers generate text
Prompt Craft
beginner
Write zero-shot and few-shot prompts
LLM Engineering
intermediate
Call LLM APIs with function/tool use
Fine-tuning LLMs
advanced
Prepare fine-tuning datasets
Multimodal LLMs
advanced
Use GPT-4V / Claude Vision for image understanding

Showing 5,455 reads from curated sources

OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
Meta-learning for wrestling
We show that for the task of simulated robot wrestling, a meta-learning agent can learn to quickly defeat a stronger non-meta-learning agent, and also show that
Lilian Weng's Blog 🧠 Large Language Models ⚡ AI Lesson 8y ago
Anatomize Deep Learning with Information Theory
Professor Naftali Tishby passed away in 2021. Hope the post can introduce his cool idea of information bottleneck to more people. Recently I watched the talk &l
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
Learning to model other minds
We’re releasing an algorithm which accounts for the fact that other agents are learning too, and discovers self-interested yet collaborative strategies like tit
Lilian Weng's Blog 🧠 Large Language Models ⚡ AI Lesson 8y ago
From GAN to WGAN
[Updated on 2018-09-30: thanks to Yoonju, we have this post translated in Korean !] [
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
OpenAI Baselines: ACKTR & A2C
We’re releasing two new OpenAI Baselines implementations: ACKTR and A2C. A2C is a synchronous, deterministic variant of Asynchronous Advantage Actor Critic (A3C
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
More on Dota 2
Our Dota 2 result shows that self-play can catapult the performance of machine learning systems from far below human level to superhuman, given sufficient compu
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
Dota 2
We’ve created a bot which beats the world’s top professionals at 1v1 matches of Dota 2 under standard tournament rules. The bot learned the game from scratch by
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
Gathering human feedback
RL-Teacher is an open-source implementation of our interface to train AIs via occasional human feedback rather than hand-crafted reward functions. The underlyin
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
Better exploration with parameter noise
We’ve found that adding adaptive noise to the parameters of reinforcement learning algorithms frequently boosts performance. This exploration method is simple t
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
Proximal Policy Optimization
We’re releasing a new class of reinforcement learning algorithms, Proximal Policy Optimization (PPO), which perform comparably or better than state-of-the-art a
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
Learning from human preferences
One step towards building safe AI systems is to remove the need for humans to write goal functions, since using a simple proxy for a complex goal, or getting th
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
Learning to cooperate, compete, and communicate
Multiagent environments where agents compete for resources are stepping stones on the path to AGI. Multiagent environments have two useful properties: first, th
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
OpenAI Baselines: DQN
We’re open-sourcing OpenAI Baselines, our internal effort to reproduce reinforcement learning algorithms with performance on par with published results. We’ll r
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
Robots that learn
We’ve created a robotics system, trained entirely in simulation and deployed on a physical robot, which can learn a new task after seeing it done once.
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 8y ago
Roboschool
We are releasing Roboschool: open-source software for robot simulation, integrated with OpenAI Gym.
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Spam detection in the physical world
We’ve created the world’s first Spam-detecting AI trained entirely in simulation and deployed on a physical robot.
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Evolution strategies as a scalable alternative to reinforcement learning
We’ve discovered that evolution strategies (ES), an optimization technique that’s been known for decades, rivals the performance of standard reinforcement learn
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Learning to communicate
In this post we’ll outline new OpenAI research in which agents develop their own language.
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Attacking machine learning with adversarial examples
Adversarial examples are inputs to machine learning models that an attacker has intentionally designed to cause the model to make a mistake; they’re like optica
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Team update
The OpenAI team is now 45 people. Together, we’re pushing the frontier of AI capabilities—whether by validating novel ideas, creating new software systems, or d
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Faulty reward functions in the wild
Reinforcement learning algorithms can break in surprising, counterintuitive ways. In this post we’ll explore one failure mode, which is where you misspecify you
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Universe
We’re releasing Universe, a software platform for measuring and training an AI’s general intelligence across the world’s supply of games, websites and other app
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
OpenAI and Microsoft
We’re working with Microsoft to start running most of our large-scale experiments on Azure.
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Report from the self-organizing conference
Last week we hosted over a hundred and fifty AI practitioners in our offices for our first self-organizing conference on machine learning.
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Infrastructure for deep learning
Deep learning is an empirical science, and the quality of a group’s infrastructure is a multiplier on progress. Fortunately, today’s open-source ecosystem makes
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Special projects
Impactful scientific work requires working on the right problems—problems which are not just interesting, but whose solutions matter.
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Concrete AI safety problems
We (along with researchers from Berkeley and Stanford) are co-authors on today’s paper led by Google Brain researchers, Concrete Problems in AI Safety. The pape
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
OpenAI technical goals
OpenAI’s mission is to build safe AI, and ensure AI’s benefits are as widely and evenly distributed as possible.
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 9y ago
Generative models
This post describes four projects that share a common theme of enhancing or using generative models, a branch of unsupervised learning techniques in machine lea
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 10y ago
OpenAI Gym Beta
We’re releasing the public beta of OpenAI Gym, a toolkit for developing and comparing reinforcement learning (RL) algorithms. It consists of a growing suite of
OpenAI News 🧠 Large Language Models ⚡ AI Lesson 10y ago
Introducing OpenAI
OpenAI is a non-profit artificial intelligence research company. Our goal is to advance digital intelligence in the way that is most likely to benefit humanity