Large Language Models

We’ve released new versions of GPT-3 and Codex which can edit or insert content into existing text, rather than just completing existing text.

Call for expressions of interest to study the economic impacts of large language models.

We describe our latest thinking in the hope of helping other AI developers address safety and misuse of deployed models.

This is part 2 of what to do when facing a limited amount of labeled data for supervised learning tasks. This time we will get some amount of human labeling wor

We built a neural theorem prover for Lean that learned to solve a variety of challenging high-school olympiad problems, including problems from the AMC12 and AI

We’ve trained language models that are much better at following user intentions than GPT-3 while also making them more truthful and less toxic, using techniques

We are introducing embeddings, a new endpoint in the OpenAI API that makes it easy to perform natural language and code tasks like semantic search, clustering,

We’ve fine-tuned GPT-3 to more accurately answer open-ended questions using a text-based web browser.

Fine-tune with a single command.

As part of our effort to support and develop AI talent, we’re excited to announce the OpenAI Residency.

Wider availability made possible by safety progress.

We’ve trained a system that solves grade school math problems with nearly twice the accuracy of a fine-tuned GPT-3 model. It solves about 90% as many problems a

[Updated on 2022-03-13: add expert choice routing .] [U

Scaling human oversight of AI systems for tasks that are difficult to evaluate.

Today, we’re excited to announce the appointment of Helen Toner to our board of directors.

We’ve created an improved version of OpenAI Codex, our AI system that translates natural language to code, and we are releasing it through our API in private be

We’re releasing Triton 1.0, an open-source Python-like programming language which enables researchers with no CUDA experience to write highly efficient GPU code

After five years, Distill will be taking a break.

Our latest research finds we can improve language model behavior with respect to specific behavioral values by fine-tuning on a small, curated dataset.

The goal of contrastive representation learning is to learn such an embedding space in which similar sample pairs stay close to each other while dissimilar ones

We’re proud to announce that the 2021 class of OpenAI Scholars has completed our six-month mentorship program and have produced an open-source research project

Reprogramming Neural CA to exhibit novel behaviour, using adversarial attacks.

OpenAI is committed to developing general-purpose artificial intelligence that benefits all humanity, and we believe that achieving our goal requires expertise

When a neural network layer is divided into multiple branches, neurons self-organize into coherent groupings.

Weaviate v1.2 introduced support for transformers (DistilBERT, BERT, RoBERTa, Sentence-BERT, etc) to vectorize and semantically search through your data.

Over 300 applications are delivering GPT-3–powered search, conversation, text completion, and other advanced AI features through our API.

Large pretrained language models are trained over a sizable collection of online data. They unavoidably acquire certain toxic behavior

We’ve discovered neurons in CLIP that respond to the same concept whether presented literally, symbolically, or conceptually. This may explain CLIP’s accuracy i