research
∙
06/28/2023
Towards Measuring the Representation of Subjective Global Opinions in Language Models
Large language models (LLMs) may not equitably represent diverse global ...
share
research
∙
05/24/2023
Model evaluation for extreme risks
Current approaches to building general-purpose AI systems tend to produc...
research
∙
04/11/2023
Regulatory Markets: The Future of AI Governance
Appropriately regulating artificial intelligence is an increasingly urge...
research
∙
02/15/2023
The Capacity for Moral Self-Correction in Large Language Models
We test the hypothesis that language models trained with reinforcement l...
research
∙
09/24/2022
In-context Learning and Induction Heads
"Induction heads" are attention heads that implement a simple algorithm ...
research
∙
08/23/2022
Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned
We describe our early efforts to red team language models in order to si...
research
∙
07/11/2022
Language Models (Mostly) Know What They Know
We study whether language models can evaluate the validity of their own ...
research
∙
05/02/2022
The AI Index 2022 Annual Report
Welcome to the fifth edition of the AI Index Report! The latest edition ...
research
∙
04/12/2022
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
We apply preference modeling and reinforcement learning from human feedb...
research
∙
02/15/2022
Predictability and Surprise in Large Generative Models
Large-scale pre-training has recently emerged as a technique for creatin...
research
∙
12/01/2021
A General Language Assistant as a Laboratory for Alignment
Given the broad capabilities of large language models, it should be poss...
research
∙
08/28/2021
Why and How Governments Should Monitor AI Development
In this paper we outline a proposal for improving the governance of arti...
research
∙
08/05/2021
Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implications
Recently, there have been breakthroughs in computer vision ("CV") models...
research
∙
03/09/2021
The AI Index 2021 Annual Report
Welcome to the fourth edition of the AI Index Report. This year we signi...
research
∙
02/26/2021
Learning Transferable Visual Models From Natural Language Supervision
State-of-the-art computer vision systems are trained to predict a fixed ...
research
∙
02/04/2021
Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models
On October 14th, 2020, researchers from OpenAI, the Stanford Institute f...
research
∙
09/10/2020
Measurement in AI Policy: Opportunities and Challenges
As artificial intelligence increasingly influences our world, it becomes...
research
∙
05/28/2020
Language Models are Few-Shot Learners
Recent work has demonstrated substantial gains on many NLP tasks and ben...
research
∙
04/15/2020
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
With the recent wave of progress in artificial intelligence (AI) has com...
research
∙
12/11/2019
Regulatory Markets for AI Safety
We propose a new model for regulation to achieve AI safety: global regul...
research
∙
08/24/2019
Release Strategies and the Social Impacts of Language Models
Large language models have a range of beneficial uses: they can assist i...
research
∙
02/20/2018