We test the hypothesis that language models trained with reinforcement
l...
As AI systems become more capable, we would like to enlist their help to...
Developing safe and useful general-purpose AI systems will require us to...
"Induction heads" are attention heads that implement a simple algorithm ...
We describe our early efforts to red team language models in order to
si...
We study whether language models can evaluate the validity of their own
...
We apply preference modeling and reinforcement learning from human feedb...
Large-scale pre-training has recently emerged as a technique for creatin...
Given the broad capabilities of large language models, it should be poss...
Neural networks have shown to be a practical way of building a very comp...