research
∙
02/02/2023
Accelerating Large Language Model Decoding with Speculative Sampling
We present speculative sampling, an algorithm for accelerating transform...
share
research
∙
11/08/2022
Self-conditioned Embedding Diffusion for Text Generation
Can continuous diffusion models bring the same performance breakthrough ...
research
∙
06/30/2022
Mastering the Game of Stratego with Model-Free Multiagent Reinforcement Learning
We introduce DeepNash, an autonomous agent capable of learning to play t...
research
∙
06/10/2022
Large-Scale Retrieval for Reinforcement Learning
Effective decision making involves flexibly relating past experiences an...
research
∙
03/29/2022
Training Compute-Optimal Large Language Models
We investigate the optimal model size and number of tokens for training ...
research
∙
02/02/2022
Unified Scaling Laws for Routed Language Models
The performance of a language model has been shown to be effectively mod...
research
∙
12/08/2021
Improving language models by retrieving from trillions of tokens
We enhance auto-regressive language models by conditioning on document c...
research
∙
04/13/2021
Muesli: Combining Improvements in Policy Optimization
We propose a novel policy update that combines regularized policy optimi...
research
∙
04/12/2021
Machine Translation Decoding beyond Beam Search
Beam search is the go-to method for decoding auto-regressive machine tra...
research
∙
11/19/2019
Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model
Constructing agents with planning capabilities has long been one of the ...
research
∙
12/05/2017
Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
The game of chess is the most widely-studied domain in the history of ar...
research
∙
11/11/2016
Learning to Navigate in Complex Environments
Learning to navigate in complex environments with dynamic elements is an...
research
∙
12/20/2013