research
∙
01/31/2023
Large Language Models Can Be Easily Distracted by Irrelevant Context
Large language models have achieved impressive performance on various na...
share
research
∙
07/21/2022
Language Model Cascades
Prompted models have demonstrated impressive few-shot learning abilities...
research
∙
06/29/2022
Solving Quantitative Reasoning Problems with Language Models
Language models have achieved remarkable performance on a wide range of ...
research
∙
05/26/2022
Towards Learning Universal Hyperparameter Optimizers with Transformers
Meta-learning hyperparameter optimization (HPO) algorithms from prior ex...
research
∙
04/05/2022
PaLM: Scaling Language Modeling with Pathways
Large language models have been shown to achieve remarkable performance ...
research
∙
11/30/2021
Show Your Work: Scratchpads for Intermediate Computation with Language Models
Large pre-trained language models perform remarkably well on tasks that ...
research
∙
08/16/2021
Program Synthesis with Large Language Models
This paper explores the limits of the current generation of large langua...
research
∙
12/01/2020
Latent Programmer: Discrete Latent Codes for Program Synthesis
In many sequence learning tasks, such as program synthesis and document ...
research
∙
09/30/2020
Rethinking Attention with Performers
We introduce Performers, Transformer architectures which can estimate re...
research
∙
06/05/2020
Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers
Transformer models have achieved state-of-the-art results across a diver...
research
∙
06/05/2020
Population-Based Black-Box Optimization for Biological Sequence Design
The use of black-box optimization for the design of new biological seque...
research
∙
04/23/2018
QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
Current end-to-end machine reading and question answering (Q&A) models a...
research
∙
12/16/2016