research
∙
06/24/2023
H_2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
Large Language Models (LLMs), despite their recent impressive accomplish...
share
research
∙
06/03/2023
On Optimal Caching and Model Multiplexing for Large Model Inference
Large Language Models (LLMs) and other large foundation models have achi...
research
∙
05/02/2023
Statistical inference for counting processes under shape heterogeneity
Proportional rate models are among the most popular methods for analyzin...
research
∙
03/13/2023
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
The high computational and memory requirements of large language model (...
research
∙
05/17/2022
Reasoning About Vectors using an SMT Theory of Sequences
Dynamic arrays, also referred to as vectors, are fundamental data struct...
research
∙
04/23/2021
Politeness and Stable Infiniteness: Stronger Together
We make two contributions to the study of polite combination in satisfia...
research
∙
01/07/2021
Simplified DOM Trees for Transferable Attribute Extraction from the Web
There has been a steady need to precisely extract structured knowledge f...
research
∙
04/09/2020
Politeness for the Theory of Algebraic Datatypes
Algebraic datatypes, and among them lists and trees, have attracted a lo...
research
∙
06/17/2018
Subspace Embedding and Linear Regression with Orlicz Norm
We consider a generalization of the classic linear regression problem to...
research
∙
02/13/2018