research
∙
08/14/2023
OctoPack: Instruction Tuning Code Large Language Models
Finetuning large language models (LLMs) on instructions leads to vast pe...
share
research
∙
05/25/2023
Scaling Data-Constrained Language Models
The current trend of scaling language models involves increasing both pa...
research
∙
05/09/2023
StarCoder: may the source be with you!
The BigCode community, an open-scientific collaboration working on the r...
research
∙
01/09/2023
SantaCoder: don't reach for the stars!
The BigCode project is an open-scientific collaboration working on the r...
research
∙
12/19/2022
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting
The BLOOM model is a large open-source multilingual language model capab...
research
∙
11/03/2022
Crosslingual Generalization through Multitask Finetuning
Multitask prompted finetuning (MTF) has been shown to help large languag...
research
∙
10/27/2022
What Language Model to Train if You Have One Million GPU Hours?
The crystallization of modeling methods around the Transformer architect...
research
∙
10/13/2022
MTEB: Massive Text Embedding Benchmark
Text embeddings are commonly evaluated on a small set of datasets from a...
research
∙
02/17/2022
SGPT: GPT Sentence Embeddings for Semantic Search
GPT transformers are the largest language models available, yet semantic...
research
∙
06/15/2021
Diagnosing the Impact of AI on Radiology in China
Artificial Intelligence will significantly impact the work environment o...
research
∙
12/14/2020