research
∙
06/02/2023
GAIA Search: Hugging Face and Pyserini Interoperability for NLP Training Data Exploration
Noticing the urgent need to provide tools for fast and user-friendly qua...
share
research
∙
05/25/2023
Scaling Data-Constrained Language Models
The current trend of scaling language models involves increasing both pa...
research
∙
02/28/2023
Spacerini: Plug-and-play Search Engines with Pyserini and Hugging Face
We present Spacerini, a modular framework for seamless building and depl...
research
∙
02/27/2023
The ROOTS Search Tool: Data Transparency for LLMs
ROOTS is a 1.6TB multilingual text corpus developed for the training of ...
research
∙
07/08/2022
Improving Wikipedia Verifiability with AI
Verifiability is a core content policy of Wikipedia: claims that are lik...
research
∙
12/18/2021
The Web Is Your Oyster – Knowledge-Intensive NLP against a Very Large Web Corpus
In order to address the increasing demands of real-world applications, t...
research
∙
07/28/2021
Domain-matched Pre-training Tasks for Dense Retrieval
Pre-training on larger datasets with ever increasing model size is now a...
research
∙
02/13/2021
PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them
Open-domain Question Answering models which directly leverage question-a...
research
∙
11/10/2020
Generating Fact Checking Briefs
Fact checking at scale is difficult – while the number of active fact ch...
research
∙
09/04/2020
KILT: a Benchmark for Knowledge Intensive Language Tasks
Challenging problems such as open-domain question answering, fact checki...
research
∙
05/10/2020
How Context Affects Language Models' Factual Predictions
When pre-trained on large unsupervised textual corpora, language models ...
research
∙
01/17/2020
Node Masking: Making Graph Neural Networks Generalize and Scale Better
Graph Neural Networks (GNNs) have received a lot of interest in the rece...
research
∙
11/09/2019
How Decoding Strategies Affect the Verifiability of Generated Text
Language models are of considerable importance. They are used for pretra...
research
∙
05/23/2019