research
∙
06/01/2023
The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only
Large language models are commonly trained on a mixture of filtered web ...
share
research
∙
10/26/2022
Scaling Laws Beyond Backpropagation
Alternatives to backpropagation have long been studied to better underst...
research
∙
10/16/2021
PAGnol: An Extra-Large French Generative Model
Access to large pre-trained models of varied architectures, in many diff...
research
∙
07/25/2021
LightOn Optical Processing Unit: Scaling-up AI and HPC with a Non von Neumann co-processor
We introduce LightOn's Optical Processing Unit (OPU), the first photonic...
research
∙
06/07/2021
Photonic Differential Privacy with Direct Feedback Alignment
Optical Processing Units (OPUs) – low-power photonic chips dedicated to ...
research
∙
04/29/2021
Photonic co-processors in HPC: using LightOn OPUs for Randomized Numerical Linear Algebra
Randomized Numerical Linear Algebra (RandNLA) is a powerful class of met...
research
∙
01/06/2021