research
∙
09/20/2023
BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model
We introduce the Bittensor Language Model, called "BTLM-3B-8K", a new st...
share
research
∙
04/06/2023
Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster
We study recent research advances that improve large language models thr...
research
∙
06/28/2022
RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network
This work introduces the RevSilo, the first reversible module for bidire...
research
∙
03/17/2022
Time Dependency, Data Flow, and Competitive Advantage
Data is fundamental to machine learning-based products and services and ...
research
∙
03/17/2022
Time and the Value of Data
Managers often believe that collecting more data will continually improv...
research
∙
01/06/2022
Efficiently Disentangle Causal Representations
This paper proposes an efficient approach to learning disentangled repre...
research
∙
04/19/2021
Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation
We propose combining memory saving techniques with traditional U-Net arc...
research
∙
03/25/2020
Pipelined Backpropagation at Scale: Training Large Models without Batches
Parallelism is crucial for accelerating the training of deep neural netw...
research
∙
10/07/2019
Compositional Generalization for Primitive Substitutions
Compositional generalization is a basic mechanism in human language lear...
research
∙
09/03/2019
Beyond Human-Level Accuracy: Computational Challenges in Deep Learning
Deep learning (DL) research yields accuracy and product improvements fro...
research
∙
12/01/2017
Deep Learning Scaling is Predictable, Empirically
Deep learning (DL) creates impactful advances following a virtuous recip...
research
∙
03/15/2017