research
∙
07/27/2023
Incrementally-Computable Neural Networks: Efficient Inference for Dynamic Inputs
Deep learning often faces the challenge of efficiently processing dynami...
share
research
∙
12/21/2022
Towards Neural Variational Monte Carlo That Scales Linearly with System Size
Quantum many-body problems are some of the most challenging problems in ...
research
∙
03/18/2021
Neural tensor contractions and the expressive power of deep neural quantum states
We establish a direct connection between general tensor networks and dee...
research
∙
06/30/2020
Technical Report: Auxiliary Tuning and its Application to Conditional Text Generation
We introduce a simple and efficient method, called Auxiliary Tuning, for...
research
∙
06/22/2020
Limits to Depth Efficiencies of Self-Attention
Self-attention architectures, which are rapidly pushing the frontier in ...
research
∙
04/19/2020
The Cost of Training NLP Models: A Concise Overview
We review the cost of training large-scale language models, and the driv...
research
∙
08/15/2019
SenseBERT: Driving Some Sense into BERT
Self-supervision techniques have allowed neural language models to advan...
research
∙
02/11/2019
Deep autoregressive models for the efficient variational simulation of many-body quantum systems
Artificial Neural Networks were recently shown to be an efficient repres...
research
∙
03/26/2018
Bridging Many-Body Quantum Physics and Deep Learning via Tensor Networks
The harnessing of modern computational abilities for many-body wave-func...
research
∙
10/25/2017
Benefits of Depth for Long-Term Memory of Recurrent Networks
The key attribute that drives the unprecedented success of modern Recurr...
research
∙
10/12/2017
Sum-Product-Quotient Networks
We present a novel tractable generative model that extends Sum-Product N...
research
∙
05/05/2017
Analysis and Design of Convolutional Networks via Hierarchical Tensor Decompositions
The driving force behind convolutional networks - the most successful de...
research
∙
03/06/2017
On the Expressive Power of Overlapping Architectures of Deep Learning
Expressive efficiency refers to the relation between two architectures A...
research
∙
10/13/2016
Tractable Generative Convolutional Arithmetic Circuits
Casting neural networks in generative frameworks is a highly sought-afte...
research
∙
09/16/2015
On the Expressive Power of Deep Learning: A Tensor Analysis
It has long been conjectured that hypotheses spaces suitable for data th...
research
∙
06/09/2015