research
∙
03/22/2023
Lower Bounds on the Bayesian Risk via Information Measures
This paper focuses on parameter estimation and introduces a new method f...
share
research
∙
02/28/2023
Asymptotically Optimal Generalization Error Bounds for Noisy, Iterative Algorithms
We adopt an information-theoretic framework to analyze the generalizatio...
research
∙
06/27/2022
Finite Littlestone Dimension Implies Finite Information Complexity
We prove that every online learnable class of functions of Littlestone d...
research
∙
02/25/2022
Alpha-NML Universal Predictors
Inspired by Sibson's alpha-mutual information, we introduce a new class ...
research
∙
02/08/2022
From Generalisation Error to Transportation-cost Inequalities and Back
In this work, we connect the problem of bounding the expected generalisa...
research
∙
02/08/2022
On Sibson's α-Mutual Information
We explore a family of information measures that stems from Rényi's α-Di...
research
∙
02/05/2022
Lower-bounds on the Bayesian Risk in Estimation Procedures via f-Divergences
We consider the problem of parameter estimation in a Bayesian setting an...
research
∙
02/03/2022
The Price of Distributed: Rate Loss in the CEO Problem
In the distributed remote (CEO) source coding problem, many separate enc...
research
∙
02/02/2022
Shannon Bounds on Lossy Gray-Wyner Networks
The Gray-Wyner network subject to a fidelity criterion is studied. Upper...
research
∙
11/03/2021
A Johnson–Lindenstrauss Framework for Randomly Initialized CNNs
How does the geometric representation of a dataset change after the appl...
research
∙
10/01/2021
A Unified Discretization Approach to Compute-Forward: From Discrete to Continuous Inputs
Compute-forward is a coding technique that enables receiver(s) in a netw...
research
∙
07/30/2021
Private Retrieval, Computing and Learning: Recent Progress and Future Challenges
Most of our lives are conducted in the cyberspace. The human notion of p...
research
∙
06/08/2021
Entropy of the Conditional Expectation under Gaussian Noise
This paper considers an additive Gaussian noise channel with arbitrarily...
research
∙
02/16/2021
Lower bound on Wyner's Common Information
An important notion of common information between two random variables i...
research
∙
02/01/2021
On conditional Sibson's α-Mutual Information
In this work, we analyse how to define a conditional version of Sibson's...
research
∙
10/14/2020
Learning, compression, and leakage: Minimizing classification error via meta-universal compression principles
Learning and compression are driven by the common aim of identifying and...
research
∙
02/03/2020
Common Information Components Analysis
We give an information-theoretic interpretation of Canonical Correlation...
research
∙
02/02/2020
The Gaussian lossy Gray-Wyner network
We consider the problem of source coding subject to a fidelity criterion...
research
∙
01/14/2020
Robust Generalization via α-Mutual Information
The aim of this work is to provide bounds connecting two probability mea...
research
∙
12/15/2019
Relaxed Wyner's Common Information
A natural relaxation of Wyner's Common Information is studied. Specifica...
research
∙
12/01/2019
Generalization Error Bounds Via Rényi-, f-Divergences and Maximal Leakage
In this work, the probability of an event under some joint distribution ...
research
∙
03/09/2019
Strengthened Information-theoretic Bounds on the Generalization Error
The following problem is considered: given a joint distribution P_XY and...
research
∙
03/05/2019
A New Approach to Adaptive Data Analysis and Learning via Maximal Leakage
There is an increasing concern that most current published research find...
research
∙
02/28/2019
Quantifying High-order Interdependencies via Multivariate Extensions of the Mutual Information
This article introduces a model-agnostic approach to study statistical s...
research
∙
01/10/2019
Towards an Algebraic Network Information Theory: Simultaneous Joint Typicality Decoding
Consider a receiver in a multi-user network that wishes to decode severa...
research
∙
11/29/2018
Locally Differentially-Private Randomized Response for Discrete Distribution Learning
We consider a setup in which confidential i.i.d. samples X_1,,X_n from a...
research
∙
11/23/2018
Sum-Rate Capacity for Symmetric Gaussian Multiple Access Channels with Feedback
The feedback sum-rate capacity is established for the symmetric J-user G...
research
∙
09/26/2018
Converse for Multi-Server Single-Message PIR with Side Information
Multi-server single-message private information retrieval is studied in ...
research
∙
08/23/2018
The Optimal Memory-Rate Trade-off for the Non-uniform Centralized Caching Problem with Two Files under Uncoded Placement
We propose a novel caching strategy for the problem of centralized coded...
research
∙
08/17/2018
Single-Server Multi-Message Private Information Retrieval with Side Information
We study the problem of single-server multi-message private information ...
research
∙
05/16/2018
Remote Source Coding under Gaussian Noise : Dueling Roles of Power and Entropy Power
The distributed remote source coding (so-called CEO) problem is studied ...
research
∙
01/31/2018
A Novel Centralized Strategy for Coded Caching with Non-uniform Demands
Despite significant progress in the caching literature concerning the wo...
research
∙
12/29/2017
Compute--Forward Multiple Access (CFMA): Practical Code Design
We present a practical strategy that aims to attain rate points on the d...
research
∙
12/06/2017