Universal proofs of entropic continuity bounds via majorization flow

09/16/2019
by   Eric P. Hanson, et al.
0

We introduce a notion of majorization flow, and demonstrate it to be a powerful tool for deriving simple and universal proofs of continuity bounds for entropic functions relevant in information theory. In particular, for the case of the alpha-Rényi entropy, whose connections to thermodynamics are discussed in this article, majorization flow yields a Lipschitz continuity bound for the case alpha > 1, thus resolving an open problem and providing a substantial improvement over previously known bounds.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/14/2022

Uniform continuity bound for sandwiched Rényi conditional entropy

We prove a simple uniform continuity bound for the sandwiched Rényi cond...
research
07/18/2022

Close-to-optimal continuity bound for the von Neumann entropy and other quasi-classical applications of the Alicki-Fannes-Winter technique

We consider a quasi-classical version of the Alicki-Fannes-Winter techni...
research
04/05/2021

From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions

We prove a variety of new and refined uniform continuity bounds for entr...
research
05/03/2014

On Lipschitz Continuity and Smoothness of Loss Functions in Learning to Rank

In binary classification and regression problems, it is well understood ...
research
04/22/2019

A syntactic approach to continuity of T-definable functionals

We give a new proof of the well-known fact that all functions (N→N) →N w...
research
12/06/2022

Extending Universal Approximation Guarantees: A Theoretical Justification for the Continuity of Real-World Learning Tasks

Universal Approximation Theorems establish the density of various classe...
research
08/23/2023

Unified framework for continuity of sandwiched Rényi divergences

In this work, we prove uniform continuity bounds for entropic quantities...

Please sign up or login with your details

Forgot password? Click here to reset