Polynomial functors and Shannon entropy

01/30/2022
โˆ™
by   David I. Spivak, et al.
โˆ™
0
โˆ™

Past work shows that one can associate a notion of Shannon entropy to a Dirichlet polynomial, regarded as an empirical distribution. Indeed, entropy can be extracted from any dโˆˆ๐–ฃ๐—‚๐—‹ by a two-step process, where the first step is a rig homomorphism out of ๐–ฃ๐—‚๐—‹, the set of Dirichlet polynomials, with rig structure given by standard addition and multiplication. In this short note, we show that this rig homomorphism can be upgraded to a rig functor, when we replace the set of Dirichlet polynomials by the category of ordinary (Cartesian) polynomials. In the Cartesian case, the process has three steps. The first step is a rig functor ๐๐จ๐ฅ๐ฒ^๐‚๐š๐ซ๐ญโ†’๐๐จ๐ฅ๐ฒ sending a polynomial p to แน—๐“Ž, where แน— is the derivative of p. The second is a rig functor ๐๐จ๐ฅ๐ฒโ†’๐’๐ž๐ญร—๐’๐ž๐ญ^op, sending a polynomial q to the pair (q(1),ฮ“(q)), where ฮ“(q)=๐๐จ๐ฅ๐ฒ(q,๐“Ž) can be interpreted as the global sections of q viewed as a bundle, and q(1) as its base. To make this precise we define what appears to be a new distributive monoidal structure on ๐’๐ž๐ญร—๐’๐ž๐ญ^op, which can be understood geometrically in terms of rectangles. The last step, as for Dirichlet polynomials, is simply to extract the entropy as a real number from a pair of sets (A,B); it is given by log A-logโˆš(B) and can be thought of as the log aspect ratio of the rectangle.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset