
Recent Posts
Tags
 CayleyHamilton Theorem
 Chinese remainder theorem
 Compression
 Diophantine approximation
 Dirichlet's approximation theorem
 Dirichlet's unit theorem
 Dynamics
 eigenvalues
 Entropy
 Generic Matrix
 Geometry
 Geometry of numbers
 Homogeneous spaces
 Hyperbolic space
 Lattices
 Minkowski's Theorem
 Number Theory
 Pell's equations
 radar
 random walk
 self similar sets
 Sierpinski carpet
 Sierpinski triangle
 SL_2(Z)
 stochastic matrices
 Weak Law of Large Numbers
Archives
Category Archives: Entropy
How to measure information using entropy
Which text gives us more information – the full body of work of Shakespeare, or 884,647 random words written by 1000 monkeys? To answer this, we consider the following problem: Alice has a message over some finite alphabet and she … Continue reading