Tag Archives: Compression

How to measure information using entropy

Which text gives us more information – the full body of work of Shakespeare, or 884,647 random words written by 1000 monkeys? To answer this, we consider the following problem: Alice has a message over some finite alphabet and she … Continue reading

Posted in Entropy | Tagged , , | Leave a comment