Information and Entropy

  • 1/4*log(1/4)-3/4*log(3/4)=0.81, which is essentially how many bits would be needed for an event with probability 1/2 ^ 0.81 = 1/1.75

--

--

--

Whether I shall turn out to be a hero of this book these pages must show

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Frustration and the Geometry of Space-time. Blog Post #4

Solution Insights: Weekly Problem on Number Theory for 11–01–2022

A friend sent me a proposed proof of a famous unsolved maths problem — so why haven’t I read it?

Xyphon’s Paradox

Is time absolute in The Universe? | is Time absolute or Relative in The Universe?

The Conjunction Fallacy

3. Linear equation system

Huffman’s Algorithm Step 1 Initialize n one-node trees and label them with the characters of the…

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Kirill Novik

Kirill Novik

Whether I shall turn out to be a hero of this book these pages must show

More from Medium

Information as an ignorance machine

What Researchers Must Do Differently After January 6th, 2021.

PyG Model Tutorials with Planetoid Dataset

Thesis 11:Prototype 2 ideation