Intro to Information Theory: Claude Shannon, Entropy, Redundancy, Data Compression & Bits Script: Summary of Previous Video: In the previous video I discussed several definitions of information and I mainly concentrated on Gregory Bateson’s definition, which describes information as…
Blog Archives
What is Information? Part 2a – Information Theory
Posted in Videos Tagged with: A mathematical Theory of Communication, ASCII code, binary digit, bits per character, Claude Shannon, compression, data compression, david huffman, entropy, entropy English language, entropy in a coin flip, entropy per character, huffman code, increase in knowledge, information content, information entropy, information gain, information theory, John Tukey, John von Neumann, lossless data compression, lossy data compression, lower bound data compression, randomness, redundancy, Shannon's bit, Shannon's entropy formula, Shannon's information, Source Coding Theorem, storage bit, tossing a coin, Tukey's bit, uncertainty, uncertainty in a probabilistic process, uncertainty reduction, variable length coding, Warren Weaver
What is Information? (1)
What is information? (Part 1): Is information Subjective – Physical – Fundamental? Perception & Meaning Script: Introduction We are living in the Information Age. From the birth of the digital computer to 24-hour television, from our love affair…
Posted in Videos Tagged with: a difference which makes a difference, Anton Zeilinger, assigning meaning, binary digit, binary states, bit, consciousness, digital philosophy, digital physics, emergent or fundamental, free will, Gregory Bateson, idealism, information as perception, information matter and energy, is information fundamental, is information physical, is information subjective, knowledge acquisition, life, potential for knowledge, Rolf Landauer, sentient life, Steven Kaufman, to give form to the mind, what is information
