Wikiversity

File:Shannon entropy coins and base 2.svg

Original file ‎(SVG file, nominally 367 × 327 pixels, file size: 80 KB)

This is a file from the Wikimedia Commons. The description on its description page there is shown below.

Commons is a freely licensed media file repository. You can help.

Summary

Description
English: A bird with 3 coins can send 8 messages, while the rat with one coin less can only send half as many. Using coins to count messages is equivalent to counting in base 2 (starting at zero in this figure.) Instead of using 2 coins, the rat has the option of flipping a single 4-sided die. This informal peek at entropy can be modified to account for surprisal by adding the assumption the not all coins are "fair".
Date
Source Own work
Author Guy vandegrift. Derivative of file:Bird_-_Oiseau_-_Vogel.svg, and file:Canusium_1.svg.

Licensing

I, the copyright holder of this work, hereby publish it under the following license:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

Captions

Demonstrating Shannon entropy with 2 coins and 3 coins.

Items portrayed in this file

depicts

physics

information

inception

31 July 2021

MIME type

image/svg+xml

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current12:20, 7 August 2021Thumbnail for version as of 12:20, 7 August 2021367 × 327 (80 KB)Guy vandegriftcoins were out of order
18:01, 6 August 2021Thumbnail for version as of 18:01, 6 August 2021367 × 327 (81 KB)Guy vandegriftce
17:23, 31 July 2021Thumbnail for version as of 17:23, 31 July 2021392 × 331 (80 KB)Guy vandegriftUploaded own work with UploadWizard

The following page uses this file:

Metadata

This file contains additional information, probably added from the digital camera or scanner used to create or digitize it.

If the file has been modified from its original state, some details may not fully reflect the modified file.

Retrieved from "https://en.wikiversity.org/wiki/File:Shannon_entropy_coins_and_base_2.svg"