Entropy Calculator

Calculates entropy for data (probability of events) in an array.
763 Downloads
Aktualisiert 14. Mär 2012

Lizenz anzeigen

In information theory, entropy is a measure of the uncertainty associated
with a random variable. In this context, the term usually refers to the
Shannon entropy, which quantifies the expected value of the information
% contained in a message, usually in units such as bits. In this context, a
'message' means a specific realization of the random variable.
Shannon denoted the entropy H of a discrete random variable X with possible
values {x1, ..., xn} as,

H(X) = E(I(X)).

E is the expected value,
I is the information content of X

Example usage
-------------
in = [.25 .25 .25 .25];
b = 'bit';
Entropy = info_entropy (in, b)

Zitieren als

Vallabha Hampiholi (2024). Entropy Calculator (https://www.mathworks.com/matlabcentral/fileexchange/35611-entropy-calculator), MATLAB Central File Exchange. Abgerufen .

Kompatibilität der MATLAB-Version
Erstellt mit R2008a
Kompatibel mit allen Versionen
Plattform-Kompatibilität
Windows macOS Linux
Kategorien
Mehr zu Error Detection and Correction finden Sie in Help Center und MATLAB Answers

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!
Version Veröffentlicht Versionshinweise
1.1.0.0

It now handles 0 as entry in the probability array.

1.0.0.0