信息论基础...二元信源 信息熵 计算公式.

已经调试过了信息熵计算源代码函数源程序 CalEntropy。mInformation Shannon Entropy calculationjma@hebut。edu。cn, 22/08/2007array : Discrete Probabilities SetH : Output Shannon Entropyfunction H = CalEntropy(array)Vector numbernum = length(array);Check probabilities sum to 1:if abs(sum(array) - 1) > 。00001,error('Probablities don''t sum to 1。')endRemove any zero probabilities %%zeroProbs = find(array < eps);if ~isempty(zeroProbs),array(zeroProbs) = [];disp('Removed zero or negative probabilities。')EndCompute the entropyH = -sum(array 。* log2(array)); % 单位 bit/symbol