[Bio-information-theory] A question about surprisals
William Benish
william.benish at gmail.com
Mon Sep 4 08:32:52 EST 2006
Can anyone help me support the following statement with a published reference?
"Fundamental information theory conceptsentropy, mutual information,
relative entropy, and channel capacityare functions of a more
primitive concept, the surprisal (S). "
I am aware of use of the term surprisal by Tribus, but I have not
found an information theory textbook that defines entropy as the
expected value of the "surprisal".
Thanks in advance for your help.
Bill Benish
More information about the Bio-info
mailing list