Processing math: 100%

Capacity of Memoryless Digital Channels

© 2021 Institute for Communications Engineering, Technical University of Munich
Authors: Veronika Hofmann, Carolin Mirschina, Tasnad Kernetzky & Benedikt Leible
pA=
0.1
pB=
0.9
pb|A=
0.05
pa|A=
0.95
pa|B=
0.4
pb|B=
0.6
Binary source
Symbol probabilities
Transition probabilities

Exemplary source symbol sequence Xn
Exemplary sink symbol sequence Yn
H(XY)=

Gerichtete Darstellung.

H(X)
H(Y)
H(X|Y)
H(Y|X)
I(X;Y)
Results of the analytical calculation for the binary channel
BBBBBBBBBBBBBBABBBBBBBABBBBBBBBBBBBBBBBB
BBBBBBBBBBBBBBABBBABAABBABBABBBABBABABBB
BBBBBBBBBBBBBBBBBBBABBBBBBBBBBBBBBBBABBB
BBBBBBBBBBABBBBBBBBBABBABBBBBBAABBBBBBBB
BBBBABABBBBBBBBBBBBBBBBBBBBBBBBBBBBABBBB
babbaababaababaaababbaabbbbbabbbabbbbaab
abbbbbbabaabaaaabbabaabbbbaabbbabbaaaaab
abaabaabbabaaabbbbbabbbaaabbbbababbbabba
aababbbaaabbabaabbbaabbababbbaaababbaaab
bbbbaaababaabbbbbabaabbabaababaabaaabbbb
            1.371
0.4690.902
0.3770.994
0.3770.0920.902
0.469
0.377
0.092
0.994
0.902
Composite probabilities
Pr(XY)
Conditional probabilities
Pr(Y|X)
Inference probabilities
Pr(X|Y)
ab
A0.0950.005
B0.360.54
ab
A0.950.05
B0.40.6
ab
A0.20880.0092
B0.79120.9908
Exercises