33
情報04 津業等専学校情報学科 講師 電気通信学先進学科 協研究員 藤寿 ver. 20150502

情報理論04

Embed Size (px)

Citation preview

1. 04 ver. 20150502 2. 3. 4. 5. 3 P(X = 2) = 1 6 P(X 3) = 3 6 = 1 2 I(P(X 3)) = 2 I(P(X = 2)) = 6 6. 7. I( 1 2 ) = 2 8. I( 1 3 ) = 3 9. I( 1 6 ) = 6 I( 1 2 ) + I( 1 3 ) = 2 + 3 = 5 10. I( 1 6 ) = I( 1 2 1 3 ) = I( 1 2 ) + I( 1 3 ) 11. f(xy) = f(x) + f(y) f(x + "x) f(x) "x = f(1 + ") "x = 1 x f(1 + ") " lim "!0 f(x + "x) f(x) "x = c x 0 c = lim "!0 f(1 + ") " c 12. f0 (x) = c x f(x) = c log x + d f(1) = d = 0 0 f(x) = c log x xpp c 13. 1bit = log 2nit = log10 2dit log loge log10 c = 1 14. I(p) = log2 p p 0 1 2 3 4 5 6 7 0 0.2 0.4 0.6 0.8 1 I(p) p 15. A A () 16. p I(p) = log2 p 17. n A1, A2, ..., An p1, p2, ..., pn H = nX i=1 ( log2 pi)pi = nX i=1 pi log2 pi 18. H(p1, p2, ..., pn) = nX i=1 pi log2 pi p1, p2, ..., pnn 19. pq = (1 - p) p, q 20. p 21. H 0 H H=0pi 0 log2 0 = 0 22. pi = 1 n Hmax = nX i=1 1 n ( log2 n) = n 1 n log2 n = log2 n 23. H nit pi 24. pi = 1 n pi = c() Hpi 25. 45% 35%12%8%H H 26. 1850 1877 1948 27. 1822 1854 1865 28. Q = T S 29. (1844-1906) 1844 1877 wikipedia 30. W S = k log W 31. (1916-2001) 1916 1948 wikipedia 32. I(p) = log2 p H(p1, p2, ..., pn) = nX i=1 pi log2 pi 33.