61
 LYÙ THUYEÁT TRUYEÀN TIN LYÙ THUYEÁT TRUYEÀN TIN CHÖÔNG 2: CHÖÔNG 2:  TIN V AØ L ÖÔÏNG TIN  TIN V AØ L ÖÔÏNG TIN

Chuong 2- Tin & Luong Tin

Embed Size (px)

DESCRIPTION

truyền tin

Citation preview

Page 1: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 1/61

 

LYÙ THUYEÁT TRUYEÀN TINLYÙ THUYEÁT TRUYEÀN TIN

CHÖÔNG 2:CHÖÔNG 2:

 TIN VAØ LÖÔÏNG TIN TIN VAØ LÖÔÏNG TIN

Page 2: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 2/61

 

Noäi dung c!n cu"# c$%ngNoäi dung c!n cu"# c$%ng

22&'&'  Tin ($)c Tin ($)c

2'2' L$%*ng (inL$%*ng (in

+'+' ,oä -#.( /0n cu"# nguo1n (in,oä -#.( /0n cu"# nguo1n (in''  To.c /oä 3#ä4 (in To.c /oä 3#ä4 (in

5'5'  To6ng 3$%*ng 786n To6ng 3$%*ng 786n

Page 3: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 3/61

 

&' Tin ($)c&' Tin ($)c

Nguo1n (in 3#9 n%i 4#)( # (in ($)c' Tin ($)c /$%*cNguo1n (in 3#9 n%i 4#)( # (in ($)c' Tin ($)c /$%*c4#)( # 3#9 ;oä( <u#) (=n ng#>u ni86n'4#)( # 3#9 ;oä( <u#) (=n ng#>u ni86n'

?oä( -#"n (in cu* (8@ 3#9 ;oä( (8@ i8än cu"#?oä( -#"n (in cu* (8@ 3#9 ;oä( (8@ i8än cu"#<u#) (=n ng#>u ni86n /o)'<u#) (=n ng#>u ni86n /o)'

 Tin ($)c co) #i 3o#*i: Tin ($)c co) #i 3o#*i:o  Tin ($)c 3i86n (u*c Tin ($)c 3i86n (u*co  Tin ($)c %9i #*c' Tin ($)c %9i #*c'

?oä( -#"n (in 3i86n (u*c o#9n (o#9n ($%ng /$%ng?oä( -#"n (in 3i86n (u*c o#9n (o#9n ($%ng /$%ng%)i ;oä( -#"n (in %9i #*c <u# /0n 3B) 3#.B ;#>u%)i ;oä( -#"n (in %9i #*c <u# /0n 3B) 3#.B ;#>u#nnon#nnon

V= #äBD /8@ /%n gi#"nD (# c F8)( (in ($)c %9i #*c'V= #äBD /8@ /%n gi#"nD (# c F8)( (in ($)c %9i #*c'

Page 4: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 4/61

 

 Tin ($)c Tin ($)c

 T#.( c#" c#)c -#"n (in cu"# ;oä( nguo1n (in T#.( c#" c#)c -#"n (in cu"# ;oä( nguo1n (in/81u /$%*c (#9n 3#ä4 ($9 ;oä( -oä 7B)/81u /$%*c (#9n 3#ä4 ($9 ;oä( -oä 7B)i8äu B;-o3 cu"# nguo1n (in /o)'i8äu B;-o3 cu"# nguo1n (in /o)'

Go*i -oä 7B) i8äu n#9B 3#9Go*i -oä 7B) i8äu n#9B 3#9 AAD #9 gi#" $"D #9 gi#" $"-oä 7B) i8äu co) ; 7B) i8äu:-oä 7B) i8äu co) ; 7B) i8äu: ##&&D #D #22D D #D D #;;'' T# co): T# co):

A J K#A J K#iiD iJ&'';D iJ&''; ?oä( -#"n (in?oä( -#"n (in MM 3#9 d#B c#)c 7B) i8äu3#9 d#B c#)c 7B) i8äu #i#i 

/$%*c F#O4 F8.4 (8o ;oä( ($) ($* n#9o /o):/$%*c F#O4 F8.4 (8o ;oä( ($) ($* n#9o /o):MJ FMJ F&&D FD F22D D FD D Fnn FFii  € A € A

Page 5: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 5/61

 

 Tin ($)c Tin ($)c

V! du &: Ti8.( -0 4#)( (!n i8äu ?o8 $"V! du &: Ti8.( -0 4#)( (!n i8äu ?o8 $"du*ng (ong /i8än -#)o:du*ng (ong /i8än -#)o:o Nguo1n (in A co) + 7B) i8äu 3#9: PNguo1n (in A co) + 7B) i8äu 3#9: P''QD PQD P    QD P QQD P Q

7o#"ng (#Ong7o#"ng (#OngS  T$)c 3#9 # T$)c 3#9 #&& J PJ P''QD #QD #22 J PJ P    QD #9 #QD #9 #++ J PJ P  QQ

o Gi#" $" nguo1n (in n#9B 4#)( # -#"n (in:Gi#" $" nguo1n (in n#9B 4#)( # -#"n (in:S M J ' M J ' c$ A'c$ A'

#"n (in n#9B co): F#"n (in n#9B co): F&& J P'QD FJ P'QD F22 J PQJ PQS MJ ' ' 'MJ ' ' ' c$ 'c$ '

#"n (in n#9B co): F#"n (in n#9B co): F&& J PQD FJ PQD F22 J P'QD FJ P'QD F++ J P'QD FJ P'QD F J P'QJ P'QS MJ ' ' ' ' MJ ' ' ' ' c$ A'c$ A'

#"n (in n#9B co): F#"n (in n#9B co): F&& J PQD FJ PQD F22 J P'QD FJ P'QD F++ J P'QD FJ P'QD F J P'QJ P'Q

FF55 J P QD FJ P QD F J P'QD FJ P'QD F J PQJ PQ

Page 6: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 6/61

 

 Tin ($)c Tin ($)c

V! du* 2: ?#)B /i8än (o*#i di /oängV! du* 2: ?#)B /i8än (o*#i di /oängn#On (in c#)c (in (i8.ng An:n#On (in c#)c (in (i8.ng An:

o Nguo1n (in A go1; c#)c 7B) i8äu 3#9: #D -DNguo1n (in A go1; c#)c 7B) i8äu 3#9: #D -DcD D WD XD &D D #9 c#)c d#.u'cD D WD XD &D D #9 c#)c d#.u'S  T$)c 3#9 # T$)c 3#9 #&& J P#QD #J P#QD #22 J P-QD #J P-QD #++ J PcJ Pc  QD #2 J PWQD #2 J PW 

QQ

o Gi#" $" nguo1n (in n#9B 4#)( # -#"n (in:Gi#" $" nguo1n (in n#9B 4#)( # -#"n (in:S M J di uong c#Z8M J di uong c#Z8

#"n (in n#9B co): F#"n (in n#9B co): F&& J PdQD FJ PdQD F22 J PiQD FJ PiQD F++ J PJ PQD FQD F J PuQD J PuQD

Page 7: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 7/61

 

 Tin ($)c Tin ($)c

,o.i %)i ng$%9i n#än (inD 7i /o@i co> c#)c,o.i %)i ng$%9i n#än (inD 7i /o@i co> c#)c7B) i8äu %)i n#uD noäi dung (in (#B /o@i'7B) i8äu %)i n#uD noäi dung (in (#B /o@i'

V%)i 8ä (o.ng (uB81n (inD 7i /o@i co>DV%)i 8ä (o.ng (uB81n (inD 7i /o@i co>Do. 3#1n Fu#.( i8än cu"# c#)c 7B) i8äu 3#9o. 3#1n Fu#.( i8än cu"# c#)c 7B) i8äu 3#97o6ng /o@i #9 7o6ng #"n $%"ng (%)i7o6ng /o@i #9 7o6ng #"n $%"ng (%)i<u#) (=n (uB81n (in'<u#) (=n (uB81n (in'

M8)( (86n <u#n /i8@; (uB81n (inD (# cM8)( (86n <u#n /i8@; (uB81n (inD (# c<u#n (#6; (%)i 7#" n#[ng Fu#.( cu"# c#)c<u#n (#6; (%)i 7#" n#[ng Fu#.( cu"# c#)c7B) i8äu (ong -#"n (in ;#9 7o6ng <u#n7B) i8äu (ong -#"n (in ;#9 7o6ng <u#n(#6; (%)i 0 (! cu"# ($9ng 7B) i8äu'(#6; (%)i 0 (! cu"# ($9ng 7B) i8äu'

Page 8: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 8/61

 

 Tin ($)c Tin ($)c

N$ #äBD ;oä( nguo1n (in co) (8@ /$%*cN$ #äBD ;oä( nguo1n (in co) (8@ /$%*c;o6 (#" -#\ng -oä 7B) i8äu;o6 (#" -#\ng -oä 7B) i8äu AJK#AJK#iiD iJ&'';D iJ&''; 

#9 F#)c u#.( Fu#.( i8än c#)c 7B) i8äu#9 F#)c u#.( Fu#.( i8än c#)c 7B) i8äu/o)/o) 4#4#ii''

]B) i8äu nguo1n:]B) i8äu nguo1n: KAD 4#KAD 4#iiD iJ&'';D iJ&''; ?oä( 48)4 -i8.n /o@i (o@ng <u#)( (ong 8ä?oä( 48)4 -i8.n /o@i (o@ng <u#)( (ong 8ä

(o.ng (uB81n (in 3#9 48)4 -i8.( /o@i ($9(o.ng (uB81n (in 3#9 48)4 -i8.( /o@i ($9-oä 7B) i8äu n#9B #ng -oä 7B) i8äu 7#)c:-oä 7B) i8äu n#9B #ng -oä 7B) i8äu 7#)c:

KAD 4#KAD 4#iiD iJ&'';D iJ&''; ^_^_ KD 4-KD 4- ` `D `J&''nD `J&''n

Page 9: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 9/61

 

 Tin ($)c Tin ($)c

V! du* &: a#)( (!n i8äu ?o8 ($*c c#.(V! du* &: a#)( (!n i8äu ?o8 ($*c c#.(3#9 48)4 -i8.n3#9 48)4 -i8.n

o T$9 -oä 7B) i8äu: T$9 -oä 7B) i8äu: KbAD bD ' ' ' D bD bXD b&D' ' 'DKbAD bD ' ' ' D bD bXD b&D' ' 'Dbbo e#ng -oä 7B) i8äu:e#ng -oä 7B) i8äu: Kb'D bD b bKb'D bD b b

 Tu (!n i8äu ?o8 3#9 48)4 -i8.n /o@i Tu (!n i8äu ?o8 3#9 48)4 -i8.n /o@i

ng$%*c 3#*i:ng$%*c 3#*i:o T$9 -oä 7B) i8äu: T$9 -oä 7B) i8äu: Kb'D bD b bKb'D bD b bo e#ng -oä 7B) i8äu:e#ng -oä 7B) i8äu:KbAD bD ' ' ' D bD bXDKbAD bD ' ' ' D bD bXD

b&D' ' 'D bb&D' ' 'D b

Page 10: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 10/61

 

 Tin ($)c Tin ($)c

V! du* 2: a8)4 ;# o#) (ong c% c#.uV! du* 2: a8)4 ;# o#) (ong c% c#.u-i8.n /o@i Af (!n i8äu (o#*i:-i8.n /o@i Af (!n i8äu (o#*i:

o T$9 -oä 7B) i8äu: T$9 -oä 7B) i8äu: 25 ;$)c 3$%*ng ($"D ;o>i #25 ;$)c 3$%*ng ($"D ;o>i # ii 3#9 ;oä( ;$)c 3$%*ng ($"3#9 ;oä( ;$)c 3$%*ng ($"o e#ng -oä 7B) i8äu:e#ng -oä 7B) i8äu: KbXD b&KbXD b&

a8)4 gi#"i ;# (ong c% c#.u -i8.n /o@ia8)4 gi#"i ;# (ong c% c#.u -i8.n /o@i

fA (!n i8äu (o#*i 3#9 48)4 -i8.n /o@ifA (!n i8äu (o#*i 3#9 48)4 -i8.n /o@ing$%*c 3#*i:ng$%*c 3#*i:o T$9 -oä 7B) i8äu: T$9 -oä 7B) i8äu: KbXD b&KbXD b&o e#ng -oä 7B) i8äu:e#ng -oä 7B) i8äu: 25 ;$)c 3$%*ng ($"25 ;$)c 3$%*ng ($"

Page 11: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 11/61

 

L$%*ng /o (in ($)c 3$%*ng (inL$%*ng /o (in ($)c 3$%*ng (in

H8ä (o.ng (uB81n (in c <u#n (#6; (%)iH8ä (o.ng (uB81n (in c <u#n (#6; (%)i7#" n#[ng Fu#.( i8än ;#9 7o6ng <u#n7#" n#[ng Fu#.( i8än ;#9 7o6ng <u#n(#6; (%)i ($) ($* Fu#.( i8än c#)c cu"# c#)c(#6; (%)i ($) ($* Fu#.( i8än c#)c cu"# c#)c7B) i8äu #7B) i8äu #ii''

?oä( (in?oä( (in c#9ng !( Fu#.( i8än c#9ng co) gi#)c#9ng !( Fu#.( i8än c#9ng co) gi#)(0(0''

 Tin Tin Fu#.( i8än c#9ng ni81u c#9ng !( gi#) (0Fu#.( i8än c#9ng ni81u c#9ng !( gi#) (0'' ,8@ /#)n gi#) gi#) (0 cu"# (inD ng$%9i (# /$#,8@ /#)n gi#) gi#) (0 cu"# (inD ng$%9i (# /$#

# 7#)i ni8ä;# 7#)i ni8ä; 3$%*ng /o (in ($)c3$%*ng /o (in ($)c 3$%*ng (in3$%*ng (in''

Page 12: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 12/61

 

,0n ngh# 3$%*ng (in,0n ngh# 3$%*ng (in

L$%*ng (in cu"# ;oä( 7B) i8äu #i 3#9L$%*ng (in cu"# ;oä( 7B) i8äu #i 3#9;oä( #9; I#;oä( #9; I#iiD 4u* (uoäc #9o 7#"D 4u* (uoäc #9o 7#"

n#[ng Fu#.( i8än cu"# 7B) i8äu /o):n#[ng Fu#.( i8än cu"# 7B) i8äu /o):

o N8.u c% o. 3#9N8.u c% o. 3#9 88 (= ($) nguB86n 3#9(= ($) nguB86n 3#9 n#(n#(o N8.u c% o. 3#9N8.u c% o. 3#9 &X&X (= ($) nguB86n 3#9(= ($) nguB86n 3#9

H#38BH#38Bo N8.u c% o. 3#9N8.u c% o. 3#9 22 (= ($) nguB86n 3#9(= ($) nguB86n 3#9 -i(-i(

)(log)(

1log)( i

i

i   a pa p

a I    −==

Page 13: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 13/61

 

L$%*ng (in i86ngL$%*ng (in i86ng

Co nguo1n (in KADa#Co nguo1n (in KADa#iiD iJ&'';D iJ&''; L$%*ng (in c$)# (ong ;o>i ;o>i (in #L$%*ng (in c$)# (ong ;o>i ;o>i (in #ii 

/$%*c go*i 3#9 3$%*ng (in i86ng cu"# (in/$%*c go*i 3#9 3$%*ng (in i86ng cu"# (in/o):/o):

)(log)(

1log)( i

i

i   a pa p

a I    −==

Page 14: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 14/61

 

L$%*ng (in i86ngL$%*ng (in i86ng

V! du* &V! du* &: ?oä( nguo1n (in go1; co) -o.n 7B): ?oä( nguo1n (in go1; co) -o.n 7B)i8äu (in 3#9 KXXD X&D &XD && /#ng F#)ci8äu (in 3#9 KXXD X&D &XD && /#ng F#)cu#.('u#.('o T$)c 3#9 a# T$)c 3#9 a#&& J a# J a#22 J a# J a#++ J a# J a#J&fJ&fo V#äBV#äB I#I#&& J I# J I#22 J I# J I#++ J I# J I#J 3ogJ 3og22 &f&fJ2 -i(&f&fJ2 -i(

V! du* 2V! du* 2: ?oä( nguo1n (in go1; co) j 7B) i8äu: ?oä( nguo1n (in go1; co) j 7B) i8äu

(in 3#9 KXXXD XX&D D &&& /#ng F#)c(in 3#9 KXXXD XX&D D &&& /#ng F#)cu#.('u#.('o T$)c 3#9 a# T$)c 3#9 a# ii J &fj J &fj iJ&''jiJ&''j

o V#äBV#äB I#I#ii J 3og J 3og22 &f&fjJ+ -i(&f&fjJ+ -i( iJ&''jiJ&''j

Page 15: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 15/61

 

L$%*ng (in i86ngL$%*ng (in i86ng

V! du* +V! du* +: ?oä( nguo1n (in go1; co) #i: ?oä( nguo1n (in go1; co) #i7B) i8äu (in 3#9 KXD & /#ng F#)c7B) i8äu (in 3#9 KXD & /#ng F#)c

u#.('u#.('o T$)c 3#9 a# T$)c 3#9 a#&& J a# J a#22 J&f2 J&f2

o V#äBV#äB I#I#&& J I# J I#22 J 3og J 3og22 &f&f2J& -i(&f&f2J& -i(

Page 16: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 16/61

 

L$%*ng (in i86ngL$%*ng (in i86ng

V! du* V! du* : ?oä( nguo1n (in go1; co) -#: ?oä( nguo1n (in go1; co) -#7B) i8äu (in 3#9 KXD &XD&& co)7B) i8äu (in 3#9 KXD &XD&& co)

F#)c u#.( n$ #u:F#)c u#.( n$ #u:o abX J kl a&X J&fl a&&J&fabX J kl a&X J&fl a&&J&fo T=; 3$%*ng (in i86ng cu"# ($9ng (inm T=; 3$%*ng (in i86ng cu"# ($9ng (inm

Page 17: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 17/61

 

L$%*ng (in i86ngL$%*ng (in i86ng

V! du* 5V! du* 5: ?oä( nguo1n (in go1; co): ?oä( nguo1n (in go1; co)c#)c 7B) i8äu (in 3#9 KXDc#)c 7B) i8äu (in 3#9 KXD

&XD&&XD&&& co) F#)c u#.( n$&XD&&XD&&& co) F#)c u#.( n$#u:#u:o abX J kl a&X J&fl a&&XJ&fjlabX J kl a&X J&fl a&&XJ&fjl

a&&&J&fja&&&J&fj

o T=; 3$%*ng (in i86ng cu"# ($9ng (inm T=; 3$%*ng (in i86ng cu"# ($9ng (inm

Page 18: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 18/61

 

L$%*ng (in i86ngL$%*ng (in i86ng

V! du* V! du* : ?oä( nguo1n (in go1; co): ?oä( nguo1n (in go1; co)c#)c 7B) i8äu (in 3#9 K#&D#2D #+D #Dc#)c 7B) i8äu (in 3#9 K#&D#2D #+D #D

#5D#D # co) F#)c u#.( n$ #u:#5D#D # co) F#)c u#.( n$ #u:o a#& J &fl a#2 J&fjl a#+J&fjla#& J &fl a#2 J&fjl a#+J&fjla#J&fja#J&fj

  a#5 J &f&l a# J&f&l a#J&fa#5 J &f&l a# J&f&l a#J&f

o T=; 3$%*ng (in i86ng cu"# ($9ng (inm T=; 3$%*ng (in i86ng cu"# ($9ng (inm

Page 19: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 19/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

 Tong (uB81n (inD n8.u 786n (uB81n 3#9 Tong (uB81n (inD n8.u 786n (uB81n 3#93B) ($%"ngD (# 8 co) $* -i8.n /o@i 3B)3B) ($%"ngD (# 8 co) $* -i8.n /o@i 3B)

($%"ng ($9 nguo1n KAD 4#iD iJ&''n #ng($%"ng ($9 nguo1n KAD 4#iD iJ&''n #ngnguo1n KD4-iD iJ&''n 3#9 &^&nguo1n KD4-iD iJ&''n 3#9 &^&  T$)c 3#9: T$)c 3#9:

o ,#1u 4#)( 4#)( (in #,#1u 4#)( 4#)( (in # ii co) 3$%*ng (inco) 3$%*ng (in I#I#iiJJ

^3og4#^3og4#iio ,#1u (u (u (in -,#1u (u (u (in - ii co) 3$%*ng (inco) 3$%*ng (in I-I-iiJ ^3og4-J ^3og4-ii

o  T= T= I#I#ii J I- J I-ii

Page 20: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 20/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

]86n (uB81n 3B)($%"ng

a1  b1

P(b1/a1)=1

a2  b2

P(b2/a2)=1

a3  b3P(b3/a3)=1

an

 bn

P(bn/an)=1

 .

 .

 .

 .

 .

 .

 .

 .

Page 21: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 21/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

 Tong ($*c (8.D c#)c 786n (uB81n Tong ($*c (8.D c#)c 786n (uB81n($%9ng FuB86n co) ni8>uD 3#9; co($%9ng FuB86n co) ni8>uD 3#9; co

F#)c u#.( (u /$%*c c#)c (inF#)c u#.( (u /$%*c c#)c (in --ii 7i7i4#)( (in4#)( (in ##ii gi#"; Fuo.ng'gi#"; Fuo.ng' a#1n co9n 3#*i 8 3#9 F#)c u#.( (ua#1n co9n 3#*i 8 3#9 F#)c u#.( (u

/$%*c c#)c (in/$%*c c#)c (in --77DD 77≠ i≠ i #9#9 7J&''n7J&''n''

Page 22: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 22/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

]86n (uB81n co)ni8>u

a1  b1

P(b1/a1) < 1

a2  b2

a3  b3

an

 bn

 .

 .

 .

 .

 .

 .

 .

 .

Page 23: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 23/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

]86n (uB81n co)ni8>u

a1  b1

a2  b2

P(b2/a2)<1

a3  b3

an

 bn

 .

 .

 .

 .

 .

 .

 .

 .

Page 24: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 24/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

]86n (uB81n co)ni8>u

a1  b1

a2  b2

a3  b3P(b3/a3)<1

an

 bn

 .

 .

 .

 .

 .

 .

 .

 .

Page 25: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 25/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

]86n (uB81n co)ni8>u

a1  b1

a2  b2

a3  b3

an

 bn

P(bn/an)<1

 .

 .

 .

 .

 .

 .

 .

 .

Page 26: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 26/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

]86n (uB81n co)ni8>u

a1  b1

a2  b2

ai  bi

an

 bn

 .

 .

 .

 .

 .

 .

 .

 .

 .

 .

 .

 .

 .

 .

 .

 .

Page 27: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 27/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

N$ #äBD 7i 4#)( /i ni81u (inN$ #äBD 7i 4#)( /i ni81u (in ## ` `D (#D (#/81u co) (8@ n#än /$%*c (in/81u co) (8@ n#än /$%*c (in --ii %)i%)i

F#)c u#.( Fu#.( i8än 7#)c n#u'F#)c u#.( Fu#.( i8än 7#)c n#u'  Tong c#)c (in Tong c#)c (in ## ` ` /o) co) & (in/o) co) & (in ##ii /u)ng/u)ng

3#9 ($%ng $)ng %)i3#9 ($%ng $)ng %)i --ii' C#)c (in co9n 3#*i' C#)c (in co9n 3#*ido ni8>u (#)c /oäng ;#9 cuB8@ndo ni8>u (#)c /oäng ;#9 cuB8@n

(#9n(#9n --ii'' V#.n /81 /#( # 3#9 4#"i F#)c /0nV#.n /81 /#( # 3#9 4#"i F#)c /0n

/$%*c (in/$%*c (in ##ii ($%ng $)ng %)i($%ng $)ng %)i --ii (u /$%*c'(u /$%*c'

Page 28: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 28/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

]86n (uB81n co)ni8>u

a1  b1

a2  b2

a3  b3

an

 bn

 .

 .

 .

 .

 .

 .

 .

 .

Page 29: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 29/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

V#.n /81 /$%*c gi#"i <uB8.( -#\ngV#.n /81 /$%*c gi#"i <uB8.( -#\ngc#)c (=; 3$%*ng (in cu"# c#)c (inc#)c (=; 3$%*ng (in cu"# c#)c (in ## ` ` 

c$)# (ong (inc$)# (ong (in --ii (u /$%*c S go*i 3#9(u /$%*c S go*i 3#93$%*ng (in ($%ng o> gi$#3$%*ng (in ($%ng o> gi$# ## ` ` #9#9 --ii''  Tin Tin ## ` ` n#9o co) 3$%*ng (in ($%ng o> %)in#9o co) 3$%*ng (in ($%ng o> %)i

--ii 3%)n n#.( 3#9 (in3%)n n#.( 3#9 (in ##ii c#1n (=;'c#1n (=;'

Page 30: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 30/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

,0n ngh#,0n ngh#:: Löôïng tin töông hoã giöõaLöôïng tin töông hoã giöõa aa j j vaøvaø bbii laø löôïng tin veàlaø löôïng tin veà aa j j chöùa trong tinchöùa trong tin bbii 

C#)c (!nC#)c (!n: L$%*ng (in ($%ng o> gi$#: L$%*ng (in ($%ng o> gi$# ## ` ` #9#9--ii 3#9 3$%*ng c$)# (ong (in3#9 3$%*ng c$)# (ong (in ## ` ` ($9 /i 3$%*ng($9 /i 3$%*ng(in co9n 3#*i cu"#(in co9n 3#*i cu"# ## ` ` #u 7i /# n#än /$%*c#u 7i /# n#än /$%*c(in(in --ii 

]B) i8äu] B) i8äu:: II## ` ` ll --ii 

Page 31: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 31/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

V#äB:V#äB:

II## ` ` ll --ii  J I J I## ` ` ^ I ^ I## ` ` ff --ii 

J 3og 4J 3og 4## ` ` ff --ii  f 4 f 4## ` ` &&

 Tong /o): I Tong /o): I## ` ` ff --ii  3#9 3$%*ng (in co) 3#9 3$%*ng (in co)/i81u 7i8änD /o) 3#9 3$%*ng (in cu"#/i81u 7i8änD /o) 3#9 3$%*ng (in cu"# ## ` ` -0 (#*4 ni8>u 4#) u"B'-0 (#*4 ni8>u 4#) u"B'

Page 32: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 32/61

 

L$%*ng (in ($%ng o>L$%*ng (in ($%ng o>

 T8o co6ng ($)c #B8: T8o co6ng ($)c #B8:

 T#B #9o & (# /$%*c: T#B #9o & (# /$%*c:

V#äB:V#äB:

 Tong /o): Tong /o): 4-4-iif#f# ` ` 3#9 F#)c u#.( n#än /$%*c (in3#9 F#)c u#.( n#än /$%*c (in--ii 7i #7i # ` ` /$%*c (uB81n /i /$%*c (uB81n /i /#c (!n ni8>u cu"#/#c (!n ni8>u cu"#786n786n''

∑   =

=n

 j Aj B P  Aj P 

 Aj B P  Aj P  B Aj P 

1)/().(

)/().()/(

=

∑   =)(

1.

)/().(

)/().(log)/(

1  j

n

 j   ji j

 ji j

i ja pab P a P 

ab P a P ba I 

∑  =

=n

 j   ji j

 ji

i j

ab P a P 

ab P ba I 

1 )/().(

)/(log);(

Page 33: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 33/61

 

 T!n c#.( cu"# 3$%*ng (in T!n c#.( cu"# 3$%*ng (in

 T!n c#.( cu"# 3$%*ng (in: co) + (!n T!n c#.( cu"# 3$%*ng (in: co) + (!nc#.( c#.(  xem taøi lieäu, trang 73 xem taøi lieäu, trang 73

 T!n c#.( &: T!n c#.( &:  T!n c#.( 2: T!n c#.( 2:  T!n c#.( +: T!n c#.( +:

Page 34: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 34/61

 

L$%*ng (in (ung -=nL$%*ng (in (ung -=n

 Tong ($*c (8.D (# 7o6ng <u#n (#6; (%)i Tong ($*c (8.D (# 7o6ng <u#n (#6; (%)i3$%*ng (in c$)# (ong ($9ng (in /%n 38" ;#93$%*ng (in c$)# (ong ($9ng (in /%n 38" ;#9<u#n (#6; (%)i 3$%*ng (in c$)# (ong ;oä(<u#n (#6; (%)i 3$%*ng (in c$)# (ong ;oä(

(#ä4 %*4 (in'(#ä4 %*4 (in' V= #äBD ng$%9i (# /$# # 7#)i ni8ä; 3$%*ngV= #äBD ng$%9i (# /$# # 7#)i ni8ä; 3$%*ng

(in (ung -=n cu"# ;oä( nguo1n (in'(in (ung -=n cu"# ;oä( nguo1n (in' ,0n ngh#,0n ngh#:: Löôïng tin trung bnh cu!a moätLöôïng tin trung bnh cu!a moät

nguoàn tin laø tin töùc trung bnh chöùa trongnguoàn tin laø tin töùc trung bnh chöùa trongmoät "#ù hieäu ba$t "#ø cu!a nguoàn tinmoät "#ù hieäu ba$t "#ø cu!a nguoàn tin%où%où''

]B) i8äu] B) i8äu:: IAIA

Page 35: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 35/61

 

L$%*ng (in (ung -=nL$%*ng (in (ung -=n

Gi#" $" co) nguo1n (in KGi#" $" co) nguo1n (in KADa#ADa#iiD iJ&''nD iJ&''n

L$%*ng (in (ung -=n /$%*c (!n:L$%*ng (in (ung -=n /$%*c (!n:

 T$) nguB86n: -i(f7B) i8äup T$) nguB86n: -i(f7B) i8äup

∑∑   ==  −==  n

i   ii

n

i

i

i   a pa p

a p

a p A I 11

)(log).(

)(

1log).()(

Page 36: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 36/61

 

L$%*ng (in (ung -=nL$%*ng (in (ung -=n

V! du* V! du* : Gi#" $" co) nguo1n (in KbXD&: Gi#" $" co) nguo1n (in KbXD&/#ng F#)c u#.(' T=; 3$%*ng (in i86ng cu"#/#ng F#)c u#.(' T=; 3$%*ng (in i86ng cu"#($9ng 7B) i8äu #9 3$%*ng (in (ung -=n cu"#($9ng 7B) i8äu #9 3$%*ng (in (ung -=n cu"#nguo1nnguo1n

Page 37: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 37/61

 

L$%*ng (in (ung -=nL$%*ng (in (ung -=n

V! du &V! du & *  * : Gi#" $" co) nguo1n (in KbXD& /#ng: Gi#" $" co) nguo1n (in KbXD& /#ngF#)c u#.(' T=; 3$%*ng (in i86ng cu"# ($9ng 7B)F#)c u#.(' T=; 3$%*ng (in i86ng cu"# ($9ng 7B)i8äu #9 3$%*ng (in (ung -=n cu"# nguo1ni8äu #9 3$%*ng (in (ung -=n cu"# nguo1n

Gi#"iGi#"i L$%*ng i86ng cu"# ($9ng (in:L$%*ng i86ng cu"# ($9ng (in:

IbX J I& J 3ogIbX J I& J 3og22 &f&f2 J&f&f2 J & -i(p& -i(p L$%*ng (in (ung -=n cu"# nguo1n:L$%*ng (in (ung -=n cu"# nguo1n:

IM J 4bX'IbX q 4b&'Ib&IM J 4bX'IbX q 4b&'Ib&J k'& q k'& JJ k'& q k'& J & -i(f7B) i8äup& -i(f7B) i8äup

&aä# "hi nguoàn %a'ng xaùc (ua$t th löôïng tin&aä# "hi nguoàn %a'ng xaùc (ua$t th löôïng tinrie)ng cu!a töøng tin ba*ng löôïng tin trungrie)ng cu!a töøng tin ba*ng löôïng tin trungbnh cu!a nguoànbnh cu!a nguoàn''

Page 38: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 38/61

 

L$%*ng (in (ung -=nL$%*ng (in (ung -=n

V! du 2V! du 2 *  * : Gi#" $" co) nguo1n (in KbXD& %)i: Gi#" $" co) nguo1n (in KbXD& %)iF#)c u#.( Fu#.( i8än c#)c 7B) i8äu bX #9 b&F#)c u#.( Fu#.( i8än c#)c 7B) i8äu bX #9 b&3#1n 3$%*( 3#9 XD #9 XDX&' T=; 3$%*ng (in i86ng3#1n 3$%*( 3#9 XD #9 XDX&' T=; 3$%*ng (in i86ng

cu"# ($9ng 7B) i8äu #9 3$%*ng (in (ung -=ncu"# ($9ng 7B) i8äu #9 3$%*ng (in (ung -=ncu"# nguo1ncu"# nguo1nGi#"iGi#"i

IbX J 3ogIbX J 3og22 &fXD J&fXD J Ib& J 3ogIb& J 3og22 &fXDX& J&fXDX& J D5 -i(pD5 -i(p IM J 4bX'IbX q 4b&'Ib&IM J 4bX'IbX q 4b&'Ib&  J XD'3ogJ XD'3og22&fXD q XDX&'3og&fXD q XDX&'3og22&fXDX&&fXDX&  JJ XDXj& -i(f7B) i8äupXDXj& -i(f7B) i8äup +haän xeùt löôïng tin rie)ng cao cu!a -./ nhöng+haän xeùt löôïng tin rie)ng cao cu!a -./ nhöng

löôïng tin trung bnh ra$t tha$01löôïng tin trung bnh ra$t tha$01

Page 39: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 39/61

 

L$%*ng (in (ung -=nL$%*ng (in (ung -=n

V! du* +V! du* +: ?oä( nguo1n (in go1; co) -o.n 7B): ?oä( nguo1n (in go1; co) -o.n 7B)i8äu (in 3#9 KXXD X&D &XD && /#ngi8äu (in 3#9 KXXD X&D &XD && /#ngF#)c u#.('F#)c u#.('o T=; 3$%*ng (in i86ng #9 3$%*ng (in (ung -=n T=; 3$%*ng (in i86ng #9 3$%*ng (in (ung -=n

V! du* V! du*

: ?oä( nguo1n (in go1; co) j 7B): ?oä( nguo1n (in go1; co) j 7B)

i8äu (in 3#9 KXXXD XX&D D &&& /#ngi8äu (in 3#9 KXXXD XX&D D &&& /#ngF#)c u#.('F#)c u#.('o T=; 3$%*ng (in i86ng #9 3$%*ng (in (ung -=n T=; 3$%*ng (in i86ng #9 3$%*ng (in (ung -=n

Page 40: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 40/61

 

L$%*ng (in (ung -=nL$%*ng (in (ung -=n

V! du* 5V! du* 5: ?oä( nguo1n (in go1; co) -#: ?oä( nguo1n (in go1; co) -#7B) i8äu (in 3#9 KXD &XD&& co)7B) i8äu (in 3#9 KXD &XD&& co)

F#)c u#.( n$ #u:F#)c u#.( n$ #u:o abX J kl a&X J&fl a&&J&fabX J kl a&X J&fl a&&J&fo T=; 3$%*ng (in i86ng cu"# ($9ng (in #9 T=; 3$%*ng (in i86ng cu"# ($9ng (in #9

3$%*ng (in (ung -=n cu"# nguo1n (in'3$%*ng (in (ung -=n cu"# nguo1n (in'

Page 41: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 41/61

 

L$%*ng (in (ung -=nL$%*ng (in (ung -=n

V! du* V! du* : ?oä( nguo1n (in go1; co): ?oä( nguo1n (in go1; co)c#)c 7B) i8äu (in 3#9 KXDc#)c 7B) i8äu (in 3#9 KXD

&XD&&XD&&& co) F#)c u#.( n$&XD&&XD&&& co) F#)c u#.( n$#u:#u:o abX J kl a&X J&fl a&&XJ&fjlabX J kl a&X J&fl a&&XJ&fjl

a&&&J&fja&&&J&fj

o T=; 3$%*ng (in i86ng cu"# ($9ng (in #9 T=; 3$%*ng (in i86ng cu"# ($9ng (in #93$%*ng (in (ung -=nm3$%*ng (in (ung -=nm

Page 42: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 42/61

 

L$%*ng (in (ung -=nL$%*ng (in (ung -=n

V! du* V! du* : ?oä( nguo1n (in go1; co): ?oä( nguo1n (in go1; co)c#)c 7B) i8äu (in 3#9 K#&D#2D #+D #Dc#)c 7B) i8äu (in 3#9 K#&D#2D #+D #D

#5D#D # co) F#)c u#.( n$ #u:#5D#D # co) F#)c u#.( n$ #u:o a#& J &fl a#2 J&fjl a#+J&fjla#& J &fl a#2 J&fjl a#+J&fjla#J&fja#J&fj

  a#5 J &f&l a# J&f&l a#J&fa#5 J &f&l a# J&f&l a#J&f

o T=; 3$%*ng (in i86ng cu"# ($9ng (in #9 T=; 3$%*ng (in i86ng cu"# ($9ng (in #93$%*ng (in (ung -=nm3$%*ng (in (ung -=nm

Page 43: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 43/61

 

L$%*ng (in ($%ng o> (ungL$%*ng (in ($%ng o> (ung

-=n-=n  T$%ng ($* n$ 3$%*ng (in i86ngD I# T$%ng ($* n$ 3$%*ng (in i86ngD I# ` `l-l-iicc

co -i8.( 3$%*ng (in cu"# #co -i8.( 3$%*ng (in cu"# # ` ` c$)# (ong -c$)# (ong -ii''

 Tong ($*c (8.D (# <u#n (#6; (%)i Tong ($*c (8.D (# <u#n (#6; (%)i 3$%*ng3$%*ng(in (ung -=n cu"# nguo1n A c$)# (ong(in (ung -=n cu"# nguo1n A c$)# (ong;oä( (in -#.( 7B9 cu"# nguo1n S /$%*c;oä( (in -#.( 7B9 cu"# nguo1n S /$%*cgo*i 3#9 3$%*ng (in ($%ng o> (ung -=ngo*i 3#9 3$%*ng (in ($%ng o> (ung -=n''

]B) i8äu] B) i8äu:: IAlIAl

Page 44: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 44/61

 

L$%*ng (in ($%ng o> (ungL$%*ng (in ($%ng o> (ung

-=n-=n

L$%*ng (in ($%ng o> (ung -=n /$%*c (!n:L$%*ng (in ($%ng o> (ung -=n /$%*c (!n:

∑ ∑∑   = ===

  n

i

m

 ji

 ji

 ji B A a p

ba pba p

a p

ba pba p B A I 

1 1, )(

)/(log)..(

)(

)/(log)..();(

Page 45: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 45/61

 

L$%*ng (in (ung -=n co)L$%*ng (in (ung -=n co)

/i81u 7i8än:/i81u 7i8än: ]i (uB81n (in ($9 nguo1n A #ng nguo1n D ;oä(]i (uB81n (in ($9 nguo1n A #ng nguo1n D ;oä(

4#1n cu"# A -0 (#*; ni8>u 4#) u"B #94#1n cu"# A -0 (#*; ni8>u 4#) u"B #97o6ng (%)i /$%*c '7o6ng (%)i /$%*c '

,8@ /#)n gi#) ;$)c /oä 4#) u"B n#9BD (# co),8@ /#)n gi#) ;$)c /oä 4#) u"B n#9BD (# co)7#)i ni8ä; 3$%*ng (in (ung -=n co) /i81u 7i8än:7#)i ni8ä; 3$%*ng (in (ung -=n co) /i81u 7i8än:

,#6B c!n 3#9 3$%*ng (in (ung -=n cu"# nguo1n A,#6B c!n 3#9 3$%*ng (in (ung -=n cu"# nguo1n A-0 ;#.( /i do (#*4 ni8>u (ong <u#) (=n (uB81n-0 ;#.( /i do (#*4 ni8>u (ong <u#) (=n (uB81n#ng '#ng '

V#äB:V#äB: IAD J IA S IAfIAD J IA S IAf

∑ ∑= =−=

  n

i

m

 j   ji ji   ba pba p B A I 1 1

)/(log)..()/(

Page 46: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 46/61

 

,oä -#.( /0n cu"#,oä -#.( /0n cu"#

nguo1n (innguo1n (in ?oä( (o6ng o. c% -#"n cu"# (in ($)c 3#9 /oä?oä( (o6ng o. c% -#"n cu"# (in ($)c 3#9 /oä

-#.( /0n cu"# (inD 7B) i8äu:-#.( /0n cu"# (inD 7B) i8äu: H#H#ii

,oä -#.( /0n cu"# ;oä( (in 3#9 3$%*ng (in,oä -#.( /0n cu"# ;oä( (in 3#9 3$%*ng (incu"# (in /o) n$ng F8)( (#*i (%9i /i8@; c$#cu"# (in /o) n$ng F8)( (#*i (%9i /i8@; c$#n#än /$%*c (in n#9B'n#än /$%*c (in n#9B'

N$ #äBD 81 ;#( gi#) (0:N$ #äBD 81 ;#( gi#) (0:

H#H#ii

J I# J I#ii

J ^ 3og J ^ 3og22

4#4#ii

-i(p-i(p ,oä -#.( /0n cu"# ;oä( nguo1n (in co) gi#),oä -#.( /0n cu"# ;oä( nguo1n (in co) gi#)(0 -#\ng 3$%*ng (in (ung -=n cu"# nguo1n(0 -#\ng 3$%*ng (in (ung -=n cu"# nguo1n(in /o):(in /o):   ∑∑   ==

  −==  n

i   ii

n

ii

i   a pa pa p

a p A H 11

)(log).()(

1log).()(

Page 47: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 47/61

 

,oä -#.( /0n cu"#,oä -#.( /0n cu"#

nguo1n (innguo1n (in  T!n c#.( cu"# /oä -#.( /0n: T!n c#.( cu"# /oä -#.( /0n:

o HAHA r Xr X

o HA J X 7iHA J X 7i A co) ;oä( 7B) i8äu c#OcA co) ;oä( 7B) i8äu c#Occ#On Fu#.( i8än #9 c#)c 7B) i8äu co9nc#On Fu#.( i8än #9 c#)c 7B) i8äu co9n3#*i c#Oc c#On 7o6ng Fu#.( i8än'3#*i c#Oc c#On 7o6ng Fu#.( i8än'

o HA J HAHA J HA;#F;#F 7i c#)c 7B) i8äu cu"#7i c#)c 7B) i8äu cu"#

nguo1n 3#9 /#ng F#)c u#.('nguo1n 3#9 /#ng F#)c u#.('

Page 48: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 48/61

 

,oä -#.( /0n /o1ng,oä -#.( /0n /o1ng

(%9i(%9i ,oä -#.( /0n /o1ng (%9i 3#9 /oä -#.(,oä -#.( /0n /o1ng (%9i 3#9 /oä -#.(

/0n (ung -=n cu"# ;oä( c#4 #/0n (ung -=n cu"# ;oä( c#4 # iiD-D- ` `

-#.( 7B9 (ong 48)4 -i8.n /o@i ($9-#.( 7B9 (ong 48)4 -i8.n /o@i ($9ngu%9n A #ng nguo1n ngu%9n A #ng nguo1n '' ]B) i8äu:]B) i8äu: HAHA V#äB:V#äB:

∑ ∑= ==  n

i

m

 ji

 ji ji

a p

ba pba p AB H  1 1 )(

)/(log)..()(

Page 49: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 49/61

 

,oä -#.( /0n co) /i81u,oä -#.( /0n co) /i81u

7i8än7i8än ,oä -#.( /0n co) /i81u 7i8än 3#9 /oä,oä -#.( /0n co) /i81u 7i8än 3#9 /oä

-#.( /0n (ung -=n cu"# ;oä( 7B)-#.( /0n (ung -=n cu"# ;oä( 7B)

i8äu #i8äu #ii (uoäc (#ä4 A 7i /# -i8.((uoäc (#ä4 A 7i /# -i8.(;oä( 7B) i8äu -#.( 7B9 -;oä( 7B) i8äu -#.( 7B9 - ` ` (uoäc (#ä4(uoäc (#ä4''

]B) i8äu:]B) i8äu: HAfHAf V#äB:V#äB:

∑ ∑= =−=

  n

i

m

 j   ji ji   ba pba p B A H 1 1

)/(log).,()/(

Page 50: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 50/61

 

 To.c /oä 3#ä4 (in To.c /oä 3#ä4 (in

,8@ /#)n gi#) ;$)c /oä n#n c#ä;,8@ /#)n gi#) ;$)c /oä n#n c#ä;cu"# <u#) (=n 4#)( (in ($9 ;oä(cu"# <u#) (=n 4#)( (in ($9 ;oä(

nguo1n (inD (# $" du*ng 7#)i ni8ä;nguo1n (inD (# $" du*ng 7#)i ni8ä;(o.c /oä 3#ä4 (in cu"# nguo1n (in'(o.c /oä 3#ä4 (in cu"# nguo1n (in' ,0n ngh#:,0n ngh#: 2o$c %oä laä0 tin cu!a2o$c %oä laä0 tin cu!a

moät nguoàn tin laø löôïng tin maømoät nguoàn tin laø löôïng tin maø

nguoàn tin %où 0haùt ra trong moät %ônnguoàn tin %où 0haùt ra trong moät %ônv thôøi gian1v thôøi gian1

]B) i8äu:]B) i8äu:  RARA

Page 51: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 51/61

 

 To.c /oä 3#ä4 (in To.c /oä 3#ä4 (in

C#)c (!n:C#)c (!n:

RA J nRA J nXX ' HA J n' HA J nXX ' IA' IA

 T$) nguB86n: -i(fp T$) nguB86n: -i(fp  Tong /o): Tong /o):

o nnXX 3#9 o. 7B) i8äu do nguo1n 4#)( #3#9 o. 7B) i8äu do nguo1n 4#)( #(ong ;oä( /%n 0 (%9i gi#n'(ong ;oä( /%n 0 (%9i gi#n'

o HA 3#9 /oä -#.( /0n cu"# nguo1n (in'HA 3#9 /oä -#.( /0n cu"# nguo1n (in'o IA 3#9 3$%*ng (in (ung -=n cu"# nguo1nIA 3#9 3$%*ng (in (ung -=n cu"# nguo1n

(in'(in'

Page 52: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 52/61

 

 To.c /oä 3#ä4 (in To.c /oä 3#ä4 (in

V! du &V! du & *  * : Gi#" $" co) nguo1n (in KbXD&: Gi#" $" co) nguo1n (in KbXD&/#ng F#)c u#.(' Nguo1n (in n#9B 4#)( #/#ng F#)c u#.(' Nguo1n (in n#9B 4#)( #'XXX 7B) i8äu (ong ;oä( gi#6B' T=; (o.c'XXX 7B) i8äu (ong ;oä( gi#6B' T=; (o.c

/oä 3#ä4 (in cu"# nguo1nm/oä 3#ä4 (in cu"# nguo1nmGi#"iGi#"i

L$%*ng (in (ung -=n cu"# nguo1n:L$%*ng (in (ung -=n cu"# nguo1n:

HA J 4bX'IbX q 4b&'Ib&HA J 4bX'IbX q 4b&'Ib&

J k'& q k'& JJ k'& q k'& J & -i(f7B) i8äup& -i(f7B) i8äup nnXX J 'XXX 7B) i8äu f J 'XXX 7B) i8äu f &aä# 456 8 n&aä# 456 8 n99 x :56 8 ;<1999 bit=( 8 ;< x :56 8 ;<1999 bit=( 8 ;<

>bit=(>bit=(

Page 53: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 53/61

 

 To.c /oä 3#ä4 (in To.c /oä 3#ä4 (in

V! du 2V! du 2 *  * : Gi#" $" co) nguo1n (in K#&D#2D #+D: Gi#" $" co) nguo1n (in K#&D#2D #+D# /#ng F#)c u#.(' Nguo1n (in n#9B 4#)(# /#ng F#)c u#.(' Nguo1n (in n#9B 4#)(# &'XXX 7B) i8äu (ong ;oä( gi#6B' T=; (o.c# &'XXX 7B) i8äu (ong ;oä( gi#6B' T=; (o.c

/oä 3#ä4 (in cu"# nguo1nm/oä 3#ä4 (in cu"# nguo1nmGi#"iGi#"i

L$%*ng (in (ung -=n cu"# nguo1n:L$%*ng (in (ung -=n cu"# nguo1n:

HA JHA J -i(f7B) i8äup-i(f7B) i8äup nnXX J 7B) i8äu f J 7B) i8äu f &aä# 456 8 n&aä# 456 8 n99 x :56 8 bit=( x :56 8 bit=(

Page 54: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 54/61

 

 To.c /oä 3#ä4 (in To.c /oä 3#ä4 (in

V! du* +V! du* +: ?oä( nguo1n (in go1; co): ?oä( nguo1n (in go1; co)c#)c 7B) i8äu (in 3#9 K#&D#2D #+D #Dc#)c 7B) i8äu (in 3#9 K#&D#2D #+D #D

#5D#D # co) F#)c u#.( n$ #u:#5D#D # co) F#)c u#.( n$ #u:o a#& J &fl a#2 J&fjl a#+J&fjla#& J &fl a#2 J&fjl a#+J&fjla#J&fja#J&fj

  a#5 J &f&l a# J&f&l a#J&fa#5 J &f&l a# J&f&l a#J&f

o Nguo1n n#9B 4#)( # 5XXX 7B) i8äu (ongNguo1n n#9B 4#)( # 5XXX 7B) i8äu (ong;oä( gi#6B' T=; (o.c /oä 3#ä4 (in cu"#;oä( gi#6B' T=; (o.c /oä 3#ä4 (in cu"#nguo1nmnguo1nm

Page 55: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 55/61

 

 To.c /oä 3#ä4 (in To.c /oä 3#ä4 (in

V! du* V! du* : T!n (o.c /oä 3#ä4 (in cu"#: T!n (o.c /oä 3#ä4 (in cu"#;oä( nguo1n (in 3#9 ;oä( -oä -i8.n;oä( nguo1n (in 3#9 ;oä( -oä -i8.n

/o@i Af (!n i8äu (o#*i %)i (#1n o./o@i Af (!n i8äu (o#*i %)i (#1n o.3#.B ;#>u 3#9 j ]W #9 3$%*ng ($"3#.B ;#>u 3#9 j ]W #9 3$%*ng ($"o#) 25 ;$)c'o#) 25 ;$)c'

Page 56: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 56/61

 

 To.c /oä 3#ä4 (in To.c /oä 3#ä4 (in

V! du* V! du* : T!n (o.c /oä 3#ä4 (in cu"# ;oä(: T!n (o.c /oä 3#ä4 (in cu"# ;oä(nguo1n (in 3#9 ;oä( -oä -i8.n /o@i Af (!nnguo1n (in 3#9 ;oä( -oä -i8.n /o@i Af (!ni8äu (o#*i %)i (#1n o. 3#.B ;#>u 3#9 ji8äu (o#*i %)i (#1n o. 3#.B ;#>u 3#9 j]W #9 3$%*ng ($" o#) 25 ;$)c']W #9 3$%*ng ($" o#) 25 ;$)c'

Gi#"iGi#"i  T#1n o. 3#.B ;#>u J j ]W ^_ T#1n o. 3#.B ;#>u J j ]W ^_ nnXX J jXXX 7B)J jXXX 7B)

i8äufi8äuf L$%*ng ($" o#) 25 ;$)cL$%*ng ($" o#) 25 ;$)c

^_ IA J 3og^_ IA J 3og22 &f&f25J 3og&f&f25J 3og22 22jj JJ j -i(f7B) i8äuj -i(f7B) i8äu V#äB:V#äB: RA J jXXX F j J 'XXX -i(f J ]-i(fRA J jXXX F j J 'XXX -i(f J ]-i(f

Page 57: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 57/61

 

 To6ng 3$%*ng 786n To6ng 3$%*ng 786n

,0n ngh#:,0n ngh#: 2ho)ng löôïng "e)nh laø löôïng2ho)ng löôïng "e)nh laø löôïngtin to$i %a coù the?tin to$i %a coù the? /i <u# 786n/i <u# 786n trong moättrong moät%ôn v thôøi gian maø "ho)ng coù loãi1%ôn v thôøi gian maø "ho)ng coù loãi1

]B) i8äu:]B) i8äu:  CC -i(fp-i(fp ?o>i 3o#*i ;o6i ($%9ng (uB81n d#>n 7#)c?o>i 3o#*i ;o6i ($%9ng (uB81n d#>n 7#)c

n#u 8 co) (o6ng 3$%*ng 786n 7#)cn#u 8 co) (o6ng 3$%*ng 786n 7#)cn#un#u

No)i cungD (o6ng 3$%*ng 786n ($%9ng 3#9No)i cungD (o6ng 3$%*ng 786n ($%9ng 3#9#.( 3%)n o %)i (o.c /oä 3#ä4 (in cu"##.( 3%)n o %)i (o.c /oä 3#ä4 (in cu"#nguo1n'nguo1n'

Page 58: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 58/61

 

 To6ng 3$%*ng 786n To6ng 3$%*ng 786n

,8@ $" du*ng co) i8äu <u#" 786n (uB81nD,8@ $" du*ng co) i8äu <u#" 786n (uB81nD(# c#1n (#[ng (o.c /oä 3#ä4 (in cu"# nguo1n'(# c#1n (#[ng (o.c /oä 3#ä4 (in cu"# nguo1n'

 T$%9ng co) 2 c#)c: T$%9ng co) 2 c#)c:

o  T#[ng n T#[ng nXX: 7B (u#ä( g8)4 786n (8o (%9i gi#nD: 7B (u#ä( g8)4 786n (8o (%9i gi#nD$" du*ng ;# 4#)( i8än 3o>iD ;# $"# #i ;#$" du*ng ;# 4#)( i8än 3o>iD ;# $"# #i ;#co.ng ni8>u'co.ng ni8>u'

o  T#[ng HA: c#)c 7B (u#ä( /i81u c8. o. T#[ng HA: c#)c 7B (u#ä( /i81u c8. o.

C _ RAR(A)

Page 59: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 59/61

 

V! ds: T!n 3tng (inV! ds: T!n 3tng (in

V! du* : a8)4 -i8.n /o@i Af (!n i8äuV! du* : a8)4 -i8.n /o@i Af (!n i8äu(o#*i: (vn w 3xB ;yu: z J j7WD 3$%*ng ($"(o#*i: (vn w 3xB ;yu: z J j7WD 3$%*ng ($"o)# 25 ;$)c' T!n (o.c /oä 3#ä4 (in cu"#o)# 25 ;$)c' T!n (o.c /oä 3#ä4 (in cu"#-oä -i8.n /o@i Af'-oä -i8.n /o@i Af'

Gi#"iGi#"i::o RA J nRA J nXX F HAF HA &&

o nnXX  J z J jXXX ;#>u f   J z J jXXX ;#>u f o Nguo1n /#ng F#)c u#.( n86n HA J IA JNguo1n /#ng F#)c u#.( n86n HA J IA JI#I#ii J 3og J 3og22&f4#ip J 3og&f4#ip J 3og2225p J 3og25p J 3og2222jjp J j -i(p J j -i(f;#>uf;#>u

o RA J nRA J nXX F HA J jXXX F j J XXX -i(f'F HA J jXXX F j J XXX -i(f'

Page 60: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 60/61

 

 To#*i To#*i

 N0 = Fs = 8000

H(A) = I(A) = 8

A/

 To*#i

eo.

jXXXFj

Page 61: Chuong 2- Tin & Luong Tin

7/17/2019 Chuong 2- Tin & Luong Tin

http://slidepdf.com/reader/full/chuong-2-tin-luong-tin 61/61

Voic8 ^ (88oVoic8 ^ (88o

 N0 = Fs = 32 !"#

H(A) = I(A) = 12

A/

L eo.

+2{&X|+ { &2{2R