View
0
Download
0
Category
Preview:
Citation preview
!"#$%&'()*+%,-./012
34"56789:
;4"<=
>4"?@
A4"#$%&'()*+%,:<B
C4"<=D3
E4"<=D;
F4"GHIJ@
!(x)
K56789:
LMN#$%&'()*+%,OPQRSTU-VWXYZ78[O\]^_`a0ZbcdeRf`g
Lh:N0i:N-i:56jkl@56mnop560qSreN-i:56nstuvw56"""0x`#$%&'()*+%,OP`XYnyz`0Sa-XY{|}56^\]de`g
L#$%&'()*+%,OPQRS~�-VWXYZ��O\]^_`��^{�fg
34"56789:���������!����������!��!���!�����������!�����������!��!
"����������!��������!��!������!��� ��¡��!¢�����!¢�� ��¡�!£!
"¤¥¦§¦¨!¥§©!�!¥¦£ª
�«ª!¬����¡��!������������!��!��������������!��!�!������®��!
"���������!¯���ª!¬������!°������!°������!£!¤¥¦§¦¨!©±©!�!©¥²ª
�����!³����¡�!¯���������!���®��� ��®!��� ��¡�!���!���´�����!
"��������������!¢�����!¢�� ��¡�!£!¤¥¦§¦¨!©µ¦!�©¶¶ª
�����!³���¡�!¢�����!¢�� ��¡�!²!¤¥¦¦¥¨!£µ¥ª
�·ª¸ª!������´����!¢�����!¢�� ��¡�!²!¤¥¦¦¥¨!©§¥ª
�ª¹ª!«�������!³ª!º�����!¢�����!¢�� ��¡�!µ!¤¥¦¦£¨!¥£¦ª
K�ª!���������-».
».3""
¼""½¾»6S¿ÀSÁÂÃÄSVW56""
¼�½¹�!-ÅÆÇ,*�ÈÉÊËj¿ÀÌÈÉÊËm""
¼"""""½�Í-1VW56
"ÎTU-"""OÏqRS
"Ð6¢S1»6S��!�!Ñ�!¤�Ò¥�£�ªªª¢¨�! �Ó!¤�Ò¥�£�ªªª¢�!ÓÒ¥�£�ªªª�¨!ÔÕg""
"Ö×nØÙxPÚOx`a0ZiÛ`g
"aa^S
!(x)
f (x1, x
2,...xn )
! > 0
maxr
x !Kf(x
1,x
2, ...xn ) " ˜ f (x
1, x
2,...xn ) < #
˜ f (x1,x
2, ...x
n) = c
i! w
ijx
j"#
ij= 1
n
$%
& '
(
) *
i= 1
N
$
LÜÝxeÞS"
"¹�!-ÅÆÇ,*�ÈÉÊËj¿ÀÌÈÉÊËm�Í-1VW56""""""""""ZßzàeÙ0_STU-""""OÏqRSreN-i:56n"""j¾»6S¿ÀSÁÂÃÄSVW56mSh:Náâi:N-i:56nop0x`SÖ-PÚ�>N#$%&'()*+%,ZÔÕx`gãäSa-#$%&'()*+%,OP`XYn""""""""0qRÖ×ZØÙde`g"!!!!
f (x1, x
2,...xn )
! > 0 !(x)
f (x1, x
2,...xn )
maxr
x !Kf(x
1,x
2, ...xn ) " ˜ f (x
1, x
2,...xn ) < #
».;""
¼"""½¾»6S¿ÀSÁÂÃÄSVW56""
¼�½¹�!-ÅÆÇ,*�ÈÉÊËj¿ÀÌÈÉÊËm""
¼Ð6"""
¼TU-VWXY""½"
"ãäS
a-0_STU-""""OÏqRSreN-i:56n""j¾»6S¿ÀSÁÂÃÄSVW56mSh:Náâi:N-i:56nop0x`SÖ-PÚ�¡N#$%&'()*+%,ZÔÕx`gãäSa-#$%&'()*+%,OP`XYn""""""""0qRÖ×ZØÙde`g!!!!!
!(x)
k ! 3
f K !Rm
! > 0
!(x)
r
f : K !Rm
!
x = (x1,x2,...xn )" ( f1(x), f2 (x),...fm (x))
!
maxx"K
d( f (x),)
f (x)) < #
;4<=
K<=0?@
L#$%&'()*+%,XY-åæd"
"çèéê%ënTUìí^<=x`9:½Áîïð"
Lñqfê%ën\]"
"ç?@
K<=ò'óôõö"
÷øùqfúûn0`PÚOSüýþ#)*Zÿ!"#@x`Ù$-J%[&D'
!"#$%&
'()*+,-./
01#
!"#$%&
234%5/
67
3mê'ë'%'(")*0+,--.@½&Æ/ö0"h:,0øùqfi:,n123"i:,-üý4")*-ÂÐ""56Z7qf0_½""""""""""øùqfi:{38]1-i:{9½""øùqfi:{98]1-i:{3½
!
wi (t +1) = wi (t)
wi (t +1) = wi (t) + xi (t)
wi (t +1) = wi (t) " xi (t)
KÇ%:;*<Æ-<=jê'ë'%'m=>lbc
aa^S������ê%ë?à�������ê%ëO@Ax`g
56Z7qf0_½""""""""øùqfi:{38]1-i:{�¥½øùqfi:{�¥8]1-i:{3½
!
wi (t +1) = wi (t)
wi (t +1) = wi (t) + xi (t)
wi (t +1) = wi (t) " xi (t)
a-BC{SÖ-PÚO\]x`0�?DExfg
"h:Çë%ÆF{ÊËGHI`f{ÊËGJOKqRf`gÇë%ÆFnÇ%:;*<ÆOh:x`0SFZÊËGHOKqRf`LO{M¥nSFZGJOKqRf`LO{�¥ni:x`gê'ë'%'OP`¿NO-<=^Ç%:;*<ÆZa-PÚOP9x`PÚOx`a0Z^_`g
"a-a0n2xÙ$Oê'ë'%'nÖ-PÚOQ_RqRSTg
("UVv*¼W,*'"--.@0"ÊË"""""""?àÇë%ÆFnXY3""""""�àÞ0ZS[e\]{4Z4"""""""0qR0Z
!
F = F+" (#F
#)
!
w "X > 0
!
w
!
w" w +X
^h:ZGHOKx`LSi:{M¥SGJOKx`LSi:{�¥"""{"""""-PÚO_`@qRI`a-0x`
!
X
!
X = 1
bc½Çë%ÆbcnGH0GJOÉdx`ÁeW,*'""ZÔÕx`0x`g
!
w*
!
w*"X > # $# > 0 for%X & F = F+
' ((F()
ÖO2xf"""n»gx`g
!
G(w)
3m4nh`L-"""-Éi-@@
""4njOhQÙk-"""-,
;m4nh`L-"""-Él-@@
""4njOhQÙk-Él-,
!
G(w)
!
w*"w
t +1 = w*(w
t+X) = w
*"w
t+w
*"X #$
!
w*"w
n# n$
!
w*"w
!
G(w)
!
wt +1
2= w
t +1 "wt +1 = (wt
+X) " (wt
+X) = wt
2+ 2w
t"X + X
2< w
t
2+1
!
wn
2< n
!
G(w) =w* "w
w=cos# w
w= cos# $ 1
%
& ' '
(
) * *
!
" 1#G(w) =w*$w
w>
n%
n
" n &1
% 2
qÙZQRS¿NO-mý^=>x`g
nü[<=./
èéID<=Oop
èéID<=-uê'{Ö->q-rÉ?àrDsq
("tu½h:W,*'
""jvw�íÉx"""""{y»deRf`Zzcm
0"èéê%ë½h:W,*'"OÏ%{
""jvw�íÉx"""""{y»deRf`Zzcm
3"<=|}j#$%&'()*+%,m
èéID<=0{Sèéê%ën78x`56nSnü[�U~^XY;<:�0��xa0Z^_`g
!
x
!
FX(y | x)
!
x
!
d = f (x," )
!
FX(d | x)
!
y = F(x,w)
K<=ò'óôõö-É�
3mèéID<=0èé�q<="
LèéID<=j°����´���®!��������m½XÞeÙh:O
"ÏqR7qf�zZ�?QRf`0qR����Z�T"
Lèé�q<=j�������´���®!��������m½XÞeÙh:
"OÏqR7qf�zn�à�f^����Z�T
;m�7<=0�@<="
L¬�������´�!��������½
"<=O�ÙQR{h:W,*'0��-�_d^�7"
L¹������������!��������½
"<=O�ÙQR{�zZ7qf?�?��^��""
"ç"Ç%:;*<Æ<=
Learn ing
!"
Superv ised
Learn ing
#$%&!"
Unsupervised
Learn ing
#$'(!"
Correct ive
Learn ing
)*!"
Re inforcement
Learn ing
+,!"
Re inforcement
Learn ing
+,!"
Competit ive
Learn ing
-./!"
Kèé�q<=-�½bcÉd"
LBC½;Ö�bcOÉxx`�n,&�ë%OÉ�g
"¼�-�Z�-,&�ë%OKx`?�à�fg
"¼~�OS,&�ë%ZfTqI`?a�?à�fg
L�()*+%,
¼a-BC{Ö-PÚ�É�()*+%,^|Tg
C lass i f i e r
Network
x
y
Cluster 1
Cluster 2
Cluster 3
¼Ö-�OqfRSÁ~-Ç%:;*<Æ^{S"n
"�QR_RS
r W
OÏqR""""0{^_�fZS
n�z�9^I`g
!
"
h:W,*'-Éx06Z�?QRfeÞ�h:W,*'-�\nX `g
!
"p# P
"n# N
!
W "p # 0
W "n < 0
!
W1,W2,W3
L¬���������!¡������""
"",&�ë%-60ÉxZzc-LS
÷fTqüýþ#)*n¢UxeÞPf?£'
÷fTq�\[UVv*n0eÞPf?£'n¤$`BCg"
¼�½¥¦-6""
3m°������!��!������njÖ�ê%ëW,*'O@Ü""
;maenfTqOÉ�xeÞPf?£"
¼<=ò'óôõö-�""
""Ö-�OSfRS<=nyz`g""
3m�üýþ#)*^)*§_-¨nüý""
;m©ª[«¬n�QRS)*§_¨ZI�O�`þ#)*
""��®
x
x
W
W
W
W
W
W
1
2
11
12
21
22
31
32
Cluster 1
Cluster 2
Cluster 3
�������´���®!��������!�������!�����������
Ç%:;*<Æ<=-~�@
L~�[OSÖ-BCnyz`g""
¯BC°"jÖ�bc-7_@deÙW,*'-ÊË
""""""n±²-,&�ë%OÉ�qÙfg""
¯&D°jh:S±i:-¬���������!��� ��¡nyz`g
""""³vò�{90x`g
"3m7_@qÙUVv*""""""n&Æ/öO´`g"
";mh:ê%ë""""n&Æ/öOXYg""
">m"""""""""""nüýx`g""
"AmI�-)*§_¨nßz`þ#)*µ-UVv*""nXYg
"Cm"""""""0qRUVv*Añx`gUVv*{7_@x`g""
""Î"�þ#)*{,&�ë%O¶_q�àeRfTg
!
X = (x1,x2,...x l)
!
W1,W2,...WK
!
x j " X
!
x j "Wi (i = 1,2,...K)
!
Wm
!
Wm "x j #Wi "x j , i = 1,2,...K
!
Wm "Wm + x j
>4"?@j3m·¸
L�OP`?@9:-¹c
"3Ö�ê%뺻)¼»Ætnyz`g
"ê%ë"""""""nS56""""O�R{$`g
!
xi (i = 1,2,...I)
!
x = x(t)
½n�_Tx`a0^S""""-78ìí{fTà^a;àe`ZS¿à?�t&ºO�à�fg
ç"?@9:-ÀÁSÂ%³%º»)¼»Æt
!
xi ") x (ti ) " x(ti ),
) x (t) = a
l#
l(x)
l=1
L
$
E =) x (ti ) % xi( )
2
i=1
I
$
!
xi ") x (ti )
L?@9:-~�[ÃÄ
"Åd�()*+%,"Î"Æf\]:
"�_�()*+%,"Î"j<=ê%ë-mÇf\]:
"È�ê%ëOaÇf\]:"ÉÉÎ"Çf?@9:
L?@9:-ÊË
""«¬fÌÍ
""ôÎÆ;ôÆtD
""·¬Ö�
L?@9:-ÄÍ
""º�����!Ï����
""Ðvõ-§Ä
j;m"?@9:
K#$%&'()*+%,ÑÒí-IJ@""
"*Ó%wº½Çf?@9:SÙTùqdj����������m""""""""""""
""""""""""ÔÕ"""""""""
"ÇfìíSaÖdj�����������m"
""ç"�����×�!�����!¤��¡���×�!�����¨Ø!�� !��!���������"""
"�¢�ÑÒ@nÙ�IaÚÛ�./n0` _0ÝÚÜÝ
"^���������Ø"ÞßS�ä
KÑÒí½à78-Ù$-Ç&á%ë-6
K?@9:j«�������������m""
""âã-Ù$O2de`�-ÊËZzä©�åË^aS7qf~�[_Ýnæç^_`9:g
�¡ª!¬����´����!°ª!¡����������!è�������ª!�������!²!¤¥¦§é¨!¥¥¦¦ª
�·ª!·����¡�!ª!¬���´����¡���!��!���!�������!���´�������!��!������´�!���ê���������!�´����!��!�����!��������������!ë�����!��!¡������������!��®!���!�����������!¥¶!¤¥¦é¥¨!£¶²!�!£§±ª
K÷ìf'?@-Ù$-í¸îï
j3m<=qPÚ0qRf`56ZSI`U~^S¿à"""
"""?�a0g
j;m<=Çë%Æ-6ZMfa0SáâS[eàZ?"""
"""@-Ïð0x`©R-åË-ÊË-ñ^÷�\["""
"""�'ÈÉÊË^I`a0g""""
"""ç"ë��!·����¡�¬���´����¡��!®��������
K?@9:-I`<=
"j��mòjÑÒímç"IÅS"
""<=-)¸�óC"ç"IJ�÷ÑÒí'n»$`a0""
"""Áîxô`uê'¼¼¼õ<[GHnöz_e�fg"""""""""""""
"""j��®����������m""
"""ÑÒxô`uê'¼¼¼Ðvõù^uê'@x`g""""""""""""""
"""j�´����������m
KóC
""3muê'Z�` T÷1O<=x`a0
"";muê'O�` Tÿøín�Ùù`a0
j>m?@��¼?@9:-ÊË
L<=Pú-?@��
!
(xi ,yit);xi " (xi1,...xid ) # R
d,yi
t " (yi1t,...yim
t) # R
m,1$ i $ n{ }
) y =
) f w (x) " (
)
f 1(x),...)
f m (x))
e(xi ,yi ,w) " yij %)
f j (xi )( )j =1
m
&2
l(w) " e(xi ,yi ,w)
i=1
n
&
R(w) " E[e(x,y,w)] = L e(x,y,w)q(x,y)dxdy''
<=ê%ë½
<=û*i:½
²ü��½
<=��½
?@��½
L«¬f-»g
L«¬f-Áe
L«¬f-lý
0fÚþðnÿçqÙ0_O!`«¬f
!
"
#
nÿçqR«¬Z"#x`a0{�f?à
!
X = xk X = xk | k = 0,±1,±2,...± K{ }( )
I (xk ) = log1
pk
"
# $
%
& ' = ( logpk
!
nats (loge ) bits (log2)
!
I (xk ) = 0 for pk = 1
I (xk ) " 0 for 0 # pk # 1
X = xk
I (xk ) > I (xi ) for pk < pi
LVÆ*<$%
-%&,{
½&Æ/ö@6'-VÆ*<$%
!
I (xk )
H (X) = E[I (xk )]= pkI (xk )
k="K
K
# = " pk logpk
k="K
K
#
H (X)
0 log 0 $ 0
0 % H (X) % log(2K +1)
LVÆ*<$%-lý
("I`"OqfR"""-L��
""j÷zv»lZ�f'0fÚa0m
0"x R-"OqfR""""""-L��
""j(©T�?à�f'0fÚa0m
!
k
!
pk = 1
!
H (X) = 0
!
k
!
pk = 1/(2K +1)
!
H (X) = log(2K +1)
K�������¡��������"Ï�´�������""j�������¡��������«¬fm
½�-»g)
½æ»qÙÇ&á%ë
½æ»qÙvw�íÉx
½*-Ç&á%ë
½*-vw�íÉx
½�������¡��������«¬f
!
S
w = (w1,.....wL)
p(x |w)
w*
= (w1*,.....wL
* )
p(x |w*)
L(w,w*)
L(w,w*) = p(x |w*) logp(x |w*)
p(x |w)
"
# $
%
& '
x(S
)
= p(x |w*) logp(x |w*)
x(S
) * p(x |w*) logp(x |w)
x(S
) �������¡��������!Ï�´�������{*-|0æ»|-+,n2xg
!
S(x) " logx +1
x#1$ 0 for %x > 0
S(x) = 0& x = 1
' p1( (x) logp1(x)
p2 (x)
)
* +
,
- . dx = p1(x) S
p1(x)
p2 (x)
)
* +
,
- . #
p2 (x)
p1(x)+1
/
0 1
2
3 4 ( dx
= p1(x)( Sp1(x)
p2 (x)
)
* +
,
- . dx# p2 (x)dx( # p1(x)dx([ ]
= p1(x)( Sp1(x)
p2 (x)
)
* +
,
- . dx $ 0
!
L(w,w*) " 0
L(w,w*) = 0 for w = w*
0aÖ^S
qÙZQR
K-./j«¬fÌÍmn¢fÙ?@9:ÊË
�01S«¬fÌÍOP`>N#$%&'()*-reNþ#)*6-¤»DS
"2i«¬h3<4/56S·��ª7é©�Ï����!¢�ª¥¥!¤¥¦¦¥¨!!��!²¦±�²¦éª
3mreNþ#)*6-8�`>N#$%&'()*nÑ
""6¢UqRS[e9eS:É<=dù`g
;m[e9e-#$%&'()*-<=56OqfRSÖ
""×OPD«¬fÌÍ�¬nüýx`g
!
AIC = Nk log() " 2) + 2K,
) " 2 =
#i
2
Nki=1
N
$
!
K
N
k
"
>mIÅ�¬nßz`#$%&'()*
""-?@9:ZIaÇf0x`g
½UVv*;6
½<=ê%ë6
½i:ê%ë6
½����ê%ë��
jAm?@9:-ÄÍ
"K|¤<(½GH[=»@""
"¼reN-#$%<Æ6>?""
"¼UVv*6>?""""
"""()*+%,-ÑÒín@A'¼»0x`Bn§Ä"""""""""
"""ÑÒíÅ�*½""""
½ÑÒíÅ�*ÎC
½ÑÒíÅ�*Î9
½ºô%Ç&á%ë
DE[Oà3
!
"wi
2/w
0
2
1+ wi
2/w
0
2
i
#
wi >> w0
wi << w0
w0
K|¤<0½7Ý@
K|¤<3½<=��-FG
¼Ðvõ§_<=½1ê%ëOHùe`Ðvõ{|}O
"IJKnßz`ZLM[ÐvõjÓ�����m{¿à?�5
"6OÏx`?@9:-FGD-~q^I`g
¼N.OP½QRO6n?àx
A4"#$%&'()*+%,:<B
Kû[VW,uê'~�/"
LST&�×
L#$%&'()*+%,-V('U%
!
dui
dt= "
ui
#+ wij xj
j =1
n
$ + vi
xi =% (ui )
!
E = "1
2wij xixj
j =1
n
#i=1
n
# " vixi
i=1
n
# +1
$% "1
(y)dy0
x i&i=1
n
#
LÏV5Ës�¼ö-V('U%@@
$
n�QRS
ÎW{ÁÂ?X^IÅ�Z0Ä?Úg
!
wij = wji , (i, j = 1,2,......n)
"
"t
1
2wij xixj
j =1
n
#i=1
n
# = wij xj
j =1
n
#$
%
& &
'
(
) )
dxi
dti=1
n
#
dE
dt=
"E
"xii=1
n
# dxi
dt= * wij xj
j =1
n
# + vi *1
+, *1
(xi )
-
. /
0 /
1
2 /
3 / i=1
n
# dxi
dt= * wij xj
j =1
n
# + vi *ui
+
-
. /
0 /
1
2 /
3 / i=1
n
# dxi
dt
½ÏV5Ë
!
dE
dt= "
dui
dt
dxi
dti=1
n
#
dxi
dt=
d$ (ui )
dui
dui
dt
dE
dt= "
dui
dt
%
& '
(
) *
i=1
n
#2
d$
dui
+ 0
KMN#$%&'()*+%,0��YZ[D
j\�<=Çë%Æm
!
E =1
2X" (x) h(x) # d(x)
x$X
%2
d(x) (x$ X)
Lp[56½
L>N#$%&'()*+%,-)*½
L:<Bj]TDm
!
wij , vjk
!
dvjk
dt= "
#E
#vjk
, ( j = 0,1,2,...m,k = 1,2,...l)
dwij
dt= "
#E
#wij
, (i = 0,1,2,...n, j = 1,2,...m)
LV('U%@@
qÙZQRS
!
dE
dt" 0
!
dE
dt=
"E
"vjkk=1
l
#j = 0
m
# dE
dt=
"E
"vjkk=1
l
#j = 0
m
#dvjk
dt+
"E
"wijj =1
m
#i= 0
n
#dwij
dt= $
"E
"vjk
%
& ' '
(
) * *
k=1
l
#j = 0
m
#2
$"E
"wij
%
& ' '
(
) * *
j =1
m
#i= 0
n
#2
C4"<=D3j3m"��YZ[D
K��ÊË56jp[56m""""""
"~�OS""""
K��YZ[D-^_
"""¼Ã`DHNGH
"""¼������
"""¼af=>
"""¼bcIJ@
!
E =1
2yk (xp ,w) " yt ,k
p( )k=1
K
#p=1
P
#2
E = G(xp ,w)
p=1
P
#
j;m"��YZ[Dò'óôõö
ÂÆ&vÆDS³)dD
Kê'ë<=ÝSê'ë'%'j®���������m
""®½i:0èéê%ë-�
"" ½UVv*""""""
"""Õ"~�@"
""~�@ê'ë'%'½]TDOÌeT��YZ[D
!
"p(n ) = #$%E
%p+ &"p(n#1)
p(n )
= p(n#1)
+ "p(n )
K��jÊË56m0:<Bj\fm
""""""½Çë%Æjèéê%ëm
K]TD0:<B
""<=��n:<B-gû0qRöz`g""!!!!!!!!
!
E =1
2N"(x
n) y(x
n) # y
tn{ }2
n=1
N
$
(xn,y
tn)
!
dwij(m )
dt= "
#E
#wij(m )
dE
dt=
#E
#wij(m )
dwij(m )
dtj =1
J
$i= 0
I
$m=1
M"1
$ = "#E
#wij(m )
%
& '
( '
)
* '
+ '
2
j =1
J
$i= 0
I
$m=1
M"1
$ , 0
K��YZ[Dò'óôõö
0
1
0
1
0
1 1⇒ ⇒ ⇒
h3N""h¤��¥¨N"h�N""h¯N
I1 Im-1 Im IM
!
x(1)(p )
!
x(M)(p )h:ê%ë
i:ê%ë
!
wij(m"1)
!
xj(m )(p )
= fm (Xj(m )(p )
)
Xj(m )(p )
= wij(m"1)
i= 0
I m"1
# xi(m"1)(p )
j = 1,2,...Im
m = 2,3,...M
$
% &
'
( )
!
E = Ep
p=1
P
" = (xj(M)(p )
# yj(p )
j =1
I M
"p=1
P
" )2
3müýij
k3lUVv*Añ
""""]TDjI�Ã`Dm^��ÊË56-IÅ@
""""""""½<=wj��������!����m
""""""""""½mlBj�������!����m
""""""""""½mln6j��������!�����������m"
!
"w(t )
= #$%E
%w
&
' (
)
* +
(t )
+,"w(t#1)
!
"
!
"
!
"#w(t$1)
k;lj&Äüý
"""(""""""""""""""-üý
"""0""""""""""""""-üý"
k>lY&Äüý
"""(""""-üý"j�Ò¯�¥�¯�£�ªªªª£m
"""0""""-üý"j�Ò¯�¥�¯�£�ªªªª£m
!
....dfm
dxj(m )(p )
, xi(m"1)(p )
,.....dfM
dxj(M)(p )
, xi(M"1)(p )
#E
#xj(M )(p )
,#E
#wij(M"1)
!
"E
"xj(m )(p )
"E
"wij(m#1)
;mi:NjhoNm-üý
^3½��ÊË56jhpmOÏqRS"
^;½hpIqN-kl@56{opç""
^>½ÂÆ&vÆD^{rOqfR¨n0à�f"
!
"E
"wij(M#1)
="E
"xj(M )(p )
p=1
P
$ dfM
dXj(M)(p )
xi(M#1)(p )
!
"E
"xj(M )(p )
= (xj(M)(p )
# yj(p ))
!
dfM
dXj(M)(p )
= 1
>m~�Njh;NàhoJ3Nm-üý
^A½hphµN-kl@56{stuvw56""!!!!!!!!
!
"E
"wij(m#1)
="E
"xj(m )(p )
dfm
dXj(m )(p )
p=1
P
$ xj(m#1)(p )
"E
"xj(m )(p )
="E
"xk(m +1)(p )
k=1
I m+1
$ "xk(m +1)(p )
"xj(m )(p )
="E
"xk(m +1)(p )
k=1
I m+1
$ dfm +1
dXj(m )(p )
wjk(m )
(Q) xk(m +1)(p )
= fm +1 wik(m )xi
(m )(p )
i= 0
I m
$%
&
' '
(
)
* * ,"xk(m +1)(p )
"xj(m )(p )
=dfm +1
dXj(m +1)(p )
wjk(m )
!
fm (X) =" (X) =1
1+ e#X
dfm (X)
dX=" (X)(1#" (X))
Am;<t&sÆt-Ù$-ù0$
�!��!������!��!������
ê!��!�����Ó!��!������
êM¥!��!�����¡!��!������
!
q : 0,1,...Q = qMax
i : 0,1,...Iq"1 = iMax
j : 0,1,...Iq = jMax
k : 0,1,...Iq +1 = kMax
!
xj(q )
=" (Xj(q ))
Xj(q )
= wij(q )
xi(q#1)
i= 0
Iq#1
$
!
xi(q"1)
!
xj(q )
=" (Xj(q ))
!
xk(q +1)
!
wij(q ),Xj
(q )
�Ø!������!��!¡��´����!�����ÓØ!����!������¡Ø!������!��!����!�����
���!������!��!��!�����
®è® Ó¤�¨!!!!!!!!!!!Ø!�Ò±t�¯��®è®��Ó®è®�°Ó®è®��¢���¤¡¨!!Ø!¡Ò¥t¡¯����Ó�°Ó®���Ó�°¡��´¤�¨!!!!!!!!!!Ø!�Ò±t�¯�� ë���¤�¨!!!!!!!!!!!Ø!�Ò±t�¯�� ¢���¤¡¨!!!!!!!!!Ø!¡Ò¥t¡¯��
!
q "Q
!
"E
"wij(q )
="E
"Xj(q )
"Xj(q )
"wij(q )
="E
"xj(q )
"xj(q )
"Xj(q )
"Xj(q )
"wij(q )
="E
"xj(q )
# $ (Xj(q ))xi(q%1)
="E
"Xk(q +1)
k=1
Iq +1
& "Xk(q +1)
"xj(q )
'
(
) )
*
+
, , # $ (Xj
(q ))xi(q%1)
="E
"Xk(q +1)
k=1
Iq +1
& wjk(q +1)
'
(
) )
*
+
, , # $ (Xj
(q ))xi(q%1)
="E
"Xj(q )
xi(q%1)
"E
"Xj(q )
="E
"Xk(q +1)
k=1
Iq +1
& wjk(q +1)
'
(
) )
*
+
, , # $ (Xj
(q ))
!
q = Q
!
"E
"wij(Q )
="E
"Xj(Q )
"Xj(Q )
"wij(Q )
="E
"xj(Q )
"xj(Q )
"Xj(Q )
"Xj(Q )
"wij(Q )
="E
"xj(Q )
# ' (Xj(Q ))xi(Q$1)
"E
"Xj(Q )
="E
"xj(Q )
# ' (Xj(Q ))
j>m<=w0mln6
K<=w-U~
Lops�¼ö-<=
"
""F½""""u*ô),�jÉ""""m"
""IJ<=w"v"µÖ�bc-wxyª-z{
""""""""v"|5ú}"""-y¿,
!
p"m
!
(x1t,....xp
t)t
!
(XtX)
!
E = Xw " y2
= (Xw " y)T(Xw " y)
= wT(X
TX)w " 2y
TXw + y
Ty
L�3½opi:j;Ö�m""""""""""""""""
ç"IJ<=w{S
!
E = ax2 + by2
"x(i) = #2$ax +%"x(i #1)
"y(i) = #2$by +%"y(i #1)
!
" =1
2afor x, " =
1
2bfor y
L�;½opi:j3Ö�m
"=>~)½"""""""""""""""""""""""
"
"IJ<=w½""!!!!!!!!!!
!
E = kx2
!
"x < x + #x < x
!
E = kx2
dE
dx= 2kx, "x = #$
dE
dx= #2k$x
#x < x# 2k$x < x, % 0 < $ <1
k
!
" =1
2k
x + #x = 0
#x =1
2k
K<=w-J%��
""<=w-J%��j«¹Ø!«������!®����´�!¹�����m""""""¼��Zr�qÙ0_
¼��Z#�qÙ0_
Ù�qSa-&D{ÂÆ&vÆD-LO{ÚùTf?�fg
!
" # (1+ $up )"
" # (1% $down )"
KmlB-�d
L<=wZ�9�I�,n0`÷��'-7T^{ml
"n6a3-7T-,n0à��eÞ=>q�fga-~
")^-UVv*bc^-�`�f{�û[O�`g
jAm³)dD0ÂÆ&vÆD
KQR-�&
3m³)dD
;mÂÆ&vÆD
Xi
XiYi
Yi
NN
NN
!
E =1
2(Y
i
i=1
n
" #Yi
teacher)2
!
Ei=1
2(Y
i"Y
i
teacher)2
update W
update W
(i)
i=1,...n
LÂÆ&vÆD{��O{3�O=>q�fg=>�?à-"
"�e{<=w-�_dO�Ôx`g""
Lq?q�ZàSÂÆ&vÆDOP`UVv*bc^-�`"
"�f{&Æ/öÐvõ^{�Tº&,ë'GHn�qg""
Lops�¼ö^yz`0SÂÆ&vÆDOP`UVv*b"
"c-�`�f{�Ö56Bj�������®!��������!°�����m"
"nGrx`gãäSº&,ë'GHn�qg
>m�U��Å�DS�U��vê'D0-5n
L�U��Å�D0�U��vê'D
"jVs~Ö&�×-QR|Dm"""""
¼�U��Å�D""""¼�U��vê'D"""
!
Ax = b, A = D + E + F
!
x(k +1)
= "D"1(E + F)x
(k)+ D
"1b
!
x(k +1)
= "D"1(Ex
(k +1)+ Fx
(k)) + D
"1b
#
x(k +1)
= "(D + E)"1
Fx(k)
+ (D + E)"1b
Lops�¼ö
x
x
w
w
y=w x + w x
1
1
1
2
2
2
L<=Çë%Æ
!
x1
1w1
+ x2
1w2
= y1
x1
2w1
+ x2
2w2
= y2
x1
3w1
+ x2
3w2
= y3
P
w
w2
1
LUVv*bc^-|I`f{��
"�I�
L;Ro-��n�$`0_-�U
"��Å�D0�U��vê'D
L��YZ[DOS�`³)dD0ÂÆ&vÆDAm³)dD0ÂÆ&vÆD-~�[ÃÄ-��
³)dD ÂÆ&vÆD
<=�í � �
J%�� � �
ÇÖIJ@D-J¢ � �
KUVv*bc^-�û3m�Ö56Bj�������®!��������!°������mLçíbcOS�`òº»Æ�Å@ÜnSÅÆÇ,*��"-ÊË0[-XY�O�D�q´¢dù`0º&,ë'"GHZ´àe`g�¯ª!���������!��������!è´��� ����!¤��®����!¡�����!���®���!¥¦§§¨ª
Lòº»Æ�ÅXY"""
"""
"òº»Æ@Ü{�Ö56B-ñ?àTUOXYg"""{ò*&,ë%-���ÈÉÊËO�`g
!
x" Mx + t
det(M) < 1
an +1 = hk (an )
!
an{ }
L�Ö56B""¼F½�ÊË""¼�½çí""¼b^�fÊË?à�$RS
"""òº»Æ�ÅXY"""""Õ""¼ñqf�p-ÊË""
""¼""-=>l{ bdeRf`g"""=>¡nò*&,ë%0ÝÚg
!
hi :X " X (i = 1,....N)
!
An +1 = hj (An
j =1
N
U ), for n = 1,2,3,......
!
An{ }
L�Ö56B-�¼�ÅXY
¼�Ö56B""""
!
F1x
y
"
# $ %
& ' =
1
20
01
2
"
#
$ $ $
%
&
' ' '
x
y
"
# $ %
& ' , F2
x
y
"
# $ %
& ' =
1
20
01
2
"
#
$ $ $
%
&
' ' '
x
y
"
# $ %
& ' +
1
20
"
#
$ $
%
&
' '
F3x
y
"
# $ %
& ' =
1
20
01
2
"
#
$ $ $
%
&
' ' '
x
y
"
# $ %
& ' +
1
4
3
4
"
#
$ $ $
%
&
' ' '
!
"(A) = F1(A)#F2 (A)#F3 (A)
s¢'$Æ�£%¼��¤)*-Gr
¥m̦p""""""§máÆ�%¼�¨Æ©
"""áÆ�%¼�¨Æ©0[-̦p
;mÂÆ&vÆ��YZ[D0�Ö56BLîï""ops�¼ö""jÖ�h:W,*'jrÇë%Æm
"""
""""""½ªÇë%Æ-«rÉ"""
!
x1,...x
p
xij
y1,....yp
LUVv*Añò'óôõö¼ªÇë%Æ-��"""
¼UVv*Añj�Ò¥�£�ªªªª�m"""
"ae{Ö-PÚOQ_Üzàe`g""""""""""""""""""""""""""""""""""""""0qRS
!
Ej =1
2(w1x1
j + w2x2j + ....wn xn
j" yj
)2
wi # wi " $xij(w1x1
j + w2x2j + ....+ wn xn
j" yj
)
wi # wi " $ (w1xij x1
j + w2xij x2
j + ....+ wn xij xn
j) " $xi
j y j
Mj % mik{ },mik % xij xk
j, for i,k = 1,2,....n
w# Iw " $Mw " $t = (I " $M)w " $t
Lº&,ë'�p-�
L;Ö�ops�¼ö^Smln6n3-7¬O0QÙ0
"_-UVv*bc^-�`�fj<=wn@zRm-�jCm"��YZ[D-üýf
L��YZ[D0h-]TD-üýfnÊËx`g
LÇ&á%ë""¢½UVv*;6j÷°°þ#)*;6'0®»x`m""¯½<=Çë%Æ-;6
"""!""½©��
"""!""½Çë%ÆêOÏx`��
L3O!"nÊËx`2-üýf"à°0±�÷)*§_¨'-üýà!�¤¢¨!
!
E = Eq
q=1
Q
"
Eq
!
Eq
K]TD
LR²S!""n~qüýx`üýf½!�¤¢¨
""""Õ"!�!¢
L©UVv*OqfRS!"nüýx`üýf½�¤¢£¨
ç©Çë%ÆOqfRSaenüýx`üýf½�¤¯¢£¨
!
"Eq
"wij
!
"Eq
"wij
K��YZ[D
Lj&Äüýn~OúÚüýf½�¤¢¨
LY&Äüýn~OúÚüýf½�¤¢¨
L!"""""""-üýn~OúÚüýf½�¤¢¨
""""Õ
L©UVv*OqfRS!"nüýx`üýf½�¤©¢¨
ç©Çë%ÆOqfRSaenüýx`üýf½�¤©¯¢¨
!
"Eq
"wkj
=)
# kzj ,"Eq
"wji
= # j xi
!
"Eq
"wij
E4"<=D;
L<=-óC
"¼Ç�@
"¼Çìí@
j3m"��YZ[D-Fì
K��YZ[D-^_¼]TDHNGH¼������¼af=>¼bcIJ@K=>O5x`óC½UVv*Añf-¾~³l¼UVv*AñfO"""-p-´iZhQRf`g
¼stuvw560qRS<©�¼»),56n�Ú0S"""
¼µQRS"""^{S"""""0�`g
""ç"�_�""^{SAñfZÅdT�`g
!
d" (X)
dX
!
d" (X)
dX=" (X)(1#" (X))
!
X >> 1
!
0 <d" (X)
dX<< 1
!
X
KÏ<("¶É,·Í¾½"""""
0"56,OoprɧĽ""""""""
3"ÇÖUVv*D½""""""""""""""nAñ"""""4"stuvw56@A½"""""
!
" (X) #" (X)
d" (X)
dX#
d" (X)
dX+$
" (X) #" (X) +$X
d" (X)
dX#
d" (X)
dX+$
w # w = p +%p3
p
" (X),X = x #" (X),X = x +%x3
d" (X)
dX,X = x#
d" (X)
dx=
d" (X)
dX3%x2
KÇÖUVv*D3mÇÖUVv*D-Ü."ÂÆ&vÆDn¢fÙ��YZ[ò'óôõö^{SUVv*""-@@f""{Ö-PÚO\de`g""""!
aa^S!
stuvw56¸-¶É,{S'Ò±-7¬^�_�,n0`ZS'-¹Ï,Z�_T�`0º�OÅdT�`ga-Ù$OS¹Ï,Z�_�UVv*-»7{¼QTDq?½ù�fg[a^SUVv*"nÖ-PÚOF$`g
!!!!
!
"wi = #$%E
%wi
= #$Cd&
dX
%X
%wi
!
wi
!
"wi
!
" (X) =1
1+ exp(#X), X = wixi$
!
wi
!
Wi = wi +1
3wi
3
aa^SUVv*-Añ{��YZ[DOPD"n�$Saen¢fRúÚgÝäS¾Ö78üý{Ö-PÚO�`g""""
""""
qÙZQRS""""!
ºÒ 0qÙL-Añfn""^\x0S""""
qÙZQRS""""0�DS"-�_�c^�_�AñfZ!àe`g
!
wi
!
wi
(m +1) = wi
(m ) + "wi
(m ), "wi
(m ) = #$Cd%
dX
&X
&Wi
1+ (wi
(m ))2( )
Wi
(m ) = wi
(m ) +1
3wi
(m )( )3
, Wi
(m +1) = wi
(m +1) +1
3wi
(m +1)( )3
!
"Wi
(m )#Wi
(m +1)$Wi
(m ) = "wi
(m )1+ 3(wi
(m ))2( ) + O ("wi
(m ))2( )
!
"wi
(m ) = ") w i(m )1+ 3(wi
(m ))2( )
"Wi
(m ) = ") w i(m )1+ 3(wi
(m ))2( )2
!
wi
!
") w
;mÁ~#$%<ÆOqfR-ÇÖUVv*D-¿6"ÇÖUVv*D-¿6nvÀ-Ù$OS;h:j��!�mS3i:j�m-Á~#$%<Æn¢fR\-PÚ�ê%ënÂÆ&vÆ<=dùÙ0_-UVv*jº��!º�m-@@-³in Ùga-#$%<ÆOP`XY{Ö-PÚO\de`g
� � � �
¥ 3 �Τ¥M�¨
£ �¥ �Τ¥M�¨
© ± ±
!
z =" (Z) =1
1+ exp(#Z), Z = Wxx + Wy y
W = w
W = w +w3
3
½hpD½ÇÖUVv*D
!
1/ 3
1/ 3
3
"Í-p-XYn�ÚNDSa-<=ê%ë©ROqfR��Z9O�`|{ÔÕq�fZS%&����nIÅOx`�{º��º�%yÍ^S¤¥�±¨�!¤±�!!!!¨�!¤�¥�±¨!nÁ�0x`ÂÃp-)Ĥ±�!!!!!!!¨!^I`g�OSfR>ÖUVv*D^{a-�Z-=>Zhp-UVv*-åËPDa�fa0Z�?`g
!
1/ 3
!
3
""""""""""j¥m""""""""j§mÂÆ&vÆ<=dùÙ0_-UVv*jº��!º�m-@@j¥mhp-UVv*8j§m>ÖUVv*SÅ&0aÆÇO6-QRüýnúQRf`g
>mȪ[BCZ-J¢"Ép�y;&õu-sʺ&к%Ëáâ7ë�¶±�-Ì@e|}Oa-&DnJ¢qS[-¿¿lZ2deÙg�Ohp-UVv*n¢fÙåË0>ÖUVv*n¢fÙåË-7ë�¶±�-Ì@e|}OS�`=>Íon2xg"h:Ð%w6Si:Ð%w6S<=ê%ë6{S¥é�!¥�!²¦¥¦!g
!"!#
!"#
#
$#%#!&
! #%#!&
'%#!&
(%#!&
&%#!&)%#!
&*%#!
&
+,-(!'./01234"!'
56789:;6789:
<=>?
@ABC
j>m"ÇÖIJ@D
KÇÖ-<=D"""¼#$%*ÆD"""¼Í#$%*ÆD"""¼¾opIÅÿ�D
K��ÊË56"""
K]TD
!
E(w) =1
2yi " fi (w)[ ]
2
i=1
N
#
!
E(w +" #d) = E(w) +" # dj$E
$wjj =1
m
%&
'
( (
)
*
+ + + O(" 2)
dj = ,$E
$wj
K#$%*Æ&ºÏÆDj¢� ���!¹������!¯����®m
"""""^W{Ð,n0`jOÑ�mgaePDS
"""""a-Vs~Ö&�×n|fRS
"""""""""W-\×n¶Éx`g
"""""""""""""""""½³������!¯�����
!
w =) w
"E
"wjw=
) w
= 0 ( j = 1,2,...m) #"E
"wjw= w
(n)
+" 2E
"wk"wjk=1
m
$ %wk(n ) = 0 ( j = 1,2,...m)
w(n +1) = w
(n ) + %w(n )
"W
"wj
= &"fi
"wji=1
N
$ yi & fi (w)[ ]
" 2W
"wj"wk
="fi
"wj
"fi
"wk
&" 2 fi
"wj"wk
(yi & fi (w)
'
( ) )
*
+ , ,
i=1
N
$
KÒ)sòÆú}¸¦-üý
LïÓ-»g"""!!!
!
EW1(m,i, j) "#E
#wij(m )
=#E
#wij(m )
$
%
& &
'
(
) )
p=1
P
*(p )
EW2(m,i, j; + m , + l , + j ) "# 2E
#w + i + j ( + m )#wij
(m )=
# 2E
#w + i + j ( + m )#wij
(m )
$
%
& &
'
(
) )
(p )
p=1
P
*
¯IqNÔIqN°
!
EW2(M "1,i, j;M "1, # l , # j ) $% 2E
%w # i # j (M"1)%wij
(M"1)=
% 2E
%w # i # j (M"1)%wij
(M"1)
&
'
( (
)
*
+ +
(p )
p=1
P
,
=% 2E
%w # i # j (M"1)%xj
(M)(p )
dfM
dXj(M)(p )
xi(M"1)(p )
+%E
%xj(M)(p )
%
%w # i # j (M"1)
(dfM
dXj(M )(p )
)xi(M"1)(p )
&
'
( (
)
*
+ +
p=1
P
,
=% 2E
%x # j (M)(p )%xj
(M)(p )(
dfM
dX # j (M )(p )
)(dfM
dXj(M)(p )
) +%E
%xj(M)(p )
(d2 fM
dXj(M)(p )2
)
&
'
( (
)
*
+ + x # i (M"1)(p )xi
(M"1)(p )
p=1
P
,
¯IqNÔ~�N°
!
EW2(M "1,i, j;m "1, # i , # j )
=$ 2E
$w # i # j (m"1)$xj
(M)(p )
dfM
dXj(M)(p )
xi(M"1)(p )
+$E
$xj(M)(p )
$
$w # i # j (m"1)
(dfM
dXj(M )(p )
)xi(M"1)(p )
%
&
' '
(
)
* *
p=1
P
+
=$ 2E
$x # j (m )(p )$xj
(M )(p )
p=1
P
+ (dfm
dX # j (m )(p )
)(dfM
dXj(M)(p )
)x # i (m"1)(p )xi
(M"1)(p )
(Q)
$
$w # i # j (m"1)
(dfM
dXj(M)) =
d2 fM
dX # j (m )(p )dXj
(M )(p )= 0 (Qm , M)
!
" 2E
"x # j (m )(p )"xj
(M )(p )=
"
"xk(m +1)(p )
k=1
I m+1
$ "E
"xj(M)(p )
%
&
' '
(
)
* *
"xk(m +1)(p )
"x # j (m )(p )
=" 2E
"xk(m +1)(p )"xj
(M )(p )
dfm +1
dXk(m +1)(p )
%
& ' '
(
) * * w # j k
(m )
k=1
I m+1
$
(Q)
xk(m +1)(p )
= fm +1(Xk(m +1)(p )
) = fm +1( wik(m )xi
(m )(p )
i=1
I m
$ )
"xk(m +1)(p )
"x # j (m )(p )
=dfm +1
dXk(m +1)(p )
w # j k(m )
!
EW2(m "1,i, j;M "1, # i , # j )
=$ 2E
$w # i # j (M"1)$xj
(m )(p )
dfm
dXj(m )(p )
xi(m"1)(p )
+$E
$xj(m )(p )
$
$w # i # j (M"1)
(dfm
dXj(m )(p )
)xi(m"1)(p )
%
&
' '
(
)
* *
p=1
P
+
=$ 2E
$x # j (M )(p )$xj
(m )(p )
p=1
P
+ (dfM
dX # j (M )(p )
)(dfm
dXj(m )(p )
)x # i (M"1)(p )xi
(m"1)(p )
(Q)
$
$w # i # j (M"1)
(dfm
dXj(m )) =
d2 fm
dX # j (M)(p )dXj
(m )(p )= 0 (Q M ,m)
$ 2E
$x # j (M )(p )$xj
(m )(p )=
$ 2E
$x # j (m )(p )$xj
(M )(p )
=$ 2E
$xk(m +1)(p )$xj
(M )(p )
dfm +1
dXk(m +1)(p )
%
& ' '
(
) * * w # j k
(m )
k=1
I m+1
+
¯~�NÔ~�N°j""""""m
!
m, " m #M
!
EW2(m "1,i, j; # m "1, # i # j )
=$ 2E
$w # i # j ( # m "1)$xj
(m )(p )
dfm
dXj(m )(p )
+$E
$xj(m )(p )
$
$wij( # m "1)
(dfm
dXj(m )(p )
)
%
&
' '
(
)
* * xi(m"1)(p )
p=1
P
+
=$ 2E
$x # j ( # m )(p )$xj
(m )(p )(
df # m
dX # j ( # m )(p )
)(dfm
dX # j (m )(p )
) +$E
$xj(m )(p )
(d2 fm
dXj(m )(p )2
),m # m , j # j
%
&
' '
(
)
* * x # i ( # m "1)(p )xi
(m"1)(p )
p=1
P
+
$ 2E
$x # j ( # m )(p )$xj
(m )(p )=
$
$xk( # m +1)(p )
$E
$xj(m )(p )
%
&
' '
(
)
* *
k=1
I # m +1
+ $xk( # m +1)(p )
$x # j ( # m )(p )
(Q) xk( # m +1)(p )
= f # m +1(Xk( # m +1)(p )
) = f # m +1( wik( # m )xi
( # m )(p )
i= 0
I # m +1
+ )
$xk( # m +1)(p )
$x # j ( # m )(p )
=df # m +1
dXk( # m +1)(p )
w # j k( # m )
KÍ#$%*ÆDj¯�����¢� ���!¯����®m
"""""-*üýqR³������!¯�����!næ»x`&Dg
"""«����¯�����DS!��«°DS�����DÕM6IDg
fi (
r w
( n)),
!fi
!r w
( n)
K¾opIÅÿ�Dj«�����¢� ���DÖm
"""³������!¯�����-h;Bn�×g
"""ãäS""""""I`f{S
"""0qRS
!
" 2 fi
"wj"wk
~ 0 yi # fi (w) ~ 0
!
"fi
"wj
"fi
"wk
#
$ % %
&
' ( (
i=1
N
) *wk
k=1
N
) +"fi
"wj
yi + fi (w)[ ]i=1
N
) = 0
( j = 1,2,...m)
jAm"[-Ö-<=D-MØ
"#$%&'()*+%,-<=Lc{SII-åËSUVv*-6-Ù6560qRÃÄx`-^S()*+%,{�9�NDÅd�ÁeOÉdqÙ°ÚZÇ�^<=^_`g()*+%,-ÉdD0qR{Ö->Ú�nyz`a0Z^_`g
("h:ê%ë-Éd
"hpSi:NOqfR{3Ð%wO�`ù^Éd�9^I`gh:ê%ëO5qR{Si:@6OÏ%qRÛs�Ñ6²-()*+%,Or`PÚOÉd^_`åËZI`gÜÝÞe|bcÉx-|}^{S�@,*'-Çßà~)0Æßà~)OÉdqRS�íbc«¬0Tebc«¬n¿wPT<=^_Ùg
0"Nü<=D
"3q-Ná#$%&'()*+%,-UVv*n�NâOIJ@g
3"ãäá<=DjëÆêöáSåNá¤������������¨m
"reN-Ð%wnÉdqS�ÈÉOi:ê%ë-ãäBndD�R`g
KNü<=D(½opIÅÿ�D
"i:NjhæNmOstuvw56nJ¢q�f0_OShæ�3Nù^-UVv*ny»xeÞSi:N-ç-UVv*{op-IÅÿ�Dn3íJ¢x`a0^¤»x`g12-üý^{S()*+%,©ªnhp-��YZ[D^IJ@qRS��-@@ZX�T�QÙ0_Oa-&DnJ¢qRi:N-ç-UVv*n¤»qSèâa-;<:�n�D�xa0^<=�í-FGZ.éde`gq?qS]Õù^-1E^{�ê�<=¿w-FG{À$àe�?QÙg
KNü<=D0½:ëÆ*D
"hæJ3NPDç-NOqfR{stuvw56Z��eRf`-^SÍ-opIÅÿ�D{�z�fgì�x`o²-UVv*OqfRSíî!¤îÒ¥�£�ªªª¯¨"��UVv*n@zRÇÖ-�ÉïnüýqRVs3Ö&�×n´`g
a-Vs~Ö&�×n! �!OqfR|Ta0^UVv*!º�±!OÏx`�7fZ�$àe`gQRn�D�qR!º�!n�$`a0Z^_`g
!
Wm = Wm0 + wm , wmam " m
m=1
M
# + b " m = 0 ( " m = 1,2,...M)
a " m µ =$E
$w " m % µ
&$E
$w " m 0
'
(
) )
*
+
, ,
1
%µ
(µ = 1,2,...M), b " m =$E
$w " m 0
KåNá<=D
"<=¢ê%ën�QR~ð<=qÙkS[-��nèéê%ë0qRèâ<=dù`ga-;<:�n�D�qRXY-ìínÇ$`a0Z^_`g��[Å_ñ-BC^{Çìí-<=Z1]^_`ZS�_ñ�BC^-¿¿lOqfR{ÈvÀ^I`g
�7ª!Ï��������!³ª��ª!������!ëª!«������!ò³�����������!��������!��!��� ��¡�!��®!���®������!��!�������!����!�������ò!¡������!�������!!¥µ§�!µé!�!¶£!¤¥¦¦¥¨ª
LåNá<=-·ó�
P0
P1
P2
h:ê%ë"#$%&'()*+%,"i:ê%ë"èéê%ë"��
x
x
x
!
y
"1
"2
!
) y
) " 1
) " 2
!
) " 1
= #y =) y $ y
) " 2
= #"1
=) " 1$"
1
) " 3
= #"2
=) " 2$"
2
!
y +"1 +"2 +L = () y #
) " 1) + (
) " 1 #
) " 2) + (
) " 2 #
) " 3) +L =
) y +L$
) y
y +"1 +"2 +L = (P0 + P1 + P2 +L)X
!
!"#
!"$
!"%
!"&
'
! !"# !"$ !"% !"& '
!"#"$
!"#"%
!"#"&
"
"#"&
"#"%
"#"$
"#"'
" "#& "#% "#$ "#' (
!"#"$
!"#"%
"
"#"%
"#"$
"#"&
"#"'
" "#% "#$ "#& "#' (
!
!"#
!"$
!"%
!"&
'
! !"# !"$ !"% !"& '
"""ãäá<=DOP`$&s)wá56-<=�
ô½èéê%ëSõ½#$%&'¼()*+%,i:"¤�¨h978½�S
""¤�¨��½í¥S¤�¨��-��½í£S¤®¨;˽�Mí¥Mí£
F4"?@0GHIJ@j3m"?@0�<=
KÐvõ-I`ê%ëOqfR-56�R{$�
L56�R{$-�C
"33ê%ë�g56{"""""gÉö9S%&9-�U�ÉxÐvõn§Äg1o{>Ö-MB×�R{$g
sin(2!x)
9
9 3
LMB×IR{$
¼<=ê%ë""
¼¼�*ê%ëçIż�*��
¼ÅÖ6½zØ÷
¼�Ö6½�<=
%&
'(
)*+
,-(
)*+
L#$%&'()*+%,OP`�R{$��
j;m()*+%,i:-|ø
¼ÚÁ-ùS÷<=-Ù$-ê%ëZ�NOI`åË'
"nyz`g
K��ÊË56
< t
k|
r x >
!
E =1
2yk (x
q,w) " tk
q{ }k=1
c
#q=1
n
#2
E =1
2yk (x,w) " tk{ }
2p(tk x$
k=1
c
# )p(x)dtkdx
K<=��½
"��ÊË56nIÅOx`PÚOi:nÂÐx`a0""¼()*+%,ZTU-56núr^_`�àS""""""
""""""Õ
¼aaù^-û/{S#$%&'()*+%,ON`a-
"^{�fg
¼q?qS#$%&'()*+%,{åæ^I`-^
"""ç"Í-IJ@��Z12O1ú�9^I`g
"""""j""""-IJ�78nßz`gm
!
< tk | x >
!
"E
"y # k ( # x )= 0 = yk (x,w) $ tk{ }" (x $ # x )"k # k p(tk x%
k=1
c
& )p(x)dtkdx
!
yk (x) =< tk | x >" tk# p(tk | x)dtk
Ki:ZS"""-78nßz`a0-�
¼Ö-5nZ¤»/[Oßzàe`Bnyz`g
¼a-5nn<=dù`L-<=ê%ë{Ö-hD^I`g"
"aa^S"{Ðvõ^S""""0x`g
¼Íï<=ê%ë^<=qÙ#$%&'()*+%,XY{""
"""""""Õ
¼a-PÚOSÐvõZI`ê%ë?àaHùeRf`¤»
"/[5nZüi^_`g
!
< tk | x >
!
x " y(x) = h(x)
!
x " t = h(x) +#
!
"
!
< " >= 0
!
y(x) "< t | x >= h(x)
j>m?@
KÍï5/naÙàqÙ®»
("<=ê%ë{�NOI`g
0"#$%&'()*+%,{TU-56n\]^_`g""
""444q?qS12{¿N-<=ê%ëq?�fg
K<=-p[
L�_�()*+%,SÅd�<=ê%ëÊË
""ç"ìíìf<={�9""q?qS
L<=p[{<=ê%ëOHùe`*ÓÆwnýz`a0g
K#$%&'()*+%,OS�`Ö6
LàUVv*6
LÙ�qS~�OSÿøí¯UVv*6
K����!þ!·�������
Låæl-Åd�()*+%,56½"
"""""�_�÷³vò�'n�qg
Lê%ë-ÐvõOÿùRqùÚ56½
"""""�_�÷³ôòÆ�'n�qg"
K����η�������!¬������
L#$%&'()*+%,J¢-ó%'½
"""""³vò�Ô³ôòÆ�-*Ó%wºg
L³vò�Ô³ôòÆ�-ÅÆ*<%'
"ç"("UVv*6-�N
"""0"%¿dn q@A'¼»n��ÊË56O§Ä"""
"""""""j��������������m
"ç"÷�<=-OÙ'
jAm7Ý@0<=jM@65678BCm
�"ëª!¡������!�ª!«������!¹�������������!����������!���!��������!����!���!
""�ê��´�����!��!����������!��� ��¡��!°������!£²é!¤£©!��������!¥¦¦±¨!
""¦é§!�!¦§£ª
K!y-èGr
LXYS5678½
LÁî<=½"""""-"nÊ$Rïðg
L?@½"""""OS�`"-,nÊËx`g
"""""Õ
÷"#'I`f{S~�OS÷ê%ë�c-yn78'
"""""jÐvõZIQRaìfm
^÷"#'{S÷ê%ë�c-yn78'-ÐN
""jÐvõç9m""
L<=½÷!y-èGr'
d
!
(xi ,yi )" di
!
(xi , yi ,di )
!
x,y (" xi ,yi )
K7Ý@
L÷ê%ë�Z�f~)OS�`XYn~U[O¤$`
"O{S«¬Z÷D�f'ç"��������®!�������
LAOSê%ëO{ÐvõZHùeRf`g
La-��������®!�������n ��������®!�������Ox`O
"{S$à?-ò;ôÂô���Zí¸^I`g
Lò;ôÂô���½÷XY{�ö%õ^I`'
LÖ-ò;ôÂô�®»-�
"("XY{op^I`g
"0"XY-%&{7^I`g
"3"XY-~){NàeRf`g
"4"XY{I`@Ü'-a0^z@^I`g
jCm"?@9:-ÄÍ
Kº�����!Ï����
¼ÑÒxô`|-��n(�x`g
¼z¸�UVv*Z�_T�D�ô�fPÚ@A'¼»B
"nÄz`g
KÐvõ-§Ä
¼Ù0zÞSñcN-h:O%&9SÉö"-7_Ðvõ
"n§Äg
!
"
jEm"GHIJ@
¼reN-6
¼reN-þ#)*-6
¼h:N-þ#)*-6"
""ç"üýf->?jÇ�@mS?@9:-Ã�
K<=¿w-N6�Ôl
"UVv*@6--.,�ÔlZcv^�fÙ$O<=¿w0Å�*¼Çº)%uÆ�-N6�Ôln»f[Of `a0{*+^{I`ZS��[ì,�<=núÚ-.,OqfR��0üýÅ�*-5nn ÙgBC0qR{S*ëu,á;&õu-o-.Ç&á%ën�$`YBCn/¢qSÉp�y-uê'¼*ëu,¼;&õuOqfRÖ-sʺ&к%Ën�QRê%
ën´QÙg""""
";&õu]ÈOS?eÙ01;<%23Ój�m?à;&õue}j¹�!3m0Ç&á%ë�n�$`BCO#$%&'¼()*+%,nJ¢x`g�OS>NàCNOqfR<=��-�_dnüýfOÏqR;<)*qRI`ga-üý-%&^{SANàCN^Å�*¼Çº)%uÆ�Zìfg
!
"(R,Z,#) = 2CR ln8R
$
%
& '
(
) * + 2
,
- .
/
0 1 +C ln
$
a
%
& '
(
) * + (# + 0.5) 1+
a2
$2
%
& '
(
) *
,
- . .
/
0 1 1 $ cos 2 3
!"!#
!"#
#
#!
! $ % & ' #! #$ #%
()
*)
+)
!"#$
%&'()
<=¿w-N6�Ôl
K()*+%,*¨<©%-¤»
L>N#$%&'()*+%,-åË
""ç"Iż�*��n1]x`reNþ#)*6""n¤$`g
L¤»DJ3
"¼4¢�9�ê%ën&Æ/öO¼�*ê%ëOqRt&ºn5Tg
L¤»DJ;
"(ê%ë:)*nS&Æ/öO6²-ÈÉÊËOÉ�`g
"06J3²-ÈÉÊËOqfR<=núÚg7D3²-ê%ë:)""
""*^¼�*j���´�!���!���mg
"3Íï-��n6Ú�úÚg56j��ÊË56m-%&n0`g
"4µn@zRS0S3n�D�xg56n��qR""n¤$`g
!
) m
!
) m
K89í:»
!"# !"$%#
&'
%
' '
%
(
m m+1
&
)ijm
x
x
x
x
m1 m+1
1
mi
m+1j
xmi'
!
xjm +1
= f ( wijmxi
m
i= 0
I m
" )
LµN-i:Z~ÖµKS©Çë%ÆZÖ×^\]^_`0
"®»g
"a-åËSÖ×ZrDsq-^S�×!þ#)*{>;qRa
"ìfg"
"©Çë%ÆOqfRa-5n×Z��OrDsq�à�×{T
"U^I`g"a-5n{��O{rDs�fg
"Î"i:Z-JK-X�fþ#)*n>;g""""""
"
!
x " i
m= #i
" i xi
m
i=1i$ " i
I m
%
!
wijmxi
m =
i= 0
I m+1
" wijm + w # i j
m$i# i ( )
i= 0i% # i
I m+1
" xim
L�×!þ#)*n>;x`a0^S�×!þ#)*-i<^#
"�e`«¬
"
L�×!þ#)*n>;x`a0Zi:,Oá=x¿6"
La-6,Z>»qÙÌÍ\?O�`PÚOþ#)*
"n>;x`g
�@1î~SABCDSE1FGS%HIJKS|ìLØSüçÿû��
"<4/56"©¥�!£©¶!¤¥¦¦µ¨ª"
�MNOCSP1QRSñ@~SSTAUVSë¹�¯�¥¯OS�`º»%
"w³),��O¢f`#$%&'()*+%,-GHIJ@S;&õu
"WXË<46Sé¶!¤£±±±¨!¦¥¥!�!¦£¥ª
!
"ym # i =$y
$x # i m" # i
m
!
" # i
m $ x # i
m % &i
# i xi
m
i=1i' # i
I m
(
Recommended