!"#$%&'()*+%,-./012

34"56789:

;4"<=

>4"?@

A4"#$%&'()*+%,:<B

C4"<=D3

E4"<=D;

F4"GHIJ@

!(x)

K56789:

LMN#$%&'()*+%,OPQRSTU-VWXYZ78[O\]^_`a0ZbcdeRf`g

Lh:N0i:N-i:56jkl@56mnop560qSreN-i:56nstuvw56"""0x`#$%&'()*+%,OP`XYnyz`0Sa-XY{|}56^\]de`g

L#$%&'()*+%,OPQRS~�-VWXYZ��O\]^_`��^{�fg

34"56789:���������!����������!��!���!�����������!�����������!��!

"����������!��������!��!������!��� ��¡��!¢�����!¢�� ��¡�!£!

"¤¥¦§¦¨!¥§©!�!¥¦£ª

�«ª!¬����¡��!­������������!��!��������������!��!�!������®��!

"���������!¯���ª!¬������!°������!°������!£!¤¥¦§¦¨!©±©!�!©¥²ª

�����!³����¡�!¯���������!���®��� ��®!��� ��¡�!���!���´�����!

"��������������!¢�����!¢�� ��¡�!£!¤¥¦§¦¨!©µ¦!�©¶¶ª

�����!³���¡�!¢�����!¢�� ��¡�!²!¤¥¦¦¥¨!£µ¥ª

�·ª¸ª!������´����!¢�����!¢�� ��¡�!²!¤¥¦¦¥¨!©§¥ª

�­ª¹ª!«�������!³ª!º�����!¢�����!¢�� ��¡�!µ!¤¥¦¦£¨!¥£¦ª

K�ª!���������-».

».3""

¼""½¾»6S¿ÀSÁÂÃÄSVW56""

¼�½¹�!-ÅÆÇ,*�ÈÉÊËj¿ÀÌÈÉÊËm""

¼"""""½�Í-1VW56

"ÎTU-"""OÏqRS

"Ð6¢S1»6S��!�!Ñ�!¤�Ò¥�£�ªªª¢¨�! �Ó!¤�Ò¥�£�ªªª¢�!ÓÒ¥�£�ªªª�¨!ÔÕg""

"Ö×nØÙxPÚOx`a0ZiÛ`g

"aa^S

!(x)

f (x1, x

2,...xn )

! > 0

maxr

x !Kf(x

1,x

2, ...xn ) " ˜ f (x

1, x

2,...xn ) < #

˜ f (x1,x

2, ...x

n) = c

i! w

ijx

j"#

ij= 1

n

$%

& '

(

) *

i= 1

N

$

LÜÝxeÞS"

"¹�!-ÅÆÇ,*�ÈÉÊËj¿ÀÌÈÉÊËm�Í-1VW56""""""""""ZßzàeÙ0_STU-""""OÏqRSreN-i:56n"""j¾»6S¿ÀSÁÂÃÄSVW56mSh:Náâi:N-i:56nop0x`SÖ-PÚ�>N#$%&'()*+%,ZÔÕx`gãäSa-#$%&'()*+%,OP`XYn""""""""0qRÖ×ZØÙde`g"!!!!

f (x1, x

2,...xn )

! > 0 !(x)

f (x1, x

2,...xn )

maxr

x !Kf(x

1,x

2, ...xn ) " ˜ f (x

1, x

2,...xn ) < #

».;""

¼"""½¾»6S¿ÀSÁÂÃÄSVW56""

¼�½¹�!-ÅÆÇ,*�ÈÉÊËj¿ÀÌÈÉÊËm""

¼Ð6"""

¼TU-VWXY""½"

"ãäS

a-0_STU-""""OÏqRSreN-i:56n""j¾»6S¿ÀSÁÂÃÄSVW56mSh:Náâi:N-i:56nop0x`SÖ-PÚ�¡N#$%&'()*+%,ZÔÕx`gãäSa-#$%&'()*+%,OP`XYn""""""""0qRÖ×ZØÙde`g!!!!!

!(x)

k ! 3

f K !Rm

! > 0

!(x)

r

f : K !Rm

!

x = (x1,x2,...xn )" ( f1(x), f2 (x),...fm (x))

!

maxx"K

d( f (x),)

f (x)) < #

;4<=

K<=0?@

L#$%&'()*+%,XY-åæd"

"çèéê%ënTUìí^<=x`9:½Áîïð"

Lñqfê%ën\]"

"ç?@

K<=ò'óôõö"

÷øùqfúûn0`PÚOSüýþ#)*Zÿ!"#@x`Ù$-J%[&D'

!"#$%&

'()*+,-./

01#

!"#$%&

234%5/

67

3mê'ë'%'(")*0+,--.@½&Æ/ö0"h:,0øùqfi:,n123"i:,-üý4")*-ÂÐ""56Z7qf0_½""""""""""øùqfi:{38]1-i:{9½""øùqfi:{98]1-i:{3½

!

wi (t +1) = wi (t)

wi (t +1) = wi (t) + xi (t)

wi (t +1) = wi (t) " xi (t)

KÇ%:;*<Æ-<=jê'ë'%'m=>lbc

aa^S������ê%ë?à�������ê%ëO@Ax`g

56Z7qf0_½""""""""øùqfi:{38]1-i:{�¥½øùqfi:{�¥8]1-i:{3½

!

wi (t +1) = wi (t)

wi (t +1) = wi (t) + xi (t)

wi (t +1) = wi (t) " xi (t)

a-BC{SÖ-PÚO\]x`0�?DExfg

"h:Çë%ÆF{ÊËGHI`f{ÊËGJOKqRf`gÇë%ÆFnÇ%:;*<ÆOh:x`0SFZÊËGHOKqRf`LO{M¥nSFZGJOKqRf`LO{�¥ni:x`gê'ë'%'OP`¿NO-<=^Ç%:;*<ÆZa-PÚOP9x`PÚOx`a0Z^_`g

"a-a0n2xÙ$Oê'ë'%'nÖ-PÚOQ_RqRSTg

("UVv*¼W,*'"--.@0"ÊË"""""""?àÇë%ÆFnXY3""""""�àÞ0ZS[e\]{4Z4"""""""0qR0Z

!

F = F+" (#F

#)

!

w "X > 0

!

w

!

w" w +X

^h:ZGHOKx`LSi:{M¥SGJOKx`LSi:{�¥"""{"""""-PÚO_`@qRI`a-0x`

!

X

!

X = 1

bc½Çë%ÆbcnGH0GJOÉdx`ÁeW,*'""ZÔÕx`0x`g

!

w*

!

w*"X > # $# > 0 for%X & F = F+

' ((F()

ÖO2xf"""n»gx`g

!

G(w)

3m4nh`L-"""-Éi-@@

""4njOhQÙk-"""-,

;m4nh`L-"""-Él-@@

""4njOhQÙk-Él-,

!

G(w)

!

w*"w

t +1 = w*(w

t+X) = w

*"w

t+w

*"X #$

!

w*"w

n# n$

!

w*"w

!

G(w)

!

wt +1

2= w

t +1 "wt +1 = (wt

+X) " (wt

+X) = wt

2+ 2w

t"X + X

2< w

t

2+1

!

wn

2< n

!

G(w) =w* "w

w=cos# w

w= cos# $ 1

%

& ' '

(

) * *

!

" 1#G(w) =w*$w

w>

n%

n

" n &1

% 2

qÙZQRS¿NO-mý^=>x`g

nü[<=./

èéID<=Oop

èéID<=-uê'{Ö->q-rÉ?àrDsq

("tu½h:W,*'

""jvw�íÉx"""""{y»deRf`Zzcm

0"èéê%ë½h:W,*'"OÏ%{

""jvw�íÉx"""""{y»deRf`Zzcm

3"<=|}j#$%&'()*+%,m

èéID<=0{Sèéê%ën78x`56nSnü[�U~^XY;<:�0��xa0Z^_`g

!

x

!

FX(y | x)

!

x

!

d = f (x," )

!

FX(d | x)

!

y = F(x,w)

K<=ò'óôõö-É�

3mèéID<=0èé�q<="

LèéID<=j°����´���®!��������m½XÞeÙh:O

"ÏqR7qf�zZ�?QRf`0qR����Z�T"

Lèé�q<=j�������´���®!��������m½XÞeÙh:

"OÏqR7qf�zn�à�f^����Z�T

;m�7<=0�@<="

L¬�������´�!��������½

"<=O�ÙQR{h:W,*'0��-�_d^�7"

L¹������������!��������½

"<=O�ÙQR{�zZ7qf?�?��^��""

"ç"Ç%:;*<Æ<=

Learn ing

!"

Superv ised

Learn ing

#$%&!"

Unsupervised

Learn ing

#$'(!"

Correct ive

Learn ing

)*!"

Re inforcement

Learn ing

+,!"

Re inforcement

Learn ing

+,!"

Competit ive

Learn ing

-./!"

Kèé�q<=-�½bcÉd"

LBC½;Ö�bcOÉxx`�n,&�ë%OÉ�g

"¼�-�Z�-,&�ë%OKx`?�à�fg

"¼~�OS,&�ë%ZfTqI`?a�?à�fg

L�()*+%,

¼a-BC{Ö-PÚ�É�()*+%,^|Tg

C lass i f i e r

Network

x

y

Cluster 1

Cluster 2

Cluster 3

¼Ö-�OqfRSÁ~-Ç%:;*<Æ^{S"n

"�QR_RS

r W

OÏqR""""0{^_�fZS

n�z�9^I`g

!

"

h:W,*'-Éx06Z�?QRfeÞ�h:W,*'-�\nX `g

!

"p# P

"n# N

!

W "p # 0

W "n < 0

!

W1,W2,W3

L¬���������!¡������""

"",&�ë%-60ÉxZzc-LS

÷fTqüýþ#)*n¢UxeÞPf?£'

÷fTq�\[UVv*n0eÞPf?£'n¤$`BCg"

¼�½¥¦-6""

3m°������!��!������njÖ�ê%ëW,*'O@Ü""

;maenfTqOÉ�xeÞPf?£"

¼<=ò'óôõö-�""

""Ö-�OSfRS<=nyz`g""

3m�üýþ#)*^)*§_-¨nüý""

;m©ª[«¬n�QRS)*§_¨ZI�O�`þ#)*

""��­®

x

x

W

W

W

W

W

W

1

2

11

12

21

22

31

32

Cluster 1

Cluster 2

Cluster 3

�������´���®!��������!�������!�����������

Ç%:;*<Æ<=-~�@

L~�[OSÖ-BCnyz`g""

¯BC°"jÖ�bc-7_@deÙW,*'-ÊË

""""""n±²-,&�ë%OÉ�qÙfg""

¯&D°jh:S±i:-¬���������!��� ��¡nyz`g

""""³vò�{90x`g

"3m7_@qÙUVv*""""""n&Æ/öO´`g"

";mh:ê%ë""""n&Æ/öOXYg""

">m"""""""""""nüýx`g""

"AmI�-)*§_¨nßz`þ#)*µ-UVv*""nXYg

"Cm"""""""0qRUVv*Añx`gUVv*{7_@x`g""

""Î"�þ#)*{,&�ë%O¶_q�àeRfTg

!

X = (x1,x2,...x l)

!

W1,W2,...WK

!

x j " X

!

x j "Wi (i = 1,2,...K)

!

Wm

!

Wm "x j #Wi "x j , i = 1,2,...K

!

Wm "Wm + x j

>4"?@j3m·¸

L�OP`?@9:-¹c

"3Ö�ê%뺻)¼»Ætnyz`g

"ê%ë"""""""nS56""""O�R{$`g

!

xi (i = 1,2,...I)

!

x = x(t)

½n�_Tx`a0^S""""-78ìí{fTà^a;àe`ZS¿à?�t&ºO�à�fg

ç"?@9:-ÀÁSÂ%³%º»)¼»Æt

!

xi ") x (ti ) " x(ti ),

) x (t) = a

l#

l(x)

l=1

L

$

E =) x (ti ) % xi( )

2

i=1

I

$

!

xi ") x (ti )

L?@9:-~�[ÃÄ

"Åd�()*+%,"Î"Æf\]:

"�_�()*+%,"Î"j<=ê%ë-mÇf\]:

"È�ê%ëOaÇf\]:"ÉÉÎ"Çf?@9:

L?@9:-ÊË

""«¬fÌÍ

""ôÎÆ;ôÆtD

""·¬Ö�

L?@9:-ÄÍ

""º�����!Ï����

""Ðvõ-§Ä

j;m"?@9:

K#$%&'()*+%,ÑÒí-IJ@""

"*Ó%wº½Çf?@9:SÙTùqdj����������m""""""""""""

""""""""""ÔÕ"""""""""

"ÇfìíSaÖdj�����������m"

""ç"�����×�!�����!¤��¡���×�!�����¨Ø!�� !��!���������"""

"�¢�ÑÒ@nÙ�IaÚÛ�./n0` _0ÝÚÜÝ

"^���������Ø"ÞßS�ä

KÑÒí½à78-Ù$-Ç&á%ë-6

K?@9:j«�������������m""

""âã-Ù$O2de`�-ÊËZzä©�åË^aS7qf~�[_Ýnæç^_`9:g

�¡ª!¬����´����!°ª!¡����������!è�������ª!�������!²!¤¥¦§é¨!¥¥¦¦ª

�·ª!·����¡�!­ª!¬���´����¡���!��!���!�������!���´�������!��!������´�!���ê���������!�´����!��!�����!��������������!ë�����!��!¡������������!��®!���!­�����������!¥¶!¤¥¦é¥¨!£¶²!�!£§±ª

K÷ìf'?@-Ù$-í¸îï

j3m<=qPÚ0qRf`56ZSI`U~^S¿à"""

"""?�a0g

j;m<=Çë%Æ-6ZMfa0SáâS[eàZ?"""

"""@-Ïð0x`©R-åË-ÊË-ñ^÷�\["""

"""�'ÈÉÊË^I`a0g""""

"""ç"ë��!·����¡�¬���´����¡��!®��������

K?@9:-I`<=

"j��mòjÑÒímç"IÅS"

""<=-)¸�óC"ç"IJ�÷ÑÒí'n»$`a0""

"""Áîxô`uê'¼¼¼õ<[GHnöz_e�fg"""""""""""""

"""j��®����������m""

"""ÑÒxô`uê'¼¼¼Ðvõù^uê'@x`g""""""""""""""

"""j�´����������m

KóC

""3muê'Z�` T÷1O<=x`a0

"";muê'O�` Tÿøín�Ùù`a0

j>m?@��¼?@9:-ÊË

L<=Pú-?@��

!

(xi ,yit);xi " (xi1,...xid ) # R

d,yi

t " (yi1t,...yim

t) # R

m,1$ i $ n{ }

) y =

) f w (x) " (

)

f 1(x),...)

f m (x))

e(xi ,yi ,w) " yij %)

f j (xi )( )j =1

m

&2

l(w) " e(xi ,yi ,w)

i=1

n

&

R(w) " E[e(x,y,w)] = L e(x,y,w)q(x,y)dxdy''

<=ê%ë½

<=û*i:½

²ü��½

<=��½

?@��½

L«¬f-»g

L«¬f-Áe

L«¬f-lý

0fÚþðnÿçqÙ0_O!`«¬f

!

"

#

nÿçqR«¬Z"#x`a0{�f?à

!

X = xk X = xk | k = 0,±1,±2,...± K{ }( )

I (xk ) = log1

pk

"

# $

%

& ' = ( logpk

!

nats (loge ) bits (log2)

!

I (xk ) = 0 for pk = 1

I (xk ) " 0 for 0 # pk # 1

X = xk

I (xk ) > I (xi ) for pk < pi

LVÆ*<$%

-%&,{

½&Æ/ö@6'-VÆ*<$%

!

I (xk )

H (X) = E[I (xk )]= pkI (xk )

k="K

K

# = " pk logpk

k="K

K

#

H (X)

0 log 0 $ 0

0 % H (X) % log(2K +1)

LVÆ*<$%-lý

("I`"OqfR"""-L��

""j÷zv»lZ�f'0fÚa0m

0"x R-"OqfR""""""-L��

""j(©T�?à�f'0fÚa0m

!

k

!

pk = 1

!

H (X) = 0

!

k

!

pk = 1/(2K +1)

!

H (X) = log(2K +1)

K�������¡��������"Ï�´�������""j�������¡��������«¬fm

½�-»g)

½æ»qÙÇ&á%ë

½æ»qÙvw�íÉx

½*-Ç&á%ë

½*-vw�íÉx

½�������¡��������«¬f

!

S

w = (w1,.....wL)

p(x |w)

w*

= (w1*,.....wL

* )

p(x |w*)

L(w,w*)

L(w,w*) = p(x |w*) logp(x |w*)

p(x |w)

"

# $

%

& '

x(S

)

= p(x |w*) logp(x |w*)

x(S

) * p(x |w*) logp(x |w)

x(S

) �������¡��������!Ï�´�������{*-|0æ»|-+,n2xg

!

S(x) " logx +1

x#1$ 0 for %x > 0

S(x) = 0& x = 1

' p1( (x) logp1(x)

p2 (x)

)

* +

,

- . dx = p1(x) S

p1(x)

p2 (x)

)

* +

,

- . #

p2 (x)

p1(x)+1

/

0 1

2

3 4 ( dx

= p1(x)( Sp1(x)

p2 (x)

)

* +

,

- . dx# p2 (x)dx( # p1(x)dx([ ]

= p1(x)( Sp1(x)

p2 (x)

)

* +

,

- . dx $ 0

!

L(w,w*) " 0

L(w,w*) = 0 for w = w*

0aÖ^S

qÙZQR

K-./j«¬fÌÍmn¢fÙ?@9:ÊË

�01S«¬fÌÍOP`>N#$%&'()*-reNþ#)*6-¤»DS

"2i«¬h3<4/56S·��ª7é©�Ï����!¢�ª¥¥!¤¥¦¦¥¨!!��!²¦±�²¦éª

3mreNþ#)*6-8�`>N#$%&'()*nÑ

""6¢UqRS[e9eS:É<=dù`g

;m[e9e-#$%&'()*-<=56OqfRSÖ

""×OPD«¬fÌÍ­�¬nüýx`g

!

AIC = Nk log() " 2) + 2K,

) " 2 =

#i

2

Nki=1

N

$

!

K

N

k

"

>mIÅ­�¬nßz`#$%&'()*

""-?@9:ZIaÇf0x`g

½UVv*;6

½<=ê%ë6

½i:ê%ë6

½����ê%ë��

jAm?@9:-ÄÍ

"K|¤<(½GH[=»@""

"¼reN-#$%<Æ6>?""

"¼UVv*6>?""""

"""()*+%,-ÑÒín@A'¼»0x`Bn§Ä"""""""""

"""ÑÒíÅ�*½""""

½ÑÒíÅ�*ÎC

½ÑÒíÅ�*Î9

½ºô%Ç&á%ë

DE[Oà3

!

"wi

2/w

0

2

1+ wi

2/w

0

2

i

#

wi >> w0

wi << w0

w0

K|¤<0½7Ý@

K|¤<3½<=��-FG

¼Ðvõ§_<=½1ê%ëOHùe`Ðvõ{|}O

"IJKnßz`ZLM[ÐvõjÓ�����m{¿à?�5

"6OÏx`?@9:-FGD-~q^I`g

¼N.OP½QRO6n?àx

A4"#$%&'()*+%,:<B

Kû[VW,uê'~�/"

LST&�×

L#$%&'()*+%,-V('U%

!

dui

dt= "

ui

#+ wij xj

j =1

n

$ + vi

xi =% (ui )

!

E = "1

2wij xixj

j =1

n

#i=1

n

# " vixi

i=1

n

# +1

$% "1

(y)dy0

x i&i=1

n

#

LÏV5Ës�¼ö-V('U%@@

$

n�QRS

ÎW{ÁÂ?X^IÅ�Z0Ä?Úg

!

wij = wji , (i, j = 1,2,......n)

"

"t

1

2wij xixj

j =1

n

#i=1

n

# = wij xj

j =1

n

#$

%

& &

'

(

) )

dxi

dti=1

n

#

dE

dt=

"E

"xii=1

n

# dxi

dt= * wij xj

j =1

n

# + vi *1

+, *1

(xi )

-

. /

0 /

1

2 /

3 / i=1

n

# dxi

dt= * wij xj

j =1

n

# + vi *ui

+

-

. /

0 /

1

2 /

3 / i=1

n

# dxi

dt

½ÏV5Ë

!

dE

dt= "

dui

dt

dxi

dti=1

n

#

dxi

dt=

d$ (ui )

dui

dui

dt

dE

dt= "

dui

dt

%

& '

(

) *

i=1

n

#2

d$

dui

+ 0

KMN#$%&'()*+%,0��YZ[D

j\�<=Çë%Æm

!

E =1

2X" (x) h(x) # d(x)

x$X

%2

d(x) (x$ X)

Lp[56½

L>N#$%&'()*+%,-)*½

L:<Bj]TDm

!

wij , vjk

!

dvjk

dt= "

#E

#vjk

, ( j = 0,1,2,...m,k = 1,2,...l)

dwij

dt= "

#E

#wij

, (i = 0,1,2,...n, j = 1,2,...m)

LV('U%@@

qÙZQRS

!

dE

dt" 0

!

dE

dt=

"E

"vjkk=1

l

#j = 0

m

# dE

dt=

"E

"vjkk=1

l

#j = 0

m

#dvjk

dt+

"E

"wijj =1

m

#i= 0

n

#dwij

dt= $

"E

"vjk

%

& ' '

(

) * *

k=1

l

#j = 0

m

#2

$"E

"wij

%

& ' '

(

) * *

j =1

m

#i= 0

n

#2

C4"<=D3j3m"��YZ[D

K��ÊË56jp[56m""""""

"~�OS""""

K��YZ[D-^_

"""¼Ã`DHNGH

"""¼������

"""¼af=>

"""¼bcIJ@

!

E =1

2yk (xp ,w) " yt ,k

p( )k=1

K

#p=1

P

#2

E = G(xp ,w)

p=1

P

#

j;m"��YZ[Dò'óôõö

ÂÆ&vÆDS³)dD

Kê'ë<=ÝSê'ë'%'j®���������m

""®½i:0èéê%ë-�

"" ½UVv*""""""

"""Õ"~�@"

""~�@ê'ë'%'½]TDOÌeT��YZ[D

!

"p(n ) = #$%E

%p+ &"p(n#1)

p(n )

= p(n#1)

+ "p(n )

K��jÊË56m0:<Bj\fm

""""""½Çë%Æjèéê%ëm

K]TD0:<B

""<=��n:<B-gû0qRöz`g""!!!!!!!!

!

E =1

2N"(x

n) y(x

n) # y

tn{ }2

n=1

N

$

(xn,y

tn)

!

dwij(m )

dt= "

#E

#wij(m )

dE

dt=

#E

#wij(m )

dwij(m )

dtj =1

J

$i= 0

I

$m=1

M"1

$ = "#E

#wij(m )

%

& '

( '

)

* '

+ '

2

j =1

J

$i= 0

I

$m=1

M"1

$ , 0

K��YZ[Dò'óôõö

0

1

0

1

0

1 1⇒ ⇒ ⇒

h3N""h¤��¥¨N"h�N""h¯N

I1　　　　 　Im-1　　Im　　　 　IM

!

x(1)(p )

!

x(M)(p )h:ê%ë

i:ê%ë

!

wij(m"1)

!

xj(m )(p )

= fm (Xj(m )(p )

)

Xj(m )(p )

= wij(m"1)

i= 0

I m"1

# xi(m"1)(p )

j = 1,2,...Im

m = 2,3,...M

$

% &

'

( )

!

E = Ep

p=1

P

" = (xj(M)(p )

# yj(p )

j =1

I M

"p=1

P

" )2

3müýij

k3lUVv*Añ

""""]TDjI�Ã`Dm^��ÊË56-IÅ@

""""""""½<=wj��������!����m

""""""""""½mlBj�������!����m

""""""""""½mln6j��������!�����������m"

!

"w(t )

= #$%E

%w

&

' (

)

* +

(t )

+,"w(t#1)

!

"

!

"

!

"#w(t$1)

k;lj&Äüý

"""(""""""""""""""-üý

"""0""""""""""""""-üý"

k>lY&Äüý

"""(""""-üý"j�Ò¯�¥�¯�£�ªªªª£m

"""0""""-üý"j�Ò¯�¥�¯�£�ªªªª£m

!

....dfm

dxj(m )(p )

, xi(m"1)(p )

,.....dfM

dxj(M)(p )

, xi(M"1)(p )

#E

#xj(M )(p )

,#E

#wij(M"1)

!

"E

"xj(m )(p )

"E

"wij(m#1)

;mi:NjhoNm-üý

^3½��ÊË56jhpmOÏqRS"

^;½hpIqN-kl@56{opç""

^>½ÂÆ&vÆD^{rOqfR¨n0à�f"

!

"E

"wij(M#1)

="E

"xj(M )(p )

p=1

P

$ dfM

dXj(M)(p )

xi(M#1)(p )

!

"E

"xj(M )(p )

= (xj(M)(p )

# yj(p ))

!

dfM

dXj(M)(p )

= 1

>m~�Njh;NàhoJ3Nm-üý

^A½hphµN-kl@56{stuvw56""!!!!!!!!

!

"E

"wij(m#1)

="E

"xj(m )(p )

dfm

dXj(m )(p )

p=1

P

$ xj(m#1)(p )

"E

"xj(m )(p )

="E

"xk(m +1)(p )

k=1

I m+1

$ "xk(m +1)(p )

"xj(m )(p )

="E

"xk(m +1)(p )

k=1

I m+1

$ dfm +1

dXj(m )(p )

wjk(m )

(Q) xk(m +1)(p )

= fm +1 wik(m )xi

(m )(p )

i= 0

I m

$%

&

' '

(

)

* * ,"xk(m +1)(p )

"xj(m )(p )

=dfm +1

dXj(m +1)(p )

wjk(m )

!

fm (X) =" (X) =1

1+ e#X

dfm (X)

dX=" (X)(1#" (X))

Am;<t&sÆt-Ù$-ù0$

�!��!������!��!������

ê!��!�����Ó!��!������

êM¥!��!�����¡!��!������

!

q : 0,1,...Q = qMax

i : 0,1,...Iq"1 = iMax

j : 0,1,...Iq = jMax

k : 0,1,...Iq +1 = kMax

!

xj(q )

=" (Xj(q ))

Xj(q )

= wij(q )

xi(q#1)

i= 0

Iq#1

$

!

xi(q"1)

!

xj(q )

=" (Xj(q ))

!

xk(q +1)

!

wij(q ),Xj

(q )

�Ø!������!��!¡��´����!�����ÓØ!����!������¡Ø!������!��!����!�����

���!������!��!��!�����

®è® Ó¤�¨!!!!!!!!!!!Ø!�Ò±t�¯��®è®��Ó®è®�°Ó®è®��¢���¤¡¨!!Ø!¡Ò¥t¡¯����Ó�°Ó®���Ó�°¡��´¤�¨!!!!!!!!!!Ø!�Ò±t�¯�� ë���¤�¨!!!!!!!!!!!Ø!�Ò±t�¯�� ¢���¤¡¨!!!!!!!!!Ø!¡Ò¥t¡¯��

!

q "Q

!

"E

"wij(q )

="E

"Xj(q )

"Xj(q )

"wij(q )

="E

"xj(q )

"xj(q )

"Xj(q )

"Xj(q )

"wij(q )

="E

"xj(q )

# $ (Xj(q ))xi(q%1)

="E

"Xk(q +1)

k=1

Iq +1

& "Xk(q +1)

"xj(q )

'

(

) )

*

+

, , # $ (Xj

(q ))xi(q%1)

="E

"Xk(q +1)

k=1

Iq +1

& wjk(q +1)

'

(

) )

*

+

, , # $ (Xj

(q ))xi(q%1)

="E

"Xj(q )

xi(q%1)

"E

"Xj(q )

="E

"Xk(q +1)

k=1

Iq +1

& wjk(q +1)

'

(

) )

*

+

, , # $ (Xj

(q ))

!

q = Q

!

"E

"wij(Q )

="E

"Xj(Q )

"Xj(Q )

"wij(Q )

="E

"xj(Q )

"xj(Q )

"Xj(Q )

"Xj(Q )

"wij(Q )

="E

"xj(Q )

# ' (Xj(Q ))xi(Q$1)

"E

"Xj(Q )

="E

"xj(Q )

# ' (Xj(Q ))

j>m<=w0mln6

K<=w-U~

Lops�¼ö-<=

"

""F½""""u*ô),�jÉ""""m"

""IJ<=w"v"µÖ�bc-wxyª-z{

""""""""v"|5ú}"""-y¿,

!

p"m

!

(x1t,....xp

t)t

!

(XtX)

!

E = Xw " y2

= (Xw " y)T(Xw " y)

= wT(X

TX)w " 2y

TXw + y

Ty

L�3½opi:j;Ö�m""""""""""""""""

ç"IJ<=w{S

!

E = ax2 + by2

"x(i) = #2$ax +%"x(i #1)

"y(i) = #2$by +%"y(i #1)

!

" =1

2afor x, " =

1

2bfor y

L�;½opi:j3Ö�m

"=>~)½"""""""""""""""""""""""

"

"IJ<=w½""!!!!!!!!!!

!

E = kx2

!

"x < x + #x < x

!

E = kx2

dE

dx= 2kx, "x = #$

dE

dx= #2k$x

#x < x# 2k$x < x, % 0 < $ <1

k

!

" =1

2k

x + #x = 0

#x =1

2k

K<=w-J%��

""<=w-J%��j«­¹Ø!«������!­®����´�!¹�����m""""""¼��Zr�qÙ0_

¼��Z#�qÙ0_

Ù�qSa-&D{ÂÆ&vÆD-LO{ÚùTf?�fg

!

" # (1+ $up )"

" # (1% $down )"

KmlB-�d

L<=wZ�9�I�,n0`÷�­�'-7T^{ml

"n6a3-7T-,n0à��eÞ=>q�fga-~

")^-UVv*bc^-�`�f{�û[O�`g

jAm³)dD0ÂÆ&vÆD

KQR-�&

3m³)dD

;mÂÆ&vÆD

Xi

XiYi

Yi

NN

NN

!

E =1

2(Y

i

i=1

n

" #Yi

teacher)2

!

Ei=1

2(Y

i"Y

i

teacher)2

update W

update W

(i)

i=1,...n

LÂÆ&vÆD{��O{3�O=>q�fg=>�?à-"

"�e{<=w-�_dO�Ôx`g""

Lq?q�ZàSÂÆ&vÆDOP`UVv*bc^-�`"

"�f{&Æ/öÐvõ^{�Tº&,ë'GHn�qg""

Lops�¼ö^yz`0SÂÆ&vÆDOP`UVv*b"

"c-�`�f{�Ö56Bj�������®!��������!°�����m"

"nGrx`gãäSº&,ë'GHn�qg

>m�U��Å�DS�U��vê'D0-5n

L�U��Å�D0�U��vê'D

"jVs~Ö&�×-QR|Dm"""""

¼�U��Å�D""""¼�U��vê'D"""

!

Ax = b, A = D + E + F

!

x(k +1)

= "D"1(E + F)x

(k)+ D

"1b

!

x(k +1)

= "D"1(Ex

(k +1)+ Fx

(k)) + D

"1b

#

x(k +1)

= "(D + E)"1

Fx(k)

+ (D + E)"1b

Lops�¼ö

x

x

w

w

y=w x + w x

1

1

1

2

2

2

L<=Çë%Æ

!

x1

1w1

+ x2

1w2

= y1

x1

2w1

+ x2

2w2

= y2

x1

3w1

+ x2

3w2

= y3

P

w

w2

1

LUVv*bc^-|I`f{��

"�I�

L;Ro-��n�$`0_-�U

"��Å�D0�U��vê'D

L��YZ[DOS�`³)dD0ÂÆ&vÆDAm³)dD0ÂÆ&vÆD-~�[ÃÄ-��

³)dD ÂÆ&vÆD

<=�í � �

J%�� � �

ÇÖIJ@D-J¢ � �

KUVv*bc^-�û3m�Ö56Bj�������®!��������!°������mLçíbcOS�`òº»Æ�Å@ÜnSÅÆÇ,*��"-ÊË0[-XY�O�D�q´¢dù`0º&,ë'"GHZ´àe`g�¯ª!���������!��������!è´��� ����!¤­��®����!¡�����!���®���!¥¦§§¨ª

Lòº»Æ�ÅXY"""

"""

"òº»Æ@Ü{�Ö56B-ñ?àTUOXYg"""{ò*&,ë%-���ÈÉÊËO�`g

!

x" Mx + t

det(M) < 1

an +1 = hk (an )

!

an{ }

L�Ö56B""¼F½�ÊË""¼�½çí""¼b^�fÊË?à�$RS

"""òº»Æ�ÅXY"""""Õ""¼ñqf�p-ÊË""

""¼""-=>l{ bdeRf`g"""=>¡nò*&,ë%0ÝÚg

!

hi :X " X (i = 1,....N)

!

An +1 = hj (An

j =1

N

U ), for n = 1,2,3,......

!

An{ }

L�Ö56B-�¼�ÅXY

¼�Ö56B""""

!

F1x

y

"

# $ %

& ' =

1

20

01

2

"

#

$ $ $

%

&

' ' '

x

y

"

# $ %

& ' , F2

x

y

"

# $ %

& ' =

1

20

01

2

"

#

$ $ $

%

&

' ' '

x

y

"

# $ %

& ' +

1

20

"

#

$ $

%

&

' '

F3x

y

"

# $ %

& ' =

1

20

01

2

"

#

$ $ $

%

&

' ' '

x

y

"

# $ %

& ' +

1

4

3

4

"

#

$ $ $

%

&

' ' '

!

"(A) = F1(A)#F2 (A)#F3 (A)

s¢'$Æ�£%¼��¤)*-Gr

¥m̦p""""""§máÆ�%¼�¨Æ©

"""áÆ�%¼�¨Æ©0[-̦p

;mÂÆ&vÆ��YZ[D0�Ö56BLîï""ops�¼ö""jÖ�h:W,*'jrÇë%Æm

"""

""""""½ªÇë%Æ-«rÉ"""

!

x1,...x

p

xij

y1,....yp

LUVv*Añò'óôõö¼ªÇë%Æ-��"""

¼UVv*Añj�Ò¥�£�ªªªª�m"""

"ae{Ö-PÚOQ_Üzàe`g""""""""""""""""""""""""""""""""""""""0qRS

!

Ej =1

2(w1x1

j + w2x2j + ....wn xn

j" yj

)2

wi # wi " $xij(w1x1

j + w2x2j + ....+ wn xn

j" yj

)

wi # wi " $ (w1xij x1

j + w2xij x2

j + ....+ wn xij xn

j) " $xi

j y j

Mj % mik{ },mik % xij xk

j, for i,k = 1,2,....n

w# Iw " $Mw " $t = (I " $M)w " $t

Lº&,ë'�p-�

L;Ö�ops�¼ö^Smln6n3-7¬O0QÙ0

"_-UVv*bc^-�`�fj<=wn@zRm-�jCm"��YZ[D-üýf

L��YZ[D0­h-]TD-üýfnÊËx`g

LÇ&á%ë""¢½UVv*;6j÷°°þ#)*;6'0®»x`m""¯½<=Çë%Æ-;6

"""!""½©��

"""!""½Çë%ÆêOÏx`��

L3O!"nÊËx`2-üýf"à°0±�÷)*§_¨'-üýà!�¤¢¨!

!

E = Eq

q=1

Q

"

Eq

!

Eq

K]TD

LR²S!""n~qüýx`üýf½!�¤¢¨

""""Õ"!�!¢

L©UVv*OqfRS!"nüýx`üýf½�¤¢£¨

ç©Çë%ÆOqfRSaenüýx`üýf½�¤¯¢£¨

!

"Eq

"wij

!

"Eq

"wij

K��YZ[D

Lj&Äüýn~OúÚüýf½�¤¢¨

LY&Äüýn~OúÚüýf½�¤¢¨

L!"""""""-üýn~OúÚüýf½�¤¢¨

""""Õ

L©UVv*OqfRS!"nüýx`üýf½�¤©¢¨

ç©Çë%ÆOqfRSaenüýx`üýf½�¤©¯¢¨

!

"Eq

"wkj

=)

# kzj ,"Eq

"wji

= # j xi

!

"Eq

"wij

E4"<=D;

L<=-óC

"¼Ç�@

"¼Çìí@

j3m"��YZ[D-Fì

K��YZ[D-^_¼]TDHNGH¼������¼af=>¼bcIJ@K=>O5x`óC½UVv*Añf-¾~³l¼UVv*AñfO"""-p-´iZhQRf`g

¼stuvw560qRS<©�¼»),56n�Ú0S"""

¼µQRS"""^{S"""""0�`g

""ç"�_�""^{SAñfZÅdT�`g

!

d" (X)

dX

!

d" (X)

dX=" (X)(1#" (X))

!

X >> 1

!

0 <d" (X)

dX<< 1

!

X

KÏ<("¶É,·Í¾½"""""

0"56,OoprɧĽ""""""""

3"ÇÖUVv*D½""""""""""""""nAñ"""""4"stuvw56@A½"""""

!

" (X) #" (X)

d" (X)

dX#

d" (X)

dX+$

" (X) #" (X) +$X

d" (X)

dX#

d" (X)

dX+$

w # w = p +%p3

p

" (X),X = x #" (X),X = x +%x3

d" (X)

dX,X = x#

d" (X)

dx=

d" (X)

dX3%x2

KÇÖUVv*D3mÇÖUVv*D-Ü."ÂÆ&vÆDn¢fÙ��YZ[ò'óôõö^{SUVv*""-@@f""{Ö-PÚO\de`g""""!

aa^S!

stuvw56¸-¶É,{S'Ò±-7¬^�_�,n0`ZS'-¹Ï,Z�_T�`0º�OÅdT�`ga-Ù$OS¹Ï,Z�_�UVv*-»7{¼QTDq?½ù�fg[a^SUVv*"nÖ-PÚOF$`g

!!!!

!

"wi = #$%E

%wi

= #$Cd&

dX

%X

%wi

!

wi

!

"wi

!

" (X) =1

1+ exp(#X), X = wixi$

!

wi

!

Wi = wi +1

3wi

3

aa^SUVv*-Añ{��YZ[DOPD"n�$Saen¢fRúÚgÝäS¾Ö78üý{Ö-PÚO�`g""""

""""

qÙZQRS""""!

ºÒ 0qÙL-Añfn""^\x0S""""

qÙZQRS""""0�DS"-�_�c^�_�AñfZ!àe`g

!

wi

!

wi

(m +1) = wi

(m ) + "wi

(m ), "wi

(m ) = #$Cd%

dX

&X

&Wi

1+ (wi

(m ))2( )

Wi

(m ) = wi

(m ) +1

3wi

(m )( )3

, Wi

(m +1) = wi

(m +1) +1

3wi

(m +1)( )3

!

"Wi

(m )#Wi

(m +1)$Wi

(m ) = "wi

(m )1+ 3(wi

(m ))2( ) + O ("wi

(m ))2( )

!

"wi

(m ) = ") w i(m )1+ 3(wi

(m ))2( )

"Wi

(m ) = ") w i(m )1+ 3(wi

(m ))2( )2

!

wi

!

") w

;mÁ~#$%<ÆOqfR-ÇÖUVv*D-¿6"ÇÖUVv*D-¿6nvÀ-Ù$OS;h:j��!�mS3i:j�m-Á~#$%<Æn¢fR\-PÚ�ê%ënÂÆ&vÆ<=dùÙ0_-UVv*jº��!º�m-@@-³in Ùga-#$%<ÆOP`XY{Ö-PÚO\de`g

� � � �

¥ 3 �Τ¥M�¨

£ �¥ �Τ¥M�¨

© ± ±

!

z =" (Z) =1

1+ exp(#Z), Z = Wxx + Wy y

W = w

W = w +w3

3

½hpD½ÇÖUVv*D

!

1/ 3

1/ 3

3

"Í-p-XYn�ÚNDSa-<=ê%ë©ROqfR��Z9O�`|{ÔÕq�fZS%&����nIÅOx`�{º��º�%yÍ^S¤¥�±¨�!¤±�!!!!¨�!¤�¥�±¨!nÁ�0x`ÂÃp-)Ĥ±�!!!!!!!¨!^I`g�OSfR>ÖUVv*D^{a-�Z-=>Zhp-UVv*-åËPDa�fa0Z�?`g

!

1/ 3

!

3

""""""""""j¥m""""""""j§mÂÆ&vÆ<=dùÙ0_-UVv*jº��!º�m-@@j¥mhp-UVv*8j§m>ÖUVv*SÅ&0aÆÇO6-QRüýnúQRf`g

>mȪ[BCZ-J¢"Ép�y;&õu-sʺ&к%Ëáâ7ë�¶±�-Ì@e|}Oa-&DnJ¢qS[-¿¿lZ2deÙg�Ohp-UVv*n¢fÙåË0>ÖUVv*n¢fÙåË-7ë�¶±�-Ì@e|}OS�`=>Íon2xg"h:Ð%w6Si:Ð%w6S<=ê%ë6{S¥é�!¥�!²¦¥¦!g

!"!#

!"#

#

$#%#!&

! #%#!&

'%#!&

(%#!&

&%#!&)%#!

&*%#!

&

+,-(!'./01234"!'

56789:;6789:

<=>?

@ABC

j>m"ÇÖIJ@D

KÇÖ-<=D"""¼#$%*ÆD"""¼Í#$%*ÆD"""¼¾opIÅÿ�D

K��ÊË56"""

K]TD

!

E(w) =1

2yi " fi (w)[ ]

2

i=1

N

#

!

E(w +" #d) = E(w) +" # dj$E

$wjj =1

m

%&

'

( (

)

*

+ + + O(" 2)

dj = ,$E

$wj

K#$%*Æ&ºÏÆDj¢� ���!¹������!¯����®m

"""""^W{Ð,n0`jOÑ�mgaePDS

"""""a-Vs~Ö&�×n|fRS

"""""""""W-\×n¶Éx`g

"""""""""""""""""½³������!¯�����

!

w =) w

"E

"wjw=

) w

= 0 ( j = 1,2,...m) #"E

"wjw= w

(n)

+" 2E

"wk"wjk=1

m

$ %wk(n ) = 0 ( j = 1,2,...m)

w(n +1) = w

(n ) + %w(n )

"W

"wj

= &"fi

"wji=1

N

$ yi & fi (w)[ ]

" 2W

"wj"wk

="fi

"wj

"fi

"wk

&" 2 fi

"wj"wk

(yi & fi (w)

'

( ) )

*

+ , ,

i=1

N

$

KÒ)sòÆú}¸¦-üý

LïÓ-»g"""!!!

!

EW1(m,i, j) "#E

#wij(m )

=#E

#wij(m )

$

%

& &

'

(

) )

p=1

P

*(p )

EW2(m,i, j; + m , + l , + j ) "# 2E

#w + i + j ( + m )#wij

(m )=

# 2E

#w + i + j ( + m )#wij

(m )

$

%

& &

'

(

) )

(p )

p=1

P

*

¯IqNÔIqN°

!

EW2(M "1,i, j;M "1, # l , # j ) $% 2E

%w # i # j (M"1)%wij

(M"1)=

% 2E

%w # i # j (M"1)%wij

(M"1)

&

'

( (

)

*

+ +

(p )

p=1

P

,

=% 2E

%w # i # j (M"1)%xj

(M)(p )

dfM

dXj(M)(p )

xi(M"1)(p )

+%E

%xj(M)(p )

%

%w # i # j (M"1)

(dfM

dXj(M )(p )

)xi(M"1)(p )

&

'

( (

)

*

+ +

p=1

P

,

=% 2E

%x # j (M)(p )%xj

(M)(p )(

dfM

dX # j (M )(p )

)(dfM

dXj(M)(p )

) +%E

%xj(M)(p )

(d2 fM

dXj(M)(p )2

)

&

'

( (

)

*

+ + x # i (M"1)(p )xi

(M"1)(p )

p=1

P

,

¯IqNÔ~�N°

!

EW2(M "1,i, j;m "1, # i , # j )

=$ 2E

$w # i # j (m"1)$xj

(M)(p )

dfM

dXj(M)(p )

xi(M"1)(p )

+$E

$xj(M)(p )

$

$w # i # j (m"1)

(dfM

dXj(M )(p )

)xi(M"1)(p )

%

&

' '

(

)

* *

p=1

P

+

=$ 2E

$x # j (m )(p )$xj

(M )(p )

p=1

P

+ (dfm

dX # j (m )(p )

)(dfM

dXj(M)(p )

)x # i (m"1)(p )xi

(M"1)(p )

(Q)

$

$w # i # j (m"1)

(dfM

dXj(M)) =

d2 fM

dX # j (m )(p )dXj

(M )(p )= 0 (Qm , M)

!

" 2E

"x # j (m )(p )"xj

(M )(p )=

"

"xk(m +1)(p )

k=1

I m+1

$ "E

"xj(M)(p )

%

&

' '

(

)

* *

"xk(m +1)(p )

"x # j (m )(p )

=" 2E

"xk(m +1)(p )"xj

(M )(p )

dfm +1

dXk(m +1)(p )

%

& ' '

(

) * * w # j k

(m )

k=1

I m+1

$

(Q)

xk(m +1)(p )

= fm +1(Xk(m +1)(p )

) = fm +1( wik(m )xi

(m )(p )

i=1

I m

$ )

"xk(m +1)(p )

"x # j (m )(p )

=dfm +1

dXk(m +1)(p )

w # j k(m )

!

EW2(m "1,i, j;M "1, # i , # j )

=$ 2E

$w # i # j (M"1)$xj

(m )(p )

dfm

dXj(m )(p )

xi(m"1)(p )

+$E

$xj(m )(p )

$

$w # i # j (M"1)

(dfm

dXj(m )(p )

)xi(m"1)(p )

%

&

' '

(

)

* *

p=1

P

+

=$ 2E

$x # j (M )(p )$xj

(m )(p )

p=1

P

+ (dfM

dX # j (M )(p )

)(dfm

dXj(m )(p )

)x # i (M"1)(p )xi

(m"1)(p )

(Q)

$

$w # i # j (M"1)

(dfm

dXj(m )) =

d2 fm

dX # j (M)(p )dXj

(m )(p )= 0 (Q M ,m)

$ 2E

$x # j (M )(p )$xj

(m )(p )=

$ 2E

$x # j (m )(p )$xj

(M )(p )

=$ 2E

$xk(m +1)(p )$xj

(M )(p )

dfm +1

dXk(m +1)(p )

%

& ' '

(

) * * w # j k

(m )

k=1

I m+1

+

¯~�NÔ~�N°j""""""m

!

m, " m #M

!

EW2(m "1,i, j; # m "1, # i # j )

=$ 2E

$w # i # j ( # m "1)$xj

(m )(p )

dfm

dXj(m )(p )

+$E

$xj(m )(p )

$

$wij( # m "1)

(dfm

dXj(m )(p )

)

%

&

' '

(

)

* * xi(m"1)(p )

p=1

P

+

=$ 2E

$x # j ( # m )(p )$xj

(m )(p )(

df # m

dX # j ( # m )(p )

)(dfm

dX # j (m )(p )

) +$E

$xj(m )(p )

(d2 fm

dXj(m )(p )2

),m # m , j # j

%

&

' '

(

)

* * x # i ( # m "1)(p )xi

(m"1)(p )

p=1

P

+

$ 2E

$x # j ( # m )(p )$xj

(m )(p )=

$

$xk( # m +1)(p )

$E

$xj(m )(p )

%

&

' '

(

)

* *

k=1

I # m +1

+ $xk( # m +1)(p )

$x # j ( # m )(p )

(Q) xk( # m +1)(p )

= f # m +1(Xk( # m +1)(p )

) = f # m +1( wik( # m )xi

( # m )(p )

i= 0

I # m +1

+ )

$xk( # m +1)(p )

$x # j ( # m )(p )

=df # m +1

dXk( # m +1)(p )

w # j k( # m )

KÍ#$%*ÆDj¯�����¢� ���!¯����®m

"""""-*üýqR³������!¯�����!næ»x`&Dg

"""«����¯�����DS!��«°DS�����DÕM6IDg

fi (

r w

( n)),

!fi

!r w

( n)

K¾opIÅÿ�Dj«�����¢� ���DÖm

"""³������!¯�����-h;Bn�×g

"""ãäS""""""I`f{S

"""0qRS

!

" 2 fi

"wj"wk

~ 0 yi # fi (w) ~ 0

!

"fi

"wj

"fi

"wk

#

$ % %

&

' ( (

i=1

N

) *wk

k=1

N

) +"fi

"wj

yi + fi (w)[ ]i=1

N

) = 0

( j = 1,2,...m)

jAm"[-Ö-<=D-MØ

"#$%&'()*+%,-<=Lc{SII-åËSUVv*-6-Ù6560qRÃÄx`-^S()*+%,{�9�NDÅd�ÁeOÉdqÙ°ÚZÇ�^<=^_`g()*+%,-ÉdD0qR{Ö->Ú�nyz`a0Z^_`g

("h:ê%ë-Éd

"hpSi:NOqfR{3Ð%wO�`ù^Éd�9^I`gh:ê%ëO5qR{Si:@6OÏ%qRÛs�Ñ6²-()*+%,Or`PÚOÉd^_`åËZI`gÜÝÞe|bcÉx-|}^{S�@,*'-Çßà~)0Æßà~)OÉdqRS�íbc«¬0Tebc«¬n¿wPT<=^_Ùg

0"Nü<=D

"3q-Ná#$%&'()*+%,-UVv*n�NâOIJ@g

3"ãäá<=DjëÆêöáSåNá¤������������¨m

"reN-Ð%wnÉdqS�ÈÉOi:ê%ë-ãäBndD�R`g

KNü<=D(½opIÅÿ�D

"i:NjhæNmOstuvw56nJ¢q�f0_OShæ�3Nù^-UVv*ny»xeÞSi:N-ç-UVv*{op-IÅÿ�Dn3íJ¢x`a0^¤»x`g12-üý^{S()*+%,©ªnhp-��YZ[D^IJ@qRS��-@@ZX�T�QÙ0_Oa-&DnJ¢qRi:N-ç-UVv*n¤»qSèâa-;<:�n�D�xa0^<=�í-FGZ.éde`gq?qS]Õù^-1E^{�ê�<=¿w-FG{À$àe�?QÙg

KNü<=D0½:ëÆ*D

"hæJ3NPDç-NOqfR{stuvw56Z��eRf`-^SÍ-opIÅÿ�D{�z�fgì�x`o²-UVv*OqfRSíî!¤îÒ¥�£�ªªª¯¨"��UVv*n@zRÇÖ-�ÉïnüýqRVs3Ö&�×n´`g

a-Vs~Ö&�×n! �!OqfR|Ta0^UVv*!º�±!OÏx`�7fZ�$àe`gQRn�D�qR!º�!n�$`a0Z^_`g

!

Wm = Wm0 + wm , wmam " m

m=1

M

# + b " m = 0 ( " m = 1,2,...M)

a " m µ =$E

$w " m % µ

&$E

$w " m 0

'

(

) )

*

+

, ,

1

%µ

(µ = 1,2,...M), b " m =$E

$w " m 0

KåNá<=D

"<=¢ê%ën�QR~ð<=qÙkS[-��nèéê%ë0qRèâ<=dù`ga-;<:�n�D�qRXY-ìínÇ$`a0Z^_`g��[Å_ñ-BC^{Çìí-<=Z1]^_`ZS�_ñ�BC^-¿¿lOqfR{ÈvÀ^I`g

�7ª!Ï��������!³ª��ª!������!ëª!«������!ò³�����������!��������!��!��� ��¡�!��®!���®������!��!�������!����!�������ò!¡������!�������!­!¥µ§�!µé!�!¶£!¤¥¦¦¥¨ª

LåNá<=-·ó�

P0

P1

P2

h:ê%ë"#$%&'()*+%,"i:ê%ë"èéê%ë"��

x

x

x

!

y

"1

"2

!

) y

) " 1

) " 2

!

) " 1

= #y =) y $ y

) " 2

= #"1

=) " 1$"

1

) " 3

= #"2

=) " 2$"

2

!

y +"1 +"2 +L = () y #

) " 1) + (

) " 1 #

) " 2) + (

) " 2 #

) " 3) +L =

) y +L$

) y

y +"1 +"2 +L = (P0 + P1 + P2 +L)X

!

!"#

!"$

!"%

!"&

'

! !"# !"$ !"% !"& '

!"#"$

!"#"%

!"#"&

"

"#"&

"#"%

"#"$

"#"'

" "#& "#% "#$ "#' (

!"#"$

!"#"%

"

"#"%

"#"$

"#"&

"#"'

" "#% "#$ "#& "#' (

!

!"#

!"$

!"%

!"&

'

! !"# !"$ !"% !"& '

"""ãäá<=DOP`$&s)wá56-<=�

ô½èéê%ëSõ½#$%&'¼()*+%,i:"¤�¨h978½�S

""¤�¨��½í¥S¤�¨��-��½í£S¤®¨;˽�Mí¥Mí£

F4"?@0GHIJ@j3m"?@0�<=

KÐvõ-I`ê%ëOqfR-56�R{$�

L56�R{$-�C

"33ê%ë�g56{"""""gÉö9S%&9-�U�ÉxÐvõn§Äg1o{>Ö-MB×�R{$g

sin(2!x)

9

9 3

LMB×IR{$

¼<=ê%ë""

¼¼�*ê%ëçIż�*��

¼ÅÖ6½zØ÷

¼�Ö6½�<=

%&

'(

)*+

,-(

)*+

L#$%&'()*+%,OP`�R{$��

j;m()*+%,i:-|ø

¼ÚÁ-ùS÷<=-Ù$-ê%ëZ�NOI`åË'

"nyz`g

K��ÊË56

< t

k|

r x >

!

E =1

2yk (x

q,w) " tk

q{ }k=1

c

#q=1

n

#2

E =1

2yk (x,w) " tk{ }

2p(tk x$

k=1

c

# )p(x)dtkdx

K<=��½

"��ÊË56nIÅOx`PÚOi:nÂÐx`a0""¼()*+%,ZTU-56núr^_`�àS""""""

""""""Õ

¼aaù^-û/{S#$%&'()*+%,ON`a-

"^{�fg

¼q?qS#$%&'()*+%,{åæ^I`-^

"""ç"Í-IJ@��Z12O1ú�9^I`g

"""""j""""-IJ�78nßz`gm

!

< tk | x >

!

"E

"y # k ( # x )= 0 = yk (x,w) $ tk{ }" (x $ # x )"k # k p(tk x%

k=1

c

& )p(x)dtkdx

!

yk (x) =< tk | x >" tk# p(tk | x)dtk

Ki:ZS"""-78nßz`a0-�

¼Ö-5nZ¤»/[Oßzàe`Bnyz`g

¼a-5nn<=dù`L-<=ê%ë{Ö-hD^I`g"

"aa^S"{Ðvõ^S""""0x`g

¼Íï<=ê%ë^<=qÙ#$%&'()*+%,XY{""

"""""""Õ

¼a-PÚOSÐvõZI`ê%ë?àaHùeRf`¤»

"/[5nZüi^_`g

!

< tk | x >

!

x " y(x) = h(x)

!

x " t = h(x) +#

!

"

!

< " >= 0

!

y(x) "< t | x >= h(x)

j>m?@

KÍï5/naÙàqÙ®»

("<=ê%ë{�NOI`g

0"#$%&'()*+%,{TU-56n\]^_`g""

""444q?qS12{¿N-<=ê%ëq?�fg

K<=-p[

L�_�()*+%,SÅd�<=ê%ëÊË

""ç"ìíìf<={�9""q?qS

L<=p[{<=ê%ëOHùe`*ÓÆwnýz`a0g

K#$%&'()*+%,OS�`Ö6

LàUVv*6

LÙ�qS~�OSÿøí¯UVv*6

K����!þ!·�������

Låæl-Åd�()*+%,56½"

"""""�_�÷³vò�'n�qg

Lê%ë-ÐvõOÿùRqùÚ56½

"""""�_�÷³ôòÆ�'n�qg"

K����η�������!¬������

L#$%&'()*+%,J¢-ó%'½

"""""³vò�Ô³ôòÆ�-*Ó%wºg

L³vò�Ô³ôòÆ�-ÅÆ*<%'

"ç"("UVv*6-�N

"""0"%¿dn q@A'¼»n��ÊË56O§Ä"""

"""""""j��������������m

"ç"÷�<=-OÙ'

jAm7Ý@0<=jM@65678BCm

�"ëª!¡������!�ª!«������!¹�������������!����������!���!��������!����!���!

""�ê��´�����!��!����������!��� ��¡��!°������!£²é!¤£©!��������!¥¦¦±¨!

""¦é§!�!¦§£ª

K!y-èGr

LXYS5678½

LÁî<=½"""""-"nÊ$Rïðg

L?@½"""""OS�`"-,nÊËx`g

"""""Õ

÷"#'I`f{S~�OS÷ê%ë�c-yn78'

"""""jÐvõZIQRaìfm

^÷"#'{S÷ê%ë�c-yn78'-ÐN

""jÐvõç9m""

L<=½÷!y-èGr'

d

!

(xi ,yi )" di

!

(xi , yi ,di )

!

x,y (" xi ,yi )

K7Ý@

L÷ê%ë�Z�f~)OS�`XYn~U[O¤$`

"O{S«¬Z÷D�f'ç"��������®!�������

LAOSê%ëO{ÐvõZHùeRf`g

La-��������®!�������n ��������®!�������Ox`O

"{S$à?-ò;ôÂô���Zí¸^I`g

Lò;ôÂô���½÷XY{�ö%õ^I`'

LÖ-ò;ôÂô�®»-�

"("XY{op^I`g

"0"XY-%&{7^I`g

"3"XY-~){NàeRf`g

"4"XY{I`@Ü'-a0^z@^I`g

jCm"?@9:-ÄÍ

Kº�����!Ï����

¼ÑÒxô`|-��n(�x`g

¼z¸�UVv*Z�_T�D�ô�fPÚ@A'¼»B

"nÄz`g

KÐvõ-§Ä

¼Ù0zÞSñcN-h:O%&9SÉö"-7_Ðvõ

"n§Äg

!

"

jEm"GHIJ@

¼reN-6

¼reN-þ#)*-6

¼h:N-þ#)*-6"

""ç"üýf->?jÇ�@mS?@9:-Ã�

K<=¿w-N6�Ôl

"UVv*@6--.,�ÔlZcv^�fÙ$O<=¿w0Å�*¼Çº)%uÆ�-N6�Ôln»f[Of `a0{*+^{I`ZS��[ì,�<=núÚ-.,OqfR��0üýÅ�*-5nn ÙgBC0qR{S*ëu,á;&õu-o-.Ç&á%ën�$`YBCn/¢qSÉp�y-uê'¼*ëu,¼;&õuOqfRÖ-sʺ&к%Ën�QRê%

ën´QÙg""""

";&õu]ÈOS?eÙ01;<%23Ój�m?à;&õue}j¹�!3m0Ç&á%ë�n�$`BCO#$%&'¼()*+%,nJ¢x`g�OS>NàCNOqfR<=��-�_dnüýfOÏqR;<)*qRI`ga-üý-%&^{SANàCN^Å�*¼Çº)%uÆ�Zìfg

!

"(R,Z,#) = 2CR ln8R

$

%

& '

(

) * + 2

,

- .

/

0 1 +C ln

$

a

%

& '

(

) * + (# + 0.5) 1+

a2

$2

%

& '

(

) *

,

- . .

/

0 1 1 $ cos 2 3

!"!#

!"#

#

#!

! $ % & ' #! #$ #%

()

*)

+)

!"#$

%&'()

<=¿w-N6�Ôl

K()*+%,*¨<©%-¤»

L>N#$%&'()*+%,-åË

""ç"Iż�*��n1]x`reNþ#)*6""n¤$`g

L¤»DJ3

"¼4¢�9�ê%ën&Æ/öO¼�*ê%ëOqRt&ºn5Tg

L¤»DJ;

"(ê%ë:)*nS&Æ/öO6²-ÈÉÊËOÉ�`g

"06J3²-ÈÉÊËOqfR<=núÚg7D3²-ê%ë:)""

""*^¼�*j���´�!���!���mg

"3Íï-��n6Ú�úÚg56j��ÊË56m-%&n0`g

"4µn@zRS0S3n�D�xg56n��qR""n¤$`g

!

) m

!

) m

K89í:»

!"# !"$%#

&'

%

' '

%

(

m m+1

&

)ijm

x

x

x

x

m1 m+1

1

mi

m+1j

xmi'

!

xjm +1

= f ( wijmxi

m

i= 0

I m

" )

LµN-i:Z~ÖµKS©Çë%ÆZÖ×^\]^_`0

"®»g

"a-åËSÖ×ZrDsq-^S�×!þ#)*{>;qRa

"ìfg"

"©Çë%ÆOqfRa-5n×Z��OrDsq�à�×{T

"U^I`g"a-5n{��O{rDs�fg

"Î"i:Z-JK-X�fþ#)*n>;g""""""

"

!

x " i

m= #i

" i xi

m

i=1i$ " i

I m

%

!

wijmxi

m =

i= 0

I m+1

" wijm + w # i j

m$i# i ( )

i= 0i% # i

I m+1

" xim

L�×!þ#)*n>;x`a0^S�×!þ#)*-i<^#

"�e`«¬

"

L�×!þ#)*n>;x`a0Zi:,Oá=x¿6"

La-6,Z>»qÙÌÍ\?O�`PÚOþ#)*

"n>;x`g

�@1î~SABCDSE1FGS%HIJKS|ìLØSüçÿû��

"<4/56"©¥�!£©¶!¤¥¦¦µ¨ª"

�MNOCSP1QRSñ@~SSTAUVSë¹�­¯�¥¯OS�`º»%

"w³),��O¢f`#$%&'()*+%,-GHIJ@S;&õu

"WXË<46Sé¶!¤£±±±¨!¦¥¥!�!¦£¥ª

!

"ym # i =$y

$x # i m" # i

m

!

" # i

m $ x # i

m % &i

# i xi

m

i=1i' # i

I m

(