17

Basics of Information Retrieval - Statistics and Linguistics

Embed Size (px)

Citation preview

Page 1: Basics of Information Retrieval - Statistics and Linguistics

������������ ��������������������� ���!�#"$��� ���%��&���')(* � �����%+���� ������,.-/�0��1!23��4���� �

57698)8;:�<>= ?)@ A�?CB4D

������������ �����������������������%�!�#"E�F� �+����&G��';(* � �����%+���� ������,.-/�0��1!23��4���� �

H;I+J0JLK�MONQP%R STP0UWV

X�YZYCY;[Q\;]0^Q_%`Qa�_cb3d)[TX�YZYCY

e0fTgihWj k lnm oLk p j p qWp g r%sQtTr%u�vWqLp gxw4eLyij gxoLyxgz qWuF{con|n{%y}lLj oLg m o0p gxw}{cyxp j r%on{%oLhn~C{%oL��qW{c��g �QoL��j oLgxgxw j oW��~){c��r�w}{cp r%w �

� r��������%�L�We������%�����7��� ���0���� ���L�eLf�gxhLgxo

Page 2: Basics of Information Retrieval - Statistics and Linguistics

������������� ��

� lLj kQj kQ{+k lLr�w p;j o�p w r0hWqLyxp j r�o�p r+��{ck j yTyxr%oWyxgivWp kQj o7j oWs r%w uF{cp j r%o w gxp w j g��c{�� �)m p;j k;f w j p p gxo7s w r%u {� j oL�%qWj k p j y�v�r�j o�p;r%s��0j gxf��0{%oLh�{cw ��qLgxkQp r�fT{%w hLkQu�r�w g w gik q�� p kQs w r%u�� j oW�%qLj k p j yik;p r��ZgTj o�p w r0hWqLyxgxhj oj oLs r�w u�{cp j r%onw gxp w j g��%{��Qk �0k p gxu hLg��%g�� r�vLu�gxo0p�� � lLj k j k�{�� k r9p lLg��Lw k p vW{%w p�r%sTu���hLr0yxp r%w}{��hLj k k gxw p}{%p j r�o��}e0p ��� j k p j y��;�0v�gxw j u�gxo�p k4j o�m oWs r%w uF{cp j r%o��4gip w j g��c{�� ��

!#"%$ �'& $ �(�

)*),+.-�/10�243�576 /8+:9<;=570�6 ;=>?3?@�ACBD573�576 E�576 F=EC3?+.G:H�6 +.I1J.6 E�576 F=E K

LNMPO�Q�R�SUT V�T S=Q(R(W�XZY Y [7W�\]T X�S�X�^._=X=W,`Ua([�SZ\]b c��� � |n{co0qW{��=��k+{cqWp r%uF{%p j y�u�gxp lWr0hLk(�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� ���� � e0p}{coWhW{cw h9j oLs r%w uF{%p j r�oFw gxp w j g��%{��Zk �0k p gxu�kf�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�hg

ikjml7R�Y `UR7\]T S=Q�T S=^ X�O�a'R7\�T XZS�O][�\�O�T [�l7R�Y n��� �o� gxyx{�� �C{coWh�vWw giyxj k j r%op�d�d�e�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� ���� � z rcf��%r0rLh9{cw g�p lWg�g��%{�� qW{%p j r�o�u�g�{ck qLw gxkrqs�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� �]t

cou1[�vZ\�R�bPR�SCX�w=x�[7W�\�X�^mb�\�`U_=y L�c��� �kzr%w hLk+{ck j oWhLj y�{cp r%w k r%s;hLr0yxqLuFgio0p4p r�vLj y{�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� ������ � � gx�%r%oLhnk j oL�,� g�f�r%w h9s w g�|0qLgxoLyx�9yir�qLo0p k%�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� �]}��� ��~+r0yxqLu�gxo0pD� gxoW�%p l��d�d�d�e�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�.�0���� � � gi�0p kT{cw g k r%u�gxp j u�gxk;f w j p p gxoe� {%oLh�w gx{%hZ���>j oP� {coL��qW{%�%gxk;r�p lWgxwQp l�{coF�;oW��� j k l �%���� g e0p w qLyxp qLw gxh9p g}�Lp+{%oLh9k p w qLyxp qLw j oL�Fp gi�Lp��d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�.�%���� ���+p lLgxw�|�q�{�� j p j gxk r%s)p gi�0p��e�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�.��g��� }�z lW{cp y�{%o9f�g hWr7f j p l�j oWs r%w uF{cp j r%o9{c��r�qLp p gi�0prq��e�d�d�d�d�e�.�d�e�d�d�d�d�e�.������ � � ��vWj yx{��=|�qWgxw ��vWw r0yxgik k j oL���d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�.�0���� � |n{cp y}lWj oW�P|0qLgxw j gxk+{coWh�hWr0yxqLu�gxo0p k��TeLg�{cw y}l��d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�.�0���� ��t � r0r,� g�{%op��k���vLw r%��{c�Lj � j k p j y+w gxp w j g��c{��s�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�.�%���� �����+qWgiw ��g}�LvW{%oLk j r%on{%oLh9w g�� g��c{%oLyxg�s gxgxhL��{cyr���d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�.�%���� �c�<�Lw r%uf|0qLgxw j gik4p r7hWj {�� r%�{�e�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�.�c�

�o��S=^ X�O�a'R7\�T XZSC�pW,W�[7b�bP�dO]XUW�[�b]b�[7b��e�pT R�Y X�Q cZ��7� �o��r�{�� k4{coWh9p}{ck ��kC�d�d�d�d�e�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�.���

�D�D�P���1�P��� j j j

�7� � m o�p gxw}{cyxp j r�o�uFr0hLg�� k8����gx�%r%oLhnk j oW��� g.|�qWgxw j gxk��d�e�d�d�d�d�e�.�d�e�d�d�d�d�e�.����7� ��� gxk g�{%w y}lnj k k qLgxk��d�d�d�d�e�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� �,t

��MP�?[7SC�p[�b�[,R�O�W�� ��`=[7b�\�T XZSUbP^ X�Op¡1T S=QZ`UT b�\]T W,bPT S��]S=^ X�O�a(R7\�T X�S<�pW,W�[�b]b �Zcg�� �k¢3w r,� g�s r%wD� j oL�%qWj k p j yxk£�d�e�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� ���g�� ��z lW{cp j k4{7hWr0yxqLu�gxo0prqp� � f�r��0j gxf k��d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� �%�g�� � ~Zj oL��qLj k p j y+u�gxp lLrLhLk4j o9j oLs r�w u�{cp j r%oFw gip w j g��c{��e�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� �%�g�� ��|9q7� p j � j oW�%q�{�� j p �k�d�d�d�d�e�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� �,gg�� g z rcf�p g}�Lp qW{�� j p �Fyxr%q�� h9��g qLp j � j ¤xgxh���gxp p giw��d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� ���g�� ���+p lLgxw4vLw r%vZgiw p j gxk r%s)p gi�0p k<�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� �,}g�� }�� g�{chLj oW�e�E{coLhnf lLr�j k p lLg w gx{%hLgxwrqN�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� �,}g�� � � gx�%r%oLhs¢�eLtTm mm�d�d�d�d�d�e�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� �,�g�� � e0�0k p gxu/g��c{�� qW{cp j r%o¥�d�d�d�e�d�d�d�d�e�d�d�d�d�d�d�d�e�d�d�d�d�e�.�d�e�d�d�d�d�e� �,�

9<;U-r;U0�;=+.F=;UE ¦8§

j �

Page 3: Basics of Information Retrieval - Statistics and Linguistics

� ���'���

� $��8" ��� ���� ":$ & ����U& �f�������:�(������s���� ��� $���� $���� ��s���� �

! ����� �'&�� �

! � � � $ #" $�� �$� " �%�U&��<�� "%$ "&�'�" � � � & $ �(�

��w �0{coWj ¤xj oL��{GhWr0yxqLu�gxo0p�yxr�� � giyxp j r%o k r�p lW{%p�hLr0yxqLuFgio0p k�y�{%o ��g�s r�qLoWhOg�{ck j � �!j k�hLj (�yiq�� pi�gxk v�gxyij {�� � �j s u�r%w gFp lW{co�r�oLg�w g�{chWgiw7j k�gi�0vZgiyxp gxh�p rn��g9{c��� g�p rnqLk g�p lLg�yxr,� � gxyxp j r�oZ� � lLgxk g�Lw k p+y}l�{cvWp gxw k��%j �%g7{��Ww j gxs;r��%gxw �0j gxf r%sQgi�Lj k p j oL�9{cqLp r�uF{cp j y�uFgip lWr0hLk+s r%w+p gi�0p�j oLhLgi�Lj oL��{coWhw gxp w j g��c{����Er%oWg�f j hLg�� �FqLk gxhnp gxy}lWoLr�� r��%�Fs r�w r�w ��{coWj ¤ij oW�7yir,� � gxyxp j r%oLk4{cqWp r�uF{cp j y�{�� � �7r%w4k giuFj ){cqWp r%uF{%p j y�{�� � �e�E{coWh9j hLgxo0p j s �Fk r%u�g�hWj w gxyxp j r%oLk s r�w s qLp qLw g w gik g�{cw y}l=�

*,+-*/.1032546087�95:&084<;%=,>?0@;%A-B�>?CD;%E6=GF6:

� lLgnp w}{chWj p j r%o�{��TfT{���r�s+r%w ��{%oLj ¤xj oW��hLr0yxqWu�gxo�p k�{coWh���r0r,��k�j k�k r%w p j oW�p lLgxu>vLl0�0k j y�{�� � �Gj ok lLg�� �%gikF{cs p gxw7y�{cp gx�%r�w j gxk�p l�{cp�l�{��%g9��gxgxo�vWw gxhWgip gxw u�j oLgxhZ� � lWj k7��gxoLgxw}{�� � ��f�r�w ��k�f�g�� � �Q�WqLp�LoWhLj oL�7p lLg+w j ��l�pT��{�� {coWyig+��gxp f�gxgxo9yx{%p gi��r%w ����gioWgxw {�� j p ��{%oLh�yx{%p gi��r%w ��k v�gxyxj �Lyxj p ��j k�hLj (�yiq�� pIHp lLg¥� j �Ww {%w ��y�� j gxo�pFlW{ck�p r(� g�{cw o!p lWgny�{cp gx�%r�w j ¤�{%p j r�o�k y}lWgiuFgJH.|0qLj p gnr%s p gxo!j pFj k�hLj (�yiq�� p�p rhLgxp gxw u�j oLg f lW{%pQy�{%p gx��r%w �7{+hWr0yxqLu�gxo0pQ��g�� r%oW�%kQp rKHL{coWhP|0qLj p g4r%s p gxo�{�hLr0yxqWu�gxo�p�uF{�� w j �%l0p � ���g�� r%oW�7p r�k g��%gxw}{��)yx{%p gi��r%w j gxk��e0r%uFg�r�s4p lLgxk g9hLw}{�f �W{cyr�0kFy�{co!��g9w gxu�gxhWj gxh�����j oWk p}{�� � j oL�{coML NPORQ S�p rp lLg9hLr0yxqWu�gxo�p

yxr�� � gxyip j r%o=�U~+r0yxqLu�gxo0p kCyx{%o��ZgQ�%j �%gio k g��cgxw}{���vZr%j o�p gxw kCqLk j oL� k g��%giw}{���u�gxp lLrLhLk){coWh�y�{co p l0qLkC��gw g�{cy}lLgxh��0��{%o���r%sCk g��%gxw}{��Cw r�qLp gxk��UTVNPORQ SWL NRX4j k�p lLg+vLw}{cyxp j yig+r�sZgxk p {%�7� j k lLj oL� yxr�w w gxk v�r%oWhLgxoLyxgxk��gxp f�gxgxoO{�k gxpi� vZr%k k j ��� �(� {cw �%g9{%oLh!p �0vLj y�{�� � �(�LoWj p g%�Tr%s8L NPORQ S�Y QIZI[8\7r%w�k g�{cw y}l p gxw u�kF{coWhj oLhWj �0j hLq�{��QhLrLyiqWu�gxo�p k�r%w�k gxyxp j r%oLk7p lLgxw gir�s ��m oWhLgi�Gp gxw u�k7{cw g�u�g�{co0p�p r9j oWhLj y�{cp g7p lWg�p r�vLj yr%w p lLg�yxr%o0p gxo0p r%sTp lLg�p gi�0p�� p lLg�k gxp r%sTp gxw uFk�j k�y}lLr�k gio�p r�w g^]Lgxyxp p lLg�p r�vLj y�{��;k p w qLyxp qLw g�r�sp lLg�yxr,� � gxyxp j r�oZ�Ck qWy}l�{%k�j p�y�{co�Zg�hLgxp gxw uFj oWgxhZ��m oLhLgi�Lj oL�nj k�p �0vLj y�{�� � �9hLr�oLg��0��j oLhWg}�Lgxw k.�v�gxw k r%oLk+f lWrFw g�{chnhLr0yxqWu�gxo�p k�{coWhn{%k k j ��o9j oWhLgi�9p giw u�k+p rFp lLgxu��4|�{co0qW{��)j oLhLgi�Lj oL��j k4r�s p gxo��r�p lhLj (�yxq7� p {coWhhLq�� � H)j p+v�r�k gxk ��w gx{%p�hLgxuF{%oLhLk r%oGyir�oLk j k p gxoWyi��s w r�u j oLhWg}�Lj oL��k gxk k j r�op rj oLhWg}�Lj oL�nk gxk k j r%o�{%oLh���gxp f�gxgxo�hLj _�gxw gio0p�j oLhLgi�Lgxw k���m p�j k p lLg�k r�w p r�s�` r%��f lLj y}lGj k7{9vWw j u�gy�{coWhLj hW{%p g�s r�w4{cqWp r�uF{cp j ¤�{cp j r%o=�¢4qWp r%uF{%p j oW��l�qWuF{co�v�gxw s r%w uF{coWyxgFj k7oLg��%gxw�p w j �0j {�� �;g��%gxo�f lWgxo�p lLg9p {%k �G{%p7lW{%oLh�uF{��

k gxgiu>w gxv�gxp j p j �%gn{coLh!oLr%oK) yiw g�{cp j �%g9{%pP�Lw k p���� {%oLyxg���|n{co0qW{�� j oWhLgi�0j oW���0��l�qWuF{co!j oWhLgi�Lgiw kj k�{s|0qLj p g�yxr%u�v�� g}��p {%k �W� {coWh�hWj (7yxq7� p7p rgxu�q�� {%p g�����yir�u�vLqWp giw k���|�{co0qW{�� j oWhLgi�Lgiw kF{coWh{c�Wk p w}{%yip r�w k {cw g�oLr�p4yxr�oLk j k p gxo0pi�Cu�qWy}l�p r�p lLg7{%k p r�oLj k lLu�gxo0p+r%sQhLrLyiqWu�gxo�p}{%p j r�o9w gxk g�{cw y}lLgxw k��m os {cyxpx�Zgxk p {%�7� j k lLj oL��{F�%gxoWgiw}{��;vLqWw v�r%k g7w gxvLw gxk gxo0p}{cp j r%or%s�{Fp gi�0p^a k yxr%o0p gxo0p�j k+vLw r��W{c��� �n{coj u�v�r�k k j �7� g+p}{ck ����{%o�p j yxj v�{cp j oL�7s qWp qWw g�qWk gxk4r�s;{7hLr0yxqLuFgio0p4j k hWj (7yxq7� p4{%p ��gxk p��

� ��bPc^d%e fVg8hWi

� ��vWj yx{�� � �+uF{%o�q�{��%j oLhWg}�Lj oL� k y}lLgxu�gxk)yxr�o�p w r���p lWgQj oLhLgi�Lj oL�4vLw r0yxgxk k)�0�+y�{cw gxs q7��j oWk p w qWyip j r%oWk{coWh9{co9gxk p}{%�7� j k lWgxh�k gxp r�s){�� � rcf�gxh�j oLhLgi�Fp gxw u�k�� � lLj k oW{%p qLw}{�� � �7w gihWqLyxgxk��%{cw j {cp j r%oZ�0�LqWp4{�� k r� j u�j p k p lLgG]Lgi�0j �Wj � j p ��r%s p lWgFw gxk q�� p j oW�nk g�{cw y}lLgxk��Fp lLg�p w {%hLgI) rW_��Zgip fTgigxo�vWw gihWj yip}{%�Lj � j p �{coWh]Lgi�Lj �Lj � j p ���Zgiyxr�u�gxkF{(�%gx��j k k qLg�� � lLg�j hWg�{r%s.� j u�j p j oL��k gxuF{co0p j ys�%{cw j {cp j r%o�p r�{hLj k yxw gip gk gxp�r�s�f�g�� �QhLg��LoWgihGp gxw u�km� {%o�j hWgx{�f lLj y}lyxw r%vWk qLvGw gx��q7� {cw � �9j o¥�Wg�� hWk�k qWy}lG{%k {cw p j �Lyxj {��j o�p g�� � j ��gxoLyxgFr�w7uF{%y}lLj oLg�p w}{coWk � {%p j r�o(� j k7r�s4yxr�qLw k gn{nhWw}{cuF{%p j y�k j u�v7� j �Ly�{%p j r�or�s+l�qWuF{co� j oL�%qWj k p j y+�Zgil�{��0j r%w��kj+{cp qWw {��CqWk g r%s;l0qLuF{%o�� {coL��qW{%�%gxk hWr0gxk4oLr�p u�{��%g qLk g r�s;hLg��LoWj p j r%oWk r�wk gxuF{co0p j y hLg�� j u�j p {%p j r�oLk^H��LoLhWj oL� {co7gi�0v�� j yxj p;hLg��LoWj p j r%o7j o�oW{%p qLw}{��0hWj k yxr�qLw k g���� � � j k�{4k �0u�vLp r%ur%s;uF{�� s qLoWyxp j r�oZ� �l z {%oLk�m�{%w � ��w gxoC�Z���,}%�Jn� ��{coWh�� {cw ��g�yxr�u�vLqWp gxw j ¤xgih�j oWhLgi�0j oW��k y}lWgxu�gxk7l�{��%g9hLj k p {%oLyxgxh�p lLgxu�k g�� �%gxk�s w r�u p lLgxj w

g�{cw � � �%r0{��0r�sWgxu7q7� {cp j oL�+l0qLuF{%o7j oWhLgi�Lj oW�+v�gxw s r%w uF{%oLyxgTp r�yxr%oWyxgio0p w}{cp j oL��r%o7f l�{cpQyir�u�vLqWp giw khLr f�g�� � ��oW{cuFg�� � fTr%w ��j oW��r��%giw1� {cw �%g ��r0hWj gxkQr�sWh�{cp}{��?z lLgxw g j oLj p j {�� � �+p lLg u�{cj o7��r0hW� r�s�f�r�w �j o j oLs r%w uF{%p j r�o!w gxp w j g��%{���w gik g�{cw y}lOl�{ck9��gxgxoOp r�hWg��%g�� r%vOu�gxp lLr0hWk�p r�lW{%oLh�� g�p lWg�w g�� {cp j �%gv�r��%giw p ��r�s�hW{%p {9j o�w gxs gxw gioWyxg�h�{cp}{c��{ck gxkx�){%oLhp j p � gI) r%o�� ��r�w {c�Lk p w}{cyxp ) r%o7� �nhLrLyiqWu�gxo�p �W{%k gikx�p lLg9s r0yxqLk�lW{%k�k lLj s p gih�p rhLg��%g�� r%vLj oW�u�gxp lLr0hWk7p rGyir�v�g9f j p l�p lLgn{%�LqLoWhW{%oLyxg9r%s+hW{cp}{{coWhhL�0oW{%u�j y�oW{%p qWw g�r�s)hLr0yxqWu�gxo�p4hW{%p {%�W{%k gxk4p r0hW{����� lLj kQj kQf lLgxw g p lLg4u�r�k pQoLr�p j yxg�{c��� g uFgip lWr0hLr,� r��%j y�{��0k lLj s p;hWqLw j oL� p lWg vW{%k p�s r%w p ���%g�{cw kQy�{%o

��g7s r%qLoWhZ��eL��k p gxu�k�p r0hW{��np ��vWj yx{�� � �9hLr�oWr%p�p {��%g7p lWg7k gip�r�sQj oWhLgi�np gxw uFk+p r���g7vLw gxhLg��WoLgxhZ��LqWp�qLk g�p lLg�uF{%p giw j {��4p lLgx�C�WoLhOj o!p lLg�p gi�0p k�p lLgxu�k g�� �%gikn{ck�p lWgnk p}{cw p j oW��v�r%j o0p��G{Gk lLj s ps w r%u f l�{cp k r%uFgip j u�gxk j k�yx{�� � gxh6oPZVQIp qVr-rJZ OWL NPsWY Q+p r5otr-\IY p qVr-rJZ OWL NPsWY Q+j oWhLgi�0j oW�7� � lWj k k lWj s p j k{cyxyxr%uFvW{coWj gih��0�7p lLg4k lLj s p�s w r�u {�k gxp ) p lWgxr%w gxp j y�{����0j gxf�r�sZhLr0yxqLuFgio0p��W{ck gxkTp r�{+vWw r%�W{%�Lj � j k p j y�0j gxf3r�sQw gxp w j g��%{�� �Tu�r0hWgxw onw gxp w j g��%{��)k �0k p gxu�k�p ��vWj y�{�� � ��hLrFoWr%pm�0j gxf3w gxp w j g��%{��;{ck+r%v�gxw}{cp j r%oWkr%on{7k gxp4r%s)hWr0yxqLu�gxo0p ki�Wf j p l9qLk gxw w g�|�qWgxk p k�{ck yxr�oLk p w {%j o�p k4r%o9k gxp4u�gxu���gxw k lLj vZ�W�LqWp j oLk p g�{chw}{co��9hLr0yxqWu�gxo�p k+s r�wm� j �%g�� j lWr0r0h9r%sQw g�� g��%{coWyxg�p rFp lLg7f�r%w hWk�r%w+p giw u�k+p lLg7w gx{%hLgxw+l�{ck�rW_�gxw gxhp rFp lWg�k �0k p giun����{ck gxh�r%onk r%u�g�vWw r��W{%�Lj � j k p j y+y�{�� yxq7� {%p j r�oZ� � lWg�j oLhWgi�0gxk+p ��vWj yx{�� � ����gxoLgxw}{cp gxh�0�nvLw gxk gxo�p ) hW{���k ��k p gxu�k�{cw g7��gx{%w gihGp rcfT{%w hWk�s q�� � ��{cqLp r�uF{cp j y�w gxp w j g��%{��Qr%s�s q�� �)p gi�Lp k w}{cp lLgxwp lW{%o�{np w}{%hLj p j r�oW{��QvWw j o0p�j oLhWgi�Gf lLj y}l�f j � ���ZgFqLk gxh�s r%w7{%yxyigxk k�p r��Lj �7� j r%��w}{cvLlWj yx{��QhW{%p {nr�wy�{cw h9y�{cp}{�� r��%k��1¢3p w}{chWj p j r%o�{���vWw j o0p4j oWhLgi��o�{cp qLw}{�� � ��u7qLk p4��g�k uF{�� �ZgxoLr�qL�%lnp rF��g�qWk gis q��Cs r�wl0qLuF{%o7qWk gxw k��Uu4oLhLgxwQp lLg+{ck k qLuFvLp j r%o7p lW{%p;oLr l0qLuF{%o7qWk gxw�g��cgxw�f j � �W{cyxp qW{�� � � w g�{ch�p lLg j oLhWg}�p gxw uFki�Wp lLg+o0qLu7��gxw r%s)j oLhLgi�Fp gxw u�k y�{co���g {�� � rcf�gxhFp r7��w rcfOvLw}{cyxp j yx{�� � ��f j p l�oLrP� j u�j p�� � lLj kuF{��cgxk4p lLg p {%k �Fr%s;j oWhLgi�Lj oW�7p gi�Lp k+hLj _�gxw gio0p4s w r�u p lWg�p}{%k ��p lW{cp4g�{cw � j giw g^_�r%w p k fTr%w �%gihnr�oZ�z rcf�g��%gxwi�;p lWge�Wg�� h�l�{ck�oLr�p+gi�Lv�gxw j gxoLyxgxhuF{J` r%w+u�gxp lLr0hWr�� r%��j yx{��){coWh�p lWgxr%w gxp j y�{��;�Ww g�{��W)

p lLw r%qW�%lWk�� � {ck j y�{�� � �%�Qp lWg9j oLs r�w u�{cp j r%oGw gip w j g��c{�� k �0k p giuFk�r%s4p r0h�{x��f�r%w ��j o!{co�j o0p qWj p j �%g�� �{cvWv�g�{�� j oL��k j u�v7� g�fT{x�%�TqLk j oL��{�� �%r�w j p lLuFk�{%��r%qWp7s r%w p �G�%g�{cw k�r,� hZ��|9r�k p7k �0k p gxu�k�p l�{cpF{cw ghLgxv�� rc�%gxh9s r�w vLqW�7� j y�qLk g�p r0h�{x�9{cw g �W{ck gxhnr%o9j hLg�{ck4p lW{cp fTgiw gd�0oLrcf oZ��gxk p {%�7� j k lLgxhZ��{%oLh��Ww k pgi�0v�� r%w gxh7giuFvLj w j y�{�� � ��j o7p lWg+���,g�tKa kvl ~CqLlWoZ�C�c��g�}0��~CqLlLoC�C�c��g,����~CqLlWoZ�C���,g%�Jn � � lLj kQk lLr�q7� h7oLr�p��g�p {��%gio�p r7u�g�{coFp l�{cpTp lWg�{cyxp qW{���w gxp w j g��c{���k gxw �0j yxgik l�{��%g�oWr%pTj u�vLw r��cgxh�k p w j �0j oL�,� �7r��%gxwTp lLgvW{%k p s r%w p ���%g�{cw k�� g�{%w � ��yir�oJ` gxyxp qLw gFlW{ck���gxgioGk r�� j hLj �Wgihj o�p rn{�� �%r%w j p lLu�k^H;{�� �%r�w j p lWu�k+��{ck gxhr%o�g�{%w � �9yxr�oJ` gxyxp qWw g7lW{]�cg���gxgxo¥�%gxw j �Lgxh�u�{cp lLgxuF{%p j y�{�� � �%�Wp gik p gxhr%o¥� {%w ��g�yir�w v�r%w}{0�C{%oLhhLgI)�%g�� r�v�gxh9{%oLh�gxoLl�{coWyigxh9k j oLyxg���e0�0k p giuFk p r0h�{x��y�{%o ��� {cw �%g�� ��p l�{co���k p r7��gxp p giw l�{cw hLf {cw gm�uF{��cg���gxp p gxw7qLk gFr�s qLk gxw k7p r�j uFvLw r]�%gFp lLgxj w�v�gxw s r�w uF{coWyig�� � lLgxw g9{cw gFs q�� ��p gi�0p k�{]�c{%j � {%�7� g%�p lLg�j o0p gxw s {cyxgxk p r7p lLg�k ��k p gxu�k+{cw g�s {ck p gxw4{coLh��Zgip p gxw hLgxk j �%oLgxhC�Wp lWg�vLw r0yxgxk k j oW�7k v�gxgxh�j k lLj �%lgxoLr�qL�%l�p r�v�gxw uFj p+j o0p gxw {%yxp j �%g�k g�{cw y}l¥�$j o0p gxw {%yxp j �%g�j o�p lWg�k gxoLk g7p lW{%p+p lLg7qLk gxw�yx{%on��g7gi�w)v�gxyxp gihFp r vWw r��0j hWg p lWg yxr%o0p j o�qWj p �7r%sZp lLg4hLj {�� r���vLw r0yxgxk k1� {coLhFp lWg4yxr%u�vWqLp gxw?� j p gxw {%yx� r�s�p lLg{]�cgxw}{c��g7w g�{chWgxw�lW{ck�j oWyiw g�{ck gxhp r�p lWg7v�r%j o0p+f lLgxw g�gioWr%qW�%l'� j �Ww {%w ��y�� j gio0p k+y�{co��g7gi�Lv�gxyip gxhp rnqLk g�{�yxr�u�vLqWp gxw k g�{cw y}l�k �0k p gxu p rnk gx{%w y}l�{coWh(�WoLhGhWr0yxqLu�gxo0p k s r%w k qWy}l�k �0k p giuFk p rn��ghLgxk j �%oWgih�{coLhnhLgxv7� rc�cgxhnj o�u�r%k pD� j �Lw}{cw j gxkTj o9f�g�� � ) p rJ) hLr7oLgxj �%l0��r%w lWr0r0hLk��

Page 4: Basics of Information Retrieval - Statistics and Linguistics

� gi�Lp

�� gi�0p+{co�{�� �0k j k vWw rLyigxhWqLw g

�� gxvLw gxk gxo0p}{cp j r%o

|

�� g�|�qWgik p+{%oW{�� �0k j k vLw r0yxgxhLqLw g

���qLgxw ���� �

�����

|n{%p y}lWj oL��vWw rLyigxhWqLw g

�)j �%qWw g���� ��� � lLg�e0p}{coWhW{cw hn|nr0hLg��Cr�s)m oLs r�w u�{cp j r%op�4gip w j g��c{��

¢4oWh�p lLj k�j k7{nw}{cvWj h7� ��u�r���j oL�ns w r%o0p j giw��¥z lLj � g�p lLgFv�{ck p�hWgxyx{%hLgxk7lW{]�%g�k gigxo�w}{cvLj h�hLgI)�%g�� r�vLu�gxo0pFr�s�s q7� � ) p gi�Lp7k �0k p gxu�kx�+j pF{�� k rGlW{ck��Lw r%qW�%l0pFp rGw gxoLgxf�gxh�{cp p gxo�p j r%o p lWgs�%{�� qLgnr�suF{%o�q�{�� � ��vWw r]�0j hLgxhnj oWhLgi�Lgik+uF{%hLg qLvnr%sQs gxf��Wf�g�� � ) gihWj p gxh9p gxw u�k�� |�{co0qW{��)j oLhWg}�Lj oL�FlW{%k4oLr�p��gxgxo�k qLvLv�� {co0p gxh��0�9{%qLp r%u�{cp j y�s q�� � ) p gi�0p4w gxp w j g��%{��)k ��k p gxu�kx�Z�LqWp+l�{ck�{��Ww j ��l�p4s qWp qLw g7{clLg�{%hj px�Lf j p l�p r0r,� k p r7gxoLk qWw g�yir�oLk j k p gxoWyi�n{coWh�w}{%j k g�vWw rLhLqLyxp j ��j p ��r%s)l0qLuF{%o�j oWhLgi�0gxw k��� lLgk p}{cw p j oL��v�r%j o0p�r%s p lLj k9p g}�Lp9f j � ����g�p lWg�hWgik j �%o�r%s p �0vLj y�{���j oLs r�w uF{cp j r%o w gxp w j g��%{��

k ��k p gxu�knj oOqLk gGp r0hW{��%��{coWh�j p9f j � �+�%r!r%o�p r!{cw �%qWgp lW{%p�yxgxw p {%j oOk lLr%w p yxr%u�j oW�%k9r%s�p lLgxk gk ��k p gxu�k�y�{%o�Zgik p���gF{%hLhWw gxk k gxh�p lWw r%qL��lGp lWgFj oWy�� qWk j r�or%sTu�r�w g�� j oW�%qWj k p j ye�0oLrcfD� gihW�%gFj o�p rp lLg7k �0k p giu%�$j s;p lWg7j o0p gxw s {%yxg j k�yir�u�v�gxp gxo�p�p r�p w}{coWk u�j p4p lLj km�0oLrcfD� gihW�%g�{cvLvWw r%vLw j {cp g�� ��p rp lLg qLk gxw��

*,+��� ;%0326F60�UF A^2 �W=�U>?0@;%A-= 2�%C�;�UA^C�93087 :��5:#;%C@>?:

� lLg�k p {%oLh�{cw hGu�rLhLg��Qs r�w j oLs r�w u�{cp j r%o�w gxp w j g��c{��Qj k w r�qL�%l�� �{ck�k lLrcf o�j o(�W�%qLw gn��� ��� � lLgxw gj k+{��Zr0hL��r�sQp gi�Lp kIHCj oLs r%w uF{%p j r�o�w g�|0qLgxk p k {cw g�vLqWp4p r�{�k �0k p gxu f lLj y}l�lW{coWh7� gxk+p lWj k4��r0hW��r�sp gi�0p k^HCp lWg7p gi�Lp k {cw g�{co�{�� ��k gxh��0�9k r�u�g�s r�w u r%sT{coW{�� ��k j k+vWw rLyigxhWqLw g7p r���j g�� h�{FoLr�oR) p gi�0p qW{��w gxvLw gxk gxo0p}{cp j r%oFr%s�p lWg4k}{cu�gWH0p lWg4j oLs r�w u�{cp j r%o�w g�|0qLgxk p k {%w g�� j �cgxf j k g4{%oW{�� �0k gxh�����{%o�j hLgxo0p j y�{��r%w�k j u�j � {cw+vLw r0yxgxhLqWw g7p r9�0j g�� hG{ |0qLgxw ��� � lLgFp f�r9w gxvLw gxk gxo0p}{cp j r%oLk7{cw g7p lWgioGuF{cp y}lLgxh=� � lLgp gi�0p k f j p l�p lWg7��gxk p uF{cp y}lLgxk�{%w g7vLw gxk gxo0p gih�{ck v�r%p gxo0p j {��;j oLs r�w u�{cp j r%onk r�qLw yxgik�p r9s q7� ���;p lLgw g�|�qWgik p��m o9s {%yxpD�%gxw �p� j p p � g+r%s;p lLj k vWw rLyigxk k+j k4{cyxp qW{�� � �F�W{%k gxhnr%ong}�Lv7� j yxj pD��oWr�fD� gxhL��g r%s�� {coW�%qW{%�%g��

� �0vLj y�{�� � ���Zr%p l�{%oW{�� �0k j k+vWw rLyigxhWqLw gxk {coLh�uF{cp y}lWj oW�FvLw r0yxgxhLqLw g�{%w g�v�gxw s r%w u�gxh�qLk j oL�Fk p}{cp j k )p j yx{��Tu�gxp lLrLhLk�� � lLg9w r�� g�s r�wP� j oL��qLj k p j yxk�r�wP�0oLrcfD� gxhL�%gnr%s�� {coW�%q�{c�%g9j o���gxoLgxw}{��4j k7qWk qW{�� � �{ck k qLuFgih�p r9��gFj oj u�vLw r���j oL�9p lLgF{%oW{�� �0k j k r%sTw g�|�qWgik p k7{%oLhGp gi�0p k^HQp lWg�w givWw gik gxo0p {%p j r�oLk�{cw gj o�k r%u�g�fT{x�9{ck k qLu�gxh9p r7��g {J) � j oW�%qLj k p j y4{%oLhn{cu�gxoW{%�7� g+p r7vWqLw g�s r�w uF{���u�{coLj vWq7� {cp j r%o=� � lLgv�r�j o0p+r�s�p lLgF{co�{�� ��k j k�r%vZgiw}{%p j r�oLk+j k�p �0vLj y�{�� � �9p}{��%gxop r��Zg�{��+p r9w gxhLqLyxg�p lWg�{cu�r�qLo0p�r%s�j oR)s r%w uF{%p j r�onj o�r%w hLgxw�p r�u�{��%g�p lLg7w gxvLw gxk gxo�p}{cp j r%oWk�uF{co�{c��gx{%�7� gd��{coLhp lLg7oLr%j k g�y�{%qLk gxh���

w gxhLqLyxg�p r�p lW{%p�gxoLh � {coWh����Qk p w {%j �%l0p gxo�r%qLpTp lWgm�c{%�%qLgxoWgik k4{coLhFj oLhWgxp gxw u�j oW{%yx�7j oWlLgxw gxo�p�j ooW{%p qLw}{��=� {%oL��qW{c��g�j o�r�w hWgxw p rFs {cyxj � j p}{cp g4u�{cp y}lLj oL���� lLj k�|0qLj p gTj o0p qLj p j �cg {coLh7j o�uF{%o�� f {x�0k�{cvWv�g�{�� j oL�4u�rLhLg��0lLj hWgik;p lLg yxr%u�v�� gi�Lj p ��r�sWl�qWuF{co

� {coW�%qW{%�%g�qWk gFs w r%u p lWg�u�{cp y}lLj oL��vLw r0yxgxhLqWw g%�Qf lWj y}l�y�{%oGp lLgxo���g9{chLhWw gik k gxh�qWk j oW�ns r�w u�{��u�gxp lLr0hWk�� � lLj k�j kQoLr%p�gxo�p j w g�� �7p r p lLg4��gxoLg��Lp�r�s�p lLg4gxo0p giw vWw j k g�� � lLg��%gxw �7k}{cu�g4u�gxy}lW{%oLj k u�kf lLj y}l�uF{��%g p lWgTuF{%p y}lLj oL��yir�u�v7� j y�{cp gxhd� p lWg8�%{c��qLgxoLgxk k�{%oLh7j oLhWgxp gxw u�j oW{%yx��r�sWl0qLuF{%oP� {coR)�%q�{c��gD�E{cw g+f lW{%pTuF{��cgxk l0qLuF{%o � {coW�%q�{c�%g+f�r�w ��f�g�� �Z{%k {�yir�u�u�qWoLj y�{cp j �%g4p r0r,� H0{�fT{cw gxoLgxk kr%sZp lWj kQj kQp �0vLj y�{�� � ��{%�Lk p w}{cyxp gihFr%qLp�r%sZp lWg k g�{cw y}l�vLw r0yxgxk k�� � lWg uF{J` r%wQhWj _Zgiw gxoLyxg4�Zgip fTgigxoFqLk )j oL��{%o�{cqLp r�uF{cp gxhFj oWs r%w uF{%p j r�o7w gxp w j g��%{��Wk �0k p gxu {%oLh�yir�oLk q7� p j oL� f j p l�{ l�qWuF{coFj oLs r�w u�{cp j r%o{co�{�� �0k pQj kQp l�{cpQp lWgD� {cp p giwQoLr�w u�{�� � ��hLr0gxk�oLr%pQw g�|0qLj w g p lLg w g�|�qWgxk pTp r��Zg p w}{%oLk s r%w u�gxh7p r�k r�u�gj o,�%{cw j {co0p {coWhqLo�{cu7�Lj �%qWr%qLk w gxvLw gxk gxo0p}{cp j r%o HQoLgxj p lLgxw�hWr0gxk p lLg�l�qWuF{co�{%oW{�� �0k p�w g�|�qWj w g�p lLghLrLyiqWu�gxo�p k4p r���g�{coW{�� �,¤xgxh9j o�p r�k qLy}l�{co9w givWw gik gxo0p {%p j r�oZ�1¢ l0qLuF{%on{co�{�� ��k p oWr%p4r%o7� �Fyxr%v�gxkf j p l��LqLp�qWp j � j ¤xgxk+p lLg ]Wg}�Lj �Lj � j p ��r�sQj oLs r�w uF{cp j r%onj o�l�qWuF{co'� {coW�%qW{%�%g��4j p+j k�oLr%p {%o�r��Lk p}{cy�� g�LqWp�{�s gx{%p qLw g���¢ k gxgxu�j oL�,� �9qWoLw g�� {cp gxhp g}�Lp uF{��nyxr�o�p}{cj o'�%{�� q�{c�7� g7w g�� g��%{co0p vW{cw}{�� � g�� k+p rn{w g�|�qWgik p��

� ��{%�%qWgioWgxk k�u�{x�9�Zg�p lLg7vLw j yig�p lW{%p+l�{ck+p r���g�v�{cj hnj onr�w hLgxw+p r�{%y}lLj g��%g7p lWg�0j oLh�r%sC��� j hLj oW� s w r%u r%oLg+yxr%oWyxgivWp p r7{coWr%p lLgxwTf lLj y}l�j kToLgxyxgxk k}{%w ��s r%wToLr�oR) p w j �0j {��w gxp w j g��%{�� 5l z {coWkDm {cw � �%w gxoZ�Z�c��}%�Wn �

� lLg�oLgi�Lp�s gxf y}l�{cvLp gxw k f j � �Wgi�W{cu�j oWg4lLrcf j oWs r%w uF{cp j r%o7w gxp w j g��%{�����gxlW{]��j r�w�j k�g��%{�� qW{%p gihC�0lLrcfj oLhWg}�Lj oL�4k y}lWgiuFgikQu�r0hWg��0{%oLh�w gxvLw gxk gxo0p;p gi�0p kx�%lLrcf�p lLgx��g�� j yxj p){coWh uFr0hLg���j oLs r�w u�{cp j r%o�oLgxgxhLkx�{coWh9lLrcf�p lLg hLj {�� r%�7��gxp f�gxgxonw g�{chLgxw+{coWh9k ��k p gxu/j k k gxp4qLvZ�

} �

Page 5: Basics of Information Retrieval - Statistics and Linguistics

! ����� �'&����

� �f��� � ���� $�� $ �D" ��� ���� "%$ �(& ����U& �f���

m oLs r�w uF{cp j r%oFw gxp w j g��c{��C{�� �%r�w j p lLuFk�f�r%w �Ff j p l9{�f�g�� �Zs r�w u�{�� j ¤igxh�{coWh�hWg��LoLgxh9uFr0hLg���r�sCqWk {%�%g{coWh!qLp j � j p ��� � lLj k7l�{ck���w gx{%p7�ZgioWg��Lp kFs r%w�p lWg9vLqWw v�r%k gxkFr%s+g��c{�� q�{cp j oL��k �0k p gxu qWk {%�%g%� {coWhj oLs r�w u�{cp j r%oGw gip w j g��c{���w gxk g�{cw y}l!lW{ck7hWg��cg�� r%vZgih {nf�g�� �ThWg��LoLgxh {coWh�fTg�� � gik p}{c��� j k lWgih�k gxp7r�sg��c{�� qW{cp j r%o9p r0r�� k�� � lWgi�n{cw g ��{ck gxhnr%o9p lLg�oLr%p j r%oWk r�s#oPZVQVqIL \IL rJNF{coWh�Z QVq s�� � � � lWge�L�%qWw g s w r%up lLg�vLw g���j r%qWkTk gxyxp j r%o�j kTw gxv�g�{%p gxh�lWgiw g�� �;j �%qLw g+�7� � �i�0f j p l�{ Z QV\��� Y� L \IYZ{%hLhWgih�p r7p lWg+vLw r0yxgxk k��{�o0qLu7��gxw�r�s�v�r%p gxo0p j {�� � �9qWk gis q��QhWr0yxqLu�gxo0p k�f j � �;��g�vLw gxk gxo�p gxhGp r9p lWg7w g�{chWgxw j o�k r%uFg7fT{x���� w gxyxj k j r�o9{coWh�w gxy�{�� �C{cw g�u�g�{%k qWw gih9�0��gi�W{cu�j oWj oW��lWr�fOu�{co0��w g�� g��%{co0pThLrLyiqWu�gxo�p k p lLgxw g�{cw gj o�p lWg�w gxp w j g��%gxh9k gip��

� gi�Lp

�� gi�0p+{co�{�� �0k j k vWw rLyigxhWqLw g

�� gxvLw gxk gxo0p}{cp j r%o

m oWs r%w uF{%p j r�o�w g�|0qLgxk p

�� g�|�qWgik p+{%oW{�� �0k j k vLw r0yxgxhLqLw g

���qLgxw ���� �

����� |n{%p y}lLj oL��vLw r0yxgxhLqWw g

��4gik q�� p j oL�P� j k pTr�s)v�r%p gxo0p j {�� � ��qWk gis q��ChWr0yxqLu�gxo0p k�)j �%qWw g���� ��� � lLg�e0p}{coWhW{cw hn|nr0hLg��Cr�s)m oLs r�w u�{cp j r%op�4gip w j g��c{��

�5+-* � C�BD087-7 0826F�� UC�BDA-:�A-= 2

� [7W�R�Y Y�����X��%[�v=�=R�`Ub�\�T l�[¥T be\��=[¥b�[,R�O�W���m s�r�oLgl�{ckn{��%r0rLh gxk p j u�{cp g�r�s lLrcf u�{co0�!w g�� g��%{co0p9hLrLyiqWu�gxo�p kn{�hLrLyiqWu�gxo�pn�W{ck g

w g�� g��c{%o�pQhLr0yxqLuFgio0p k�{cw gTs r�qLoWh�{%oLh7w gxp w j g��%gih��0��{%o�{�� �%r%w j p lLu�� � lWg w}{cp j r+��gxp f�gxgxo�p lLgo0qLu7��gxw+r�sQw gxp w j g��%gxhw g�� g��c{%o�p�hLr0yxqWu�gxo�p k�{%oLh�p lLg7o�qWu���gxw�r%sQoLr�oR) w gxp w j g��%gihw g�� g��%{co0phWr0yxqLu�gxo0p k j k y�{�� � gxh6ZVQVq s�� � �

�dO�[�W,T b�T XZS�����X�%a'`UW��CQ�R�O]w�R7Q�[�� lWgTw gxp w j g��%gxh7k gxp;p �0vLj y�{�� � ��yxr�o�p}{cj oWk;��r�p l7w g�� g��%{co0pQ{coWh�oWr%oR) w g�� g��%{co0p;hWr0yxqLu�gxo0p k�� � lLgw}{%p j r9��gxp f�gxgxo�p lWg�o0qLu��Zgiw�r%sTw g�� g��%{co0p hLr0yxqWu�gxo�p k�{%oLhGp lLg�o0qLu7��gxw r%sToLr�oR) w g�� g��%{co0phWr0yxqLu�gxo0p k j on{�w gxp w j g��%gxh9k gxp4j k y�{�� � gxh oPZVQVqIL \IL rJN��

� X�a¥w�T SUT S=Q'�UO�[�W,T b�T XZS�R�SU_CO�[�W�R�Y Y� w j �0j {�� � �c�Tj s {coO{�� �%r�w j p lLu {�� fT{���kFw gxp w j g��%gxk�{�� �4hLr0yxqWu�gxo�p kFj o {hWr0yxqLu�gxo0pF�W{ck g%�4j pl�{ck�r�oLg9l0qLoWhLw gxh!v�gxw�yxgxo0p�w giy�{�� � � z rcf�g��%giwx�4j p7vWw gxk qLu�{c�7� ��lW{ck � rcf vLw gxyxj k j r%o=�!m op lWj k�k gxoLk g%��vLw gxyxj k j r�o�{coLh�w gxy�{�� �1�%{cw �j o�{%o�j o,�%gxw k g�w g�� {cp j r%o=�nm o�uF{%o��g��%{�� qW{%p j r�oLkx�vWw giyxj k j r%o�j k u�g�{ck qLw gxhn{%p {P�0�Lgihno�qWu���gxw4r%s)w gxp w j g��%gxh9hWr0yxqLu�gxo0p k��e� vWw gxyxj k j r�o9{cp4�,g� L�g�� ��� �Z��j �cgxk {Fu�g�{ck qLw g7r%sQlWr�f f�g�� �Q{%o{�� �%r�w j p lLu/hWg�� j �%gxw k�{cp+p lLg7p r�v�r%sQp lLg7w gxp w j g��%gxh� j k p��7m oGr%p lWgiw kx�;w giy�{�� ��{%oLhvWw giyxj k j r%oG{%w g�v7� r�p p gxhG{%��{cj oWk p�g�{%y}lGr%p lWgiw�� vWw giyxj k j r%oG{%p {yxgxw p}{cj ov�r�j o0p r%sTw giy�{�� �Qj oWhLj y�{cp gxk�lWr�f u��0y}l�0{cw �W{%�%g�w gx{%hLgxw k�lW{]�cgFp r9fT{%hLgFp lLw r%qW�%lqWo�p j �Cp lLgx�p�0oLrcf3p lWgx��lW{]�cg�s r%qLoWh�{cp�� g�{%k p4lW{�� s)r%s;p lLg j o�p gxw gik p j oL��hWr0yxqLu�gxo0p k�� m o9p lLg� �+�Qt g��c{�� q�{cp j r%oWk�{%o��i���I) v�r�j o0p {]�%gxw {%�%g�u�g�{ck qLw g+j k�qLk gxhZ�Wf j p lFvLw gxyxj k j r�o�uFgx{%k qLw gxh{%pFg��%gxw ���]tvZgiw yxgxo�p�r%s�w gxy�{�� � �{cpn�]tGv�gxw yxgxo0pFw gxyx{�� � �4{cp���tGv�gxw yigxo0p�w giy�{�� � �4{coLh k rs r�w p lFhLrcf o�p r���t�t�vZgiw yxgxo�pTw gxy�{�� � ��f lLgxw g�{�� �Lw g�� g��c{%o�p�hWr0yxqLu�gxo0p kT{cw g+{ck k qLu�gxhFp r lW{]�%g�Zgigxonw gxp w j g��%gih=� � lWg�{��%gxw}{c��g vLw gxyxj k j r%o�{cp+{�� �Zp lLr�k g w giy�{�� �CvZr%j o�p k4j k qWk gxh{ck4p lWg p r%p}{��uFgx{%k qLw g��

�5+���� =����,=G=GF 0�%C ;%E6C C�93087^4603;%A^=,2 >?C�08:%4 %C@: �

¢+k+g��%{�� q�{cp j r%o9u�g�{%k qWw gik+vWw gxyxj k j r�on{coWhnw gxy�{�� �Cl�{��%g7k g��%gxw}{����%giw �n{%p p w}{%yip j �%gd|0qW{�� j p j gik�� � lLgx�{cw g�j o�p qLj p j �%g�� ���%{�� j h {coWh y�{co�gxu�vLj w j y�{�� � � ��gQhWgxp gxw u�j oLgxh p r4�ZgQw g�� j {%�7� g�� z r�f�g��%gxwx�%p lLgx��k qK_�gxws w r%u k r�u�g4hLj k p j oWyip j �%g hWw}{xfk) �W{%yr��k��1�Wr%w�p lLg4w g�|0qLj w gxh�y�{�� yxq�� {%p j r�oLkQp lWg4g��c{�� qW{cp r�wQu�qLk p1��oWr�flLrcf!uF{co0��w g�� g��c{%o�pQhWr0yxqLu�gxo0p k�p lLgxw g4{%w gc�0lLrcf!uF{co0��hLr0yxqWu�gxo�p k�p lWgxw g�{cw g j o7p lLg4�W{%k gc�0lLrcfuF{%o��hLr0yxqWu�gxo�p k7{%w g�w gxp w j g��%gxhZ��lLrcf p rnf�gxj �%l�w g�� g��%{coWyxg�p r�vLw gxyij k j r%oC�;lLrcf p r�hLgxp gxw uFj oWgf lW{%p7{s|�qWgiw �Gj kx�Q{coWh�lLrcf p r ` qLhL��gFw g�� g��%{coWyxg��¥¢m� ��r�s p lWgxk g�p lLj oL��k�y�{co���gFhWr%oLg%�Q�WqLp7{%pw j k ��r�s;uF{��0j oL��p lWg g��c{�� qW{cp j r%o9p r0rF{%hR) lLr0y�{coWhnj onj p k g�� s)j w w g�� g��c{%o�px��{ck+j p4f�gxw g��Tj oLs r�w u�{cp j r%ok vW{%yigxk+k g�� hWr%u/l�{��%g7{�k p w qLyxp qLw g�k j u�v7� g�gxoLr�qL�%l�p r���g uF{%vLv�gxhnp r�p lLj k4k r%w p4r%sQvLw r%p r%p �0vLj y�{��g��c{�� qW{cp j �%g�k vW{cyxg��

! R�a'��Y T S=Qm o��%gxoWgiw}{�� �Tf�g�hWr�oWr%p7l�{��%gn{n��r0r0h�vLj yxp qWw g�r%s4lLrcf u�{co0�hWr0yxqLu�gxo0p k�{%w g9w g�� g��%{co0pj o�{n�%j �%gio�hWr0yxqLu�gxo0p���{ck g�� u4o7� gxk k�f�g�l�{��%g9{nk uF{�� �Tg}�Lv�gxw j u�gxo�p}{��ThW{cp}{%�W{ck g�qWoLhLgxwyxr�u�v7� gxp g�g}�Lv�gxw j u�gxo�p}{��Cyxr%o0p w r,�Cf�g u�qWk p w gxk r%w p p r�k}{cu�v�� j oW��vLw r0yxgxhLqWw gik��

" SUT l�[,O�b�[m oWhLgxgxhZ�0r�s p gio�f�g4y�{%oLoLr�pQhLgxp gxw uFj oWg f lW{%pQp lLg3a gxo0p j w g hLrLyiqWu�gxo�p��W{%k gJa�j k��)s r�wQj oWk p {%oLyxg%�j o p lWg�y�{ck g�r%s m o�p gxw oLgxp9w gxp w j g��%{�� � f lWgiw g�p lLg�h�{cp}{c��{ck g�j k ]WqLj hO{coWh l�qW�%g��0��uFr%k pyxr�o�p gxu�v�r�w {%w ��k p}{coWhW{%w hWk��

�$#Ic&% 'wcKe ( )*+( ), -Jg .GcKe ( -/) gIf-e g ( f&#Vc�% �%�

��\][,O�R7\�T X�S¢�|0qLgxw �9j k4f�g�� �)hLg��WoLgxh�gi�Lv�gxw j uFgio0p}{�� � �%�W�WqLp+f lW{%p4j p k4yxr%qWo�p gxw vW{%w p�j o9w g�{���� j s g j k�� gik kfTg�� � hLg��LoWgih=� u k gxw k7r�s p gio�y�{%oLoLr�p7v�r%k g�p lLgxj w�j oWs r%w uF{cp j r%oGoLgxgxhLk�j o�k qWyiyxj oLyxp7k g�{cw y}lp gxw u�k4�LqLp4yx��y�� g p lWw r%qL��ln{7o�qWu���gxw4r%s;j p gxw}{cp j r%oWkTqWo�p j �Zp lLge��j k j �7� g+p r%vns gif�j p gxu�k j o9{w gxp w j g��%gxh�k gip+k gxgxu k}{cp j k s {%yxp r�w ���m¢ p+f lW{%p+v�r%j o0p4k lLr%q�� h9fTg�g��c{�� qW{cp g�p lLg�k ��k p gxu q�¢ pg�{%y}l9k qLyxyxgik k j �%ge|0qLgxw ��q'�+w4{%p p lLg gioWh9r%s;p lLg k gxk k j r%o�q

� [�\�O�T [�l7R�Y� lWg�w gxp w j g��%gxh�k gxp+j k+oLr�p4hWg�� j u�j p gxh9j onu�r�k p4vWw r%�W{%�Lj � j k p j y w {%o7�0j oL�Fk �0k p gxu�k��.¢�� j k p4r�sk g��%gxw {��;p lLr�qLk}{coWh�hLr0yxqWu�gxo�p k+j k+vLw gxk qLuF{%�7� �9oLr%p.�%giw �9qWk gis q��;p r�{Fl�qWuF{co�qLk gxw�� z rcfu�{co0��hWr0yxqLu�gxo0p k4k lLr%q�� h�f�g7{ck k qLu�g�{cyxp qW{�� � ��l�{��%g �Zgigxo9w gxp w j g��%gxh�q

�dO�[�W,T b�T XZS�l=b�O][7W�R�Y Y¢m�%gxw}{c�%j oW��w gxy�{�� � ) vLw gxyij k j r%o9p w}{chWg�rW_�k+j ong�� �7� ���I) v�r%j o0p4{]�%gxw {%�%gxk�j k4yxr%u�uFr%onvLw}{cyxp j yxgc��WqLp)lW{%kCp lLg�qLoWhLgxk j w {%�7� g�yir�oLk g�|�qWgxoLyxgTp r+uF{ck ��{�� �%r�w j p lWuOhLj _�gxw gxoLyxgxk��;k r�u�g�{�� ��r%w j p lWu�ku�{x�FhLr �cgxw ��f�g�� �Cj o�lWj ��lR) vLw gxyxj k j r�oFk g�{cw y}lLgxk�{coWh�� gik k4f�g�� �Cj o9lLj ��l�w gxy�{�� �Cy�{ck gxk^HWk r�u�gu�{x��hLrnf�g�� �Qj oy�{ck gxk�f lLgxw g�p lLgxw g�{cw gP�%gxw ��s gxf hWr0yxqLu�gxo0p k�p rn��g�s r%qWoLhC�)r%p lLgxw k�hLr�Zgip p gxw f lWgxo9p lWg�hWr0yxqLu�gxo0p �W{ck g j k k}{cp qWw {%p gihnf j p l9uF{cp gxw j {��Zs r%w p lLg p r%vWj y {%p lW{%oLhZ�

� [7Y [�l7R�SUW�[sR�S�_<T S=^ X�O�a'R7\�T XZS�SU[,[7_?��� �=R7\pT b10�O][7Y [�l�R�S�\&23��Wr%w+k r%uFg Y sJ\54-\+w g�� g��%{coLyxg7j km�%gxw �nhLj _�gxw gio0p�p r�p lLg7{%k k qWu�vLp j r%oWk+qWoLhLgxw � ��j oW��vLw gxyij k j r%o{%oLh7w gxy�{�� � �U¢!qLk gxw;u�{x� ��gTfTr%w ��j oW�+r%o�{4yxr%qWw p;y�{ck gTr�wQ{4vW{%p gio0pQ{%vLv�� j y�{cp j r%oC�c{%oLh7u�qLk pl�{��%gF{cogi�0l�{cqLk p j �%g�� j k p+r%s {�� �)hLrLyiqWu�gxo�p k j o{Fh�{cp}{c��{ck g��P�Wr%w+p lWj k�p}{%k ���)w gxy�{�� �;j k {coj u�vZr%w p}{co0p�s {%yxp r�w�� � qWp4{coWr%p lLgxw qLk gxw uF{��FoLgxgxh�k j u�v7� ��oLgxgxhn{con{coWk f�gxw p r�{e|0qLgxk p j r�o�!j o f lWj y}lOy�{ck g�p lWg¥�Ww k p9hLr0yxqWu�gxo�p9p r�yxr%uFg{�� r%oW��uF{x�!k}{cp j k s �!p lLggxo�p j w g�oLgxgxhZ�{%oLh�oLg��%giw�uFj oWhnp lWg�w gxk p+r�sQp lLg�yxr,� � gxyxp j r�oZ��¢+oLh�r%s p gxonp lWgiw g7j k+oLr�j oLs r�w u�{cp j r%o9oLgxgxhhWg��LoW{%�7� gF{%p�{�� � �Fm sTk r%u�gxr�oLg�j k k y�{coWoLj oL�np lLw r%qW�%l�{9yxr�� � giyxp j r%or%sTs {cuFj � �nk oW{%vLk lLr�p kx�p lWg j oLs r%w uF{%p j r�oFoWgigxhnj k k}{%p j k �Lgxhnf lLgxo{�� �ZvWj yxp qLw gxk4l�{��%g ��gxgxos��j gxf�gxhnr�w k r�u�g�uFr%w gj o0p giw gxk p j oW��p}{ck �!yir�u�gxk�qLvC�4f lLj y}lLg��%gxw9yxr%u�gxkp�Ww k p���¢ k �0k p gxu s r%w�r%w ��{%oLj ¤xj oL��{coWhw gxp w j g��0j oL��s {cu�j � �7vWlLr�p r�k f j � �CoLr�p ��g�g�{%k ��p r�g��c{�� q�{cp g�v�gxw4w gxy�{�� �){coLh9vLw gxyxj k j r�oZ�� lWgxw g {%w g+y}lW{%w}{cyxp giw j k p j yxk r%sUORr-q��R[ QINtY \�f lWj y}l�uF{��%g+w g�� g��c{%oLyxgU` qWhL�%uFgio0p kTw}{cp lWgiwD� gik kp l�{co�y�� gx{%w ) yxqWp��e�)j w k p � �%�ZhLrLyiqWu�gxo�p k�uF{��9��g7r%s�hLj _�gxw j oL� |�q�{�� j p ��� ~Cgx��{��Q{%oLh�u�gxhLj y�{��{%h7�0j yig�y�{co���g�s r%qWoLhns r�w+s w gxg�r%o�p lLg�j o�p gxw oLgxpx��f j p lLr�qLp�{co0��|�q�{�� j p �9{%k k qWw {%oLyxg7{%p�{�� � �eLr%u�gQj oWs r%w uF{cp j r%o+uF{��+��g�u�j k ��qLj hLgxh {%oLh u�j k p}{��%gxoZ�%{coWh k r%u�gQuF{��+g��cgxo7��gQvLqWw vZr%k g�� �uFj k � g�{chWj oW�7��m oG{�� � �Z|�q�{�� j p �9y�{coLoWr%p�g�{ck j � �9��g7j oLk gxw p gihj o�p r�p lLg��Lj o�{cw �9hLj k p j oLyxp j r�onr�sw g�� g��c{%oLyxg���e0gxyxr%oLh�� �c�;k r�u�g7hLrLyiqWu�gxo�p k k qLv�gxw k gihWg�r�� hWgiw�hWr0yxqLu�gxo0p k���¢+or�� h¥�%gxw k j r�or�s7{�uF{co0qW{���lW{%k9oLr�w g�� g��c{%oLyxgG{cpn{�� ��p r!{�lWg�� v |�qWgiw �%� j s7{�oLgxf�gxws�%giw k j r%o�yxr%u�gxk{�� r%oL�tH0{�w gxs qLp}{cp j r%o�r%w�yxr%qLo0p gxw y�� {cj u uF{x�e� rcf�gxw�p lLg4w g�� g��c{%oLyxg4r�sZ{�w gxs giw w gxhFhLr0yxqLuFgio0p��� giuFv�r%w}{��Tr�w�hLj {%y}lLw r%oWj y9{ck v�gxyxp k7r�s4hLr0yxqWu�gxo�p7yxr�� � gxyxp j r�oLk�y�{co�oLr%p7��g��Lw r�qL�%l0p7j o�p rw g�� g��c{%oLyxg�hWj k p j oLyxp j r%oWkTf j p l9{%o���g�{ck g��

e0rL�Zj onk qLu�uF{%w �c�Zf lLj � g vLw gxyxj k j r%o{coWhnw gxyx{�� �){%w ge�%gxw �9qWk gis q��;g}�Lv�gxw j u�gxo�p}{��;yir�oLyxgxvLp k+s r�wp gxk p j oL�9{�� �%r�w j p lWu�k4{coWh�yir�u�vW{%w j oW�F{�� ��r%w j p lWu�k4p rFg�{cy}l�r�p lLgxwx��p lWgij w+qLp j � j p �Fj km� gxk k+y�� g�{%w4s r�wu�g�{ck qWw j oW��k qLyxyxgik k�s r�w4{�k ��k p gxu j onw g�{�� ) f�r�w � h9p}{ck �0k4s r�w4y}lW{%oL��j oW��hL�0oW{%u�j y hW{%p}{c�W{%k gik���¢m� )�%r�w j p lWu�kT{cw g��LqLp vW{%w pTr�s){co�j oLs r�w u�{cp j r%oF{%yiyxgxk k k ��k p gxu�� � {ck ��hLg��WoLj p j r�oZ�LqLk gxwTvWw gis gxw gxoLyxgxkx�hLrLyiqWu�gxo�pp|0qW{�� j p j gxkx� w g�{�� ) p j uFg9s {%yxp r�w ki��{coLhOyxr%k pn{coLhOp j u�gnyxr%oWk p w}{%j o0p k9{ck�f�g�� ��{%k�r%p lLgxwyxr%o0p g}�Lp qW{��Cs {%yip r�w k4{�� �Zyxr%u�g�j o0p r7v�� {��Fs r%w k �0k p gxu g��%{�� q�{cp j r%oZ�� lLg oLgi�Lp;y}l�{cvLp gxw kQf j � �0j oLs r�w u�{�� � �4hWgxk yxw j ��gTk p}{coWhW{%w h�{�� �%r%w j p lLu�k;{coWhP�c{%w j {%p j r�oLk)p lLgxw gir�s �

r0yxy�{ck j r%o�{�� � ��w gxs gxw w j oL� p r�vWw giyxj k j r%oF{coLh�w gxyx{�� �W{ckQk p}{coWhW{%w hFu�g�{ck qLw gxkQr�sZ{�� ��r%w j p lWu3g^(�yxj gxoWyi���

���

Page 6: Basics of Information Retrieval - Statistics and Linguistics

! ����� �'&����

� &���� �f� � $ "���� &��<� " � �s� � �

m oLs r�w uF{cp j r%ow gip w j g��c{��Qp gxy}lWoLr�� r��%��j k.� {%w ��g�� ��{%��r%qWp�p gi�0p7{%oLhp lLgFyxr%o0p gxo�p�r%sTp gi�0p�� � z lWj y}lr%s4yxr%qWw k g�j k7{s� j uFj p}{%p j r�o�f lWj y}l�u�{x�k gxgxu�j oW{%vLvWw r�vLw j {cp g�j o(� j �%l0p�r%s4p lLg � {%w ��g �c{%w j gxp �r�sj oLs r�w u�{cp j r%o!k r�qLw yxgik�{��%{cj � {c��� gnp r�qWk�� �>m o3{Gw gxk gx{%w y}l3{cw g�{�f lLj y}l�uF{cj o7� ��yxr%oLyxgxw oLknp gi�0pp lLgxw g�{%w g7o0qLu�gxw r%qWk�v�� {cyxgxk�f lWgiw g�� j oL��qLj k p j y�w gxk gx{%w y}lw gxk q7� p k�yxr�q7� hvLw r,�Lp}{c��� �n��gF{cvWv7� j gxhZ�{coWhno0qLu�gxw r%qWkm|�qWgik p j r%oWk4f lWj y}l�f�g�� �)yxr%q�� h���g l�{coLhWgxh��W{cyr�9p r � j oL��qLj k p k s r�w4s qLw p lLgxw+k p qLhL���z r�fTg��%gxwx�Lj oFoLgxj p lLgxw�hLj w gxyxp j r�oF{cw g+p lLgxk g4r�v�gxoLj oL��k�w g�{�� � ��qLp j � j ¤igxh=� � lWj k�y}lW{%vLp gxw�f j � �W�%j �%g�{cor��cgxw �0j gxf3r%s)f l�{cp4p gxy}lWoLr�� r��%�Fj k ��gxj oL��qLk gxh9p r0h�{x���

�5+-* � =�%F6:&08: A^26F6A^B�0@;%=�%: =��MF6=GBD46>?C@2 ;�;�=��6A^B

� lLg���{ck j y�{%k k qWu�vLp j r%o�r%s;{cqLp r�uF{cp j y4j oLhWg}�Lj oL�7u�gxy}lW{coWj k uFkTj kTp lW{%pTp lLg�vLw gxk gioWyxg�r�w {c�Wk gioWyxgr%sQ{7fTr%w h���r%w4u�r%w g �%gxoLgxw}{�� � �%�W{GY QIZI[7��f lLj y}lnyx{%o9��g�{%o���fTr%w hnr%w4yir�u��Wj o�{cp j r%o�r�s)fTr%w hLk��j o9{7hLrLyiqWu�gxo�p4j k j oLhLj y�{cp j �%g+r�s)p r�vLj y��� lLg�yigxo0p w {���p}{ck �+j o j oLhWg}�Lj oL� j kZp lWgQy}lLr%j yxg�r%s0j oWhLgi��p giw u �crLyx{%�Lq�� {%w ���)m o p lLgQs r,� � rcf j oL�Tp lLg

{ck k qLuFvLp j r%o�j k�p l�{cp�p lWg4j oLhLgi�Lj oL�d�%r0y�{c�Wq7� {cw �7s r%w�p lLg+u�r%k p�vW{cw p�f j � �W�Zg ��{ck gxhFr%o �0oLrcfD� gihW�%g{c�Zr%qLp+p lLgP�%r0y�{c�Lq�� {cw ��r�sQp lLg�p g}�Lp kx�Cw {%p lLgxw+p l�{co{�vLw gxhLgxp gxw u�j oLgxh�k gip�� � rFqWoLhLgxw k p}{coLhp lLg�%r0y�{c�Wq7� {cw �9r%sQp lLg�p gi�0p kx�Zf�g7oLgxgxh�p rFqLoWhLgxw k p {%oLhlLrcf3p lLge� {%oL�%q�{c��g p lW{cp+p lLg�p gi�0p k���g�� r%oW�p r�fTr%w ��� � lLgxop lLg7p}{%k ��w gihWqLyxgxk�p r��+lLrcf y�{coGf�g7vLj yr�nw g�� g��c{%o�p�p gxw u�k�p r9hLgxk yiw j ��g�{�p g}�Lpx��%j �%gxo9p lW{%p f�gd�0oLrcfOf l�{cp4p giw u�k+{cw g�j o9j p4{%oLh9lLrcf�p lLr�k g�p gxw u�k4{cw g qLk gxh9g�� k gxf lLgxw g�q

��� K � K�� +.3?@ ���=; 5��.; G./�F=J.24;=+D5� lLge�Ww k p+k p givWk+p r �WoLhLj oW��j oLhLgi�np giw u�k�{cqLp r�uF{cp j y�{�� � �7j k4p rF�LqWj � hn{�� j k p4r%s;fTr%w hLk+j on{�p g}�Lpx�{coWh!yx{�� yiq�� {cp g�p lWgij w�s w g�|0qLgxoLyx��r�s+r0yxyxqLw w gxoLyxg�� � lWg9uFr%w g9s w g�|�qWgio0pFp giw u�k�{%w gnyir�oLk j hLgxw gxhu�r�w g �c{�� q�{c��� gFj oGvWw r�v�r%w p j r%op r�p lWgxj w�r%�Lk gxw �%gih�s w g�|�qWgioWyxj gxk�� � lLj k�hLgxk j �%o�k qW�%��gik p j r%o�fT{ck�Lw k p4uF{chWg���� z {coWk � gxp gxw+~ZqWlLo�l ~ZqWlLoZ�C�c��g,}���~CqLlWoZ�C�c��g%�Jn ��{%oLh9p lLg u�g�{ck qLw g j k yxr�u�u�r%o�� �y�{�� � gxh Y QIZV[��VZVQ � �tQIN q�� r�wx��j uF{%�%j oW{%p j �%g�� �%� Y �}�Zs r%w+k lLr%w p��.�Lr�w+p lWj k4p gi�Lpi�Zs r�w4j oWk p}{%oLyxg%��p lWge� j k pf j � �0�Zg4{%kQk lWr�f oFj o�p {%�7� g4��� ��� � �0vLj y�{�� � �c��s r�wQg�{cy}l�hWr0yxqLu�gxo0pQp lLg4p gxw u f�gxj �%l0p kT{cw g yxr�� � gxyxp gxhj o9{��cgxyxp r%wD�${GY QIZV[��WQVqIY rJZ8��f lLgxw g g�{cy}lnv�r%k j p j r%o9j o9p lLgd�%giyxp r%w+w gxvWw gxk gxo�p k {7p giw u9��{coWhg�{cy}l9vZr%k j p j r�o�lLr�� hWk p lLg p gxw u/f�gxj �%l0p s r%w p lW{%p hWr0yxqLu�gxo0p��

�! #"%$'& (*),+ �! #"%$#& (*).- �! #"%$'& (*)0/1 2'3 4 5�687#9*3 : 582 ;=<8>%? 7'>%3 : 5%2 @#A B%3+*C%DE& '( DF-G& '( -%/%/H& '(I -HJ%K /%LG" +�M%-HJ%KN /H& J /%-G"%O'P + I CE"D N "%O'P /Q+RJ%K + N DE& J/ NHS T -%L S T +*DF/ S O/ N " -%- S O +�-%UH"%O'P- IHS O -8CH& J +�- NHS T-8DEV�( +�UG) (*W*"%X X I CHV�(+�MH& (*) Y T +�UGP'JQW*Z#Y[(*OQ& T N DH& ( \Q&+ N ) (*& ) S (*]8"%X +�MG$') (*W S T S J%O N -G& '"%&+ NHS O#K J%) Y^"%& S J%O +�LGK J%) N CHK J%)+ NHS O#P'( \ S O'_ +*DHV�( L%MGJ%)�! #"%$'& (*).D �! #"%$#& (*).L �! #"%$'& (*) N` 7'A*4 : A a b,: >%? 5 c d=A a�A >84 9 e+%+ I & '( I -G& '( +*C'+f& '(L%LHJ%K N +RJ%K +*C%CEJ%KL8DE& J D%CH& J M%/G"%O'PL8CE"%O'P /%UG" N MG& JDFL S O /%L S O L%L S OD'+f" /%-G"%O'P DF/G"D%C S T /Q+ S O#K J%) Y^"%& S J%O D%C S T/%/HP'JQW*Z#Y[(*OQ& T + NGS T /8DHV�(/Q+fgFZ#(*) h + N K J%) /%/Gij(- N K J%) +�L T h T & (*Y T /Q+RK J%)-%/H" T +�/ S OQ& (*) "%W*& S J%O - I "%) (-Q+f& (*) Y T +�-GO'J%& -%LG& ( \Q&�;j ��qLw g ��� ���1�Ww g�|0qLgxoLyx��p}{c��� g�r%s)f�r�w hLk4j o9p lWj k p gi�Lp��

�Pf k ekcFl�c&) -#m�n^f8oJe -/,!l-e '#pQq �]g

¢4kF{nk gxuF{co0p j y�w gxvLw gxk gxo�p}{cp j r%oC�T{�p gxw u��%giyxp r%w�s r%w u�gxh�s w r%u>{¥� j k p�k qLy}l {ck7p lWg�r%oLg�j o� {%�7� gF��� ��j k v�r0r�w�� ¢+oGr%����j r�qLk�j u�vLw r��cgxu�gxo0p�j k p r���� p gxw r�qLp yxgiw p}{cj oGf�r�w hWk�p l�{cp k gxgxu p rlW{]�%g � j p p � g7p rnhLrnf j p lGp r%vWj y��p¢4� j k p r%sTk qLy}l�fTr%w hLkx�;u�r%k p r�s p gioG��w {%u�uF{%p j y�{��;s r�w u fTr%w hLk{coWhFr�p lWgxw�y�� r�k gih�y�� {%k k�fTr%w hLkx�Lj k�yxr%u�u�r�o7� ��y�{�� � gxhF{,\IY rVo1� L \IY�� {co�g}�W{cuFv7� g4y�{co���g4k gxgio�j o� {%�7� g+��� �0�L{coLh9{ w gxk q7� p j oL� k gxpTr%sZj oLhWg}�Fp gxw uFk�j o � {c��� g+��� �7��¢+oLr�p lLgxwTw r�qLp g4p r�j u�vLw r��cgxu�gxo0pj kTp r7oWr%p g���{%k ~CqLlLo�hWr0gxkTj oFlWj k+���,g%��vW{cvZgiw1��p l�{cpTp lLg�u�r%k pTs w g�|0qLgxo�p fTr%w hLk k g�� hLr%u/{cw gk j �%oLj �Wyx{%o�p�s r%w�p lLj k�k r�w p r�s gxo�p gxw vLw j k g%��{%oLhGp l�{cp�p l�qWk�j p u�j �%l0p ��gFv�r�k k j ��� gFp rs�7� p gxw p lWgiur%qWp�{cqLp r�uF{cp j y�{�� � �c�W��{ck gxh�r�onp lLgxj w+s w g�|0qLgxoWyi��w}{cp lLgxw+p l�{conp lWgij w+p gi�0p ) gi�0p gxw oW{��Qr%wm� j oL�%qWj k p j ys g�{cp qLw gxk��

p lWg { {coWh p l�{cp r�oLgj p p f�r�uF{�� yir�q7� h k qLy}loLgi�0p ` qWk p�lW{�� s ��r%p l r�sp r j o s r%w f lLj y}l j p k

� � ��)j �%qWw g���� ����e0p r�v7� j k p��

��� K � rts +./vu<@ ;=G.I8; 3=wP/1Jm5C@ 3?+.I1J.3?I1;m s f�g�p w �!p r�hLgxp giw u�j oWgnf lW{%p�p giw u�k�j oO{GhLr0yxqLuFgio0p9{cw g�k j �%oWj �Wy�{co0pFs r%w�w givWw gik gxo0p j oW��j p kyxr%o0p gio0px�Tf�gp�WoLh�p l�{cp�p gxw u�k7p lW{%p�{cw g�yxr%u�u�r�o�j o�{nhWr0yxqLu�gxo0pi�T�LqLp�{�� k ryxr%u�uFr%oGj o!{�� �r%p lWgiw4hLrLyiqWu�gxo�p kx�Z{cw g.� gxk k qWk gis q��)p lW{%o9r%p lLgxw k�� � lLge|�qWgik p j r%o9j k4lLrcf \ otQVqIL xkq {7p gxw u/j k p rF{hLrLyiqWu�gxo�px�Wr�w lLrcf �KN qVrJ[ [ rJN � � qVrJ[ [ rJN�j p j k��yUr&� � QVqIY L rJNz�VZ Q � �PQIN q��c��L N{�WQIZ \-Q<ORr-q��R[ QINtY0�VZ Q � �tQIN q��%��r�wx� {c�0{cj o�j u�{c�%j o�{cp j �cg�� �%�vL O �}�Tj kF{

u�g�{ck qWw gTr%sLp giw u3k v�gxyxj �Lyxj p ��r%w j �%j oW{�� � �4hLg��LoWgxh��0�3m {cw gxo7e0vW{%w yr�^|%r%oLgxkvl eLvW{cw yr�}|%r�oLgxkx�C����}��Jn �m hLs;j k4{7s qLoLyxp j r%o9r�s!~��Q�'�Cf lLgxw g�~ j k k r%u�g�yxr%oWk p {%o�px��p ��vWj yx{�� � �FhLgxv�gxoLhWgio0p+r%o���Wp lLg p r%p}{��o0qLu��Zgiw4r%s;hLr0yxqLuFgio0p k j on{�yxr,� � gxyxp j r�oZ�W{coWh��'�Cj k p lWg�o0qLu7��gxw r�s)hLr0yxqWu�gxo�p k4f lLgxw g�{�p gxw u��r0yxyxqLw k���p lLgGORr-q��K[ QINtY��VZVQ � �tQIN q���� � lLj k�u�g�{ck qLw g���j �cgxk�lLj �%l¥�c{�� qWg�p r�p giw u�k�f lLj y}l�r0yxyxqLwj onr%o7� �9{Fs gif3hWr0yxqLu�gxo0p k��@u4k gxh{�� r%oWgc�Zj p4�%j �%gxk�{%��r%qWp+{ck+qLk gxs q7�;w gxk q7� p k+{%k+p gxw u s w g�|0qLgxoLyx�qLk gxh�{�� r%oWg��� lLgxw g�{cw g4k g��%gxw {��Zu�r0hLj �Wyx{%p j r�oLkQr�sZp lLg8L O �;uFgx{%k qLw g�� � {cw}{c��w}{cvLlWkx�0j oWk p g�{chFr�sZhLrLyiqWu�gxo�p k

y�{co���g�qWk gxh{%k�{���{ck j kx��j onr%w hWgiw+p rFuFr0hLg��)p lLg�s {%yip�p lW{cp+hWr0yxqLu�gxo0p k+uF{��9oLr%p���g�lLr�u�r%��gV)oLr�qLk,l ~){cl0p j oLgxoZ�C�c�%���0�Cg�� ��� n H)r%oLg7u�{x�9fTgij ��l�p�p lLg7uFgx{%k qLw g7j o�hLj _�gxw gio0p�fT{���k �W{%k gihGr%o�p lLghLrLyiqWu�gxo�p4vLw r�v�gxw p j gxk�� �¢ v�r%p gxo0p j {�� vLw r%��� gxu>f j p l L O �7{ckF{u�g�{ck qLw g9j k�p l�{cp�j p7j k�qWoLy�� gx{%w7f l�{cp�qWoLj �%gxw k gnp lLg

hLrLyiqWu�gxo�pFs w g�|0qLgxoLyx�!k lLr�q7� h!��g9y�{�� yxq7� {cp gxh�r��%giw�� � lLgny�{�� yxq7� {cp j r%o�hLgxv�gxoWhLkFr�o!lW{]��j oL��{p r%p}{��4r��cgxw �0j gxf r]�%gxw�{�� � hLr0yxqLuFgio0p kFj o {%o!yxr�� � gxyip j r%oC�T{coWh!gxk p}{c�7� j k lLj oL�Gf lW{cpFp lLgn��gioWgxw {��qLk}{%�%gFr�s4{np giw u j k�uF{����ZgFhLj (�yxq7� px�;j sToWr%p�j u�vZr%k k j ��� g��nm o�k r�u�gFy�{ck gxk�{nyir,� � gxyxp j r%oj k�k rf�g�� � ) hWg��LoLgxh�p lW{cp�{nyxr,� � gxyxp j r�oGj o0p gxw oW{���L O ��j kP|0qLj p g�{chWg�|�q�{cp gWH j o�r�p lLgxw ki��f lLgxw g9v�r%p gxo�p j {��� �!�=����� �%�����%� ���#�����8�F�F�����,���F��� ���*�����0��� �F����� � �=��� � �� 8� � �%�,�  F�0� �%¡���¡��,� � ¢ �£¡ �8¢=�,�8� ¤8� �^�F�8¥ �F�0� �8�¦ ��� ���%� �F�[� � ¢ ��¡ ¢ � §%�%� �%¥ �¨� ��� ����¥ ¥ ���%�8� ©��v %� � ¢0��� ��� �%¢ ��ª«�  F�^¬®­ ¯ ° ±%² ­ ³�¯ ³ ´.��¢�¬{¯ ³ ´.� �0¥ ��� ¥ �%� �*� � �¨�8�.�¡ �F�%¥ � � �8�[�*¡{µ ¶*·{¢ �*�  F� ¢��  F���[µ�· �F�v F� ¢ �!µ ¶ ·®� ���  %�=¡ ¢ � §8�F� �F¥ � � �v��¡#� � ¢ �¹¸®� �,�  F�.¢ � � �Q� ¥ � � ¤��!�F�8¥ �F�0� ��� � ©®�v F� � ¢� �F�F� ¢ � ��� ��� �=� � � �£� �[� �F�%� ¥ ��� �0����� �0�F¢ �*¤�� ��� ���=� ���Q� ¢ ¡ ��¢ �0�8�%¥ �.ª ¦ �%�=�  F� �^ F�*¤��0� ��¥ ¢ � ºF¥ � �^� ���0���*¡®�  F��F¢ � ¦ � ¦ � � � � � � ¥!�  %� ��¢ � � � ¥ ���'�%�F�%� ¢ �F� �%�F� �%�8�v�*¡®»8�F��¢ ¥ ��¼8���F� �v��¢ � �8� �F���Q¡ ��¢ �.�%� �*� � �8�'©v½ �����%�%�F�����Q¾ � ���*���8�0�F¿ À�Á Â

��� ��bPc^d%e fVg[ÃRi

�= '"%$#& (*)�+ �= #"%$'& (*)0- �= '"%$#& (*)0/1 2#3 4 5 ;.<8>8? 7#>83 : 5%2 @�A B%3+�MG& (*) Y T +�UG) (*W*"%X X N%N & ( \'&+ N ) (*& ) S (*]8"%X +�UGP#JQW*Z'Y^(*OQ& T DFUG& (*) Y T+ NGS O'K J%) Y["%& S J%O +�MG$#) (*W S T S J%O D%DHW S & (+ NGS O'P#( \ S O#_ +*C S O#K J%) Y^"%& S J%O D%CHP#JQW*Z'Y^(*OQ&+ N QZ#Y["%O UG) (*X (*]�"%O#W*( /%M S O'K J%) Y["%& S J%O+�- T h T & (*Y T UGP#JQW*Z'Y^(*OQ& /%LGP#JQW*Z'Y^(*OQ& T+%+R& ( \'& T I ) (*& ) S (*]%(*P /%/Gi!J%) P T+%+RX "%O'_%Z#"%_%( I ) (*X (*]�"%OQ& /8CH& ( \'& T+*C S O'P#( \ NGT (*& -%MG& (*) Y+*CHP#JQW*Z'Y^(*OQ& T N ) (*& ) S (*]8"%X - I i!J%) PUG& hQ$ S W*"%X X h N gQZ#(*) h -8DH) (*& ) S (*]8"%XU T (*& N O#(*(*P -Q+RV{(*& i!(*(*OMG& ( \'& NGS & (*Y + N Y�Z#X & SMGP#JQW*Z'Y^(*OQ& N V#" T ( + N X "%O'_%Z#"%_%(�= '"%$#& (*)=D �= #"%$'& (*)0L �= '"%$#& (*) N` 7#A*4 : A*a b�: >8? 5 c d.A a*A >%4 9 e/%/GP#JQW*Z'Y^(*OQ& T /Q+ S O#K J%) Y^"%& S J%O -%LG& ( \'&/Q+RgQZ#(*) h +�L T h T & (*Y T -%-G& ( \'& T-Q+R& (*) Y T +�/ S OQ& (*) "%W*& S J%O +�MGO#(*(*P+�UGV{JFJ%X (*"%O +%+RZ T (*) +�MGX "%O'_%Z#"%_%(+ NGS O'K J%) Y["%& S J%O +%+RY^JQP'(*X +�M S O'K J%) Y["%& S J%O+ N P#JQW*Z'Y^(*OQ& +%+R"%W*W*( T T + I ) (*& ) S (*]8"%X+�/ T (*& +*C T h T & (*Y +�L T h T & (*Y T+�- T h T & (*Y T +*CHP#JQW*Z'Y^(*OQ& T +�LG"%O#"%X h T S T+�- T (*"%) W UG& " T ÄQT +�/Gi!J%) P T+�-G) (*& ) S (*]8"%X UG) (*& ) S (*]8"%X +�/Gi!J%) P+*CHZ T ( NGT (*& +�- T (*W*& S J%O+*CHW S & ( N gQZ#(*) h +*C T (*Y["%OQ& S WUGZ T (*) N O#(*(*P +*CHV{(*& & (*)MG) (*gQZ'( T & N P#Z#) S O'_ U T & Z'P#h�)j �%qWw g ��� �7�1�Ww g�|�qWgioWyx��p {%�7� g�r%s;f�r%w hLk+j o�p lWj k4p gi�0px���7� p gxw gih9f j p l9k p r�v7� j k p��

Page 7: Basics of Information Retrieval - Statistics and Linguistics

j p+uF{��9oWr%p�� � {c��� g��7� ��k lLrcf k��'�;k yxr%w gxk�s r�w�f�r%w hLk�j o�p lLj k�p gi�0px�Cf j p l�p lWgP�Lw k p�k j ��y}lW{%vLp gxw k�0j gxf�gxh�{ck4j oLhWj �0j hLq�{���hWr0yxqLu�gxo0p k���p lWg�k yxr%w gxk4w}{coW�%g�s w r%u r%oWg�p r�k j �Z�

N "%O#"%X h T S T � � �N V�(*_ S O +R"%P�� "%W*(*O'W*hN V�(*& & (*) +R"%X _%(*V') " S WN P#JFW*Z#Y^(*OF& +R" T T ( T T Y[(*OQ&N P#JFW*Z#Y^(*OF& T +R"%Z#& 'J%) S & "%& S ]%(*O#( T TN _%(*O#(*) "%X +RV{JFJ ÄNGS O'K J%) Y["%& S J%O +RV{JFJ Ä W*" T (N Y^"%& (*) S "%X +RV#Z') T & hN Y^JFP#(*X +RW*J%X X JQW*"%& S J%O TN ) (*X (*]8"%O#W*( + S OQ& (*) "%W*& S ]%(*X hN ) (*& ) S (*]8"%X + S OQ& (*) "%W*& S ] S & hNGT (*"%) W +RY^J%) $# #J%X J%_%hNGT h T & (*Y +R$ T hQW #J%X S O#_%Z S T & S WNGT h T & (*Y T +R& ( \'& Z#"%X S & hN & (*) Y T +R& #( T "%Z#) Z TN & ( \'& + T hQO'J%OQhQY[J%Z T� � � + T hQO'J%OQhQY�h

�)j �%qWw g ��� ���1~+r0yxqLu�gxo0p s w g�|0qLgxoLyxj gxk4s r%w p gxw u�k j o�p lWj k yxr,� � gxyxp j r�oZ�

��� K � ��� /12 w.6 +.6 +.I457-�3?+.G:6 G.-� lLgxw g+{cw g8�%{cw j r%qWk;fT{���kTr%s�yir�u��Wj oWj oL�+p gxw u s w g�|0qLgxoLyxj gxk�{%oLh�j o,�%gxw k g4hLrLyiqWu�gxo�pQs w g�|0giqWgxoLyxj gikx�{coWhGgiuFvLj w j y�{��;k p qLhLj gxkGl eL{�� p r�o9{coWh��T{coW�L�Z�c��}��Jn�k lWr�f p l�{cp p lWgFr%vLp j uF{��;yxr%u7�Lj oW{%p j r�o�uF{���%{cw �Fs w r�u yxr�� � gxyip j r%o�p r7yir,� � gxyxp j r%oZ�?��gxoWgiw}{�� � �%�PY �Tj k u�q�� p j v7� j gxh��0�<L O ��p r7r��Lp}{cj o9{�yxr%u7�Lj oLgxhp gxw u/f�gxj �%l0p��?¢m� p gxw o�{cp j �%gik4f�r�q7� h��Zg�s r%w j oLk p}{coWyig p r7gxo0p j w g�� �FhLj k yx{%w h�p gxw u�k f j p l L O ����g�� rcf{7k gxp p lWw gxk lLr,� hp��f lWj y}l9k gxgxu�k4p r���g�k � j �%l0p � �F��gxp p gxw s r�w k g�{cw y}lLgxk+p lW{%p w g�|�qWj w g lLj ��l�vWw gxyxj )k j r%oZ� � r%p l�u�g�{ck qWw gxk4{%w g�qLk qW{�� � �Fk uFr0r%p lLgxh��0�Fp {���j oW�P� r���{%w j p lLuFk�w}{cp lLgxwTp l�{co�p lLg�k p w}{cj �%l0pu�g�{ck qWw ge��r%w�k r�u�g�k j u�j � {cw4k j uFv7� g�p w}{%oLk s r%w uF{%p j r�op��p r9{��%r%j h�hWw {%uF{cp j y�g^_�gxyip k r%s�k uF{�� �o0qLu��Zgiw k��

�5+�����C � = 26F :�A^2 �,7^C ��=�%F ��%CG46C�26B � BD=,462G;�:

e0r�s {%wx�Zp lLg7u�gxp lLrLhLk�r%qWp � j oWgih{c��r��%g7qLk g���oWr�fD� gxhL��g7r%s1� {%oL��qW{c��g�r%o7� �9j oWhLj w giyxp � ��� � qLp.� j oR)�%qWj k p j y+u�gxp lLr0hWk�l�{��%g r%����j r�qLkTw r,� gxkTp r7v7� {��7s r�wTj oLhWg}��p gxw u k g�� giyxp j r%o=�1�+oWg+w g�{ck r%o�p r�{cvWv7� �� j oL�%qWj k p j yD�0oLrcfD� gxhW�%g+p r j oWhLgi��p gxw u k g�� gxyxp j r�oFj kTp r�vWw r��0j hWg+u�q7� p j ) g�� gxu�gxo0pQp gxw u�k�g^_�gxyxp j �cg�� ���� lLj k�j k�{%k k qWu�gxh�p r�vLw r���j hWg���{%j oLk+j onvLw gxyxj k j r�oZ�Z����{�� � rcf j oL� �LoWgiw��%w}{cj oWgih�hLj k p j oWyxp j r�oLk+��gI)p f�gxgxo�k j u�j � {cw��WqLp9oLr%oK) j hWgxo�p j y�{��+u7q7� p j ) g�� gxu�gxo�pFp gxw u�k�f j p l�hLj _�gxw j oW��j o�p gxw oW{���k p w qWyip qWw g%�r%w��0��gxk p}{c��� j k lLj oW�9uFr%w g�g�� {c��r�w {%p g�w g�� {%p j r�oLk ��gxp f�gxgio�j hLgxo0p j �Wgih�p giw u g�� gxu�gxo0p k�� � l0qLkx��j pf�r�q7� h��Zg�v�r�k k j ��� g�p r�hWj k p j oL��qLj k l���gxp f�gxgio w givWw gik gxo0p {%p j r�oR) f j k g�k j u�j � {cw �WqLp�oLr%oK) j hWgxo�p j y�{��hLrLyiqWu�gxo�p k��

�= #"%$'& (*)�+ �= '"%$#& (*).- �= '"%$#& (*)./1 2#3 4 5 ;=<%>8? 7'>%3 : 582 @�A B%3LGO#"%& Z#) "%X N�� /G) (*W*"%X X +�/ � LHi!J%) PL S O#P'( \'(*) T N $#) (*W S T S J%O +�/ S P'KD S O#P'( \ S O'_ / � -GP#JQW*Z'Y^(*OQ& T +%+R& ( \'&D ��( \ S V S X S & h /GW*J%Y^( T +*CH& K/ � -G QZ#Y["%O /GV#" T ( U � /G& (*) Y/G& (*) Y T - T "%Y[$#X S O#_ UG& (*W #O S W*"%X/G$#) JFW*(*P#Z#) ( -G${(*) UGY^"%& (*) S "%X T/GY^"%OQZ'"%X -GY^(*" T Z#) ( T M � -G& (*) Y T/GK J%) & h -GX J�i!(*) I�� LG& ( \'& T/GV{JQP'h - S OQ& (*) O#(*& I #(*"%) T &/G"%O#"%X h T & -GK "%Y S X h N�� I P#JFW*Z#Y^(*OF&- � MG& ( \'& T -G( \' #"%Z T & S ]%( N�� N i!J%) P T�= #"%$'& (*)=D �= '"%$#& (*).L �= '"%$#& (*) N` 7#A*4 : A a b�: >%? 5 c d.A a*A >%4 9 eU � LGV{JQJ%X (*"%O L � - S O'K J%) Y["%& S J%O N�� LGi!J%) PN�� -GgQZ#(*) h LG] S T Z#"%X S � "%& S J%O L � LG& ( \'& TN ]%(*W*& J%) T LG${J S OQ& T LGZ#O S & TL � LGP#JQW*Z'Y^(*OQ& T D � / S OQ& (*) "%W*& S J%O LGP#( T W*) S V{(*PL T $�JQ(*) ) S / T (*( ÄQS O#_ D � L T & Z'P#h/ � LG& (*) Y T / S OQ& (*) "%W*& S ] S & h D � LGX "%O'_%Z#"%_%(/ � LGK (*(*P#V'"%W Ä /GP#(*X S ]%(*) h D � -G& ( \'&/G& ) (*"%& (*P - � L T h T & (*Y T / � N O#(*(*P/G& #(*J%) (*& S W*"%X X h - � L T Z'$#$�J%) & / � LGX S O#_%Z S T & T/GX S Y S & (*P - � -G& " T ÄQT / � / T (*Y["%OQ& S W- � IGS O#K J%) Y^"%& S J%O - � -G"%W*W*( T T / S O'K J%) Y["%& S J%O- � I P#JQW*Z'Y^(*OQ& -G& Z#) O T /Gi!(*" Ä�;j �%qLw g �7� g��1�Ww g�|0qLgxoWyi��p}{%�7� g�r%s)fTr%w hLk4j o9p lLj k p g}�Lpx���7� p gxw gxh9f j p l9��r%p l9j hWs;{coWh�k p r%v�� j k p��

�Pf k ekcFl�c&) -#m�n^f8oJe -/,!l-e '#pQq ���

¢4oWr%p lLgxw w gx{%k r%oj k+p r9yxr%oK]�{cp g�k j u�j � {cw��%{cw j {co0p k�j o0p r�r%oLg�j oLhWg}��p gxw u�� � lWj k�j k {%k k qWu�gxhp r�vLw r���j hLg7�0{cj oLk+j o�w gxyx{�� � �Z�0��{�� � r�f j oL�Fu�r�w g�hLrLyiqWu�gxo�p k�f j p l�r%o�� �np w j �0j {��)hLj _�gxoWyigxk�p r���g�%gx�cgxhO�0�!p lLg�k}{cu�g�k gip�r%s p giw u�k�� � lLg¥�Ww k p�lW{ck�p �0vLj y�{�� � ��j o,�%r,� �%gxhOw gxk g�{cw y}lOj o!k �0o�p}{c���f�r�w hnhLgxv�gxoLhWgioWyxj gxkx��hLgxw j �%{cp j r%o�{��Zu�r�w vWlLr,� r��%�%�W{coWh�p gxw u�j oLr�� r��%�PH0p lLg k gxyxr%oWhnj o9j oK]Wgiyxp j r%o�{��u�r�w vWlLr,� r��%���;eLr�s {%wi�0eLvW{%w yr� |%r�oLgxk1�LoLhWkQp l�{cpQoLr�yir�oLy�� qLk j �%g j u�vWw r��%gxu�gxo�pQs w r%u qWk j oW��gxj p lLgxwp gxy}lLoLj |0qLg�l�{ckT��gxgxo�gik p}{c��� j k lWgih l e0vW{%w yr��|%r%oWgxki�)�����%�Jn �?¢m� �Wr�sCp lLgxk g�p gxy}lWoLj |�qWgxk yx{%oFu�r�w g4r�w� gxk k4��g�{cvWvLw rx�Lj uF{cp gxh9qLk j oL��vLqLw g�� �Fk p}{cp j k p j y�{��Zu�gxp lLrLhLk��

��� r�� K 9<;=G.J.F=6 +.I45��.; +�J.2 we;U0</1-p57;=0�2fE�A � /8+��d3�576 /1+� X�O����=XZY X�Q�T W�R�Y8W�X�S���R7\]T X�S¢+k y�{co9��g+k gxgxo9j o�p {%�7� gxk �7� � {coWh9��� ��p lLg�fTr%w hLk � hWr0yxqLu�gxo0p �{%oLhC� hWr0yxqLu�gxo0p k 7��r�p l�k lWr�fqLv7j o p lWg��Zgi��j oLoLj oW�4r�sLp lLg8� j k p�� � lLgTf�r%w hWk.� j oWhLgi�0gxh� �{coWh¥� j oWhLgi�Lj oW�� +hLr�oLr�pi��{%oLh�vWw r%�W{%�7� �k lLr�q7� hs�$p lLgx��k lWr�f qLvs qLw p lLgxw�hLrcf o�j o�p lLgP� j k p��dzr%w h�s r%w u {co�{�� �0k j kx�Zr%w [ rJZ o��tr&� r XWL q s��sWNPs�� �-\IL \TfTr%q7� h9yxr%oK]�{cp g p lWgxk g�s r%w u�kx�W{%oLh9w}{cj k g�p lLgxj w yxr%u��Wj oLgxh�fTgij ��l�p��|9r%w vWlLr�� r��%j y�{��T{%oW{�� �0k j k�p r�j hLgxo0p j s �u�r%w vWlLr�� r��%j y�{��?�%{cw j {co0p k7r%s4{s� gi�0gxu�g9{cw gFoWr%w uF{�� � �

j u�v7� gxu�gxo0p gxh{ck3\IY QI[ [ L NRX�r%w+k j u�v�� g�k qK(7��k p w j vLvWj oL�7� � r�w p gxw�hLgxk yxw j �Zgik {Ff j hWg�� �n{%hLr�vLp gxh{coWh3g^(�yxj gxo0p�yxr%o0p gi�Lp ) k gxoLk j p j �cg�k p giuFu�j oL� {�� �%r%w j p lLu s r�w��QoL��� j k l3�W{%k gxh r%o {!k qK(7� � j k pl � r%w p gxwx�C�����,tJn � ¢m� p gxw oW{%p j �%g�� ��p lWgnqLk gxw�y�{coO��gngxoWyir�qLw}{c��gxh oWr%pFp r�gxo0p gxw�s q�� �+f�r%w hLk��WqLpp w qLoLy�{%p gxh9s r�w u�k��� lLg�qLp j � j p �Gr%s�k p gxu�u�j oL�Gs r%w��;oW��� j k l�j kFhLgx��{cp}{c��� g%�3l z {%w u�{coZ�C�����0�^n4�LqWpFj p kFj o0p qLj p j �cg

u�gxw j p kT{cw g+�%rLr0h�gxoLr�qL�%l�{%oLhFj p k�yir�k p�j oFvLw r0yxgxk k j oW�e|�qWj p g�� rcf��0k r�uF{co0�7k �0k p gxu�kTuF{��%g4k r�u�gg^_�r%w p j o�p lLj k�hWj w gxyxp j r�oZ�'� � lLj k�uFgx{%oLk�p lW{%p�u�{cp y}lLgxk�{cw g7oWr%p u�j k k gxhp lLw r%qW�%lp w j ��j {��;f�r�w h�%{cw j {cp j r%o�{%k�f j p lk j oW�%q7� {%w �%v7� qLw}{��)s r%w u�k�� �l � r���gxw p k r%o�{coLh�e0vW{%w yr��|%r%oWgxki�)�����%�Jn ���QoL�,� j k lZ�r%s�yxr%qLw k g%� lW{%kF{co!gi�0yxgxgxhLj oL�,� ��k vW{%w g9uFr%w vLlWr�� r%���c�Tf j p l!s gxf/u�r%w vWlLr�� r��%j y�{��8�c{%w j {%o�p kF{coWhp gxoLhLk�oLr�p4p rFs r%w u �%w}{cvWlLj y�{��)yxr%u�v�r�qLoWhLk�{ck+r%s p gxo�{ck+r%p lWgiwm� {coW�%q�{c�%gxk�� ��r�p lnp lLgxk g�y}l�{cw}{cyI)p gxw j k p j yikQfTr%q7� h�k gigxu p r hLgxyxw g�{%k g+p lLg4qLp j � j p ��r�sZ{co�g�� {%��r%w}{%p g uFr%w vLlWr�� r%��j y�{��0{%oW{�� �0k j kQs r�wQp lLj k� {coW�%qW{%�%g��m p j k qLoLs r�w p qWoW{%p g/s r%w p lWg ��gioWgxw {�� j p � r%s p lWg w gxk q�� p k j o�p lLg �Wg�� h>p l�{cp p lWg w gI)

k g�{cw y}l {coWh��LqWk j oWgxk k�� {coL��qW{%�%g r�s p lWg f�r%w � h�yiqWw w gxo0p � ��j k �;oW��� j k l=� e0j u�v�� g k p gxu )u�j oL��j kk qK(�yxj gio0p�s r%w��QoL�,� j k lZ�F�LqLpGoWr%pGs r�wu�r�k pGr�p lWgxw(� {coW�%qW{%�%gxkr�s�p lWg!f�r�w � h=�Em oyxr%u�v�{cw j k r%oZ��f lLgxw g gi�Lv�gxw j u�gxo0p k�r%o u�r%w vWlLr�� r��%j y�{���{%oW{�� �0k j kO�W{%k gxh oWr%w uF{�� j ¤�{cp j r%o r%ouF{%p gxw j {��Gs w r%u�� {coW�%qW{%�%gxk3r%p lWgiw3p l�{co��QoL�,� j k l lW{]�cg ��gxgxo�v�gxw s r�w u�gxhZ��p lLgx� hWr/vWw rW)�0j hWg j uFvLw r]�%gxh w gik q�� p k�� lLrcf�� {coWh gi�L{%yxp � � f lW{%p j k qWk gis q���hLgxv�gxoLhWk r%o p lLg%� {coR)�%q�{c��g�� � e�� r��cgxoWg���l � r%v�r���j y�{coWh�z j � � gxp px�������%�Jn Hs�)j oLoWj k l=��l m+r�k �cgxoWoLj gxu�j �Z�����%�Jn H�~+qWp y}l=�l m�w}{%{cj ` {coWh � r%l7� uF{%oLoC���c�%���-n H(�Lw gxoLy}l=� l |�{cy�|�qWgxu�j o9{%oLh � ¤xr%q��%giw uF{%oLoC�C�c�%�%�Jn �9eLf�gxhLj k lZ�l z gxh7� qLoWh QIYks�� � ����t�t,tJn ���

! yUS=X�SZy=a�bPX�Opb�[�a(R�S�\�T W�W�X�S���R7\]T X�S¢+oLr�p lWgxw7{ck v�gxyxp�r�sTyxr%ot]W{%p j r�oGj kd�LoWhLj oL��k gip k7r%s k ��oWr%o0��uFke� k qWy}l�{ck�p lWgi�GuF{x�gi�0j k pd�r%w oWg�{cw4k �0oLr�o��0u�kx�Z{%oLh9g�|0qW{%p j oW��p lLgxu s r�w k gx{%w y}l9vWqLw v�r�k gxk�� � lWj k4j k p ��vWj yx{�� � �FhLr%oWg f j p l9{

��t ��bPc^d%e fVg[ÃRi

k p}{cp j y f�r%w h¥� j k p8��{5Y �tQV\^s��RZ5�R\ ���E��{ck gxh�r%onyxr�u�vLj � gxh�� g}�Lj y�{��U�0oLrcfD� gihW�%g�� � lLj k�{cvWvLw r�{%y}lj k7r%s p gxo�hLg��%g�� r%v�gxh�j o0p r�LqWj � hWj oL�¥� {cw �%gxw7oLgxp f�r%w �0kFr%s��0oLrcfD� gihW�%g9g�� gxu�gxo�p k�r%w7k gxoLk gxkFf j p lgi�0p gxoLk j �%gFu�r%w g7r%wd� gxk k hLr�uF{cj oK) k v�gxyxj �Ly7j oWs r%w uF{%p j r�oZ� � lLgxk g ��oWr�fD� gxhL��g�w gik r�qLw yxgik�p gxoWhp r��g7yiqWu���gxw k r%u�g�p rFk p}{coWhW{%w hWj ¤ig%�Z�LqWj � hC�Z{coWh�uF{cj o0p}{cj oZ���LqWp4vWw r]�0j hLg�hWj k p j oLyxp4j u�vWw r]�%gxu�gxo�p kj o�p lWg.�Wg�� h9p lLgx�9{cw g�hLgxk j �%oWgihns r%w��¢�� p gxw oW{cp j �%g�� �np lLgxw gF{%w g�k p}{cp j k p j y�{��Qp gxy}lWoLj |�qWgxk f lWj y}lw gihWqLyxg�{ � {%w ��g7k gip�r%s�f�r�w hLk p rn{

k uF{�� � gxw+k gxp r%s�k gxoLk gxkx�;u�r%k p�oLr�p}{c�7� �n~){cp gxo0p eLgiu�{co0p j y7m oWhLgi�0j oW�7�5l ~+gxgxw f�gxk p gxw QIYks�� � �C������tJn~){cp gxo�p�eLgxuF{co0p j y�m oLhWgi�0j oL�nf�r%w �0k s w r�u p lLg�r��Lk gxw �c{%p j r�op lW{cp�{�uF{%p w j ��r%sTj oLhWgi��p gxw uFk ���hLrLyiqWu�gxo�p k�j k+k v�{cw k g�� u�r�k p4p giw u�k+hWrFoLr�p+{cvWv�g�{cw+j onu�r%k p4hWr0yxqLu�gxo0p k {coWh9p lWg�uF{%p w j ��f j � �u�r�k p � �yxr%o0p}{cj o�oLj �8�%{�� qLgxk�� � lLj k7uF{cp w j �y�{%o���g�w gxhLqWyxgih!p r{nk uF{�� � gxwx��{coWh�p l�qWk7hWgioWk giwx�uF{%p w j �������%{cw j r%qLk�uF{%p lWgxuF{cp j y�{��Tp gxy}lLoWj |�qWgikx�4g�� �7� k j oW�%q7� {%wP�%{�� qLg9hLgxyxr%uFv�r%k j p j r�oZ��f lWj y}lf j � �Qw gxk q7� p�j oGyxr�oK]W{%p j r�oGr%s4p gxw u�k�f j p l(�%gxw �Gk j u�j � {cw hLj k p w j �LqWp j r�oLk�� � lLg�w gxk q7� p j oL��gio0p w j gxk{cw g�j o�k r%uFg7k gxoLk gG\-QINK\-QV\+r�w�u�g�{coWj oW�%k�r�s�fTr%w hLk�{%oLhp gxw u�k���p lLgx���%w r%qWvp gxw uFk�p lW{%p�lW{]�%gp r7hWr7f j p l9gx{%y}lnr%p lLgxwx�Lf lWj y}lnvLw gxk qWuF{c��� �Ff j � ���Zg�qLk gxs q7�)j o9{7k g�{cw y}lnk j p qW{%p j r�oZ� z rcf�u�qWy}lr%oWg�fT{%o�p k�p r�w gihWqLyxg7p lLg�uF{%p w j �9j k�{�|0qLgxk p j r�o�r%sQlLrcf u�qLy}l�j oLs r%w uF{%p j r�o9r%oWg�j k+f j � � j oW�7p rk}{cyxw j �Lyxg�p r���{%j o9p lLg ��gxp p gxw4w giy�{�� �C�%j �%gxo��0��p lLg yir�oK]�{cp j r%oZ�

��� r�� r ),+.F=0�;=3?E76 +.I�5{�.; +DJ.2 wP;=0</1- 5�;=0�24EZA � /12��.@ ;��%57;=0�2fE� `UY \]T � �eX�O�_�\�[�O�a�btTr%qWo�p j oL��k r�� j p {%w ��f�r%w hLkQj kU�WoLg%�%�WqLpQp lWgTj hWg�{4p lW{%pU� r�oLg�f�r�w hLkQ�0� p lLgxu�k g�� �%gxk;y�{%w w � p lWg�p r�vLj yr%sQp lLg�p g}�Lp+j k r�oLg�r%sQp lWg u�r�w g�r%����j r%qWk+r]�%gxw ) k j u�v�� j �Wyx{%p j r�oLk j o9p lLg�u�rLhLg��Ck rFs {cw�� m oWhLgi�0j oW�p gi�0p k�r�o�j yxg�yxw g�{%u�r%o�� j yxg� G{coWh � yxw g�{%u� �j k7j o0p qWj p j �%g�� �'� gik k�qLk gxs q7� p lW{%o�� r0r��0j oL�{cp7p lLgyxr%u7�Lj oW{%p j r�o � j yxg9yxw g�{%u� 7� z rcf�g��%gxwi�+j o!g}�Lv�gxw j u�gxo�p k�hWgik j �%oWgxh!p rGp gxk p�p lLgnqWk gxs q�� oWgxk kFr�su�q�� p j ) f�r�w hnp gxw u�kx�Z{%o��n{chWhLj p j r�o9vW{%k p4k j oL�,� g f�r%w h�j oWhLgi�Lj oW�Fj k+yiqWu���gxw k r%u�g7{%oLhngi�Lv�gxoLk j �%gj o!u�gxu�r%w ��{%oLh!vLw r0yxgxk k j oW�L� f lWj � gn{chWhLj oL�Gyxr%u�v�{cw}{cp j �%g�� ��� j p p � g�p rvZgiw s r�w u�{coLyxg�� m o {%o��y�{ck g%�;p lLgFhLj k yiw j u�j oW{%p r%w �nv�r�fTgiw�r%sTk j oL�,� g7f�r�w hp gxw u�k j k u7qLy}lGk p w r�oL�%gxw�p lW{%op l�{cp r%s {%o��r%p lWgiw�j oLs r%w uF{%p j r�o�k r�qLw yxg5l e0p w ¤�{�� �%r�f k �0jkQIYks�� � �C�c�%�����Zg�� ��� n �d�)j oWhLj oL�Fu�q�� p j)f�r�w hp gxw uFk4y�{%o��g hLr�oLg ����k p}{%p j k p j yx{��Zp gxy}lLoWj |0qLgxk4r�w ���p� j oL��qLj k p j y�{�� � �7u�r%p j �c{%p gih�p gxy}lLoWj |�qWgik��

� X�Y Y X=W�R7\�T XZSUbdR�SU_<a'`UY \�T � �eX�O�_�\][�W��USUT W�R�Y?\][,O�a(b��oLg�fT{��!r�s�gi�LvW{coWhLj oL��p lLg�k g�{cw y}lOp r�f�r�w hWk��Zgi�%r�oLhOk j oL�,� g�p giw u�k�j kFk j u�v7� ��p}{c�Wq7� {cp j oL�f�r�w hWk�p l�{cp�r0yxyxqLw�{%hJ` {%yigxo0p � �j op lLgFp gi�0pd� Ntp XWZ sW[8\����Lr�w�j oWk p}{%oLyxg%�Q|n{%�%o0qLk7|9gxw �%g���l�{ckj u�v7� gxu�gxo0p gxh{Fp r0r,�;s r%w�w gip w j g���j oL��w gxyxqLw w gxo�p fTr%w h�k g�|0qLgxoLyxgxk�j o�p gi�0p l |9gxw �%g��kQIYks�� � �C�����c�L�|9gxw �%g�� �)�����%�Jn �u k j oL��u�r%w g�p lLgxr%w gxp j y�{��L{cvWvW{cw}{%p qWkx�cr�p lLgxw;p ��v�gxkQr%sW{%w �Lj p w {%w � {coLh�w gxyxqLw w gio0p;yxr�u��Lj o�{cp j r%oLk

j oGp lLg�p g}�Lpd�'qVr&� � r-q sWY L rJNK\.��yx{%o���gFw gxyxr%��oLj ¤xgih�{coWh�p {%�Lq�� {%p gih�{ck7f�g�� � �¥�Ww {%o7�GeLuF{chW` {lW{%kTj u�v�� gxu�gxo0p gih9{ k gxp r%sCp r0r,� k@l eLuF{chW` {0�C���%���Jn�s r�wTw gxp w j g��0j oL�7yir,� � rLyx{%p j r�oLk�r�s=�c{%w j r�qLkTp �0v�gxkqLk j oL���Zr%p l�k p}{cp j k p j y�{��T{coWh�� gi�0j y�{��Tj oLs r�w uF{cp j r%o HQlLg�j hLgxo0p j �Wgik7p lWw gxg�uF{J` r%w7p ��v�gxk�r%s4yxr�� � rJ)y�{cp j r%oWk��+vWw gxhWj y�{%p j �%g�w g�� {cp j r%oWk4k qWy}lG{ck�lWr�� h���gxp f�gxgxo'�%giw �Wk {%oLhp lWgxj w�r%�K` giyxp k�j o�w giyxqWw w gxo0pyxr%oWk p w qLyxp j r%oWki�Cj hLj r%uF{%p j y�oLr�qLo�vLlWw}{ck gxki�){coWh�vLlLw}{%k {��)p gxu�v7� {cp gxkx��f lLgxw g7r%o�� �9{Fyigxw p}{cj onk � r�p�%{cw j gik s w r�u j oLk p}{coWyig�p r�j oWk p}{%oLyxg��� �Q¢ �8� �  F�! !¢ � � �[² ±%¯ " #%$�& ' " ¿�� ¢ � �8� �F¢ ���8�8�v� �j��� ¢ ��©

Page 8: Basics of Information Retrieval - Statistics and Linguistics

�0oLrcfD� gxhW�%g9p rGk j u�v�� gFk p}{cp j k p j yxkx��{%oLh�qWk g9j p7p r�gi�Lp w}{%yip5Y QVq%�RNtL q s��kY QIZI[8\�� � gxy}lLoWj y�{�� p gxw u�k{cw g{�k v�gxyij �Wy�y�{cp gx�%r�w ��r�s�fTr%w hLk9f lWj y}l ��gxl�{��%gG{�� uFr%k p � j �%gnvWw r%v�gxw�oW{%u�gxk�� � lLgx� y�{coK)oLr�p7g�{%k j � �G��g9u�r0hLj �Wgih�� p lLgxj w7g�� gxu�gxo0p k7y�{coWoLr�p7��gnk yxw}{cu7�7� gxh�r�w7w gxv7� {%yigxh��0��u�r�w g�r�w� gxk k�k ��oWr%o0��u�r�qLk9yxr%u�v�r�oLgxo0p kx�+{%oLh p lLgx�!qLk q�{�� � ��y�{coWoLr�pF��g�w gxs gxw w gihOp rGf j p l vLw r%oWr%qWoLk��� l0qLkx�;p lLgFp gxy}lWoLj y�{���p gxw u�k�p gxoLh�p r9k p {��j o��%{cw j {co0p�p lWw r%qL��lLr�qLp�{9p gi�0px�Q{coWh�Zgip fTgigxo�p gi�Lp kl |%qWk p gxk r%o�{coWh<m {cp ¤%�Z������gJn �|%qLk p gik r�o a k {coWh,m {cp ¤Wa�{%vLv�g�{�� j oW��� ��k j u�v�� g4{�� �%r�w j p lWu3p r�k v�r%p�u�q�� p j ) f�r�w h7p giy}lWoLj y�{��Wp gxw u�k

p}{c�Wq7� {cp gxk4{�� �Zu�q�� p j ) f�r%w h�k g�|0qLgxoLyxgxk+f j p ln{7oLr%qWo�lWg�{ch9s w r%u/{7p g}�Lpx��{coWh�w gxp}{cj oLk p lLr�k g�p lW{%p{cvWv�g�{cw u�r%w g+p l�{co9r%oLyxg�� � lLj k u�gxp lLrLh��%j �%gik4{�k qWw vWw j k j oL�,� �7y}l�{cw}{cyxp gxw j k p j y+vLj yxp qLw g�r%s;{�p gi�0pp r%vWj y%�Q�%j �%gio�p lW{cp�p lLg�p g}�Lp�j k�r%s4{np giy}lWoLj y�{��Tr%w7{%pd� g�{ck p�oLr�oR) �Lyxp j r%oGoW{%p qLw g�� � lLgxj w�u�{-` r%wv�r�j o0p4j k4f�g�� �CfTr%w p l9oWr%p j oL����p lLg s {%yip4p lW{%p+{7yxr%u�v�� g}�9oWr%qWo9vWlLw}{ck g j k4qLk gxhnu�r�w g�p lW{%onr%oLyxgj o!j hWgxo�p j y�{��4s r�w u j k�g���j hWgioWyxg�gioWr%qW�%l!s r�wFj p kFk v�gxyxj {���|0qW{�� j p ��{ck9{p gxy}lWoLj y�{��+p giw u���m pFj kZVQ otQIY L Y L rJNW�LoWr%p4s w g�|0qLgxoWyi�%��p lW{cp4j k oLr�p {%�7� g�s r%w p gxy}lLoWj yx{��Cp giw u�k��~Zj oL��qLj k p j yQuFgip lWr0hLk;{cw g�r%s p gxo k qL�%��gxk p gxh�s r�wCp lWgQvWqLw v�r%k g�r�sLg}�Lp w}{cyxp j oW�4u�q�� p j ) f�r�w h p gxw uFk��

�)j w k p�uFgio0p j r%or�s1� j oL��qLj k p j y7u�gxp lLr0hWk.��j op lWj k y�{ck g%�;p w}{coWk s r�w uF{cp j r%oWkm��s r�w�oWr%w uF{�� j ¤xj oL�k ��o0p}{cyxp j yD�c{%w j {%p j r�o�j o�p gi�0p�j k;j o7p lLgD� {cp g8�Ls p j gxkDl z {cw w j ki�C���,g��Jn �0{coWh7j oWhLgxgxhZ�U� � lWg uF{cj o7u�r0hR)gxw o�w}{%p j r�oW{�� g�s r%wP� j oL�%qWj k p j y�{�� � ��u�r%p j �%{cp gxh�j oLhWgi�0j oL�j k7j o�y�{%vLp qLw j oL�u�q�� p j ) g�� gxu�gxo0p�p gxw u�kg^_�gxyxp j �%g�� ��� �l e0v�{cw yr�}|%r%oWgxki�C�c�%���-n � � lLg7w gxk g�{%w y}lj os� j oL��qLj k p j y�{�� � ��u�r�p j �%{cp gxhnj oLhLgi�Lj oL�Fl�{ckp �0vLj y�{�� � ��p}{��%gxok p}{%p j k p j yx{�� � ����gxoLgxw}{cp gxh�u7q7� p j ) f�r�w h9p gxw u�k�{%k {F�W{%k g�� j oLg7{coWh{%p p gxu�vWp gih�p rj hLgxo0p j s �9��gxp p gxw�p gxw u�k��m¢+o�g}�W{cuFv7� g�j k�eLp w ¤�{�� �%rcf k �0j a k�f�r�w �nj o�p w �0j oL��p rp�LoWh¥� j oW�%qLj k p j yx{�� � �u�r�p j �%{cp gxh9yxr%o0p gio0p+fTr%w hnyxr%u7�Lj oW{%p j r�oLk4p lLw r%qW�%lnk p}{cp j k p j y�{��){%oW{�� �0k j k+r%s;fTr%w hnv�{cj w k+{coWhnp lLghLgxv�gxoWhLgxoLyxg�w g�� {%p j r�o7�Zgip fTgigxo�p lLgxu l e0p w ¤�{�� �%r�f k �0j �C�c�%�c���Kn �QeLp w ¤�{�� �%rcf k �0jZlW{%k�gi�Lv�gxw j uFgio0p gxhqLk j oL��lLg�{ch�uFr0hLj �Lgxw4k p w qLyxp qLw gxk�s w r�u/s q�� � ��v�{cw k gihp gi�0p k+p r�g}�Lp w}{cyxp�j oLhLgi�np gxw u�k�� p lWj k+oWr%w )uF{�� j ¤xgxk)vLlWw}{ck gxkQk qWy}l�{%k.� j oLs r�w u�{cp j r%o w gxp w j g��%{�� �{coWh'� w gxp w j g��%{��0r�sWj oWs r%w uF{%p j r�o7 4p r�p lLgTk}{%u�gj oLhWg}�9w givWw gik gxo0p {%p j r�oZ�z rcf�g��%gxwi��j pFlW{%k���gxgxo w gxv�g�{cp gxh7� ��k lLrcf oOp lW{%pFyxr%uFv�r%qWoLh p gxw uFkFhLr�oLr�pFj u�vWw r��%gnw gI)

p w j g��%{���v�gxw s r%w uF{coWyxg�s r�w7�;oW��� j k lGuF{%p giw j {��QuFr%w gFp l�{co�uF{cw �%j o�{�� � �c�Ul �W{%��{coC�Z�c���%�Jn {coWhGp lW{%pp lLgTg^_�r%w p;oLgxgxhLgxh7p r+j u�v�� giuFgio0p;{coLh7w qLoe� j oL��qLj k p j yQuFgip lWr0hLk;j o��%gxoLgxw}{��0j k)oWr%p;f�r�w p l7p lLgT�0{cj ol eLvW{cw yr�}|%r�oLgxkx�C���%���Jn �?�+o7p lWj k)oWr%p g%�,� r���gxw p k r�o7{coWh7eLvW{cw yr��|%r�oLgxk;hWj k yxr�qLw}{c��g�j u�v�� giuFgio0p gxw ks w r%u yxr�oLk j hLgxw j oW�7r%p lLgxw p l�{co�vWw g��0j r%qLk � � ��oWr�f o9u�q�� p j ) g�� giuFgio0p�p gxw u�k��d� ~+j k yir��%gxw j oW�L�L���Fj oR)k v�gxyxp j r�oZ�Wf lW{%p u7q7� p j ) fTr%w h�k p w j oL��k p lWgiw g�{cw g j on{P�7� g�j k.� � �T{e�%gxw ��gi�0v�gxoWk j �%g�gxo�p gxw vLw j k g���� � �m o��%gxoWgiw}{���p lWgik g�g�� {%��r%w}{cp j r%oWkT{cw g+p w j yr�0��p r�u�{coW{%�%g+{%oLh�oWr%pTw giyxr�u�u�gxoLhWgih�s r�w���gx�%j oWoLgxw k�� l � r���gxw p k r�on{coWh9eLvW{cw yr�}|%r�oLgxkx�C�c�%�%�Jn �

�5+*��� =GBD46>?C@2 ;&7^C@2 �8;%E

¢+k p lWg�p gxw u f�gxj �%l0p j k hWg��WoLgxhnj o�p lLg,Y �Tyxr%u�vZr%oLgxo0p r�s)p lLg yxr%u��Wj oLgxh�s r�w u�q7� {L�0j p j k lLg�{]��j � �j oK]WqLgxoLyxgxhG�0��hLr0yxqWu�gxo�pd� gxoL��p lZ� ¢4� r%oW��hWr0yxqLu�gxo0p�{c��r�qLp�{9p r�vLj y7j kd� j �cg�� �np r9lW{]�%g�uFr%w glLj p k+p lW{co{�k lLr�w p4r�oLg7f j � �)s r%w�{�w g�� g��%{co0p+p gxw u<H�p lWj k+uF{��9oLr%p+w g^]Lgxyxp+j p k+�%w g�{cp gxw�� j �%g�� j lWr0r0hr%s;��gxj oW�7w g�� g��c{%o�p �WqLp4k j u�v�� ��j p k ��w gx{%p giw�� gxoL�%p l=�|9r%k p {�� �%r%w j p lLu�k�j o qWk g j o0p w r0hLqWyig hLrLyiqWu�gxo�p � gxoL�%p l�{%k { oLr%w uF{�� j ¤�{%p j r�o s {%yxp r�w

r%s�k r%uFg k r%w px�3j sOp lLg hLr0yxqLuFgio0p k j o p lLg hWr0yxqLu�gxo0p �W{%k g �c{%w � {ck w gx��{%w hWk4� gxoL�%p ll eW{�� p r%on{coLh � qWyr�,� gx�%�C�c���,�-n ��m p�j k yxr%u�uFr%op rnw gxhWqLyxgFgx{%y}lGp gxw u f�gxj �%l0p j o�p lWg�hLr0yxqWu�gxo�p

s {cyxp r%w;hLgxw j �%gxh7s w r%u3p lLgThWr0yxqLu�gxo0pU� gxoL��p l j o�f�r�w hWk;r�w)y}lW{%w {%yxp gxw k^H�p lWg�k p w gxoL�%p l7r�sLp lLgTw gxhLqLyI)p j r%o�uF{�����gTyxr%o0p w r�� � gih��0� {+vW{%w {%u�gxp giw;f lLj y}l7j k)k gip�{cs p gxw;g}�Lv�gxw j u�gxo�p j oL�+f j p l p lWgTyxr�� � gxyip j r%o{cp+l�{coLh�l � r%��gxw p k r%on{%oLhneLvW{cw yr�}|%r�oLgxkx�C���%���Jn � � lLj k+��j �cgxk.|�qWj p g�{�k p w j yxp+oWr%w uF{�� j ¤�{cp j r%o=�Tj pvLw r�u�r%p gxk k lLr%w p hWr0yxqLu�gxo0p k4hLj k vLw r�v�r%w p j r%oW{%p g�� �%�L{%oLh9j o�vWw}{cyxp j yxg�p lLg�g^_�gxyxp k r�s)qLk q�{�� � ��lW{]�%gp rF��g�hW{cuFv�gxh9k r�u�gxf lW{cpx�Z{%km� r�oL��hWr0yxqLu�gxo0p k4r�s p gio�p qLw onr�qLp4p rF��g�u�r%w g j o�p gxw gik p j oL��p l�{cof lW{%p p lWj k oWr%w uF{�� j ¤�{cp j r%oFf�r�q7� hn{ck k qLu�g fTr%q7� hn{ck k qLu�g l eLj oW�%l�{��UQIYvs�� � �Z������gJn �

�5+ ����C��G;�:�0�%C :%= >?C�;�A->?C�: � UAI;�;%C�2�� 0826F %C@08F�� A^27^082 �,460��,C�: =8;%E6C ;%E6032 � 2 � 7-A^:%E

¢+kFl�{ckF��gxgxoO{cw �%qWgihO{c��r��%g%� p �0v�r�� r��%j y�{��4�Lj {ck�w gxoLhWgxw k�uFr%k p�hLj k yxqLk k j r%oLk�r%s�p lWgnqWp j � j p �Gr�s� j oL�%qWj k p j y�{�� � ��u�r�p j �%{cp gxh�j oLhWg}�Lj oL��u�r0r�p��Uj4r%oR) � j oL��qLj k p j y�{coWhp� j oL��qLj k p j y+u�gxp lLrLhLk+{�� j �cg�lW{]�%g��gxgxo7p gik p gxh7r�o��;oW��� j k l p gi�Lp k����QoL�,� j k l�j kQ{4p �0v�r,� r��%j y�{�� � �+k v�gxyxj {���� {coW�%q�{c�%g��)m pQw g�� j gxk;u�r%w gTr%of�r�w hFr%w hLgxw�p l�{co�hWr�uFr%k p?� {coL��qW{%�%gxkx�0{coLhFj p kQu�r�w vLlLr,� r%�%��j kQuFr%w g j u�v�r��cgxw j k lLgxh7p l�{co�u�r�k p��� lLgxk gFy}lW{%w {%yxp gxw j k p j yxk lW{]�cgFgI_Zgiyxp k oWr%p r%o7� �nr%oGp lWgP� j oL��qLj k p j y7u�gxp lLr0hWk��LqLp r%oGp lWg�hLgxk j �%or%sQvWqLw g�� �9k p {%p j k p j y�{��;{�� ��r%w j p lLu�k+{ck�f�g�� � ��m s?� j oWgx{%w+r%w hLgxw+j k+j u�v�r�w p}{%o�px��yir,� � rLyx{%p j r�oLk4y�{co���g{ck k qLuFgihp rFk j u�v7� gxw4p lW{%o�j s?� r�oL�FhLj k p}{coWyig7w g�� {cp j r%oWk+{cw g�u�{cw �%gih��0��{c��w gxgxu�gxo0p+uF{%w �%gxw k+r�sk r%u�g�k r%w p��)m o ��gioWgxw {�� �cj pCu�qLk p)��gT{ck k qLu�gxh�oLgxyxgxk k}{%w � p r4v�gxw s r%w u�oWgxfk gxp k;r%s0gi�Lv�gxw j u�gxo0p k)r%og�{cy}l � {coW�%qW{%�%g+{�w gxp w j g��c{��Wk ��k p gxu j k�u�r]�%gxhFp rL�0p r7{%k yxgxw p}{cj o�p lW{%pQp lLg+u�gxy}lW{coWj k uFkQgxu�v�� rc�%gxhj oLhWgigxh9��j �cg�k}{%p j k s {cyxp r%w ��w gxk q7� p k4j o9p lLg oLgxf � {coL��qW{%�%g��|9r%w gxr��cgxwx��p gi�0p k+f w j p p gxo9j on{P� {coL��qW{%�%g�p lLg w g�{chWgxw4hLr0gxk4oLr�p4yxr%u�vWw gxlWgioWhnw j k �F�Zgij oW�7j �J)

oLr�w gih�s r%wQp lWg f w r�oL� w gx{%k r%oLk��?z lLj � gTs q7� � ��{%qLp r%uF{%p j yT��gioWgxw {��LvWqLw v�r%k g4lLj �%lP|0qW{�� j p ��uF{cy}lWj oWgp w}{coLk � {cp j r%o�w gxuF{%j oWk {7k gxgxu�j oL�,� ��{cp p}{cj oW{%�7� g+�WqLp4j o�w g�{�� j p �Fg�� qWk j �%g�{coWh�v�gxw v�gxp qW{�� � �FhLj k p}{co0p�%r0{�� s r�w7g��%gxw�oWgxf/�%gxoLgxw}{cp j r%oWk7r�s�� {%oL�%q�{c��g�gxoL��j oLgxgxw k�{coLh!yxr%uFvLqLp}{%p j r�oW{��D� j oW�%qWj k p kx�Qk v�gI)yxj {��;vLqWw vZr%k g7p w {%oLk � {cp j r%o�uF{cy}lWj oWgxw ��{�� w gx{%hL�9hWr0gxk�k lLrcf vWw r%u�j k g�r�sQqWk gxs q�� oWgxk k����;k v�gxyxj {�� � �j s)p lLg hLj k p j oWyxp j r�oLkT�Zgip fTgigxo�yiw qWhLg%�Ww}{�f���{%oLh9k ��j u ) r%o�� �W) p w}{coLk � {cp j r%oWk@l z {coLk�m {cw � �%w gxoZ�Z���,��}Jn{cw g�uF{chWg�y�� g�{cwTp r�k �0k p giu/vLw r���j hLgxw kx�Wf�g�uF{���gi�0vZgiyxp4p r7��g {c��� g�p r7v�gxw qWk g�p gi�0p k qWk gxs q�� � ��j o� {coW�%qW{%�%gxk f�g hWr7oWr%p uF{%k p gxwD��j sCf�g�yx{%o��LoWh9p lLgxu��¢4oWhnu�r�w g�hWj k p w gxk k j oL�,� �c�Wp gi�Lp k+f w j p p gxonj on{�� {coL��qW{%�%g�p lLg�w g�{chLgxw8ORr-QV\ yxr%uFvLw gxlLgxoLh�w j k �

��gxj oL�+j �%oWr%w gxh j sWw g�{%hLgxw k;k v�gxyxj s � p lLgxj w;j oWs r%w uF{%p j r�o�oWgigxh7j o7�;oW��� j k l w}{%p lWgxw)p l�{co�j o7{co0� r�sLp lLgr%p lWgiw�� {coW�%qW{%�%gxk4p lWgx�p��oWr�f.� � lLj k4r%s;yxr%qWw k g�uF{x�p� gx{%h9p rF{P�0j yij r�qLk yx��y�� g r�s)k qWy}lnuF{%p gxw j {�� k��gxj oL��uF{chWg {��%{cj � {c��� g4r�w vLw r0hWqLyxgxh9f j p l�� gxk k4gio0p l�qWk j {%k u/p l�{co9uF{cp gxw j {�� kTj on�;oW��� j k l=�|9gxy}lW{%oLj k u�k�p r�lW{coWh7� g [+�� Y L p � L NRX��Ks���Z QIY ZVL Q��Js����$j � g�� w gxp w j g��%{��;r%s�p gi�Lp k�j onk g��%gxw {��?� {coR)

�%q�{c��gikx�Z{coWh qIZ r-\V\Ip � L NRX��ts�� Z QIY ZIL Q��Js�����j � g���w gxp w j g��%{��Cr�s)p gi�Lp k+j o�{coLr�p lLgxwD� {%oL�%q�{c��g�p lW{%o9p lLg|0qLgxw �c�){cw g�yxqWw w gxo0p � �9��gxj oL�FhWgxk j ��oLgxh{coWhnp gxk p gxhf j p l�k r�u�g�k qLyxyxgik k���e0qLy}l�k �0k p gxu�k�y�{%on��g�LqWj � p�qLk j oL��k g��%giw}{���hWj _�gxw gxo0pTu�gxp lWr0hLk�� � lLgm|0qLgxw ��j p k g�� sZuF{��7��g+p w {%oLk � {cp gxhZ� � lLg+hLr0yxqWu�gxo�pw gxvLw gxk gxo0p}{cp j r%oLk�uF{����g�p w}{%oLk � {cp gxhZ�(�+w7p lWg�hLr0yxqWu�gxo�p7w gxvLw gxk gio0p}{cp j r%oWk�{coLh�|0qLgxw j gxk7uF{����r�p l!��gnw gxvLw gxk gio0p gxhOj o!{yxr%uFu�r%o�� {%oL�%q�{c��g���w giyxgxo0pFgi�0vZgiw j u�gxo0p kFqWk g~C{%p gio0p�e0gxuF{%o�p j ym oLhWgi�0j oL�W�WvLw gxk gio0p gxh�{c�Zr]�%g%�Ws r%w p lW{%p vWqLw v�r�k g l ~+qWuF{cj k3QIYvs�� � �Z������}Jn �

�Pf k ekcFl�c&) -#m�n^f8oJe -/,!l-e '#pQq �%�

�5+��� ; %46Bv;%4 UC�F ;%C��G; 0326F :#; U46Bv;%4 %A-2 � ;%C��G;

��� ��� K���;���5C6 EC24/10�; 5��.3?+:3 w.3?I4/1-�u(/80�G.E� gi�Lp)j k)u�r%w g�p lW{co�p lLgTk gxp;r%sLf�r�w hLk;j o j pi�%{coWh�k vZgiyxj �Ly�{�� � �%�cj p)j k)u�r�w g�p lW{%o�{4v7� {cj o k g�|�qWgxoLyxgTr�sf�r�w hWk��8z lLj � g�p gi�0p k+{%pD�Ww k p4�,� {coLyxg {%w g�r%oLgI) hLj u�gxoWk j r�oW{��Zgxo0p j p j gxki�Wj o9p l�{cp�� j oW�%qLj k p j y4r��R` gxyxp kk qLy}l�{ck�k ��� � {c�7� gxkx� fTr%w hLkx�+{%oLh y�� {cqLk gxk��^r&� � r��3g�{%y}l r�p lWgxwFj o {Gk p w j yxpFk g�|�qWgioWyxgc� Z Q�� sWY L rJNK\��gxp f�gxgxoGw gxs gxw gxo�p kx�;p gxw u�kx�Cf�r�w hWkx�)gxo�p j p j gxkx�Ck qL�Wp gi�Lp ki�;k gx�%u�gxo0p ki�)y�� {cqLk gxkx�)vW{%w}{c�%w}{%vLlLkm��r�wf lW{%p g��%gxw�r%p lLgxw p �0v�gFr%sTp lLj oW�9r%oWg7f j k lLgxk�p r9v�r%k p q7� {%p gF{ck�k qWj p {%�7� g�j p gxu�k�r�sTk p qLhL�s� {cw gvLw gxk gxo�p�j o�p lLg p gi�0px��oWr%pQyxr%oWk p w}{cj oWgih7�0�e� r0y�{��L{%hJ` {cyxgxoLyx�7j o7p lLg k p w j oW��r%w;k r�qLoLh�vW{%p p gxw oZ�0{coWhy�{co9w}{coL��g.|�qWj p g�s {cw r��%giw p lWg.� gxoL��p l�r�sCp lWg�p gi�Lp�� � lWj k ��j �cgxk p gi�0p k+{�s w}{cyxp}{��Zo�{cp qLw g�r�sCk r%w p kx�{ y}l�{cw}{cyxp gxwTr�sCw g�{%y}lLj oL�7��gx�cr�oLh�p lLg�r%oWg4hWj u�gxoLk j r%oFp lLg+k p w j oL�7{W_�r%w hWk�j p��?~+j k yxr]�%gxw j oL��p lLgxk gw g�� {%p j r�oLk7j kP� {%w ��g�� �Gf lW{cp�p gi�0p�qLoWhLgxw k p}{%oLhLj oW�j k�{c��r�qLp���¢/k gxw j gik�r%s+hLj _�gxw gio0p�p gxy}lWoLj |�qWgxkp w �9p r9r%w ��{%oLj ¤xg�p lLg7p gi�Lp�uF{%p giw j {��;j o0p r�y}l�qWo7�0ke� {%w �%gxw+p l�{cop giw u�k�� � lLg�w g�� {cp j r%oWk+��gxp f�gxgiop gi�0p qW{��0j p giuFk)y�{co�p}{��cg4{4o�qWu���gxw;r%sWs r%w u�kx�%u�qLy}l7hLgxv�gxoLhWgxo�pQr�o p lWg�s r�w u3r�sW{co�{�� �0k j k)y}lWr%k gxoZ��Lr�wQp gi�0pTw gxp w j g��%{���p lWg4k p}{coLh�{cw hFu�r0hWg���vLw gxk gxo�p gxh�j o �)j �%qWw g��,� ��{coLhFhWj k yxqLk k gxh�k r s {%wQl�{ck

{cvWv�g�{�� j oL�,� � k j u�v7� g {%oLh�j o0p qLj p j �%g�� � qLoWhLgxw k p {%oLh�{c�7� g4vLw r%vZgiw p j gxk��1�)j oLh�r%qWpQf lW{%p�{�hLr0yxqWu�gxo�pj k7{c��r�qLpx�Q{%oLh��LoWh�r%qWp f l�{cp7p lWgFqWk gxw7fT{%o�p kx�T{coLh�uF{cp y}l�p lLg�p f�rKH {9hLrLyiqWu�gxo�p7j k�{%��r%qWpf lW{%p�j kQuFgio0p j r%oLgxh�j o�j p^H�f lW{%p�j kQuFgio0p j r%oLgxh�j k�u�gxo�p j r%oWgxh�qLk j oL��f�r�w hWk^H0yxr�qLo0pT{coWh�p}{c�Lq�� {cp gp lLg�f�r�w hLk�� � lLj k j k g�{%k ��p r7qLoLhWgxw k p}{coWhn{coWh�p r7j u�v�� gxu�gxo0p�� � � qLp p lLj k k j u�v7� g+u�r0hWg���l�{ck j p ks {cq�� p k��

��� ��� r�� /80�G%G.6 E�570�6 w.Jm5�6 /1+.EC3?0�; w.J.0�E,5Q��Wr%w�j oWk p}{%oLyxg%��u�r%k p7k p}{cp j k p j y�{�� {%vLvLw r0{cy}lLgxkF{ck k qLu�g�fTr%w hLkF{cvWv�g�{cw7u�r�w g�r�we� gxk k7w}{coWhLr�u�� �j oG{�p gi�0px�;j o{ � r�j k k r�oR) k p �,� g�hWj k p w j �LqLp j r%oC�Cj oWhLgxv�gxoLhWgio0p � ��r%sTg�{cy}lGr%p lLgxw�{%oLhvWw g��0j r%qWk r0yI)yxqLw w gxoLyxgxk�� � lLj k�j k�oW{cp qWw {�� � � {G��w r�k k�k j u�v7� j �Ly�{%p j r�oZ�f�r%w hLkn{cvWv�g�{cw9j oO{Gp gi�0p9oLr�p�j oO{u�gxu�r�w �w) � gik k4hWj k p w j �LqWp j r�o��WqLp+s r�� � r�f j oW��{�vW{%p p gxw on��r]�%gxw oLgxh��0�9p lLg�p g}�Lp qW{��)p r%vLj y vWw r%�%w gxk )k j r%oF{%oLhFyxr%u�u7qLoLj y�{cp j �%g yxr%o��cgxo0p j r�oLk@l z {coWkDm {cw � �%w gxoZ�C���,}�g0�Rm�{%p ¤c�C�c�%���-n �;m sZp g}�Lp�k gx�%u�gxo0p ku�r�w gP� j �%g�� �9p r��Zg7p r�vLj y�{�� � ��vZgiw p j oLgxo0p {cw g7y}lLr�k gxo�{coWh�p gxw u�k�f j p lLj o�p lLgxu f�gxj �%l0p gxhqLvG{ckyxr%u�v�{cw gxhnp rFp gxw u�k4s w r%u/r�p lWgxw4k giyxp j r%oWk4p lWj k+f�gxj ��l�p j oL�Ff�r%q�� hnw g^]Lgxyxp+p lLg�p r�vLj y�{��)uF{��%gI) qLvr%s�p lLg7p gi�0p��Zgip p gxw+p lW{%o{FoWr%oK) vWw r%�%w gxk k j r�oW{��)uFr0hLg�� � � lLgxk g7s r,� � rcf j oL�Fk gxyip j r%oWk�yxr]�%gxw�k r�u�ggi�0j k p j oL��p gxy}lLoLj |0qLgxk v�r�p gio0p j {�� � ��qWk gxs q��Qs r%w+p lWj kx�Ck qLy}l�{%k�k qWu�uF{%w j ¤�{cp j r%o�{%oLhp gi�Lp�k gx�%uFgioK)p}{cp j r%o=�

��� ��� ��� 6 ;=@ G.;=G:E7;U3?0�F{�e0r�u�g uF{%p gxw j {�� kQ{cw g k p w qWyxp qWw gihFp r ��gx�%j o7f j p l=��¢ k g�{cw y}l�j oF{+h�{cp}{c��{ck g s r�w;p lLg4�%g�� � rcf�vW{%�%gxkx�s r%w�j oLk p}{coLyxg%�Cf j � �)o�{cp qLw}{�� � �9uF{��%g7qWk g7r�s�s w gxg7p gi�Lp�k gx{%w y}lG{ck�f�g�� �Q{%k�k giv�{cw}{cp g7k g�{cw y}lLgxk s r�wyxr%u�v�{co0�7o�{cu�gxk r%wT{%hLhLw gxk k gik4j oFk gxv�{cw}{cp gm�Wg�� hWk��?¢Ok g�{cw y}l9j oF{�vLw gxk k {cw y}lWj �%g�f j � ��oW{%p qWw}{�� � �{�� � rcf � r%w)k lLr�q7� h {�� � rcf �Zs r%wCk g�{cw y}lWj oW�4j o�p lWg������ j oLg�{coWh hW{%p g?�Wg�� hWkCk gxvW{%w {%p g�� ��s w r%u�k g�{cw y}lLj oW�j o�p lWg�p gi�0p4j p k g�� s �� �Q¢ �8�¹�Q� ¢ � �8�%���'� �%�Q� ¢ � � �F¥ �!���%�%�*���  F�*�j�0¥ � ��� �v�*¡{¥ ���0�F�%� � ¢j� ¥ � � �%¥ �=� � �%�F� �8� �v¥ ��� ¦ �!� ���%�8 ���� �0�F�%�F� ¢ �� � ���F�'�#���F�%¢ � ¥ � ��� �.���F�^� �0�F� � �0� �8�.���®�8¢ �%� �%�,� �%¡ ��¢ �0�*� � �8�^¢ � � ¢ � � ¤ ����� �8� � � �£¡ ¢ ��� � ¥ ¢ �*� ¥  ^� ��� � � �!�  F�������%��F�*��©

�c� ��bPc^d%e fVg[ÃRi

��� ��� ¦���;���5CE7;=I12f;=+D573�576 /8+� qWpQu�r%k pQuF{%p giw j {�� k;{%w g oLr%pQr�w ��{coWj ¤igxh���gxs r%w gxlW{%oLhZ�Qm pQj k;p r�k r�u�g hLgx�%w gxg4v�r%k k j �7� gTp r�{ck k qLu�g{4k p w qLyxp qLw g s r%w;p gi�0p q�{��LuF{cp gxw j {��0f lLj y}l7j k)oWr%pQg}�Lv7� j yxj p � ��r%w ��{%oLj ¤xgih=� � gi�0p kQy�{co7��g w gx{%k r%oW{%�7� �w g�� j {%�7� � k v7� j p;j o0p r k p w qWyxp qWw}{���{coWh�p r%vWj y�{��Lk gx�%u�gxo0p k���{+p gi�0p�uF{���yxr%oWk j k pQr�s�k g��%gxw {��Wk qW�Lp r%vWj yxkj o�k g�|0qLgxoLyxg�� � �0vLj y�{�� � �%��k qWy}l�{%oW{�� �0k j kCj kChLr�oLg�f j p lWr%qLpCw gx��{%w h�p r�� j �%g�� �4k g�{cw y}l w g�|0qLgxk p k;qWoLhLgxwp lLg {%k k qWu�vLp j r%o�p lW{%pTp lLgxw g�j k {�k p w qLyxp qLw g�f lWj y}l�j kTvZr%k k j ��� g+p r7y}lW{%w p �0�Fj oWk vZgiyxp j r%o�r%s)p gi�Lp k{ckTp lWgx��{%w g�� � r�k r�u�g4hLgx�%w gxg+p lWj k�j kQp w qLg%�L{�� p lWr%qL��l7s r�w�j oLk p}{coWyig+j oFp gi�Lp�k gx�%u�gxo0p {%p j r�o�p}{ck �0kl0qLuF{%o k qL�R` gxyxp k;hWr4oLr�p){�� f {x�0k;{c��w gig�r%o�f lLgxw g�k gx�%uFgio0p)��r�qLoWhW{cw j gxkCy�{%o ��gT{%k k j �%oWgxh��]� � gi�Lp ky�{coF��g4k v7� j pQqLvFj o�k qL�Lp r�vLj y k gx�%uFgio0p kT�W{ck gxhFr%oFf�r�w hFr0yxyxqLw w gxoLyxgxk��Qj sZf�r%w hFs w g�|0qLgxoWyij gxkTk lLj s poLr�p j yxg�{c��� �9s w r%u r%oWg7k p w gxp y}lr�s�k p w gxp y}lp rn{coLr�p lLgxwx�Cj p�j k�w g�{%k r�oW{%�7� g7p r9{ck k qLu�g�p lW{cp�p lWgiw gj k�{%o!{cp p gxoLh�{co0p7k lLj s p�r%s+p r%vWj y�� l z g�{cw k p+{coWh � � {cqLo0px�C�����%�0� z gx{%w k px�C�c�%�c�0{0�1� gx��o�{cwx�C�����c�L�eL{�� p r�o9{coWh�¢m� � {%oZ�Z�����c�L� z g�{cw k pi�C�c�%�,}-n � � lWj k j k p lWgFqLoWhLgxw � ��j oL��{%k k qWu�vLp j r%oGr%s uFr%k p p gi�0pk gx�%u�gxo0p {%p j r�o9{�� �%r%w j p lLu�k��

��� ��� � � 3?E7E73?I1; 0�;=570�6 ;=>?3?@p3?+.G"!�J.;=E�576 /1+:3?+.E#u�;U0�6 +.Ie0v�{cw yr� |%r%oLgxk7{coWh m�{���f w r�p gFj o!�c��}%�9p l�{cps��� � ��p lWgxw gFj kd� j p p � g7hLr%qW�Lp�p lW{%p�j p j k s w r�u p lLj khLj w gxyxp j r�oGl s {%yip;w gxp w j g��%{��Lr%w�|0qLgxk p j r�o�{coLk f�gxw j oL�wn0p l�{cp;u�{co0� r%sWp lLg oLgxf�j hLg�{%k)j o0p w rLhLqLyxgxh7j o�p rhLrLyiqWu�gxo�p}{%p j r�or��%gxw p lWg�oWgi�0p7s gif �%g�{cw k7f j � ��yxr%u�g�� �l eLvW{cw yr�}|%r�oLgxk4{%oLh<m {��c�C�c��}��-n � lLj kvLw r�u�j k g�k gxgxu�k+s w r%u/p r0h�{x�Pa k+v�gxw k vZgiyxp j �%g�oLr�p+p rFl�{��%g��Zgigxo�s q7� �7� � gxhZ� � lWg�r�vLp j u�j k u r�s;p lLgg�{cw � ��k g��%gxo0p j gxk�s r%w+k r,� ��j oL��{cw p j �Wyxj {��Cj o�p g�� � j ��gioWyxg {%oLhs��oWr�fD� gxhL��g�w gxvLw gxk gio0p}{cp j r%o�j k k qLgxk�fT{cky�� gx{%w � �FqWoLs r%qWoLhWgih=�Tm p j k4y�� gx{%w p lW{cpD��k j u�j � {%w � ��p r7p gi�Lp4k gi��u�gxo�p}{%p j r�o ��v�{ck k}{c�%g�w gxp w j g��%{��j k oLr�oR) p w j �0j {��Zg��cgxons r%w l0qLu�{coLkx�Wg��%gxo9f lWgxo9p lWg�h�{cp}{�k gxp4j kD|0qLj p g k u�{�� � �z rcf�g��%gxwi��p lLgxw g�{%w gQk r�u�g;p w g�{chLk;{�� r�oL� p lLgQv�{cp l�p r4k ��k p gxuF{cp j yQs {cyxpCw gxp w j g��c{��%p l�{cp){%yip q�{�� � �

lW{]�%g�vLw r��cgxhO��r%p l vWw r�u�j k j oW�G{coWh qLk gxs q7� �3m o �%gxoWgiw}{�� �4p lLg�j hWg�{p lW{%p�{k �0k p gxu yx{%o<�LoWhj oLs r�w u�{cp j r%o�j oFp gi�0pT�0��gi�0p w}{cyxp j oL�7k p w qLyxp qLw gxkTp l�{cpTr%w j �%j oW{%p g s w r%u p lWg+j oLs r�w u�{cp j r%o7w g�|�qWgik p kp lLgxu�k g�� �cgxk j k+u�qWy}l�uFr%w g�p w}{cyxp}{c��� g7p lW{coG{cp p gxu�vLp j oL��p r�r%w ��{%oLj ¤xg�p gi�0p k j o{%o�p j yxj vW{cp j r%onr�ss qLp qWw g w g�|�qWgik p k��¢4k�{%o9gi�L{%u�v7� g%��{�� �%r%w j p lLu�k s r%w4gxo�p j p ��k v�r%p p j oL�L�Wk p}{cw p j oL��f j p l9v�gxw k r%oC��v7� {cyxg%�Wr%w �0{coLj ¤�{-)

p j r%o9o�{cu�g k v�r%p p j oL�L��{%oLhnhW{%p g k v�r%p p j oL��p rFu�r�w g���gioWgxw {��Cgxo0p j p ��k v�r�p p j oW��s qLoWyip j r%oWk4{%y}lLj g��%gk r%u�g�hWgx�%w gxg r%s)k qWyiyxgxk k l e0p w ¤�{�� �%r�f k �0j){%oLh�zG{%oL�W�Z�����%�L�Lg�� �7� n ��{coWhn{chWh�oWr%p j yig�{%�7� �Fp r�j oLs r�w )uF{%p j r�o�w gxp w j g��%{��Qv�gxw s r%w uF{coWyxg7f lWgioGyir�u��Wj oWgxhf j p l'� gxk k�j o��%gxo�p j �%g�k j oW��� g7{%oLhu7q7� p j;f�r�w hp gxw u j oLs r�w u�{cp j r%oZ�)eLj u�j � {%w � �%��p gxy}lWoLj y�{��0p gxw u�k;lW{]�cg4{4u�r%w g�w j �%j h k p w qLyxp qLw gTp lW{%o�r%p lLgxw;u�q�� p j )f�r�w hGp gxw u�k.� w}{cp lWgiw�k j u�j � {cw+p rnoW{%u�gxki�;j oGp lWgxj we� j oW�%qLj k p j y���gxlW{]�0j r�wx�)j os {cyxp.��{coWhy�{%o��g�vLj yr�%gxh�r%qWp4p lLw r%qW�%lnv�{cp p gxw o�uF{cp y}lWj oW��p gxy}lLoLj |0qLgxk {cqW�%u�gxo0p gih�f j p ls� gi�0j y�{��)j oLs r�w u�{cp j r%os w r%u/{7v�{cw p ) r�s ) k vZgigxy}l�� gi�Lj yxr�o l |%qLk p gxk r�o�{%oLh<m�{%p ¤%�C�c�%��gJn �� lLj k+p ��v�g7r%sQp gxy}lLoWj |0qLg7y�{co���g�gi�0p gxoLhWgxh¥|0qLj p g�s {cw4p rFvZgiw s r�w u L N%�^rJZI[,sWY L rJN�Q SWY Z sRqIY L rJN��

� lLj kTj kT{ p gxy}lLoWj |�qWg+f lLj y}l�j k { hLgxk yxgxoLhW{%o�p r�sZp lLg+r�w j ��j o�{��WhWgik yxw j vLp j r%oFr%s�� k yxj gxo0p j �Wy+k qW�7� {coK)�%q�{c��gik �r%wTk v�gxyxj �Lym�c{%w j gxp j gxkQr�sZ� {coW�%qW{%�%gD� ��r�p l�{%k�w gx��{%w hLk8� g}�Lj yxr%oF{%oLhFk �0o�p}{c��� qLk gxhFj ok v�gxyxj �Wy�yir�o�p gi�Lp k��0�$#Zg�� � j � z {%w w j k8l z {%w w j kx�Z�c��g��Jn ��¢+oLh�j o�{%vLv7� j y�{cp j r%oC�WuF{cp y}lLj oW��w giyxqWw w gxo0p% & �8� � ���F�F� �������F�('#� � �0���[¡ ���F�%���  %�*�=� � ¦*) � ¥ � �j�F� �[����¢ � ��¾,+j� ��¢ � �v¡ ���F�%�[�  F� ���%� �#�F����¢ �=�8¢v� � � � �F�v� �  F� ��}¢ �8�%���8© & �8� � ���F�F� �������F�-'#� � �0���z�F� � �z� �Q����� �z���*� � ¢ � ��� �=���F�-+j� ��¢ � �^�F� � �z�v¢ � � � � � �Q���%�F� ��¢^� ¥ � � �%¥ �� � �%� � ©/.[�8� ��� � ��� � ���  %��¢ � ¥  %� ¢0� �%¡ ��¢ �0�*� � ��� � �¨�  F��� �Q���8� � �0�%�%����¥ ¥ ���F��� � �¨¡ ��¢.�  F���%� 0'� ¢ � �F¥ ��� � ¢ � � �F� � � ©½ & ��� � ���%�F� ���,���F��'#� � �����#�21 À�À43%��+j� ��¢ � � �21 À8À�Á��%�*+j� �8¢ � � �21 À�À�Á ¦ Â

Page 9: Basics of Information Retrieval - Statistics and Linguistics

r%s�{%yiyxqWw {%yx��{coLh!k vZgigxhC�Tk qLy}l {ckFj k7hWgxu�r%oWk p w}{cp gxh�j o�p lLg9�%g�{cw � ��|9gxk k {%�%g<u4oWhLgxw k p}{%oLhLj oW�tTr%oWs gxw gxoWyigxk�� � lWgxk gFp gxy}lLoWj |0qLgxk7{cw g�p ��vWj yx{�� � �n��{ck gxhr�ok p giw gxr%p �0v�gxh�{coWhw g�� {%p j �%g�� �nk p}{%�7� gj oLs r�w u�{cp j r%onw g�|0qLgxk p k�{coWh�g�� {c�Zr%w}{cp ge� j oL��qLj k p j ye�c{%w j {%o�p�hLgxp giyxp j r%oG{�� �%r�w j p lWu�k4p lW{%p {cw g7vLw gI)yxr%u�vWj � gxh�p rk j uFv7� g�vW{%p p gxw o�uF{%p y}lWgxk<l ��w j k lLuF{%oZ�Z�����%�0�Tg�� ��� n �!m s�{co�j oLs r�w uF{cp j r%o�oWgigxh!j kw g�� {%p j �%g�� �9�%gxoWgiw}{���{%oLhv�gxw k j k p gio0p r��%giw�p j u�g%�){coj oLs r�w uF{cp j r%ongi�0p w}{cyxp j r%ok �0k p gxu y�{coGp w}{�fD�p lLg�j oLs r�w u�{cp j r%o9k v�{cyxg�s r�w+hLr0yxqLuFgio0p k+p lW{%p+hLgxk yiw j ��g�j oLk p}{coWyigxk�r%sQp lLg�w g�� {%p j r�o9r%w+g��%gxo�p�w gI)|0qLgxk p gxh=��{coGgi�L{%u�v7� g�yir�q7� h��g�{�k �0k p gxu s r�w.�WoLhWj oW�noLgxf k�j p gxu�k p lW{cp hLgxk yxw j �ZgF{%j w�p w}{W(7y{cyxyxj hLgxo0p kx�)j hWgio0p j s ��j oL��� r0y�{cp j r%oC�Zp �0v�g�r%s {%j w yxw}{cs px�ChW{%p gc�)o0qLu��Zgiw�r%s�y�{ck q�{�� p j gxkx�;{cj w � j oWgc�){coWhv�r�k k j �7� g�yx{%qLk gxk4r%s)p lLg {%yiyxj hLgxo0p�� � lWgik g k �0k p gxu/hWr7oWr%p {%p p gxu�vWp�� p gi�0p qWoLhWgiw k p}{coWhLj oL�, L�L�WqLpk g�{cw y}l9s r%wD� r0y�{�� � �7yir�oLk j k p gxo0p gi�LvLw gxk k j r�oLk4p l�{cpD�WpTp lLg �%j �%gxo�vW{cp p gxw oZ� � lW{cpD� r0y�{���gi�0vWw gxk k j r%oj kFp lLgxo�{co�{�� �,¤xgxh w g�� {%p j �%g�� ��p lWr%w r%qW�%l7� �%�4qLk j oL��g^(7yxj gxo�p�k �0o�p}{%yip j y{co�{�� �0k j k9{coLh k gxuF{%o�p j yyxr%u7�Lj oW{%p j r�oFw q7� gxk p}{%j � r�w gxh�s r�w p lWg�hWr%uF{%j oZ�LvW{%p p gxw oZ��{%oLh9p gi�Lp4p �0v�g��� g�{��=� j �cg k gxuF{co0p j y {%oW{�� �0k j k j k ��gx�%r%oWhnp lLg k yir�v�g r�s;{cqWp r�uF{cp j y�k ��k p gxu�k4p r0h�{x�%�W�LqWp4k ��k )

p gxu�kFs r%w�lWj ��lLgxw � g��%g��4p gi�0p q�{���{co�{�� ��k j kF{%w g�{�� w g�{chW��{%pFp lWgnv�r%j o0p�f lLgxw gnp lLg�j oLy�� qLk j r%o�r�sk gxuF{co0p j yP�0oLrcfD� gxhL�%g�k qLy}lG{%k�vWw giyxr�u�vLqWp gxh�%gxoLgxw}{��Qyxr�oLyxgxvLp lLj gxw {%w y}lLj gxk�k qWy}l�{ck.zr�w hWoLgxpx�r%wnr%s�f�g�� � p ��vZgih3hLr�uF{cj oR) k v�gxyxj �Ly�k g�� gxyxp j r%oW{���w gxk p w j yxp j r%oLk�l ��w j k lLuF{%o9{%oLhne0p gxw � j oW�L�Z������t0�g�� �7� n j u�vLw r��%gik!gi�Lp w}{%yip j r%o/w gik q�� p kx�{coWhf|0qLgxk p j r�o {coWk fTgiw k �0k p gxu�k p �0v�r,� r��%j ¤xg |0qLgxw j gxkp r qLoWhLgxw k p}{%oLh f l�{cp p �0v�g3r%sG{%oLk f�gxwOp lWg |0qLgxw � gi�Lv�gxyip k�� v�gxw k r�oZ�v7� {cyxg%��h�{cp g%��gxp y��l �Qr0r�w lLgxgxk4{%oLh � j yxg%�C���%���0�Lg�� �7� n

��� ��� � � w.E�570�3?FZ576 +.I43?+.G:E7J.242f3?0�6 �=3�576 /1+¢�yxr%u�u�r�oFvLw r%��� gxu j oFj oLs r%w uF{%p j r�o7w gxp w j g��%{���j k�p l�{cpTp lLgxw g4j k {d� {cw �%g4o0qLu7��gxwTr%sChLrLyiqWu�gxo�p kf lLj y}lOuF{�����gnw g�� g��c{%o�p9{coLhOuF{����Zg�oLr%px�+{coWh p lW{%pFhWgiyxj hLj oW�Gf lLj y}l�{cw gnf lWj y}l j kFp j uFgV)yxr%oWk qWu�j oL�����Lr�w)p lLj k)vWqLw v�r%k g%�0{cqWp r%uF{%p j y�{%�Lk p w {%yxp j oW�L�%k qLu�uF{%w j ¤�{%p j r�o�r�w)�%j k p j oW�+{�� ��r%w j p lWu�k{cp p gxu�vLp4p rFvLw r]�0j hLg�{�yir�u�vW{%yxpD�%gxw k j r�onr%sQ{7p gi�Lp��4|nr%k p+{%qLp r%uF{%p j y {%�Lk p w}{cyxp j r�on{�� ��r%w j p lWu�kf�r�w �9r%onp lLg7{ck k qLu�vWp j r�o9p l�{cp4k g�� giyxp j oL�F{�o0qLu7��gxw4r�s;k gxo0p gioWyxgik�s w r�u/p lWg�p gi�Lp+f j � �CvLw r]�0j hLg{7vLj yxp qWw g�r�s)p lLg p gi�Lp p r�vLj y�vLw r%��w gik k j r%o�l ~ZqWlLoZ�C�c��g,�-n �

�5+�����;%E6C G46087^A^;�A-C�:�= �M;%C��G;

��� �,� K���;���5C;=F=/8@ /1I=�� gi�Lp k�{%w gFqLk gxhZ�T{coWh�r%s p gxo�qLk gxh�k ��k p gxuF{cp j y�{�� � ���¥z lLgxo!{co0�yxgiw p}{cj o�p gi�Lp7j k w g�{chC�Qyxgiw p}{cj or%p lWgiwQp gi�Lp k�{%w gD� j �%g�� � p r���g w gx{%h�{ck�{�yxr%oLk g�|0qLgxoLyxg%�Lr%w;p r {%vLv�g�{cwQj o7j p k?��j yxj oLj p � j o7k r%u�g fT{x���m o�{%hLhLj p j r%o p r4p lLg@qVrJNtY QINtY0{coWh p lLgj�^rJZI[�r%sLp lLg�hLrLyiqWu�gxo�p k)w gxp w j g��%gxhZ�%hLrLyiqWu�gxo�p k)l�{��%gT{ qVrJNtpY Q SWY �0r%w@QVqVr&� r XQ���;p gi�0p kT{%w g+{cyxp qW{�� � ��qLk gxh��0�7v�gxr%v�� g s r�wQf lLr%u p lWgi��{%w g j u�v�r�w p {%o�p�����oLg4fT{��r%sWqLp j � j ¤xj oL�D�0oLrcfD� gxhL�%g {%��r%qWp)qLk g%�%qWk {%�%g%��{%oLh�p lLgTk r0yxj {���y}lW{%w}{cyxp giw j k p j yxk;r%sWp g}�Lp)j k)p r+yxr%oLk j hLgxwj pTf lLgxo9hLgxk j �%oWj oW��j o0p gxw s {cyxgxkx�Lp r7k qLvWv�r%w p hLj _�gxw gxo�p k p w}{%p gx��j gxk r�sCqLk g%�W�LqLp p lLj kTp �0v�g r%sCj oLs r�w )uF{%p j r�o�y�{co{�� k r���g qWk gih�hWj w gxyxp � �Fj onw gxp w j g��%{��Ul zG{�� �%gxwi�C�c���L�c��zG{�� �%gxwx�C�����0�%� � g�� �0j oZ�C���%�%�Wn �m o�{%hLhWj p j r%oC�WhLr0yxqWu�gxo�p k+r�s p gionlWr�� hnw gxs gxw gxoLyxgxk�p rFr�p lWgxw4hWr0yxqLu�gxo0p k���tTj p}{%p j r�on{co�{�� ��k j k4j k+{f�g�� �CqWoLhWgiw k p r0r0hnp r0r��Cs r�w r�w ��{coWj ¤ij oW�7k yxj gio0p j �Ly uF{%p giw j {�� k8�Ek yij gxo0p j �Wy uF{cp gxw j {��Zl�{ck4gi�Lv7� j yxj pyxj p {%p j r�oLkx��|�qWr%p gxkx��{%oLh�r%p lWgiw7v�r%j o0p giw k�p rnr�p lWgxw�k j u�j � {%w�uF{cp gxw j {�� k�� � r0h�{x�%��l��0v�gxw � j o���k�{cw gyxr%u�uFr%o�j o!uF{cp gxw j {�� k7vWqL��� j k lLgxh r%o!p lLgsz<z<z3� {coLh qLk j oL�(� j o7�0j oW�j oLs r�w u�{cp j r%o��%j �%gik�{

r%s;uF{%p giw j {�� k p l�{cp+{cw gd� j o7�%gxh9p r%��gip lWgiw��Tm o�{chWhLj p j r�oZ�Wl��0v�gxw � j o��cgxhnuF{%p gxw j {�� k j o9{�k gxoLk g�s r%w u{co�{%u�r%w vLlWr%qWk�f lLr,� g��;k g�{cw y}lLj oL��{cs p gxw�uF{%p gxw j {��Wr%oFp lLg�z<z<z j o��cr,� �cgxk8�LoWhLj oL�,\-rJ[ QQhLrLyiqK)u�gxo0p f j p l�w g�� {cp j �%g�� �Fv�gxw p j oWgxo�p4hW{%p {e�E{7w g�{ck r%o�{c��� g {%k k qWu�vLp j r%o9j k p l�{cp s qLw p lLgxw�� j o���k y�{%o��g s r%qWoLh9j o9p lLgd��j yxj oLj p �Fr%s;{7oLg�{%w lWj p��

� [7W�XZa(a'[7SU_=R�\]T XZSCb�yUb�\�[7a(bm o�p lLgp� {%k p7s gxf �%g�{cw kx��j o0p giw gxk p7j o�qWp j � j ¤xj oW�np gi�Lp7qWk}{c�%gn{ck�{%oLr�p lWgxw7j oLhWj yx{%p r%w�r%s4p gi�Lp7qWk gI)s q7� oWgik k�lW{ckFw gxk q7� p gih j o {o0qLu7��gxwFr�s+k p qLhLj gxk�{%oLh j oLhWgxgihO{o0qLu7��gxwFr%s�j u�v7� gxu�gxo�p}{%p j r�oLkf lLj y}l w gxyxr%u�u�gxoWh!j p giuFk�p r�qLk gxw k���{ck gxh r%o p lLgxj wFvLw g���j r�qLk�{%yxyigxk k�lW{%�Lj p k�� � lLgxk g�p �0v�gxkr%s�k ��k p gxu qWk qW{�� � ���LqWj � h!r�o!w g�{chLgxw kF�Ww r�{chWy�{ck p j oW�Gr%w�k qL�Wu�j p p j oW�p lLgxj w�r�vLj oLj r�oLk�r%wFg��c{�� )qW{%p j r�oLkGr%s9hLrLyiqWu�gxo�p k�r%wGf l�{cp g��%giw�j p gxu�k�{cw g!qWoLhWgiw�yxr�oLk j hLgxw}{cp j r%oLkx��{coWh p lLgxk g�` qLhL�W)u�gxo0p k�{%w gnp lLgxo f�gxj ��lLgxh!p r��%gxp lLgxwFp rGvWw rLhLqLyxg�{vLw gxhLj yxp j r�o!r%s+lWr�f/fTg�� �+{qWk gxw�j k � j �%g�� �p rp� j �%g�{coG{%w p j y�� g��Gl � w rLhLhW{L�Z�c�%��t0�#m {cw � �%w gxoZ�Z������t0�#m {cw � �%w gxoZ�Z�c�%�%�%�Z�U� gxk oLj yr� QIYks�� � �C�����c�L�e0l�{cw hW{%oW{%oLhn{%oLhn|�{cgxkx�C���%�,g0� z j � �UQIYks�� � �Z�c�%�,g-n� lLj k+vWw {%yxp j yxg�w gik p k+r�onp f�r�r��Lk gxw �c{%p j r�oLk��.�;j w k p � �c��qLk gxw k�r%s p gxonl�{��%g7{Fs {cj w4j hLg�{Fr%s;f l�{cp

p lLgx��l�{��%g�w g�{chZ�+{coWh p lLgx��y�{co w g�� {cp gnp lWgxj w |0qLgxw �!p r�p lLgxj w�rcf o w g�{chLgxw k lLj v lLj k p r%w �PH+p lLgk j p q�{cp j r%o{coLhp lLg7w g�|�qWgxk p j o�j oLs r%w uF{%p j r�o9w gxp w j g��c{��;k j p qW{%p j r�oLk�yx{%o�r�s p gio��Zg7s r%w u�q�� {%p gih{ck{�s r�w u r%sP� m�w gx{%h����Dr-r^O�r-r/4e��m+f {co0p u�r%w g�r%sTp lLg�k}{%u�g� 9v�r%k gxhGp rn{p� j �Lw}{cw j {co�r�w {yxr�� � g�{c�%qWg%�0r�w p rF{�o0qLu7��gxw r�s)p lLgxu��e0gxyxr%oLh�� �c�C{%onr%w hWj o�{cw j � �FqLoWr%w ��{%oLj ¤xgxh9�Zr0r��%y�{ck g�u�{x�9k g�� s ) r%w �0{coLj ¤xg.�Ek r%u�gxf lW{%p+qLoLk �0k )

p gxuF{cp j y�{�� � �p����{ck gxh�r%o�qLk gxw k^a)�Zgil�{��0j r%w��nm o0p gxw gxk p j oL��hLrLyiqWu�gxo�p k7uF{x���gFs r%qWoLh�oWg}�Lp�p rg�{cy}l�r%p lLgxw�� � lLgx�G{%w g�j o0p giw gxk p j oW�n��gxyx{%qLk gFk r�u�gxr%oLgFv7� {cyxgxhGr�wd� gis p�p lWgxu p lLgxw g%�Q{%oLhGp lWgi�{cw g�v7� {cyxgxhp lLgxw g���gxy�{cqWk g�p lLgx��lW{]�%g�k r%u�g�w g�� {%p j r�o�p rnp lWg7r�w j ��j oW{��;hWr0yxqLu�gxo0p��Fm os {cyxpx�Cj o{�� j �Lw}{%w ��r%w7{9�Zr0r��0k p r�w gc�Qv�gxr%v�� g�{%w r�qLoWh�{co�j o�p gxw gik p j oL����r0r��%y�{ck g�p gxoWh�p r���gFj o�p gxw gik p j oL�v�gxr%v�� g�� ��r%q�p gxoLhFp r���g+{c�7� g4p r ��gxpQ��r0r0h�w g�{chWj oW� p j vLk�s w r�u p lLgxu���e0j u�j � {cw � �%�%{ �%r0r0h�� j �Lw}{cw )j {co�f j � �)w gxu�gxu���gxw�p lW{%p {Fyigxw p}{cj o��r0r��np gxoWhLk p r9��g7w g�{ch���{Fyxgiw p}{cj ok gip�r�s�v�gxr%v�� gc�){coWh{coWr%p lLgxw ��rLr��F����p lLg k {%u�g�k gxp r�s)v�gxr%v�� g%��{coLh9p lW{%p p lWgxw g uF{��F��g {7k j u�j � {%w j p �7�Zgip fTgigxonp lLg��r0r,��kx��g��cgxo�p lLr�qL��l9p lWgi��u�{x��oWr%p4��g�yx{%p}{�� r%��j ¤xgxh9p r��%gxp lLgxw �9{ck+r%s;yxr%qLw k g%��p lLgx�9r%s p gxo9f j � �oLr�p ��g��?¢+o��%r%oWg f lLr�lW{%k p w j gxh�p r7r�w ��{coWj ¤ig {���r0r,�cy�{%k g �0�Fp r%vWj y.��oWr�f k+lLrcfOuF{co0�Fy�{ck gxk r�sqLoWgi�0v�gxyxp gxhny�{cp gx�%r�w ��yxr%oK]Wj yip r�oLg gxoLyxr%qWo�p gxw k��� lLgxk g�k �0k p gxu�k�{%k k qWu�g�p lLgFgi�Lj k p gxoLyxg9r%s4{nqWk gxw7u�rLhLg�� �)yxr�o�p}{cj oWj oW�nqWk gxw�` qWhL�%uFgio0p k�r�s

k r%u�g4k r%w p�r�o�hWr0yxqLu�gxo0p k��?z lWgxp lWgxw�p lLg4��w {%hLgxkT{%w g�{cy�|�qWj w gxhF�0�7p lWg4k ��k p gxu �0�7gi�Lv7� j yij pQqWk gxww gxyir�u�u�gxoLh�{cp j r%o9r%w4r��Lk gxw �c{%p j r�o9r%sQqLk gxw4��gxlW{]��j r�wi�Zp lWg u�gxp lLr0hWk4s r%w��w\IL NRX p lLg�j oLs r�w u�{cp j r%oj o�p lLgxu f j � �)�Zg7k j u�j � {cw�� � lLg7j oLs r�w u�{cp j r%onj o�{�k gxp�r�sQk j u�v7� g�qLk gxw�u�r0hWg�� k�y�{co��g�qWk gxhp ryxr%u�vWqLp g�{7vWw rx�Lj u�j p ��uFgx{%k qLw g ��gxp f�gxgxo�hLr0yxqWu�gxo�p k�� � lWgd�Lw k p4k p giv�j k p r�hWg��WoLg L NtY QIZVQV\IY){ck{�w g�� {cp j r%o���gxp f�gxgxo!{nqWk giwF{coWh�{nhWr0yxqLu�gxo0p�� � lLgxo�hWr0yxqLu�gxo0p k7y�{co���g�w gxyxr%u�u�gxoWhLgxh�p rqLk gxw k+��{ck gxhnr%o�p lLg�s r�� � r�f j oW�7k p}{cp gxu�gxo�px��p lWg �p[�W�XZa(a([�S�_=R7\�T X�S ��yZ�?X�\]�=[7b�T b �Tm s�{�qWk gxw�3j k4j o�p gxw gxk p gxhnj o9hLr0yxqWu�gxo�p k�� {coLh� )�Z{coWhn{%oLr�p lWgxw qWk gxw���j k j o0p giw gxk p gih�j o�� �Wj p j k�� j �%g�� �p lW{%p��Of j � �Z{�� k rP� j �%g� ����+wD� gik k4s r%w uF{�� � ���)m s)qWk gxw k+{%�%w gxg�r%on{�hWr0yxqLu�gxo0p p lWgx�Ff j � �Z{c��w gxg r%or%p lWgiw k+{ck4f�g�� � �j rcf���l�{��0j oL�FhLg��LoWgxhnw gxyir�u�u�gxoLh�{cp j r%oWki�Wp lWgd|0qLgxk p j r%onj k4lLrcf�p rFqLk g j p�� � lWgd� j �%g�� j lWr0r0h

r%sT{Fw gxyir�u�u�gxoLh�{cp j r%oWk+��gxj oL��qWk gxs q��;�%w rcf k�f j p lp lLg7o0qLu7��gxw+r%sTqLk gxw k�p l�{cp {c��w gig%�){%oLh�p lLgo0qLu��ZgiwQr�sWhLr0yxqWu�gxo�p kQp lLgx�7{%�%w gxgTr�oZ� � lLg4f lLr,� g v�r%j o0p;j kQp r�k qWu w gxyxr%uFu�gxoLhW{%p j r�oLk;r��cgxwT{�� �

�Pf k ekcFl�c&) -#m�n^f8oJe -/,!l-e '#pQq ��}

qLk gxw k�� � lLg4vLw rx�Lj u�j p � s w r%u {�hLr0yxqLuFgio0p�p r�{coWr%p lLgxwQy�{coF��g hLg��LoWgxhF{%k�{+k qWu r��cgxwT{�� �0k l�{cw gxhw g�{chLgxw k^aZj o0p gxw gxk p k+j onp lWgius� � lWj k4k qWu y�{co�p lLgxon�Zg�qLk gxh�p rFy�� qLk p gxw4hWr0yxqLu�gxo0p k��3j4r%p g�p lW{%p{ck+hLg��LoWgihC��p lLg vWw rx�Lj u�j p ��uFgx{%k qLw g hLrLgik+oLr%p+oLgxgxh9p r��Zg k ��u�uFgip w j y�{�� �Qp lWg�vWw r��Lj uFj p ��s w r%uhLrLyiqWu�gxo�p�� p r hLr0yxqWu�gxo�p� �hWr0gxkQoWr%p�lW{]�cg+p r���g g�|0qW{��Wp r p lLg4vLw r��0j u�j p ��s w r%u hLr0yxqLuFgio0p��p r�hLr0yxqWu�gxo�p� ��%p lWj k;f�r�q7� h7yxr�w w gxk v�r%oWh7p r�p lLg j hWgx{+r%s�k r%u�g hLr0yxqLuFgio0pQk qLv�gxw k gxhLj oL��{coWr%p lLgxwx�r%w p lWg�k g�|�qWgxoLyxg�r�s;{�k gxw j gik4r%s;j o0p gxw w g�� {cp gxh�hWr0yxqLu�gxo0p k��

��� �,� r�� /�F=J.24;U+85<E,5Q�m@ ;� gi�Lp k {%w g k r�u�qLy}l�u�r%w g�p lW{%o,` qLk p+k gxp k�r%sQf�r�w hLk��+m oLhLgxgxhZ�Cp g}�Lp k {cw g�u�r%w g p l�{co,` qWk p4f l�{cpp lLgx�F{%w g�{%��r%qWp�� � gi�0p kD�c{%w ��j oFuF{co0�7f {x�0k��?¢+qLp lWr%w kTuF{��%g4y}lLr�j yxgxkTf lWgxo�p lWgx��f w j p g+{�p g}�Lp��p lLgx��hLgxyxj hLgnlLrcf p rr�w ��{coWj ¤ig9p lLg9u�{cp gxw j {��Tp lLgx��lW{]�%gnv7� {coWoLgxh!p rGj o0p w r0hLqWyigWH4p lLgx��uF{��%gy}lLr�j yigxk���gxp f�gxgxoFk ��oWr%o0��uFkT{coWh7k �0o�p}{cyxp j y yxr�oLk p w qWyxp j r�oLk^H0p lLgx��y}lWr0r%k g+{%o7j o0p gioWhLgxhF{%qLhLj gxoLyxgs r%w�p lWgFp gi�Lp���¢+qWp lWr%w k�f j � ��uF{��cgFp lLgxk gFy}lWr%j yxgxk j o(�%{cw j r%qLk�fT{x�0k�{coWhGs r%we�c{%w j r�qLk w g�{ck r�oLk���W{%k gih�r�onv�gxw k r%o�{��)vWw gxs gxw gxoLyxgxki�)r%o�p lLgxj w���j gxf3r%sQp lWg�w g�{chLgxwx�C{coWhnr%o�f lW{%p4p lWgi�s��oWr�f {coWh� j �cg {%��r%qWp r%p lLgxw4k j uFj � {%w�p g}�Lp k��� \IY �&� Q4j k4{�yxr%oWk j k p gxo�p+{%oLhnhLj k p j oL�%qWj k l�{c��� g�p gxoLhWgxoLyx�9p r�uF{��cg�k r�u�g r�s)p lWgik ge� j oL�%qWj k p j y

y}lLr�j yigxk���e0p ��� g j kx��r%o�{+k qLw s {%yig�� g��cg�� ���cgxw �7r%���0j r�qLk � ��hWgip gxyxp}{c�7� g+{ck�p lLg4y}lLr%j yxg4��gxp f�gxgioFj p gxu�kj o�{s�%r0y�{%�Lq7� {%w �%����gxp f�gxgxo�p �0v�gxk�r%s4k �0o�p}{cyxp j y�{��Tyxr�oLk p w qWyxp j r�oLkx����gxp f�gxgxo!p lWgp�%{cw j r%qWk�fT{��0k{�p gi�Lp7y�{co���g�f�r��cgxo!s w r%u�p lLg�uF{%p giw j {��Tj p�j k7uF{chWgFr%s �Gm p7j k7p lLg�j oLs r�w uF{cp j r%oGy�{cw w j gih�j o{9p gi�Lp�f lLgxo�yxr%u�v�{cw gxhGp rnr�p lWgxw�p gi�0p kx�Qr%w�j o�{nk gxoWk g�yxr�u�vW{%w gxh�p rs� {%oL�%q�{c��gF{ck�{9f lLr,� g��� lLj kFj oLs r�w u�{cp j r%o�� j s+k gxgioOr%wFhLgxp giyxp gxh �0��p lLgnw g�{chWgiw � f j � � j u�v�{cw p7p r�p lWgnw g�{%hLgxw�{vLw gxhLj k v�r�k j p j r%oFp r�qWoLhLgxw k p}{coLh9p lLg+u�g�{coWj oL��r%sCp gi�0p j oFyxgxw p}{%j o�fT{���k��8�+wx�Lu�r%w g4w r�qL�%l�� �7vWqLpx�k p �,� g j k p lWg�hWj _�gxw gxoWyig���gxp f�gxgionp f�rFfT{x�0k+r%s)k}{���j oW�7p lLg k}{cu�g p lLj oL���e0rL�Cp lLge�c{%w j {%p j r�o9j o�{Fp gi�Lp�r%w+hLj _�gxw gxoLyxgxk+��gxp f�gxgxop gi�0p k�p l�{cp�j k+oWr%p+vLw j uF{cw j � �Fp r�vLj y�{�� �

p lW{%pQl�{ck�oWr%p�p r�hLr�f j p lFu�g�{coLj oW�L��j kQk p ��� j k p j y���j+{%p qWw}{�� � �c��hLgxuF{%w y�{%p j r�o7r�s�k p ��� j k p j yD�%{cw j {cp j r%op r�p r%vWj yx{����%{cw j {cp j r%o�j kTj uFv�r%k k j �7� g��;tTgxw p}{%j o�u�g�{coWj oW�%k�u7qLk pTr%wTp gxoLh�{�� fT{x�0kTp r7��g+g}�LvLw gxk k gihj o�yxgiw p}{cj o�k p ��� gxk��1� gx�0{���uF{%p p gxw kTp gxoLh9p r7��g�f w j p p gxo�j op� gi�0{��w` {%w �%r%o�w}{%p lWgxwTp lW{%o�lWg}�W{cuFgip gxw^Hy�{cw�rcf oLgxw k lWj vGk p}{cp j k p j yxk j o5` r%qLw o�{�� j k p j y7r%w�s {%yip q�{���k p ��� g�� � lLg�j uFv�r%k k j �Lj � j p �nr%sThWw}{xf j oL��{y�� gx{%os� j oWg���gxp f�gxgio�uFgx{%oLj oL��{coLhnk p ��� g�lW{ckm� g�{%h9p r�u7qLy}l��Lw r�f �Zgx{%p j oW�F{cuFr%oL�Fk p ��� j k p j yxj {coLk{coWh�� j oL�%qWj k p kx�W{coWh�hWj k yxqLk k j r%on{%��r%qWp j s)p lLgxw g�j o9s {cyxp4{cw g k p ��� gxk4{%p4{�� �%l �Qo7���0j k px�)����}��Jn ��Lr�w+p lLg7vLqLw v�r�k gik r%s�j oLs r�w u�{cp j r%o9w gxp w j g��%{�� ��j p+j k+j o�s {cyxp�{�� �;p lWg7u�r%w g�j o�p gxw gxk p j oL��p r�j oR)

�%gxk p j ��{%p g�p lLg7f�r�w ��j oL��k+r�sQk p ��� j k p j ye�c{%w j {%p j r�onj sQj p4j k�oLr%p�yxr%u�v�� gxp g�� ��hLj �%r%w yxgihs w r%u p r%vLj y�{���%{cw j {cp j r%oZ� � lWg vLqWw v�r%k g f�r�q7� h9��g p r��LoWh9u�gxp lLr0hWk p r6qVrJ[�o � QI[ QINtYCp r%vLj y�{��Cj oLs r%w uF{%p j r�oFw gI)p w j g��%{�� �%oLr�p;�0� j u�vWw r]�0j oL�+p r�vLj y�{��0w gxy�{�� �LoLr%wQoLgxyxgxk k}{%w j � ��p r%vLj y�{��LvWw gxyxj k j r�oZ���LqLpQ����j u�vWw r��0j oW�p lLgd� j �%g�� ��k qL�K` giyxp j �%gd|0qW{�� j p �Fr�s)p lLg w gxp w j g��%gxh9hWr0yxqLu�gxo0p k��� lLgs�%{cw j {cp j r%o!p l�{cp�f j � �4��gnu�r%k pFqLk gxs q7�+p rGyir�u�v7� gxu�gxo0p�p r%vLj yI) �W{%k gxh j oWs r%w uF{%p j r�o�w gI)

p w j g��%{��Wj kQoLr�p1�%{cw j {cp j r%o��Zgip fTgigxo9{%qLp lLr�w kx�0oLr�w���gxp f�gxgxoFj oLhWj �0j hLq�{��Lp gi�Lp kx�0�WqLp�p lWg yxr%oWk j k p gxo�px�vLw gxhLj yxp}{c��� g%�L{coWh�hWj k p j oL��qLj k lW{%�7� gD�c{%w j {%p j r�o7p l�{cp�k gxp k�r�sZp gi�LpTuF{x�7k lWr�f.� � lWg4��r�{��Wj k�p re� r0r,�s r%w7p g}�Lp qW{��Ty}lW{%w}{cyxp giw j k p j yxk7p lW{%p7{%w g�u�g�{ck qLw}{%�7� g |0qW{%o�p j p j gxke� \IY �&� L \IY L q L Y QI[8\.� {coLh�qLk gp lLgxu p r9vZr%k j p.�c{%w j {%�7� gxk+p r�y�{%p gx��r%w j ¤ig�r%w�k r�w p p gi�0p k�� � lLg�{cj u j k�p r��LoWh}�5�RN qIY L rJNPs���\IY �&� QV\l ��{%y}lLg��W�)���,}�gJn;p lW{cp�y�{co���g7qLk gxhp rFqLoWhLgxw k p {%oLhf lWj y}l XRQINtZ Q+{FoWgif r%w+lWj p lWgxw p r�qLo7�0oLrcf op gi�0p7��g�� r�oL��k p rL�Q{%oLh�p l0qLk7p rnvLw gxhLj yxp�p lLg � j �%g�� j lWr0r0hr%sTp lWgFp gi�0p���gxj oL��j o0p gxw gxk p j oL�np rnp lLgw g�{chLgxwx�W�%j �%gxo9p lW{%p j p k p r%vWj y�lW{ck4��gxgxo9hLgxp gxw u�j oLgxh9yxr%w w gxyip � �F�0�Fp r�vLj y�{��C{%oW{�� �0k j k��

��� ��bPc^d%e fVg[ÃRi

�5+�� � E603;&B�032���C�F6= � AI;%E A-2 �W=�%>?03;%A^=,2 0�� = 4<;&;%C��G; �

� lLg+vWw gxyxgxhLj oL�7k giyxp j r%oWk�l�{��%g+�%j �%gxoFgi�W{cu�v�� gxk�r�sZlWr�f p gi�0pTy�{coF�0j g�� hFu�r�w g4j oLs r�w u�{cp j r%o�p l�{cof�r�w hFk p}{%p j k p j yikx�L{coWh�{%w ��qLgxh�s r�w�{�hLgxgxv�gxwT{co�{�� �0k j kQr�s�p g}�Lp�� � qLp�yx{%o�f�g4u�{��%g4{%o��7qLk g4r�s�p lLj kp �0v�g r%sWj oLs r�w uF{cp j r%o�q � lLj k;hLgxv�gxoWhLk�yiw qWyij {�� � ��r%o7lLrcf�y�� j gxo�p kx�%qWk giw kx��r%wQw gx{%hLgxw k;gi�LvLw gxk k�p lLgxj wj oLs r�w u�{cp j r%onoLgxgxhLkx�Q{coWhlLrcf p lWg7k �0k p gxu qWoLhLgxw k p}{coLhWk�p lWgxu�� � lLg�oLgi�Lp y}lW{%vLp gxw�hWgik yxw j ��gxklLrcf |�qWgxw j gxk+{%w g�vWw r0yxgik k gxhZ�

Page 10: Basics of Information Retrieval - Statistics and Linguistics

�Pf k ekcFl�c&) -#m�n^f8oJe -/,!l-e '#pQq �0�

y}lW{cvWp giwVu4oLhWgxw k p}{coWhLj oL�Fj oLs r�w uF{cp j r%o�oLgxgxhLk��8� g�|0qLgxk p k�{coLh¥�+qWgiw j gxk� lLg�vLw gxyigxhWj oW��k gxyxp j r�oLk�l�{��%g�yir�oLyxgxo�p w}{cp gxhr�o�hLr0yxqLuFgio0p {co�{�� �0k j k���tTgxo0p w}{��;p r�p lWg7gioK)

p gxw vWw j k g9r%s+k g�{cw y}lLj oL�GhLr0yxqLuFgio0p�h�{cp}{c��{ck gxk�j k7p lWg9j oLs r�w u�{cp j r%oGoWgxgihC� {%k7gi�Lv�gxw j gxoLyxgxh {coWhqLoWhLgxw k p rLr0h!�0��p lWg9qWk giwx�4{%oLh {%kFyir�u�u�qWoLj y�{cp gxh�p rGp lWgnk �0k p gius� � lLj kFw givWw gik gxo0p {%p j r�o!r�sj oLs r�w u�{cp j r%o9oWgigxhj k4p lWgiouF{%p y}lWgxh�p r�p lWg�hW{%p}{c�W{%k g�j o�k r%u�g�uF{%oLoLgxw�� � lLgxk g7k gxyxp j r%oLk�f j � �r%qWp � j oWg+lLrcf�p lLg j oWs r%w uF{%p j r�oFoLgxgxh9w g�� {cp gxk p rF{�hWr0yxqLu�gxo0p h�{cp}{c��{ck g��

�5+���� � �6A^BD087 G46C �� � U=GBDC�:%:�A-2 �

m o�p lLg�k p}{coWhW{cw h�u�rLhLg���p lLg�j oLs r�w uF{cp j r%ow g�|0qLgxk px��v�r�k gxh�j o��QoL��� j k lGr�w�{%k�{9k gxp7r%s k g�{cw y}lp gxw uFki�Wj kTp w gx{%p gih9u�qWy}lp� j �%g+p lLg�hWr0yxqLu�gxo0p k j o�p lWg�hW{cp}{%�W{ck g���j pTj k {%oW{�� ��¤xgxh�r�o�p lWg��W{%k j k r�sp gxw u/r0yxyxqLw w gioWyxgc��{%oLh9j k p w}{%oLk s r%w u�gxh9j o0p r�{e�%gxyxp r%w4r%s)p gxw u fTgij ��l�p kD� s r%w f lWj y}l9p lLg�p gxw u� �tQIZ���p ��vWj yx{�� � �Fj k w gxk gxw �%gxh���k j u�j � {cwTp r7p lWg�p gxw uf�%gxyip r�w k+yir�u�vLqWp gihns r%w p lLg hLr0yxqWu�gxo�p k��� qLp4hLrLyiqWu�gxo�p k+{coWh�j oLs r�w uF{cp j r%oFw g�|�qWgik p k�{cw g�p �0vLj y�{�� � ���%giw ��hWj _Zgiw gxo0p��T~CqLlLo a k4r%w j �%j oW{��

u�r0hWg��)fT{ck�s r%w4p lWg�k g�{cw y}lLgxw�p rFyxr%uFv�r%k g7{co�gik k}{��9r�sQ{%vLvLw r��0j uF{%p g�� ��p lLg7k}{cu�g�s r%w u {ck+p lLgk r%qW�%l0p)s r%w)hWr0yxqLu�gxo0p k�� � lWg�hWr0yxqLu�gxo0p k)f�gxw g�qWoLhWr%qL�Wp gih�� � {%k k qWu�gxh p r+��g�k lWr%w px�cj o p lWg�s r%w ur%sQ{%�Lk p w {%yxp k+w}{cp lWgiw+p l�{co9s q�� �Cp gi�Lp ki�Zf lWj y}lnuF{%hLg p lLj k4u�r0hWg��Ck gxgxu vLw}{cyxp j yx{�� HWp lWj k r�s;yxr%qWw k goLr � r%oW�%gxw4j k4p w qLg��ThWr0yxqLu�gxo0p k+yx{%on��ge|�qWj p gd� r�oL�7�8¢+oLhnyxr%o��%gxw k g�� �n{ck+lW{ck+��gxgxongxk p}{%�7� j k lWgxh��r�p l!����j oLs r�w uF{��Tr%�Wk giw �%{cp j r%o!{%oLh�k g��%gxw {��4s r%w uF{��Tg}�Lv�gxw j u�gxo�p kx�Tj oLs r�w uF{cp j r%o�w g�|0qLgxk p k�p rj oLs r�w u�{cp j r%onw gip w j g��c{��;k ��k p gxu�k p gxoLhp r9��g��cgxw �nk lWr%w p���p lLg�uF{J` r%w j p �9��gxj oL��p lLw gxg7fTr%w hLk r�w� gxk k3l � r�k g�{coWhne0p g��%gxoLkx�)�����%�0��� r%k g�{coWh9tTqWp p j oL�W�C�����%�Jn � � lLj k �%j �%gikD�%giw � � j p p � g4vLqLw y}l�{ck g�p ru�r�k pm� j oL��qLj k p j y�{�� � ��r�w j gxo0p gxh�u�gxp lLrLhLkx�C{coLh�r�oLg7f�r%q�� h�f j k l�p r �WoLh�u�gxp lLr0hWk+f lLj y}l�fTr%q7� hgxoLyxr%qWw}{c�%g k g�{cw y}lLgxw k+p r�vLw r0hWqLyxgd� r�oL��giw w g�|0qLgxk p k+qWk j oW�7u�r�w g�p gxw u�k�� ���j �cgxo�p l�{cp7w g�|�qWgik p kF{%w g9r%s+hLj _�gxw gio0pP� gxoL�%p l!{coWh�hLj _�gxw gxo�p7p �0v�g9p lW{%o�p lWg�p}{cw ��gip7hWr0yI)

qLuFgio0p kx�;p lLgFw gxk vZgiyxp j �%gFp gxw u �%gxyip r�w k�{%w g�qLk qW{�� � ��p w g�{cp gxhGhWj _Zgiw gxo0p � ���s�Wr%w j oLk p}{coLyxg%�;uFr%k pk ��k p gxu�k9qWk gG{��Lj oW{%w �!s w g�|0qLgxoLyx�Oy�{�� yxq7� {cp j r%o!s r%wp|0qLgxw �!p gxw u�k���r0yxyxqLw w gioWyxgc��w}{cp lLgxw9p l�{cos w g�|�qWgioWyx�c�Zj k qWk gih�{ck+{7�W{%k j k s r�w f�gxj ��l�p j oL��p lLgd|�qWgxw ��p gxw u�k��Dl eL{�� p r%o9{%oLh � qLyr��� gi�%�)���,���Jn

�5+�� .10@;%BkE6A^2 � G46C UA^C@:&0826F F6=GBD46>?C@2 ;%:�� �GC@0 UBkE

��j �%gxo {'|0qLgxw � {coWhO{hLrLyiqWu�gxo�pFw gxvLw gxk gio0p}{cp j r%oOj o��%gxyxp r%w�s r%w u�kx� lWr�f�g��%gxw�p lLgng�� gxu�gxo�p kj o�p lWgP�cgxyxp r%w�{%w g7yir�u�vLqWp gihC�Cp lWgP|�qWgik p j r%oj k�lWr�f p r�u�{cp y}l�p lWg7p f�rnp gxw u%�%giyxp r%w k p r��LoWhhLrLyiqWu�gxo�p k;p lW{%pU�Lp;p lLgTw g�|�qWgik p��Q|nr%k p;k gx{%w y}l7gioW�%j oLgxk;vLqWp)u�r�w gTgI_Zr%w p)j o�p r+j oLhWg}�Lj oL�+p r�{��%r%j hyxr%u�v�� j y�{%p gxhu�{cp y}lLj oL��{�� �%r�w j p lLuFk��7{9yxr%u�uFr%ou�gxp lLrLhj k p rnqLk g�p lWgFyir�o,�%gxo0p j r�oW{��Tk y�{�� {%wvLw r0hWqLyxpQr%sZp lWg p f�rd�cgxyxp r%w kx�0�0��k j u�v7� ��{chLhWj oL� p lWg vW{%j w f j k gTvWw rLhLqLyxp k�r%s�gx{%y}l�g�� giuFgio0pQr%s�p lLgp f�rd�%giyxp r%w k�qWoLhWgiwQyxr�oLk j hLgxw}{cp j r%oe�>p l0qLk�r%�Wp {%j oLj oL� {3\IL [ L � sWZVL Y �@\-qVrJZVQ;s r%wQgx{%y}l7hWr0yxqLu�gxo0p�{ckyxr%u�v�{cw gxh7p r�p lWg8�%gxyxp r�w���|9r%k pQk �0k p giuFkQqWk gD�%{cw j {cp j r%oWk)r%s�p lLj k;uFgip lWr0hZ� � lWgxw g+{cw g o�qWu�gxw r�qLk�%{cw j {cp j r%oLk�p r�p lLj k�k y}lWgxu�g%�Qf j p l��c{%w j r�qLk7{chW` qLk p u�gxo�p k7uF{chWgFp rs�Wp�p lLg�yir,� � gxyxp j r%oG{%oLh�p lLgqLk gxw4v�r%vWq7� {cp j r%o9{cpTl�{coWhZ�T|9r%k p vWqL�7� j k lLgxh9u�r0hLg�� kTl�{��%g�{�o�qWu���gxw4r%s)vW{%w {%u�gxp giw k p r7w g^]Lgxyxpp lLgxk gd�%{cw j {cp j r%oLk��

� �Q��¢v��¤�� ¢ ��� � �0�F� �8�%��� �v� �%¥ ¥ � � � ¡ �%�'�*� � � �0�%� �F� � ���=��¢ � ��¢ � ���8�%��F¢ ������ �#©�½ �=��¢ � �8¢ � �,���F� �Q¢ �8���� �#�,1 À8À� Â

�%� ��bPc^d%e fVg[ÃRi

��� § � K���/�/1@ ;U3?+:243�57F®�.6 +.I¢ k v�gxyxj {��+y�{ck gr�s�p lWg�uF{%p y}lLj oL��vWw rLyigxk k9r%qLp � j oLgxhO{c�Zr]�%gj k @r-r&� Q sWN�w gxp w j g��%{�� � � r0r,� gx{%ow gxp w j g��c{��Qj k ��{ck gxh�r%oGk j u�v7� gF{�� �%gx�Lw}{%j y�k gxp�p lLgxr%w �%�Q{%oLhGqLk gxk��Wj oW{cw �f�gxj �%l0p k�s r�w u�r0hWg�� j oL�p lLg�yxr�� � gxyip j r%o=��hLrLyiqWu�gxo�p k�{cw g w gxvLw gxk gxo�p gxh��0�9r0yxyiqWw w gxoWyig7r%sQp lWg�f�r%w hLk+r�w4p giw u�k+j onp lLgxu9�oLr�p�s w g�|�qWgxoLyx�(� {%k7{cw g�p lWgp|�qWgxw j gxk�� � lLg�k gxp7r%s4hLr0yxqLuFgio0p k7j o�p lWg�hLr0yxqWu�gxo�p7hW{cp}{%�W{ck g{cw g�gi�L{%u�j oLgxh�p r9k gigFf lLj y}lr%oWgxk k lW{cw g�p giw u�k f j p l�p lLg�|0qLgxw �c�;g}�W{cyxp � �%�)f j p loLr9w gx��{cw hp rs w g�|�qWgioWyxj gxk�r�w7r%p lLgxw7f�gxj �%l0p j oL�s qLoLyxp j r%oWke� u�g�{coLj oW�L�Qj s4p lLg�k y�{�� {cw7vWw r0hLqWyipx��uFgio0p j r%oLgxh{c�Zr]�%g%� r�s�p lLgnp fTr��cgxyxp r%w k�j k�u�r�w gnp lW{%oC¤xgxw r7� � lWj kFu�g�{coWkFp l�{cpFs r%wFg�{cy}l hWr0yxqLu�gxo0px�4{�Lj o�{cw ��hWgxyij k j r%o�j k+uF{%hLg��4gij p lLgxw+p lLg7hLr0yxqLuFgio0p+j k+j onp lWg�k gxpx�C{coWh�uF{cp y}lWgik�p lLg�w g�|0qLgxk pi�Cr�wp lLg7hWr0yxqLu�gxo0p+j k+r�qLp k j hWg7{%oLh�hLrLgik�oWr%p�� m s�{FhWr0yxqLu�gxo0p+uF{%p y}lWgxk {Fw g�|0qLgxk p�j p+j k+vLw gxk gxo0p gihp r7p lWg�qWk gxwx��j s)j p hLr0gxk4oLr�pi�Wj p f j � �ZoLr�p �Zg��� lLj kFf�r�w ��k�w g�{%k r�oW{%�7� ��f�g�� �4j s+p lLg�k gip�r%s�j oLhWgi��p gxw u�kFj k � j u�j p gih��0��hLgxk j �%o p lLw r%qW�%l

�%gx��f�r�w hLk4r�wTk v�gxyxj {�� � ��{%k k j ��oLgxh�j oWhLgi�Fp gxw uFk1� r�w {�� p giw o�{cp j �cg�� ��s r%wThWr0yxqLu�gxo0pT��{ck gxk f lLgxw gp lLg�hWr0yxqLu�gxo0p k�{%w gFk lLr�w p�{%oLh�yxr%oWyxj k g���{s� j k p�r%s�� j p gxw}{cp qLw g�{c�Wk p w}{cyxp k7r%w7hLr0yxqWu�gxo�p7p j p � gxkx�s r%w7j oWk p}{%oLyxg��(¢/hLrLyiqWu�gxo�p7h�{cp}{c��{ck g9r%s4k lLr�w p7j p gxu�k7lW{ckF{ck�{�k j hLg�g^_�gxyxp7p lW{%p7p lLg�k gxp7r�s{]�c{%j � {%�7� g�p gxw uFk7j kP� j uFj p gxhG{%oLh�p lWg�o�qWu���gxw7r�s k vLqWw j r�qLk7p gxw u�k7j oGg�{cy}l�hWr0yxqLu�gxo0p7j ke� r�f.�� lLj k+{%vLvWw r0{cy}lnlW{%k4k g��cgxw}{��;hLgxk j w}{%�7� g�y}l�{cw}{cyxp gxw j k p j yxk��Tj p4j k4g�{ck �n{coLhng^(�yij gxo0p4p r�j u�v�� giuFgio0p{coWh9p lLgxr%w gxp j yx{�� � �Fyir�u�vLw gxlLgxoWk j ��� g�p lWw r�qL��l9p lLg f�g�� �CqLoWhLgxw k p r0rLh9vLw r%vZgiw p j gxk r�s)k gip4p lLgxr%w ���m oy�{ck gxk f lLgxw g�p lLg�k gip�r%s�j oLhWgi��p gxw uFk�j k.� j u�j p gxhnr%w�p lWg7k g�{cw y}l�{�� �%r�w j p lWu j k � r0r,� g�{%oZ�

j p j k4yxr%u�u�r�o�p rFs r%w uF{�� j ¤xg�p lWgd|0qLgxw ��s r�w u7q7� {cp j r%o�p lWw r�qL��ln{�|0qLgxw �p� {%oL�%q�{c��g��W{ck gxhnr�onk gxpp lLgxr%w gxp j yx{�� gi�LvLw gxk k j r�oLk��3eLqLy}l k g�{cw y}l j o�p gxw s {cyxgxkF{�� � rcf p lLgnyxr%u��Wj oW{cp j r%o!r%s+k g�{cw y}l p gxw u�kj oO{(� r��%j y�{��4k p w qLyxp qLw g%�+p �0vLj y�{�� � ��qWk j oW� � r0r�� g�{co r�v�gxw {%p r%w k�k qLy}l�{%kp¢�jm~����.� r%w5jm� � �� rLr�� g�{co�|�qWgiw ��� {coL��qW{%�%gxk�{%w g9u�r%k p�r%s p gxoZ� �LqLpFoLr%p�oLgxyxgxk k {%w j � �%�Tyxr�oLoLgxyxp gxh!p r�{ � r0r,� gx{%ok g�{cw y}l�{�� ��r%w j p lLu��P¢4k�f j p lp lWg�k gx{%w y}l�{�� ��r%w j p lWu9� � r0r�� g�{co'|0qLgxw �¥� {%oL��qW{c��gxk�l�{��%gFk g��%gxw}{��hLgxk j w}{c�7� g7y}l�{cw}{cyxp gxw j k p j yik�� {c��r��%g�{�� � �Zp lLgx�nl�{��%g�p lWgir�w gip j y�{�� � ��yxr�u�vLw gxlLgxoLk j �7� g7p lLw r�qL�%lp lLgf�g�� �CqLoWhLgxw k p r0rLh9vLw r%vZgiw p j gxk r%s)k gxp4p lLgxr%w ���� r0r,� g�{%onk ��k p gxu�k lW{]�cg7hWg��LoLj p g�hWw}{xf ��{cyr�0ki�;lLrcf�g��cgxw��e¢+k {co�gi�L{%u�v7� g%�Z¢+oLk g�� u eLv�r0gxw w j

k lLrcf kTj o�{coFgi�L{%u�v7� g4lLrcf � rLr�� g�{co�k g�{cw y}lFy�{%o��Zg hWj (�yxq7� p�p r�f�r%w ��f j p l<l e0v�r0gxw w j �Z�����c�Wn �Qm o{co�gi�W{cu�v�� g4h�{cp}{c��{ck g+r�sCk g��%gxw {��Zp gxoLk r�sCp lWr%qWk {%oLhWk r%s)j p gxu�k�r�o�yxr%u�vWqLp gxwTk yxj gxoWyig%�WlLg�v�r�k gxk{P|0qLgxw ��p r�w gxp w j g��%g j p gxu�k4r%oC� ��j k qW{��=|�qWgxw ��� {coW�%qW{%�%gxk s r%w4w gxp w j g���j oW�7j oLs r�w uF{cp j r%o9{coLhnp lW{%pyxr%oWk j hWgiw4l0qLuF{%o�s {%yip r�w k4j k k qWgxk �� z g s r%w u�q�� {cp gxk4{ � r0r�� g�{cop|0qLgxw ���

����� ������������� �"!$#�%$&'��()*��!"+,-�.�/"0"1���2*��3*��1/4�"5�3��'� 5�&"��!6-�87�)*5���94!���/���)*���"5"(:;�<��)�2"��/=0��*�3*1��*(

� lLj ke|0qLgxw �y�{co���g�qLoWhLgxw k p r0rLh�{coWh�vLw r0yxgxk k gxh�j op fTr�hLj k p j oWyip�fT{��0k��Fj sD¢@jm~ j k qLk gxhp r�yxr%oW` r%j o9p lLg s r�qLw4p giw u�kx��p lLgd|0qLgxw �9j kD�%gxw ��w gxk p w j yxp j �cg����Lr�w p lLj k�|�qWgxw �%�ZeLv�r0gxw w jCw gxp w j g��%gxhr%oWg7k j oL�,� g�hLrLyiqWu�gxo�p�j op lLg7hW{%p}{c�W{%k g��7m sD�.� j k�qWk gihC�)p lLgP|0qLgxw ��j k�oLr%p.�%gxw ��k v�gxyij �Wy���s r�wp lLj k+y�{%k g%�;e0v�rLgiw w j;r%�Wp {%j oLgxh������%�0�7hWr0yxqLu�gxo0p k�� � lWj k�k lWr�f k lLrcf � rLr�� g�{co�k g�{cw y}lu�gxp lLr0hWky�{co�l�{��%g4qWoLgi�Lv�gxyip gxhFw gxk q7� p kQj o�k vLj p g r�s�j p k�p lLgxr%w gxp j yx{�� � �7{cp p w {%yxp j �%g vLw gxhLj yxp}{c�Wj � j p �%��{%oLh�p lW{%pp lLgs�.�/{%oLh�¢@jm~/r�s � r0r�� g�{co�� r��%j y�{%w g9hLgxyxgxvLp j �%g9j o�p lW{cp7p lWgi��j o���j p g�yxr%u�v�{cw j k r%o�f j p lp lLg�� r%w 7{coWh�� {%oLh7 7r%sCg��%gxw �0hW{��FhWj k yxr�qLw k g���|nr%k pTj u�vZr%w p}{co0p � �%� � r0r,� g�{%o�|0qLgxw ��s r�w u7q7� {cp j r%ouF{��cgxk oWr9yxr%oWyigxk k j r%oGp r9p lLg��LqLj � p ) j o�qWoLyxgxw p {%j o�p �{%oLh'�%{c��qLgxoLgxk k�r%s�l0qLuF{%o'� {coW�%qW{%�%g�qLk g%�

Page 11: Basics of Information Retrieval - Statistics and Linguistics

��gxp f�gxgxoGp gxw u�k���e0vZr0gxw w jQ�%r0gxk r%op lWg7hWg��LoLgF{��%w}{cvWlLj y�{���|0qLgxw �¥� {coW�%qW{%�%g7p r9r��cgxw yxr%u�g�p lLgw j �%j hLj p ��r%s � r0r,� gx{%op|�qWgxw �p� {%oL�%q�{c��gik f lWj � g�vLw gxk giw �0j oL�Fk r%u�g�r�s)p lLg hLgxk j w}{%�7� g.|�q�{�� j p j gxk��

�5+-*�� ��=G= 7-C�082 95:�+ � U= �60��6A^7-A^:�;�A-B UCD; %A-CD98087

� rLr�� g�{cok �0k p giuFk�{%w g7f j hLg�� �nj oqWk gc�;gik v�gxyxj {�� � �ns r�w�p w}{cj oLgxhhLr0yxqWu�gxo�p}{�� j k p kIH;s r�w�qLo0p w}{%j oWgxhqLk gxw k9{coWh!f j hLg�w {%oL��j oW�GhLr0yxqLuFgio0pFyxr,� � gxyxp j r�oLkx�Tp lWg � rLr�� g�{co {cvWvLw r�{%y}l lW{ck���gxgxo<� {%w �%g�� �{c��{coWhLr%oWgxh j oOs q7� � ) p gi�Lp�w gxp w j g��%{��+k ��k p gxu�kp� {�� p lLr%qW�%l p lLg�o�{cu�g Z QIY ZVL Q��Js���l�{ck���gxgxoOw gI)p}{cj oLgxhs r%w�{coG{cyxp j ��j p �nf lLj y}lGr%o�� �nj oj p k�gi�Lp w gxu�g�y�{%k gxk w gxk gxu��7� gxk w gxp w j g��%{�����j os {��%r�w�r�soPZVr��Vs��^L � L \IY L q ZVQIY ZVL Q��Js��Q{cvLvWw r�{cy}lWgxki�Tf lWj y}lMZ sWN4Fp lLg�w gxp w j g��%gih!hLr0yxqLuFgio0p k7����� j �%g�� j lLr0r0hGr�svLw r���j hWj oW�7w g�� g��%{co0p hW{cp}{7s r%w p lWg�w gxk r�� qLp j r%o�r�s)p lLg�j oLs r�w uF{cp j r%oFw g�|�qWgik p+{%k gi�0vWw gxk k gxhn�0�Fp lLgk g�{cw y}l�p gxw u�k�� � lWj k�j oGk r%uFg�k gxoLk g9vLw r���j hLgxk�{nu�r0hLg��Tr%s qWoLyxgxw p {%j o�p �%�T{ck�fTg�� � {ck7r%����j {%p gxku�r�k p�r�sTp lLg�oLgxgxh�s r%w7{9k v�gxyxj �Ly |0qLgxw �'� {coW�%q�{c�%g%�Q{cp�p lLg�vLw j yxg�r�s8� gxk k gxoWj oW��vLw gxhLj yxp}{c�Lj � j p �%�g^_�gxyxp j �%gxoLgxk kx�4{coLhC��p rk r%u�g�gi�Lp gio0px�Tgi�LvLw gxk k j �%gxoLgxk k�r%s4p lLg9j o�p gxw s {cyxg���m o!uF{co0�GfT{��0k�p lLj kj k7{nk p gxv�p r�fT{%w hLk�qLk j oL�¥� j oL�%qWj k p j y�r�w7{cpP� gx{%k pP� {%oL��qW{c��gI) r�w j gxo0p gih�u�gxp lLr0hWk�s r%w7vLw r0yxgxk k j oW�hLrLyiqWu�gxo�p k�{coWhs|0qLgxw j gik�� � qWp4k p j � � �Wp lLg�j hLg�{�j k+p rFv�gxw s r%w u {%k4u7qLy}l�{co�{�� �0k j k+{%k+v�r%k k j �7� g�j o{ch��c{%oLyxg+p r k j uFv7� j s � p lLg+uF{cp y}lWj oW��vWw r0yxgik k8� p lLg�]Lgi�0j �Wj � j p ��r%sCf lLj y}lZ�L{%k�fT{%kT{%w �%qLgxhFj o�p lLgj o�p w r0hWqLyxp r%w �Fy}lW{cvWp giwx��j k oLr%p j oWyij hWgio0p}{��C�WqLp yxw qLyxj {��Cp r7lWr�f � {coW�%q�{c�%g�fTr%w ��k��� lLg�p �0vLj y�{��QhWj _Zgiw gxoLyxgxk���gxp f�gxgxoGvLw r�p r�p ��vWj yx{��;vWw r��W{%�Lj � j k p j y�k �0k p giuFk�{%oLh � r0r�� g�{cok ��k )

p gxu�k4{%w g�,� p lWg(�kQIL X �RY L NRX r%s�p gxw uFkQ�0�7{%k k qWu�gxh�j u�v�r%w p}{coWyxg�s r�w�{+hWr0yxqLu�gxo0p^a kQw gxvLw gxk gxo�p}{cp j r%oC��g�� ����0�Fk r�u�g�r�s)p lLg u�gxp lLr0hWk vLw gxk gxo0p gih�j o�vWw gxyxgxhLj oL�Fy}lW{cvWp giw k^H

�7�4{7uF{%p y}lWj oL�F{�� �%r�w j p lLu f lLj y}l9w}{%o7�0k hWr0yxqLu�gxo0p k+���p� j �%g�� j lWr0r0h�r%s)w g�� g��%{coWyxgJH�{%oLh�7� w g�� {cp j �%g�� ��s w gxgd|�qWgiw ��s r�w u7q7� {cp j r%o�u�gxy}lW{%oLj k u�k��

�5+-* *���46C �� C�� �60826:�A-= 2 0826F UC�7-CD980826BDC �WC@C�F��608B��

��qLgxw �{%oLhGhWr0yxqLu�gxo0p k�{%oLh�hLj _�gxw gio0p��9m o(� gioW�%p lZ�P|�qWgxw j gxk7{%w g�k lLr%w p^H�hLr0yxqLuFgio0p ke� r�oL����m ouF{%p gxw j {��8|0qW{�� j p j gik��9hLr0yxqWu�gxo�p kF{cw g9p gi�0p^H�|�qWgiw j gxkF{cw g9u�r%k p � ��{�k uF{�� �To0qLu7��gxw�r%s+yir�o�p gxo0pf�r�w hWk���|nr%k p uFgiy}l�{coWj k u�k �W{%k gxh9r�op� j oL��qLj k p {coW{�� ��k j kTf�r�q7� h�w g�|�qWj w g u�r%w g�p gi�Lp qW{��CuF{cp gxw j {��p r�u�r0hWg��;p lWgP|�qWgxw �PH;{�� �)u�gxy}lW{%oLj k u�k+��{ck gxh�r�o�k p {%p j k p j y�{��;{%oW{�� �0k j k�{%w g7hW{%p {J) j o0p gxoLk j �cg�{coWhf�r�q7� h9hLg�� j �%giw �Zgip p gxw w gxk q7� p k ��j �cgxo9u�r%w g�j oLvWqLp���+oWgTu�gxp lLr0h�p r+r��Lp}{cj o�u�r�w gTp gi�0p q�{��LuF{cp gxw j {���p r�]Wgik l7r�qLpQ{co7r]�%gxw � ��yir�oLyxj k gTj oLs r�w u�{cp j r%o

w g�|�qWgik p4j k p r7qWk g�p lLg.�Ww k pD|0qLgxw �9{ck4{�k gxgxhZ�Z{coWh�p lWgxo9qLk g p lWg�w gik q�� p k s w r%u p lW{%pTw gxp w j g��%{��C{ck{co9j oLj p j {����Ww k p4yx��y�� g��

��� K8K � K 9<;=@ ;Z>13?+.F=; -r;U;UG[w.3?F¢Ow gxp w j g��%{��Wk ��k p gxu y�{co�vLw gxk gxo0pTp lWgm� j k pQr%sCw gip w j g��cgxhFhLrLyiqWu�gxo�p kTp r�p lWg4qLk gxwx�W{coLhFl�{��%g+qLk gxw koLr�p gFf lLj y}l�hWr0yxqLu�gxo0p k7k gigxu�qLk gxs q7� {%pd�Ww k p7��� {coWyxg�� � lLgxk g�w g�� g��%{co0p hWr0yxqLu�gxo0p k�{cw gFp lWgxo

p lLg+qLk gxw {�k gipTr�sZp gxw uFk�yxq�� � gxhFs w r%u p lWg+k gxp r%sZhWr0yxqLu�gxo0p k�yxr�o7�Lw u�gxh�w g�� g��c{%o�p�� � lWgik g�p gxw u�ky�{co9p lWgion��g�j oWhLj ��j hWqW{�� � �7j oLy�� qLhWgihnj o0p r7p lLg j uFvLw r]�%gxh�|0qLgxw ���¢4o�{�� r%��r%qWk � �%��oLr%oK) w g�� g��c{%o�p+hLr0yxqLuFgio0p k4y�{co���g hLj k y�{cw hLgxh�j onp lLge�Lw k p4j p gxw}{cp j r%oZ��{%oLhnp lLg

p gxw uFk�j oOp lWgxu f�gxj ��l�p gxh�hLrcf oOj oOk qL�Wk g�|0qLgxo0pnj p giw}{%p j r�oLk�� � lLj k9p gxy}lWoLj |�qWg¥� Z Q�� Q��JsWN qVQ�^QVQ O��VsRq54'� fT{ck(�Lw k ps r%w u�q�� {cp gxh3j o p lLg!k g��%gxo�p j gxk l �4r%��gxw p k r�o9{%oLhneLvW{%w yr�}|%r�oLgxkx�C���,}%�0�eL{�� p r�o9{coWh � qWyr�,� gx�%�C�c�%��tJnO{coLh j k oWr�f j o>yxr%uFu�r%o>qLk g/j o>uF{%o���j uFv7� gxu�gxo�p}{cp j r%oWk��l � r���gxw p k r�on{coWh9eLvW{cw yr�}|%r�oLgxkx�C�c�%�%�Jne0r%uFg�w gxk g�{%w y}lWgxw k�lW{]�cg7hWr%qW�Lp gxh�p lLg7qWk gis q�� oLgxk k�r%s�p lWg7p giy}lWoLj |0qLg��9gxk v�gxyij {�� � �9oLgx��{%p j �%g

s gxgxhL�W{%yr�W�)p lLg7g}�Ly�� qLk j r%o�r%s�p gxw uFk+yxq7� � gxhns w r%u hWj k y�{%w hWgxh�hWr0yxqLu�gxo0p k�p r�j oWyxw g�{%k g7vWw giyxj k j r%oZ�y�{co�� g�{ch�p r k qLw vLw j k j oL� w gxk q7� p k�s r%wQp lLg4l�{cv�� gxk k�qLk gxw�� z rcf�g��%giwx�Lj o7qWk giwTp gxk p k�j p;k gxgxu�k�p r f�r�w �|0qLj p g�w g�{ck r�oW{c��� �c��{%oLh�g��0j hLgxoLyxg�k gxgxu�k�p rnk lWr�f p l�{cp�qLk gxw k7hLrnqWoLhWgiw k p}{coWh�lWr�f w g�� g��%{coLyxgs gxgxhL�W{%yr��f�r%w �0ki�L{cvWvLw gxyxj {%p gTp lLg s qLoLyxp j r%oC�cqWk g j p;g^_�gxyxp j �%g�� � p r+j u�vWw r��%gTw gxp w j g��%{��0w gxk q7� p ki�0{coWhqLk g j p ��gxp p gxw4j s;{J_Zr%w hLgxh9u�r�w g�yir�o�p w r��Cr��%gxw4j p k fTr%w ��j oW�7�Dl m�r0gxoLgxuF{%oLon{coLh � g�� ��j oZ�C�����%�Jn� g�� g��%{coWyigFs gxgxhL��{cyr�y�{coG��gFg}�Lp gxoLhLgxh����y�� qLk p giw j oL�np lWgFw gxp w j g��%gxhGhWr0yxqLu�gxo0p k j ok j u�j )

� {cw j p �k gxp kx��j s4p lLg9k �0k p giu>l�{ck�{%o�g^(�yij gxo0p7y�� qLk p gxw j oW�{�� �%r�w j p lLus�tTqWp p j oL��gxpF{��TlW{]�%g9j u )v7� gxu�gxo0p gxh!p lLg�� q sWY Y QIZ �vsWY �tQIZ�{�� �%r�w j p lLu�s r�w7p lLj k�vWqLw v�r�k g l tTqLp p j oL�6QIYks�� � �C�����%�Jn � u4k gxw ky�{co9k g�� gxyxpToWr%p r%o�� �7k j oL�,� g�hLr0yxqWu�gxo�p k �LqWpTgxo0p j w g�y�� qLk p giw k r�sChWr0yxqLu�gxo0p k f lWj y}l�y�{co�p lWgio9��gs qLw p lLgxw4k yx{%p p gxw gxh�{coLh9y�� qLk p giw gxhnj o�k qL�Wk g�|0qLgxo0p+j p gxw}{cp j r%oWk��

��� K8K � r�� J.;U0��%;����.3?+.E76 /1+¢!u�r%w g {cqWp r%uF{%p j y�uFgip lWr0h�p r�r%�Wp {%j o�u�r�w gTp gi�Lp qW{��LuF{%p giw j {��0p lW{%o�p lLg r%w j �%j oW{���k lWr%w p;w g�|0qLgxk pp r9p lLg�k �0k p gxu �0{��%gFj k�qWk j oW�9p lLg��Zgik p�uF{%p y}lWgxk s w r%u p lWg�w gip w j g��cgxh�k gxp r�sThWr0yxqLu�gxo0p k7{ck�{k gxgihC�Q{%oLhp lLgxo�g}�Lp w}{cyxp j oW�9p gxw uFk s w r%u p lWgiu p r9yxr%oWk p w qLyxp7{�oWgif�|0qLgxw ��� � lLj k j og^_�gxyxp j kw g�� g��%{coWyig7s gxgxhL��{cyr��f j p lLr�qLp+g��%gxw�yxr�oLk q7� p j oL��p lLg7qWk gxwx�;{coLhj k+��{ck gxhr%o�p lLg�lLr�v�g7p lW{%p+p lLg�Lw k pFs gxf hLrLyiqWu�gxo�p kFj oLhWgigxh {cw g9w g�� g��c{%o�p�� l eLp w ¤�{�� �%rcf k �0jvQIYks�� � �C�������0�Tg�� ��� n3m s+p lLgnj oWj p j {��k g�{cw y}lnj k s rLyiqWk gihnr%o9vWw gxyxj k j r�o�p lWj k j k4{7fT{���r%s)j u�vWw r��0j oW�7w giy�{�� � �

�5+-* ��� %=,> G46C UA^C�:&;%= F6A-087^=��

m onyxr�oLy�� qLk j r%oZ��w g�|�qWgik p k�s r%w+j oWs r%w uF{%p j r�o9{cw g j onu�r%k p4k �0k p gxu�k�p w g�{cp gxhnuFr%w g r%wm� gxk k+{%k4hWr0yI)qLuFgio0p k�� � r��%gxp�p lWgxk g�w g�|�qWgik p k p r�uFr%w g�w gxk gxu���� g7hWr0yxqLu�gxo0p ki�Ck �0k p gxu�k�k lWr%q7� h�g�� j yij p4uFr%w gj oLs r�w u�{cp j r%o s w r%u qLk gxw kx�L{%oLh7gxoLyxr�qLw}{c��g qLk gxw k�p r�w g��WoLg+{+k qL�LuFj p p gxh7w g�|0qLgxk px�0{%kQj oLhLj y�{cp gxh�j op lLg�vLw gxyxgxhLj oL��k gxyxp j r%oZ�+m o��%gxoLgxw}{�� ��u�r�k p4k ��k p gxu�k+p r0h�{x�9k qK_�gxw+s w r�u {�oW{%w w rcf3j oLs r�w u�{cp j r%o]Lrcf3s w r%u/qWk gxw+p rFk �0k p gius� � lLg�oLgi�Lp+y}lW{cvWp giw�f j � �Cs qWw p lWgxw4hLj k yxqLk k+hWj {�� r%��f j p lnj oLs r�w u�{cp j r%o{cyxyxgxk k4k ��k p gxu�k��

��g �%�

Page 12: Basics of Information Retrieval - Statistics and Linguistics

! ����� �'&����

� $��8" ��� ���� ":$�� � �<&��'��� � " � &��'�¥&��M�� ���� "��

m o�p lLg+vLw gxyigxhWj oW� y}lW{%vLp gxw k�j pQlW{ck���gxgxo�{ck k qLu�gxhFp lW{cpQvZgir�v7� g4f j � �LfT{�� �7qLv�p r�{%o�j oLs r�w u�{cp j r%ok ��k p gxu/{%oLh�k p}{cp g�p lLgxj w�j oWs r%w uF{cp j r%oFoLgxgxhZ��{coWh�p lLgxo�f {cj pTs r%wTw gxk q7� p k��Qm oLs r%w uF{%p j r�oFw gxp w j g��%{��w gxk g�{%w y}l�p gxoLhLk7p r�{c�Wk p w}{%yip�{xf {x�s w r�u p lLg��%gxoLgxw}{�� {%k vZgiyxp k�r�s j o�p gxw}{cyxp j r�oZ�Q{coWh�w g�� {%p j �%g�� �� j p p � g�f�r�w �9lW{%k4��gxgxonvWqLp+j o�p r�qWoLhLgxw k p}{coLhWj oL�Fp lWg k v�gxyxj {��)w g�|0qLj w gxu�gxo�p k+j oLs r�w u�{cp j r%o9{cyxyxgxk kp}{ck �0k�v�r%k g4r�o7j o0p giw s {%yig+hLgxk j ��oZ� � qLpT{cpQk g��%gxw {���v�r�j o0p kQj o�p lLg4vLw gxyigxhWj oW��p gi�Lpx��mQlW{]�cg+v�r%j o0p gxhr%qWpQp lWg oWgigxh�p rd� r0r,��{.� j p p � g {cpQs qWw p lWgxwQp qLw oWk�j o7p lLg4j o�p gxw}{cyxp j r%oZ�;��r%p l�j o�p gxw uFkQr�s�w g�� g��%{coLyxgs gxgxhL�W{%yr�9{coWh9g��c{�� q�{cp j r%o=�� lLgxk g�|0qLgxk p j r%oLk�{cw g�oWr%p�oLgxf.�!|�{co0��|�qWgik p j r%oWk�s w r%u�g�{%w � ��j oWs r%w uF{%p j r�ow gxp w j g��%{�� w gI)

k g�{cw y}l�{%w g�k p j � �?�c{�� j h{%oLhGoLr�� gxk k j u�v�r�w p}{%o�p�p rLhW{����Fm oG{9v�{cv�gxw s w r�u��c��}0��� � gxoLoLgxp p r�qLp )� j oLgxk�k r�u�g�vW{%w}{cu�gxp gxw k�yxr%oWyxgiw oWj oW�nj o0p gxw {%yxp j �%g�j oLs r�w uF{cp j r%o�w gxp w j g��%{��T{coLhGj o0p gxw s {cyxgFhLgxk j �%ol � gioWoLgxp px�C�c��}0�^n �

� � lWg�y}l�{cw}{cyxp gxw j k p j yxk r�s)p lLg k g�{%w y}lWgxw� � lWg�yxr�oLyxgxvLp qW{��Cs w}{cuFgifTr%w �FvWw gxk gxo�p gxhnp r�p lLg k g�{%w y}lWgxw� � lWg�w r,� g�r�s)s gxgxhL�W{%yr�� ��v�gxw}{cp j r%o�{��Zy}lW{%w {%yxp gxw j k p j yxk4k qWy}l�{ck4yir�u�uF{%oLhp� {coW�%qW{%�%g%�LhWj k v�� {x�%�Lw gxk v�r%oWk g gxp y��� � lWg�yxr�oLk p w {%j o�p k4r%s)p lLg yxr%u�vWqLp gxw4{%oLh9m ��p giy}lWoLj |0qLgxk� � lWg�g^_�gxyxp4r�s)p lLg m �Ok ��k p gxu/r�o�p lWg�qWk gxw4j o0p giw s {%yig s r%w k g�{cw y}l� m o0p w r0hLqWyip j r%o9r%s;k g�{%w y}lns {%yij � j p j gxkTp r7p lWg�qWk gxw� � lWg�w r,� g�r�s)g��c{�� qW{cp j r%o9{%oLh9s gxgxhL��{cyr��j o9p lWg�w gxhLgxk j �%o9yx�0y�� g��

m on{P� {cp gxwTv�{cv�gxw4lLg�{chLhWk��

� � lWg�p}{%k ��p r���g v�gxw s r�w u�gxhZ�� � lWg�qWk giwx�Z{coWh

p r+p lWgTvWw r�v�gxw p j gxk)r�sWj oWs r%w uF{%p j r�o�k �0k p giu hWgik j �%o7oLgxgxhLkQp r+p}{��%g j o0p r�{cyxyxr%qLo0p��vl � gxoLoLgxp px�C���,}%�Jn� lLj kC� j k p�lW{%k!oLr%p {%�%gxhZ� m o { w gxyxgio0p!fTr%w ��k lWr%v/r%o/j o�p gxw}{cyxp j �%g3{ck v�gxyxp k!r�snj oLs r�w u�{-)p j r%o/w gxp w j g��c{�� ��f�g3qWk gih � gxoLoWgip p^a kOv�{cv�gxwO{%kO{ k p}{cw p j oL� v�r�j o0p!p r v�r%k g p lLg |0qLgxk p j r�o� z l�{cp9lW{]�%gf�g'� g�{cw o0p9{%��r%qWp�j o0p gxw {%yxp j �%gj oWs r%w uF{%p j r�o!w gxp w j g��c{���j o p lLgGvW{ck pn��g��%gx{%w k q] l z {coWk gio�{%oLh<m�{%w � ��w gxoC�Z������}Jn � � lLg�{coWk f�gxwFk gxgiuFk�p rG��g9p l�{cp�f�gnl�{��%g�{��w g�{%p gxw�qWoLhWgiw )k p}{coLhWj oL��r%s;{�� uFr%k p {�� �){ck v�gxyxp k4r%s)j o0p giw}{%yip j �%g�j oWs r%w uF{cp j r%oFw gxp w j g��%{�� � gxoLoLgxp p4u�gxo0p j r�oLkx�L�WqLpp lW{%p p lWgxw g�j k4{P� {cyr��r%sU[ QIY �tr^O j o9{%vLv�� �0j oL��p lLj kD��oWr�fD� gxhL��g�p r�k �0k p gxu/hWgik j �%o=�

�6+-*�� =,037-: 0326F ;%03: �G:

� lLgvLw r�p r�p ��vWj yx{��+j oWs r%w uF{%p j r�o!{cyxyxgxk knk yxgxoW{%w j r�yxr��%giw k9r�o7� ��v�{cw p k�r%s p ��vWj y�{��+j oLs r�w u�{cp j r%ooLgxgxhLk���k g��cgxw}{��ThLj _�gxw gio0p u�r0hLg�� k {coWhGk p qWhLj gxk k lLrcf lLrcf qWk giw k �Zgil�{��%gFj o¥�%{cw j r%qWk�f {x�0k�hLgI)v�gxoLhWj oL�Fr%o�f lW{cp8L N%�^rJZI[,sWY L rJN sRqVqVQV\V\8Y sJ\54�p lLgx�n{%w g f�r%w �0j oL�Fr�oZ� � {ck �0k+y�{co���g�v�r%k p q7� {%p gxhr%o�{co0�¥� g��%g��Qr%sT�%w}{%o�q�� {%w j p ����p}{ck �0k uF{��nj o,�%r,� �%g�gi�W{cu�j oWj oW�9{�yxgxw p}{%j oj p giu r%sTj oLs r�w u�{cp j r%oy�{cw gxs q7� � �Fr%w w gxk g�{%w y}lWj oL�F{%o9gxo�p j w g�p r�vLj y�k qLv�gxw �Lyxj {�� � ����Lr�w9j oLk p}{coLyxg%� � g�� ��j o3{co�{�� �,¤xgxknj oLs r%w uF{%p j r�o k gxg���j oW�!��gxlW{]�0j r�wnj o0p r�s r%qWwnvLw r%p r%p �0vLj y�{��

p}{ck �0k��k g�{cw y}lLj oL��s r%wF{'�0oLrcf o j p gxu9�Tk y�{coWoLj oL��p lWw r%qL��l {¥� j k p�s r%wFv�r%p gxo�p j {�� � �Gj o�p gxw gik p j oL�uF{%p gxw j {�� ��w gxhLqWyij oW�9{ � {cw ��g o0qLu7��gxw�r%s�vZr%p gxo�p j {�� � ��j o�p gxw gik p j oL��j p gxu�k+p r9{Fk uF{�� � gxw+o�qWu���gxwx�r%w gi�W{cu�j oWj oW��{�yxgxw p}{cj o�hWr0yxqLu�gxo0p p r��%gxw j s ��j p k�|�q�{�� j p j gxk@l � g�� ��j oZ�C�������Jn �� qLp+p}{ck �0k�{%w g�oWr%p+vLw j uF{cw ��� � {%k �0k�{%w g �WqLp�{�f {x�9r�sQ{%yiyxr�u�v7� j k lLj oL� XRr^s�� \i��r%sQf lLj y}l�f�g

qLk q�{�� � �e�0oLrcfC� j p p � g��Uzg4u�{x��{ck �7p lLg4qWk gxw�p r k p}{cp g4p lWgij w��%r0{��Lgi�Lv7� j yxj p � �PH�f�g+uF{x�7j oLs gxwQk r�u�gr%s;p lLg���r�{�� k p lLw r�qL�%l�{%oW{�� ��¤xj oW��qLk gxw+�W{%yr����w r�qLoWh�{coWhnvLw r%s gxk k j r�oW{��Cyir�o�p gi�Lp l z {coWk gioC�C������}0�g�� �7� n ��|nr%k p � �c�Wp lWg���r�{��Zj k4qLo7�0oLrcf onp r7p lLg k ��k p gxu��m o�s {%yxpi�7|�qWj p g4r�s p gioFp lWgxw g+f j � �L��g+oLr�r%oWg4k j oW��� g k gxp�r�sZp {%k ��k8� g�{chLj oW��p r r�oLg4��r�{�� �U�%{cw j r%qWk

p}{ck �0k {cw g+y}lLr�k gion{coWhFp}{��%gxo�r%o�hLqWw j oW��p lLg+yxr%qWw k g�r%sCvLqWw k qWj oL�7{��%r0{�� �0{%oLh�p lWg+��r�{���j k8� j �%g�� �p rny}lW{coW�%gFhLqWw j oW�9p lLgFk gxk k j r%o=�p¢+yxyxgxk k j oL��j oWs r%w uF{cp j r%o�j k u�r%w g�r�s p gioGp lW{%oGoLr%p7{p� g�{cw oWj oW�vLw r0yxgxk k�� {coWh gxk vZgiyxj {�� � ��f j p l!p r0hW{��Pa kFj o0p gxw {%yxp j �%g�� ��r�w �0{coWj ¤xgxh!oWgxp f�r%w �%gxhOj oLs r%w uF{%p j r�oZ�f lLgxw g w g�� {cp gxh�j oLs r�w uF{cp j r%oFr%s p gxo9j kD� j o7�%gxh�p r%��gxp lWgxw��� lLgnp}{ck �Gk gxp � g�� �0j o!vLw r%v�r�k gih!j k��LqLp�r%oWg9v�r�k k j �7� g9{%oW{�� �0k j kP� f lW{cp�j k7y�� g�{cw�j k7p lW{%p

v�gxr%v�� g�lW{]�%g�{9f j hLg �c{%w j gxp �r%s@L N%�^rJZV[,sWY L rJN�\-QVQ54JL NRX5\IY Z sWY Q XWL QV\ f lWj y}lGp lLgx�giuFv7� r���hWqLw j oL�p lLg7yxr%qWw k g�r%sT{Fk gxk k j r%o=� � qLj � hLj oL�Fj o�p gxw}{cyxp j �cg7j oWs r%w uF{cp j r%o�{cyxyxgik k k �0k p gxu�k f j p l{cogi�%g�r%oqLk gxw k p w}{cp gx�%j gxki�;{coWh�k qWvLv�r�w p j oL�nu�q7� p j v7� g�k p w}{%p gx��j gxk�k j u�q�� p}{%oLgxr%qWk � �nf j � �)gxo�{c�7� g�v�gxr%v�� g7p r�LoWhnp lWgxj w+p {%k ��k�{coWhnk lWj s p k4��gxp f�gxgxo�p lLgxu/k qWvLv�r�w p gxh<]Wgi�0j �7� ��qLoLhWgxw4f {x�p�Ef lLj y}lnj k uFr%w gg^_�gxyxp j �%g p lW{%o�yxr�oLk p w {%j oLj oL��p lLg qLk gxw p r�s r�� � r�f�{�k gxp4v�{cp l l � g�� ��j oZ�C�������Jn �

�6+���� 2 ;%C %08Bv;%A^=,2 >?=GF6C@7^:�� ��C �,=,26F :�A-2 � 7-C G46C UA^C�:

� lLg7w j k g7j onw gxk vZr%oLk g�k v�gxgih�{coLhj o�p gxw}{cyxp j ��j p �9lW{ck���j �cgxoqLk gxw k�p lLg7vZr%k k j �Wj � j p ��r�sQk g�{cw y}lLj oW�p lLw r%qW�%l�{�k g�|0qLgxoWyig7r�s�|0qLgxw j gik�� � lWge�Lw k p4k �0k p gxu�k�hLj h9oWr%p+uF{��%g qWk g r�s;k g�|�qWgxoLyxgxkm�Ep lWgi�p}{��%g�{7k g�|0qLgxoWyig�r�sU|�qWgxw j gxk4oLr%p+{ck+{7hLj {�� r%�7�LqWp4{%k4{7k g�|0qLgxoWyig�r�s)r%oWgV) k lLr�p w g�|0qLgxk p k��

), -Jg .GcKe ( -/)�^o8oIf*l l �%g�-#o^f l lIf*l���� ( c�% -&* �%�

� ~Cj �%g k r�uF{%o��9r%p lWgiwm�0j oLhLk�r%sQk g�� s ) a k gxw �0j yxgWa �Zs w r%u k qLv�gxw uF{cw �%gxp k {coLh¥�7� � j oL�k p}{cp j r%oWk�qLv0fT{%w hWkx�8l w gxyigxo0pFs q�� � p gi�LpFk g�{cw y}l!k �0k p gxu�k n+l�{��%gn��gxgxo vLw r%uFr%p gxh��0�k}{�� gxk u�gxonf lLr�k p ��� g�p lWg7{c�Lk gxoLyxg7r%s;k giw �0j yig�{ck�|0qLj yr�0oLgxk k {coWh9p lWg qWk giw^a k.� {c��r�qLw{%k4{%qLp r%u�{cp j r%o7 ��vl z {coLk�m {cw � �%w gxo9{coLh¥~+r%oW{�� hpzG{�� �%gxwi�C�c���,t-n� lLg�uFr0hLg��)s w r�u/p lLg�vWw g��0j r%qWk4y}l�{cvWp gxw kx�C{%k4k lLrcf o�j o¥�;j ��qLw g��7� �%��hWr0gxk+oLr%p�{%yiyxr�qLo0p4s r�w

j o�p gxw}{cyxp j r%oGf j p l�p lLgFuF{cp gxw j {��Qs r%qWoLh=��z lWj � gFj p�lW{ckP� gx{%hGp r�qLk gxs q7�T�%gxoWgiw}{�� j ¤�{cp j r%oWk�j oGp lLghLgxk j �%o�r%s4k ��k p gxu>j oWoW{%w hWkx�Qp lLg�k �0k p gxu�k�{cw gFu�r�k p � �oWr%p7�WqLj � p p rlW{%oLh7� g�j o0p gxw {%yxp j r�o�f j p lp lLg�w gxp w j g��%{��Tw gxk q7� p k���gx{%y}l�|0qLgxw �Gj kP��j gxf�gxh!{%k�{nk gxvW{%w {%p g�k gxk k j r�oZ��m o�u�r%k p7j oLs r�w u�{cp j r%o{cyxyxgxk k�vWw r0yxgik k gxkx�0p lWg qWk gxw k1� g�{cw oF{coLhFhLg��%g�� r�v�oWgxfC�0j gxf k�r%sZp lLg4uF{cp gxw j {��LhLqWw j oW��k g�{cw y}l�{coWhw gxp w j g��c{�� � � lLg7uF{%p giw j {��;p lWgx�nk y�{cop lWw r%qL��l�f lWj � g7p w �0j oL��p rp�LoWhG{Fw g�� g��%{co0p�j p gxu f j � �;�%j �%gp lLgxu>{nvWj yip qWw g�r%s4lWr�f p lWg�j oLs r%w uF{%p j r�ok vW{%yig9j k�k p w qLyxp qLw gxh!{coWh�f l�{cp7k r%w p k7r%s4uF{cp gxw j {��p lLgx�Fy�{%o9gi�0v�gxyxp4p r�gioWyxr%qLo0p gxw��e0j u�j � {cw � ��p r9{co0�9p ��vZg�r%sQhWj {�� r%��k �0k p gxu9�Cj oLs r%w uF{%p j r�o�w gxp w j g��%{��)k �0k p gxu�k�k lWr%q7� h�vLw r]�0j hLg

k qLvWv�r%w p�s r%w k gxk k j r�oLkx�QoLr�p�r%o7� ��k j oL�,� gFw g�|0qLgxk p k��¥¢ p7{�uFj oWj u�qLun�Ck �0k p giuFk7k lWr%q�� hGk qLvWv�r%w pv�gxw k j k p gxo�p {coWhnu�r0hWj �W{c��� g�hLj {�� r%�Fr%�R` gxyxp k�� p lLg7vLw g���j r�qLk+p qLw oLk�j onp lLg�hWj k yxr%qWw k g7k lLr%q�� hnoLr�p` qLk pT�%r7{�fT{���s w r%u4|�qWgiw ��p rP|�qWgiw ��� � lLg�w giyxgxo0pTs r%w u7q7� {cp j r%o�r%s){d|0qLgxw �c��{coWhFp lLg+hLrLyiqWu�gxo�p kw gxp w j g��%gihns r%w j p k lLr%q�� h���g�{]�c{%j � {%�7� g+s r%w �W{%yr��p w}{cyr�0j oL��{coWh�s r�w w gxs gxw gioWyxg hLqWw j oW�7p lLg hLj {�� r��7�

¦ � r�� K ),+857;U0�3?FZ576 /8+ �P/16 +D57E

~+r%qW��� {ckP��{%w h�s r�w u�q7� {%p gxk7{nu�r0hWg���r%s4s r%qWw j o0p giw}{%yip j r%o�v�r%j o0p k���gxp f�gxgxo�qLk gxw7{%oLh�k ��k p gxu��� � �QvZr%k j oL�7{coFj oLs r�w u�{cp j r%o�w g�|0qLgxk px� � � �Qk g�� gxyip j oL��hWr0yxqLu�gxo0p kTs w r%u {�k gipTr�sZp lLgxu9�3� ���Qgi�L{%u )j oLj oL��hLrLyiqWu�gxo�p k4j o9hLgxp}{cj � � � ��� r%w hWgiw j oL��hLrLyiqWu�gxo�p k4s r�w hWg�� j �%gxw ���@l ��{%w hn{coWh�� gxk oLj ���C�����%�Jn� lLgxk g �Lp oWj yig�� ��j o�p rn{9hLgxk yiw j vLp j r%oGr%s {9k p}{%oLhW{%w hj oWs r%w uF{cp j r%o�w gip w j g��c{��Qk �0k p gxu�{ck k lLrcf oj o'�;j �%qLw g7�7� �,�P¢ p�g�{cy}lGj o0p gxw {%yxp j r�o�v�r�j o�px�Cp lLg�qLk gxw�u�{x�n�W{%yr��qLvp r9w g��WoLg�r%w�u�rLhLj s �9p lLgr%w j �%j o�{���w g�|�qWgxk p��e0�0k p gxu�kQp rLhW{���p ��vWj y�{�� � ��s r�� � r�fGp lLj k)u�rLhLg���s w r�u � gxs p)p r4w j �%l0px�cj o�p l�{cp)p lWgi��{�� fT{��0k)gi�Lv�gxyxp

j o�p gxw}{cyxp j r%o�p r�k p}{%w p�f j p l7k r%uFg s r�w u r%sZk v�gxyxj �Wy�{cp j r%o�r%sC{co�j oWs r%w uF{cp j r%o�oWgigxhC�0j o�p lLg4s r%w u r�s{�k uF{�� �Wk gipTr%sZp r%vLj y�{��Wp gxw u�k�� � lWj kTf j � �W�%j �%g p lLg+qLk gxwT{ w {%o7�%gxh � j k pQr%sZhWr0yxqLu�gxo0p kx�0f lWj y}l�y�{%o��g7qLk gxh�gij p lLgxw+p rFk g�� giyxp�j oWhLj �0j hWqW{��ChWr0yxqLu�gxo0p k�s r%w+s qLw p lLgxw+v�gxw qLk}{�� �Zr%w+hWj k y�{cw hWgihC�Zj onr%w hLgxwp r7j u�vWw r]�%g�p lLg r%w j �%j oW{��Z|�qWgiw ���

�pW�\]T l=T \�y ! �?[�W,T �?W�R7\]T X�S���T b�`UR�Y T V,R�\]T XZS �pb�b�[7b�b]a'[7S�\k�p[�Y T l�[�O]y�;�L{%u�v7� g m oWvLqWpD|0qLgxw � m oLk v�gxyxp e0yxw r�� �ZqWv � w gxk k � � w j o�p j o�p r0h�{x�Pa k p gxw u�k w}{co7�%gxh�� j k p {coLh9hLrcf onj ok ��k p gxu�k r%s)hWr0yxqLu�gxo0p k {�hWr0yxqLu�gxo0p�LqWp qWw g � gx�cr�oLhnf�r�w hWk � gx�%r%oWh9w}{%o7�0j oW� m o�p r�p lLg � gx�%r%oWhs¢+eWtTm mk ��k p gxu�k p gi�Lp�;j ��qLw g��7� ��� � r%j o0p k4r%s;j o0p gxw {%yxp j r�o�f j p ln{co9j oWs r%w uF{cp j r%o�{%yiyxgxk k+k �0k p gius�

� lLg�vWw g��0j r%qWk+y}lW{%vLp gxw+hWj k yxqLk k gxh�k v�gxyij s �0j oL�Fj oWs r%w uF{cp j r%o9oLgxgxhZ�.~+j k yxqLk k j oW�Fp lLg�hWg�� j �%gxw �r%sWhLr0yxqWu�gxo�p k;s {�� � kCr�qLp k j hLgTp lLgTk yir�v�gTr%sWp lWj k)p gi�Lp����+j k qW{�� j ¤�{cp j r%o�{coWh7{ck k gxk k uFgio0pQ{%w g�p lWg�s rLyijr%sC{%o�j oWyiw g�{ck j oL��{cuFr%qLo0p�r%sZw gxk g�{cw y}l�{%oLh�hWg��%g�� r%vWu�gxo�px�W{coWh�f�g+y�{coFgi�0v�gxyxpTuF{-` r�w�{ch��c{%oLyxgxkj o�p lWg�oWg}�Lp4s gif���gioWgxw {%p j r�oLk4r%s)k �0k p gxu�k+j o9p lLgxk g�{cw g�{ck��

�,t ��bPc^d%e fVg��Ri

� w gxk gio0p j oL��w gxp w j g��c{�� w gxk q7� p kFj o {'� j k p�lW{ck���gxgxo!p lLgnk p}{coLh�{cw h fT{���r%s�yxr%u�u7qLoLj y�{cp j oL�p lLg7yir�o�p gxo0p k�r�sQ{FhLr0yxqLuFgio0p+h�{cp}{c��{ck g�p rFp lLg7qLk gxw�� � lLj k+j k4j o�uF{co0��f {x�0k {�yxr%oWk p w}{%j o0p+r%oqLoWhLgxw k p {%oLhWj oW��oWr%p7r�o7� �GgI_Zgiyxp k�r%s4p lLg�w g�|0qLgxk p�p lLg�qLk gxw�v�r%k gxhZ���WqLpF{�� k r{s� j uFj p}{%p j r�or%op lLg�qWk giwe��j gxf r%sTp lLg�hLr0yxqLuFgio0p k vW{%yxgF{coWhj o�p gxw w g�� {cp j r%oWk���gxp f�gxgxoGj p giuFk�j oGj p�� � lLgxw g�{cw go0qLu�gxw r%qWk���j k qW{�� j ¤�{%p j r�o�p rLr�� k4{��%{cj � {c��� g4p l�{cp4vLw r]�0j hLg�{�� p gxw oW{%p j �%g.�0j gif k+r%s;w gip w j g��c{��Cw gxk q7� p kx��LqWpQp lLgxj w)vWw gik qWu�gxh���gxoLg��Lyxj {��Lg^_�gxyxp k�{%w g lW{%w h�p r�g��c{�� q�{cp g%�%p lLg yxr�u�u�qWoLj y�{cp j �cgTyxr%o��%gxo�p j r%oWkp lLgx� uF{��%g�qLk gTr%sW{cw gT{%h lWr0y%�%{coWhd� r�o�{4u�r%w g�p w j �0j {���� g��%g���� p lLgx� {%w gTqLk qW{�� � ��oLr%p;v�r%w p}{c��� ggxoLr�qL�%l!p rG��g�u�{chLgn{]�c{%j � {%�7� gFu�r%w g�p lW{%o�j o�k v�gxyxj �Ly9k j p qW{cp j r%oWk�� � qLpFu�r%k p7j u�v�r�w p}{%o�p � �%�qLk q�{�� � �P�0j k q�{�� j ¤�{cp j r%o�p r0r,� kTj o�w gip w j g��c{���k ��k p gxu�k r%o�� ��yxr%u�u7qLoWj y�{%p g+p lLg�k}{cu�g+hW{%p}{�p l�{cpTp lLg� j k p4hLrLgik+j onk r�u�g k � j �%l0p � ��u�r%w g�{cyxyxgik k j �7� g�s r%w u�� � rF��g qLk gxs q7� ���0j k qW{�� j ¤�{cp j r%o�p r0r,� k4oLgxgxhnp r{chWh9k qL�Wk p}{%o�p j {�� � ��u�r�w g.�%{�� qWg�p r�p lLg j o�p gxw}{cyxp j r�oZ�m oLs r%w uF{%p j r�o!w gxp w j g��%{��+j kFu�r%w g�p l�{co k g�{cw y}lZ��� g�{chLj oW��{coWh<� g�{cw oWj oW�Gs w r�u hLrLyiqWu�gxo�p k

u�r0hWj �LgxkTqWk gxw4�Zgil�{��0j r%qWw hLqLw j oL�F{7k gxk k j r%o HWhWgxv�gxoLhLj oW��r%o9p lLg p ��v�g�r%s)k g�{%w y}lC�WqWk giw k4u�{x�F��gu�r�w g4r%w8� gxk k�vWw gxv�{cw gxhFj oF{ch��c{%oLyxg�� � r0r,� k�p r�k qWvLv�r�w p�j oLs r%w uF{%p j r�o7w g��WoLgxu�gxo0pT{%oLhFhLj k yxr]�%gxw ��>r�w;j oWhLgxgxhZ��p r�k qLvWv�r%w pkZVQ swOWL NRX8�>{%w g {co7j u�vZr%w p}{co0p)s qLp qLw g v�{cw p;r�sWp lWg j oLs r%w uF{%p j r�o�{cyxyxgxk ks w}{cu�gxf�r�w ���

¦ � r�� r�� 6 �e;U0�;U+85<5F���e;UEC/1-�6 +.-r/80�243�576 /1+ 3?F=F=;UE�E� {cw h a k�j o�p gxw}{cyxp j r%o�u�r0hLg���{�� � r�f kQs r�wQu�r%w g p �0v�gxk�r%s�j oWs r%w uF{cp j r%o�{cyxyxgxk kx�W{ck�j oLhWgigxh�j pQk lLr�q7� hZ�� lLg+j o0p gxw {%yxp j r�o7v�r%j o0pQu�r0hLg��Wy�{co�{ck k giu7�7� gxh�hLj _�gxw gxo�p � ��p r u�r0hWg��WhLj _�gxw gxo�p�p ��vZgikTr%sZk ��k p gxu��m p�w g�{%hLj � �G{%hLu�j p ke�%{cw j r%qWk7p ��vZgikFr�s4j oLs r%w uF{%p j r�oGk gxg���j oL�G��gxlW{]��j r%wx� {coWh��%j �%gxk7vZr%j o�p gxw k7p rf lLgxw g7j o�p gxw}{cyxp j r%o�f j p l�{Fk ��k p gxu y�{co���g7qLoLhWgxw k p r0r0hG{ck {Fk qL�Lk �0k p gxu r%sQj p k+rcf o H � g�� ��j o a kp}{ck �Gr%w j gxo�p gxh�vWw r%p r%p �0vLj y�{�� ��gxlW{]��j r%w k7�%j �%g9{co�qLoLhWgxw k p}{coWhLj oL�r%s4f lW{%p7p lLg���r�p p � gxoLgxyr�0k7r�sj oLs r�w u�{cp j r%o�{cyxyxgxk k+k �0k p gxu�k4y�{%o9��g���Lr�w�j oLk p}{coLyxg%�4j pFj kFoLr%pFoWgiyxgxk k}{cw �!p r�� j uFj p7r%oWgik g�� s�p rr�oLg�gio0p w ��v�r%j o0p�j o!p lWgnu�r0hLg�� �

��oLg�u�{x�9f�g�� �)gxo���j k j r%o�yx{%k gik�f lWgxw g7p lWg�k p}{cw p j oW�Fv�r%j o0p4j k�{�k gxp�r%sQhWr0yxqLu�gxo0p ki�Cj o,�%gxo�p j �%g�� �hLj k v7� {��%gihC�Lr%wTk gx�%uFgio0p kTr�wT�Lj p kTr%sCr�oLg+k j oL�,� g4hLr0yxqWu�gxo�p��?¢+oLh9p lLgxw g+j k {co0��o�qWu���gxw r%sCj o�p gxw )gxk p j oW� p w}{coWk j p j r%o���gxp f�gxgxo�hLj _�gxw gxo�pT{%yxp j �0j p j gxkQj o�p lLg4uFr0hLg��Wp r7{�� � r�f�s r�wQ�Zgip p gxw�j o�p gxw}{cyxp j ��j p �j o�{%oGj oLs r�w u�{cp j r%oG{cyxyxgik k7k �0k p gxu�� � r0h�{x�Pa k�k �0k p gxu�k7uFr%k p � �{%w gFoLr�p�hLgxk j ��oLgxh�p rnk qLvWv�r%w pr%p lWgiw4p lW{%o���{cyr�0p w}{%yr��j oL�Fj o9p lWg���{ck j y.� gis p ) p rJ) w j �%l0p�uFr0hLg�� �

�6+*��� C�:%C�0�%BkE A-:�:%46C�:

� lLj kTy}lW{%vLp gxwTp r%qWy}lLgxh�r%o�k g��%gxw}{��Cr%����j r%qWkTv�r%j o0p kTf lWgiw g�j oWs r%w uF{%p j r�o7w gxp w j g��%{���k �0k p giuFk oLgxgxhp r�hLg��%g�� r%vns qLw p lLgxw���m o9s {%yipx��u�qWy}l9r%s;p lLg w giyxgxo0p4hWg��cg�� r%vWu�gxo�p+j o9p lLgd�Wg�� hnj k j o9fTr%w ��j oW��r%o{ck v�gxyxp kQr�sWj o�p gxw}{cyxp j �0j p ��{coWh7w gik q�� pQvWw gik gxo0p {%p j r�oZ�)k r�u�g r%sWp lLg r��,�0j r%qWkQhLw}{xf ��{cyr�0kQj o7u�r��0j oW�k ��k p gxu�kTr%w j �%j oW{�� � � hLgxk j �%oWgihFs r�wQj oLs r�w uF{cp j r%o7vLw r%s gxk k j r�oW{�� k�p r���g qWk gih�����p lLg4��gxoLgxw}{��WvLqW�7� j ylW{]�%g p r�hLrFf j p l9hLj {�� r��7hLgxk j ��oZ� � lWg�oWgi�0p4y}l�{cvWp gxw4f j � �Zw gxy�{cvWj p q�� {%p g�p lWg�w gxk g�{cw y}ls|0qLgxk p j r�oLkv�r�k gxh�j oGvWw g��0j r%qLk�y}l�{cvLp gxw k�p r%��gxp lWgxw f j p lGp lLgFr�oLgxk�v�r�k gih�lLgxw gFp rns r�w u7q7� {cp g�r%w k �%gxp y}l�{w gxk g�{%w y}l�{%�%gxoLh�{7s r%w p lLgd�Lg�� hZ�

Page 13: Basics of Information Retrieval - Statistics and Linguistics

! ����� �'&����

! �£& $ & �¥&���� �C��� � &��s�� "%$ � �D" ��� $���� ��¥���� � $ � $ �D" ��� ���� "%$ � �M� &��'�

� lLg uF{%p gxw j {���j o�p lLj k k gxyxp j r%o9lW{ck �Zgigxo9vWw gik gxo0p gxhnj o9{co9j o,�0j p gxh9{%hLhLw gxk k p r�p lLg7���%p l5j r�w hLj ytTr%uFvLqLp}{%p j r�oW{��C~Cj oL�%qWj k p j yxk tTr�oLs gxw gioWyxg j o � w r�oLhLlWgxj un�Lj o�~+gxyxgxu���gxw �����%���� r�w gxyx{%vLj p q7� {cp g�s w r�u p lWg�vLw g���j r�qLk9y}lW{cvWp giw k�����gxk j hWgikn{�� �+yxr%u�vWqLp}{cp j r%o�{�� � ����gxoLgxw}{�� � �

j o�p gxw gxk p j oL�e|0qLgxk p j r�oLk {coWh |�qWgik p j r%oWk�k v�gxyxj �Ly�{�� � ��w g�� {cp gxh�p r�k p}{%p j k p j yik {coLh�{�� ��r%w j p lLu hWgik j �%oC�uF{%o���w gxk g�{cw y}ls|�qWgxk p j r%oWk4{%w g�k v�gxyxj �Ly�{�� � �Fw g�� {cp gxh9p r�j oLs r�w u�{cp j r%o�{cyxyxgxk k��e0�0k p gxu�kT�W{%k gih�r%o�p lWg4u�gxy}lW{%oLj k u�k�r%qWp � j oWgih�j o�p lLg4vWw g��0j r%qWk�y}lW{%vLp gxw kTy�{coF��g+j uFvLw r]�%gxhZ�j4r%p ��gxy�{cqWk g�r�s){%o��Fr%���0j r�qLk hWw {�f �W{%yr��k+j o�p lWg�u�gxy}lW{coWj k uFk p lWgxu�k g�� �%gxk��Qp lLgx��vLw r]�0j hLg�yxr%oK)k j k p gxo0p�{coWhk p {%�7� g�w gxk q7� p kx�Cf j p l'�%{cw j {cp j r%o�s w r%u k �0k p gxu p rnk �0k p giu k qLw vLw j k j oL��� �nk uF{�� � HCp lLgw g�{ck r%o�p r�yxr%o0p j o�qWg4fTr%w ��j k�p lW{%p�p lLg+k p {%�7� g4w gxk q7� p kT{%w g4oLr�p�r�o7� �7yxr%oWk j k p gxo�pT�LqWpTyir�oLk j k p gxo0p � �u�gxhLj r0yxw g��

�5+-*�� %=,7^C �w= �7-A^2 �,46A^:#;%A-BD:

¢+yxyigxk k j oL��j oLs r�w u�{cp j r%o9j k�{FvLw j uF{cw j � ��� j oL��qLj k p j y {%yxp j �0j p �c�C{%oLhnp lWg�hLrLyiqWu�gxo�p k�{]�c{%j � {%�7� g�s r�ww gxp w j g��c{��Qj oGj oLs r�w u�{cp j r%o{cyxyxgxk k�k ��k p gxu�k�r�sTp r0h�{x�G{cw gFs r%w p lWg�uFr%k p vW{%w p p g}�Lp k��n~Zj oW�%qLj k p k�0oLrcf {c�Zr%qLp�p gi�Lp kx� {%oLhOk lWr%q�� h ��oWr�f {c��r�qLp�hLj k yxr%qWw k gG{coWhOhLj {�� r��7� m oLs r�w u�{cp j r%oO{cyxyxgxk kw gxk g�{%w y}lGk lWr%q�� hoLgxgxh'� j oW�%qLj k p k^HZ� j oL�%qWj k p j yxk+k lWr%q�� h�oWgxgihGp lWg7gi�0v�gxw j gxoLyxg7hWgxk j ��oLj oL�9{%oLhhLgI)v7� rc��j oW��j oWs r%w uF{%p j r�oG{%yxyigxk k�k �0k p giuFk�y�{co!{J_�r�w h�p lLgxu��(¢+oLh�p lWg9{cvLv�� j y�{%p j r�oGr%s4k p}{cp j k p j yxkr%o¥� {%w ��g���rLhLj gxk4r�s?� {%oL�%q�{c��g�hW{%p}{Fj p k g�� sQj k {Fs r%w u r�sQk p qLhW�nr%s1� {coW�%qW{%�%g�� � lLg�j oLs r�w u�{cp j r%os r%qWoLhFj k�oLr�p�j oF{coFgi�Lv7� j yij p�s r%w u9�0�LqWp�j sZ{ w gxk q7� p�s w r%u vWw {%yxp j y�{��Wk �0k p gxu�k j k�p lW{cp�p f�r7yir�o�p gxo0pf�r�w hWkTf j p lWj oF{�s r�qLw�f�r�w h�k v�{coFs w r%u g�{%y}lFr%p lWgiwTp gxoWh�p r s r�w u yxr%o0p gio0p ) ��g�{cw j oL�7{ck k r0yxj {cp j r%oLkf lLgxw gs� r%oL��gxw7k v�{coWk�hWroLr�px�Tp lLj k�j o�j p k g�� s+r%qW�%l0p7p rG��g9j o0p gxw gxk p j oL�s r�w7p lLgnk p qWhL��r%sm� {coR)�%q�{c��g�� �)j oWhLj oL���%gxoLgxw}{�� j ¤�{c�7� g7p r�vLj y�{��Qy�� qWk p gxw k r%sThLr0yxqLuFgio0p k�j w w gxk vZgiyxp j �%g7r�s�p lWgP� {coW�%q�{c�%gp lLgx��{cw g+f w j p p gio�j o�r�qL�%l0pTp r7��g�j o�p gxw gik p j oL�7s r�wTp lLg�k p qWhL�Fr�s=� {%oL�%q�{c��g4j o�j p k g�� s �;m s)w gxp w j g��%{��r%sT{chWu�j p p gxh�� ��k lWr0hLhW�nr%qWp vLqLp�s w r%u k v�gxgxy}lw gxyir��%oWj p j r%o�k ��k p gxu�k�fTr%w ��k�r�o{]�%gxw {%�%g�{%k+f�g�� �{ckTw gxp w j g��%{��Wr�sZyx{%w gis q�� � ��vWw rLr%s ) w gx{%h�p gi�0p kTp lLj kQr�qL��l�p�p r �Zg j o0p gxw gxk p j oW� j o�j p k g�� s�s r%w�p lLg4k p qLhW�r%sD� {%oL�%q�{c��g�� � qLp�w gxk q7� p k�k qLy}l�{%k�p lLgxk g�{%w gFoWr%p7{cvWvLw gxyij {%p gxh����(� j oL�%qWj k p k r%w�j oLs r�w u�{cp j r%ok yxj gxo0p j k p kx�Ws r%w r�p lWgxw p lW{%o9u�r�p j �%{cp j r%oFs r%w gxoW�%j oLgxgxw j oW�7g^_�r�w p k��

�%� ��bPc^d%e fVg��wi

�5+�� � E603;&A-: 0 F6=GB�46>?C�2G; � � � ��= 95A^C � :

m oLs r�w uF{cp j r%o w gxp w j g��%{��+k �0k p gxu�ks��j gxf hLr0yxqLuFgio0p kn{ck9y�{cw w j giw k9r%s p r�vLj y�{��+j oWs r%w uF{cp j r%oC�4{coWhlLr,� hFf�r�w hWk4{coWh�p gxw u�k4{ckTw g�{ck r�oW{c��� g4j oWhLj y�{cp r%w kTr%sCp r%vWj y�� � lWg+p gxy}lLoWj |0qLgxk4qLk gxh�s r�w {coW{�� ��k j k{coWh�{%oLhGr�w ��{coWj ¤x{%p j r�or%s hLr0yxqWu�gxo�p�yxr�� � gxyip j r%oWk {%w g�vWw j u�{cw j � �ns r0yxqWk gxh�r�oGf�r�w h�{coWhGp gxw ur0yxyxqLw w gxoLyxg k p}{cp j k p j yxk��~Zj oL��qLj k p kF��g�� j g��%g¥� j oL��qLj k p j y9gi�LvLw gxk k j r�oLkn{cw g�yxr%u�v�r�k gihOr%s f�r�w hWk�f lWj y}l s r�w u y�� {cqWk gxk

f lLj y}ls r�w u j o�p qWw oGp gi�Lp�r�w�hWj k yxr�qLw k g�� zr%w hLk lW{]�%g�vLw gxhLj yxp}{c��� g%�)k j p q�{cp j r%oR)}�Ck vZgx{��%giw )�{coWhp r%vWj yI) j oLhWgivZgioWhLgxo0p�k p w qLyxp qLw g7f lWj y}ly�{co��g�hWgxk yxw j ��gxhs r%w uF{�� � ��� t8� {%qLk gxk�lW{]�%gP� {cw ��g�� �9vLw gI)hLj yxp}{c��� g%� k j p qW{cp j r%oK)}��k v�g�{��cgxw )F{coWh!p r%vWj yV) j oLhWgxv�gxoLhLgxo0pFk p w qLyxp qLw g�f lLj y}l!y�{%o ��gnhWgik yxw j ��gxhs r%w uF{�� � ��� � gi�0p k)l�{��%g1� {%w �%g�� �4qLoWvLw gxhLj yxp {%�7� gQk j p q�{cp j r%oK) ��k v�g�{��%gxw )}��{coWh�p r�vLj yI)VORQ otQINPORQINtY%k p w qLyI)p qLw g%�Wf lLj y}l9y�{coWoLr�p ��g hLgxk yxw j �Zgihns r%w uF{�� � �����j �cgxop lW{cp.� j oW�%qWj k p j yxk4s r0yxqLk gxk�r�o�p lLg7p lLgxr%w �nr%s�y�� {cqLk g7k p w qLyxp qLw g%�;{coLhj oLs r�w u�{cp j r%o9w gI)

p w j g��%{��Zr%on{cvWv�g�{cw}{coWyxg�r�sCf�r�w hLk+{%oLh9p gi�Lp ki�Wp lWg.� {cyr�Fr�sCyxr%o0p}{cyxp4��gxp f�gxgionp lLgd�Lg�� hLk u�{x�FoLr�p��g gxo�p j w g�� �Fk qLw vLw j k j oL�7�

� z l�{cp4j k oLgxgxhLgxhnj k4{7p lLgxr%w ��r%sU� {coW�%q�{c�%g�f lWj y}l9uF{��%gxk4j p vZr%k k j ��� g+p r�uF{��cgs {%j w � � �%w r%k kQk p}{cp gxu�gxo�p k�{%��r%qWp�� {cw �%g qLoWj p kQr%s�p gi�Lpx�0{%oLh7p lLj kQj kQ{+uF{%p p gxwQr%o7f lLj y}l� j oL��qLj k p j yxkTlW{%k l�{ch��%gxw �p� j p p � g+p r�k}{x��� l eLvW{%w yr�}|%r�oLgxk+{%oLh<m�{��%�C����}��Jn

� qWp+{conr�vLp j u�j k p j ym� {%p gxw�|�qWr%p g����<m {cw gxoneLvW{%w yr��|%r%oWgxk4r0y}l�|�{cw p j o<m�{���k gxgiuFk4p rFj oLhWj y�{%p gp lW{%p k r�u�g vLw r%��w gxk k4j k �Zgij oW�7uF{%hLg�p r��Ww r0{cy}l9p lWg�hWj �0j hLg��

� zGg�p}{��%g�lLg�{%w p;vW{cw p j yxq7� {cw � �+s w r�u�p f�r+s {%yip k��U�Ww k px��� j oW�%qWj k p k){cw g�p qLw oLj oL�+p lWgxj w{%p p gxo0p j r�onu�r�w g�{%oLh�u�r�w g p rp� {%w �%gxw+qLoLj p k+r%sQhWj k yxr%qWw k g7p l�{conp lWg7k gxo0p gioWyxgc�;{coWhk gxyxr%oWhZ�Lr�oR) � j oLg w gxp w j g��c{���k ��k p gxu�k {%w g�� j �%g�� �7p r j o��%r�� �%g4w gxp w j g��%{c��� g+qLoLj p kTk uF{�� � gxwp l�{co�p w}{chLj p j r%o�{��)hLr0yxqLuFgio0p k��dzGg7��g�� j g��%g�p lW{%p+p lLg7w g�� g��c{%oLyxg7r%s�p lLgxk gP�Lg�� hLk�p rr�oLg�{coWr%p lLgxw�f j � ����gxyir�u�g4u�r�w g+{cvWvW{cw gxo0pT{%kTp lWg+k j ¤xg4r�sZp lLg+p gi�0p qLoLj p k�p lLgx��hLg�{��f j p l9��gxyir�u�gxk uFr%w g�yxr%u�u�gxoWk qWw}{c�7� g�� l e0v�{cw yr�}|%r%oWgxk+{coWh5m {x�%�C�c��}%�Jn

� gxk g�{cw y}l�r�o�� {cw �%gxw�qLoWj p k�r%s�� {coW�%qW{%�%gFqLk g�k qWy}l!{ck7p g}�Lp kx�QhWj {�� r%�%k�r%w�hLj k yxr%qLw k g�j oG��gioWgxw {��lW{%k�oLr�p�k qLyxyxgxgihWgxh j o�vWw r��0j hWj oL���gioWgxw {�� j ¤�{%�7� g�w gxk q7� p k�� � lLgn�%r0{�� j k�� gxk kFyir�oLyxw gxp g���p gi�Lp k{cw g�oLr�p4w gx�%q7� {%w4j o9p lWg k gxoLk g7k gxo�p gxoLyxgxk�{cw g%�Z{coWhnf lLgxo�s r�w u�{�� j ¤x{%p j r�o�j k+{cp p gxu�vLp gxhZ��j p4r�o7� �k qLyxyxgxgihWk�j o�vWw r%p r%p �0vLj y�{��Qyx{%k gik��Fe0p j � � �Zp lWgxw g�j k�w gx{%k r%os r%w�r%vWp j uFj k u��dz j p l¥� {cw ��g7{cuFr%qLo0p kr%s�p gi�0p k�{��%{cj � {c��� g�s r%w�{%qLp r%u�{cp j y�{%oW{�� �0k j k+r%s�p gi�0p kx�=� j oL��qLj k p k4y�{%o�p gxk pi�)hLj k y�{cw hZ�=�%giw j s �%�){coWhw g��LoLg7u�gxp lLr0hWk4s r�w�� {cw �%gI) k y�{�� g�{co�{�� �0k j k4f j p lnp lWg k}{%u�g�gI(�yxj gioWyx�9y�� {cqWk gV) � g��%g��Q{coW{�� ��k j k+fT{ckv�gxw s r%w u�gxh9gx{%w � j gxw��

�5+*�� A^2 �,46A^:�;%A^B >?CD;%E6=GF6:�A-2 A-2 �W=�%>?03;%A^=,2 UCD; UA^CD98087

� qWp k r�s {%wx�Lw g�� {%p j �%g�� �Fs gif�w gxk q7� p k l�{��%g ��gxgxong���j hLgxo0p��T|9r�w vWlLr,� r��%j y�{��C{co�{�� �0k j k j k qLk gxhn��r%p ls r%w1�%{cw j {co0pQyir�oK]�{cp j r%oF{%oLh�yxr%uFv�r%qWoLh�p gxw u {coW{�� ��k j k��;eL��o0p}{cyxp j y+{co�{�� ��k j kQr%sZgxo0p j w g4k gxo�p gxoLyxgxks r%w�p lLg�vLqLw v�r�k g7r%s�uF{%p y}lLj oL�9{coW{�� ��k gxk�p r9{%oW{�� �0k gik r%s�j oLs r�w u�{cp j r%onw g�|0qLgxk p k lW{]�%g7�Zgigxogi�w)v�gxw j u�gxo�p gxh�f j p l�s r�w7{s� r�oL��p j u�g6l z�{�� �%giwx�C�c�%�%�0�Qg�� ��� n �T{coLh�k �0o�p}{%yip j y9{co�{�� �0k j k7j k7qLk gxh�p r

Page 14: Basics of Information Retrieval - Statistics and Linguistics

qLw g.g�� � ��� �WqLpTp lLj k1� {cp p gxwQk r�w pTr�sZw g�� {%p j r�o7y�{%oZ�W{cp1� g�{ck p�s r�wT�QoL��� j k lZ�0�Zg4y�{cvLp qWw gxh9{�� uFr%k p�{ckf�g�� �C����gi�0p w}{cyxp j oL��yxr%o0p gxo�p4p gxw u�k f j p lLj o�k r�u�g�k lLr%w p4hLj k p}{coLyxg s w r%u g�{cy}l9r�p lWgxw��

tTr�o�p gxo�p�{coW{�� ��k j k¢+oW{�� ��k j k r%s)yxr�o�p gxo�p ��/*��!�9*(���(��*��1 /"3�5�/�3eL��k p gxu�k p l�{cp+{coW{�� �,¤xg�yxr%o0p gio0pd� � �z lWgionyir�o�p gxo0p4j k ��gxj oW��{%oW{�� ��¤xgxh'� � �

�)j �%qWw g.g�� �����;�L{%u�v7� g r%s)oWr%w uF{�� j ¤�{cp j r%o�r�s;k �0o0p {%yxp j yd�c{%w j {%o�p k r�s)u�q�� p j ) f�r%w h�p gxw u�k��

e0r+f lW{%pCj k)f w r�oL�+f j p l k ��o0p}{cyxp j y {coW{�� ��k j krq z l0��hWr0gxkCj p)oLr�pClWg�� v�q ¢+vLv�{cw gxo�p � ��k p w qWyxp qWw gr%o{�y�� {%qLk}{��U� g��%g��)j k4j oLk qt(7yxj gxo�p+p rFy�� g�{cw � �Fj u�vLw r��%g fTr%w hn��{ck gxhnj oLhWg}�Lj oL�Fk y}lLgxu�gxkx�C{%oLhnp r�W{%yr� p lLj k�qLvC�+p lLgxw gj k�k r%u�gvLk �0y}lLr�� j oL��qLj k p j y�g���j hLgxoWyigGp l�{cp9p lLgk qWw s {cyxgG{cvWv�g�{cw}{coWyxg�r�sy�� {cqLk gxk4j k vWw r%u�vWp � �Fs r%w ��r%p p gion{cs p gxw p lLg y�� {%qLk g lW{ck4��gxgxon{co�{�� ��¤igxhn{%oLh9j o0p giw o�{�� j ¤igxh=�� lLg�j u�v7� j yxj p;k gxuF{co0p j y+u�rLhLg�� k�j oFp r0hW{��Pa kTk �0k p gxu�k4{%w g+��{ck gxh�r�oFk j oL��� g4fTr%w h�r0yxyxqLw w gioWyxg

{coWhZ�Cr0yxyx{%k j r�oW{�� � �%��yxr0r0yxyxqLw w gxoLyxg���gxp f�gxgioGf�r%w hLk�� � lLj k�p {��%gik qLk {F�Wj p4r�sQp lWg7fT{x�%�C�WqLp�oLr�ps {cw+gxoLr�qL��lns r%w+qWk+p rFy�� {cj u/f�g7lW{]�cg7p gi�Lp+qLoWhLgxw k p {%oLhWj oW�Ff j p lLj onw gx{%y}lZ�.zr�w hLk�{%w g �Zgik j hLgxk�%{c�%qWg ��r%p l�v�r�� �0k giuFr%qLk�{coWh7j oLyxr�u�v7� gxp g��;g��%gxw ��f�r�w h�u�g�{coWkQk g��%gxw}{��Wp lLj oL��k�{coWh7g��%gxw �7p lLj oL�y�{co9�Zg�gi�LvLw gxk k gxhnf j p ln{co0�Fr%oWg�r�s)k g��cgxw}{��;f�r%w hLk��e0gxuF{co0p j yQu�r0hLg�� kZs r�wCj oLs r%w uF{%p j r�o�{cyxyxgik k)fTr%w �+gxj p lLgxwCf j p l.� gi�Lj y�{��%w gxk r�qLw yxgxk)r%w=�0oLrcfD� gihW�%g

�W{%k gikTr�wQr�o�p r�� r��%j y�{��LoLgxp f�r�w �0kTr%sZk r%u�g4k r%w p^H0k r%u�g+k y}lWgxu�gxk�k qWy}l�{ckT~){cp gxo�pTeLgxuF{co0p j y4m oLhWgi�w)j oL�Ff�r�w �9f j p l9y�� qLk p gxw j oW�Ff�r%w hLk��W{%k gxh�r%onrLyiyxqWw w gxoLyxg7vW{cp p gxw oLkx�Z{coWhnp l0qLk+l�{��%g�{7k gxuF{%o�p j yu�r0hWg��0��{ck gxh7r�o7f�r%w h�r0yxyxqLw w gioWyxgc�0�LqWp;r�o�{+lLj �%lWgiw?� g��%g��Lr�s�{%�Lk p w}{cyxp j r�oZ� � lWgD� gi�Lj y�{�� � ����{ck gxhu�r0hWg�� k {%w g��Lw j p p � g�{coWh�hLr7oWr%p4{c��g+f�g�� � �L{coWh�k l�{cw g�f j p l�p lWg+k p}{cp j k p j y�{�� � �7�W{%k gxh9u�r0hWg�� kTp lLg� j u�j p {%p j r�o�p lW{%pTp lWgx��uFr0hLg���w g�� {cp j �%g�� ��{%p r%u�j y4qWoLj p k�r�sZu�g�{%oLj oL�W�0r%wTk gxoLk gxk8� oWr%pTw g�� {%p j r�oLkx�hLgxv�gxoWhLgxoLyxj gxki�C{cyxp j r�oLk r�w g��%gxo0p k��Tp lLg k p qt_�f lLgxw gxr%s;hLj k yxr%qLw k g j k uF{%hLg��zg oWgxgih�s {cwQ�Zgip p gxwQk giu�{co0p j y u�rLhLg�� k��)��gxp p giwQj o7p lLg4k gxoLk g p l�{cpQp lLgx��uFr0hLg��7� {coL��qW{%�%g �R\-Q

w}{cp lLgxw4p l�{co�~C{%oL��qW{c��g j o9p lLg7{c�Wk p w}{%yip��Dzg�oLgxgxh�{���gxp p gxw4qWoLhWgiw k p}{coWhLj oL��r%s;lLrcf3u�g�{coWj oW�j k oLgx�%r�p j {%p gih�j o�l0qLuF{%op� {%oL�%q�{c��g+qLk}{%�%g��?�L�0gxh9w gxvLw gxk gxo�p}{cp j r%oWk hWr7oWr%p k gxgxu/vLw}{cyxp j yx{�� �L{coWhhLroLr�p7w gI]Wgxyip�r%�Wk giw �%gxh!l�qWuF{co�� {coL��qW{%�%gFqWk}{c�%g���zg�oLgxgxh�u�r�w g�gi�W{cyxp�k p qWhL�Gr�s j oWg}�W{cyxpgi�0vWw gik k j r%oC�;r%s p lLg �trJ[ QVr-\-QI[¨�c� � lWr%u�gxrW)4s w r%u � w gxg�� �trJ[ rJL r-\+k j u�j � {cw��4r�w oLg�{%w�{coWhGy�� r%k gk ��oWr%o0��u7�Fr�sCg}�LvLw gxk k j r�oLk r�sCl�qWuF{cop� {coW�%q�{c�%g l z {%oLk�m�{%w � ��w gxoC���c��}��-n � � lLj kTu�g�{%oLkTfTg�oLgxgxhp r�qLoLhWgxw k p}{coWh�p lLg+p giuFv�r%w}{�� j p �%�%k}{�� j gxoLyx�%�L{coWhFp r%vWj yx{�� j p ��r�sZp gxw uFki�Lw g�� {cp j r%oWkx�0{%oLhF�%w}{cuFuF{cp )j y�{��;g�� gxu�gxo�p k.��j p�u�g�{%oLk u�rLhLg�� j oW�Fp lLg � j s g7yi�0y�� g�r%s�p gxw u�k j o'� {%oL��qW{c��g%�Cp lWg�� j s g�yx��y�� g�r�sw gxs giw gxo0p k+j o9hLj k yxr%qWw k g%��{coWh9p lLg yxr%oLoWgxyip j r%on��gxp f�gxgio�p lLg p f�r7�

�5+ � .1467I;%A^7-A^2 �,46037-AI; �

|9q�� p j ) � j oL�%q�{��Zw gxp w j g��c{��CoWgxgihWk+p rF��g�gi�0v�� r�w gihC�Zs r%w4p lLg�r��,�0j r%qLk+w g�{%k r�o�p lW{cp+j o0p gxw gxk p j oL�FuF{-)p gxw j {��)uF{��9��g7{]�%{cj � {c�7� g j onp lLg7f w r%oW�p� {coL��qW{%�%g����?|�q�{�� � �9yxw qLyxj {�� � �c�Zu�q7� p j ) � j oW�%qW{��Zw gxp w j g��%{��uF{��Fj u�vWw r��%g�w gxp w j g��%{��Cj o9��gioWgxw {��C�0�9y�� g�{cw j oL��p lLg hWgxyr��k+s w r%u/p lWgd� j oL�%qWj k p j y+�Wj {ck4r%s;w gik q�� p kk r�s {cw��

w g�{ck r%o�{c�7� ��k p}{c��� g�w gxk q�� p k�r%�Lp}{%j oWgxhp r9h�{cp g%�)j k p lLg�s {%yxp�p lW{%p oLrnk qW�Lk p}{co0p j �%g�w gxk g�{cw y}lGl�{ck��gxgxoFv�gxw s r�w u�gxh�r%o�r�p lLgxw�p lW{%oF�;oW��� j k l�p g}�Lp����;oW��� j k l7j kT{�p ��vZr�� r%��j y�{�� � � k v�gxyxj {���� {coW�%q�{c�%g j op lW{%p j p w g�� j gxk4u�r%w g�r%onf�r�w h9r%w hLgxw4p l�{co9r�o9j oK]Lgxyxp j r%o9p lW{%o9u�r�k p4r%p lWgiw�� {coW�%qW{%�%gxk^HWp lLj k y�{%o��g gi�0v�gxyxp gxhn��r�p lnp rFhLgxyxw g�{%k g�p lLgd�%{�� qLg r%s;oLr�w uF{�� j ¤�{cp j r%oFp lLw r%qW�%l9u�r�w vLlLr,� r%�%j y�{��C{coW{�� ��k j k{coWhnp lLg7qLp j � j p ��r%s?� j oLg�{cw+vLw gxyigxhWgioWyxg7��{ck gxh�k p}{%p j k p j yx{��CuFgip w j yxk��+m sQf�g7y�{co�gi�0vZgiyxp�f�r�w hLk+p r{cvWv�g�{cwQ{chW` {cyxgxo�p � � j o7{4vLw gxhLj yxp}{c��� gTr�w hWgxw)f j p l�u�j oLj uF{����%{cw j {cp j r%o s w r�u3rLyiyxqWw w gxoLyxg p r�r0yxyxqLw )w gxoLyxg%�Wp lWg�k ��k p gxu�k fTg��WqLj � hFf j � ���Zg.�cgxw �FhWj _�gxw gxo0p p lW{co9j sCf�g�{ck k qLu�g�p lLgxw g {cw g.� r%oW�7w}{coL��ghLgxv�gxoWhLgxoLyxj gxk4�Zgip fTgigxonlW{%vLl�{�¤�{cw h7� �9{cvLvZgx{%w j oW�7f�r%w hWk4uF{cw �%gxh9f j p l9{%�%w gxgiuFgio0p4s gx{%p qLw gxk��

�5+���� =�� ;%C��G;%46087^A^; � BD=,467^F ��C�4<;%A^7-A��DC@F ��C�;#;%C

� gi�Lp k+hLr�l�{��%g k p w qLyxp qLw g.��p lW{%p u�qLy}lnj k g���j hWgio0p���eLr�s {cwx��� j p p � g4r�s;p lWj k k p w qLyxp qLw g l�{ck4��gxgxoqLk gxhngi�Lv7� j yxj p � ��s r�w j oLs r�w uF{cp j r%o�w gxp w j g��%{�� � � lWgxw g7{cw g o0qLu��Zgiw k4r�s;g}�Lv�gxw j u�gxo�p k4p lW{%p f {cj p p r��g7v�gxw s r%w u�gxh=��j sT{Fp gi�0p y�{co��g7k p w qLyxp qLw gxhG����k r�u�g7u�g�{coWkx�){coLhj p k�yir�u�v�r�oLgxo�p k j oLhLgi�Lgxhk gxvW{cw}{%p g�� �%�Lk qLy}l�{7yxr%u�v�r�k j p g�j oWhLgi��u�j �%l0pTf�g�� �CvWw r]�0j hLg {7w j y}lWgiw vWj yip qWw g�r�s)p gi�0p p r%vWj y�p l�{co{�k j u�v�� g8� j k p��;t8� {%qLk g fTgij ��l�p j oL��{cvWvLw r�{%y}lLgxkx�0p r%vLj yI) s r0yxqLkQhLgxp giyxp j r%oC��s r�w gx��w r�qLoWhR) �W{%yr����w r�qLoWhy�� {cqLk g�j hLgxo0p j �Wy�{cp j r%oZ�Lk qWu�uF{%w j ¤�{cp j r%oC�0{%oLh9k qL�Lp r�vLj y�k gi��u�gxo�p}{%p j r�o�{cw g {�� �Zp gxy}lLoWj |0qLgxk+{��%{cj � ){c��� g s r�w�gi�0v�gxw j u�gxo�p}{%p j r�oZ�;p lLgxk g4k lWr�f vWw r�u�j k g p r�v�gxw s r%w u hLj _�gxw gxo�p � �7s w r%u p lLg4k j oL�,� g f�r�w h{coWh9u�q�� p j ) f�r�w h�p giw u/s w g�|0qLgxoLyx�9�W{%k gxhnj oLhWg}�Lj oL�7k y}lLgxu�gxk+hLgxp}{cj � gxh�j o�p lLg vLw g��0j r�qLk4k giyxp j r%o=�u oWhLgxw k p {%oLhWj oW�Gu�r%w g9r%s+f l���p gi�0p kF{%w gnp gi�Lp k�w}{cp lLgxw�p lW{%o�f�r�w h!yxr%o0p}{cj oLgxw kx� {%oLh�f l0�

p gi�0p k�j o�j uFv�r%w p}{co0p�fT{��0kF{cw g9u�r%w gp� j �cg�vWj yip qWw gxk�p l�{co�hLj yxp j r�oW{cw j gxk�f j � �T��j �%g9u�r%w g�hWgivWp lp rnp gi�Lp7{%oW{�� �0k j k�� � lLg�r%�R` gxyxp j �cg�j k k r%u�g � g��cg��Tr%s p r%vLj y�{���r%w�k gxuF{%o�p j y�{co�{�� ��k j kx�Q{coLh�s w r%up lLg�hWj k yxqWk k j r%o�{%��r]�%gF{%oLhGj op lLg�j o0p w rLhLqLyxp j r%oC�Cj p�k gxgiuFk�{%�LqWoLhW{%o�p � ��y�� gx{%w�p lWj k k lLr�q7� h��gv�gxw s r%w u�gxh�j o�j o0p gxw}{cyxp j r%o�f j p lFp lLg+j o0p gxoLhLgxhFw g�{chLgxw�r�sZp lWg4p gi�0p�� � lLg+w g�{chWgiwTr%w�qLk gxw�j kQoWr%pT{k j oL��� g4r%oWgV) k lLr�p1|0qLgxk p j r�oFk qL�Wu�j k k j r%oFu�r0hLq�� g8� p lWg4qLk gxwTj k {cyxyxgik k j oL�7p gi�Lp�s r%wTk r�u�g4w g�{ck r%oC�{coWh9p lLj k w g�{ck r%o9j k oWr%p j w w g�� g��c{%o�p s r�w j oLs r%w uF{%p j r�oFw gxp w j g��%{��CvWqLw v�r�k gxk��z rcf�g��%gxwi��k p qWhL�0j oW��p r%vWj y�{���vLw r%��w gxk k j r%oOj o�{�p g}�Lp9j k9yir�u�v7� gi�Z� ~ZrLyx{���g^_�gxyip kp� p lLg

hLj k p j oLyxp j r�o���gxp f�gxgxo���j �cgxo9{%oLhFoWgxf j oLs r�w uF{cp j r%o�j oF{�y�� {%qLk g%�0k}{x��� l�{��%g���gxgio�k p qLhWj gih9{coWhvW{%w p j {�� � �ns r%w uF{�� � �nhWgik yxw j ��gxhZ�Q�LqWp�oLr%p�w r%�WqLk p � ��gxoLr�qL��lGp rn��gFqWk gxs q���s r�w vLw gxhLj yxp j �cg�f�r%w ���f lLj y}l7j k)f l�{cp;j oLs r%w uF{%p j r�o�w gxp w j g��%{��0w g�|0qLj w gik��.� m p;j k;oLr�p)g�{ck ��p r+j hLgxo0p j s � p lLgTp r%vWj y {coLh7s r0yxqLkr%s {FvWw j o0p gihGk gxo0p gioWyxgc�;gxk v�gxyxj {�� � �nj ok qLy}l�{p� {%oL��qW{c��g�{ck �QoL�,� j k lZ�Cf lWgxw gFp lWg7k qWw s {%yxg7f�r�w hr%w hWgiw�j k7�%w}{cuFuF{cp j y�{�� � �n��r�qLoLh�p r{�%w g�{cp7gi�0p gxo0p�� �l e0��{�� � �Z�c����tJnD¢+oLh�� {cp gxw7gi�0v�gxw j u�gxo�p kyxr]�%gxwD���0��{%qLp lLr�w4{%hLu�j k k j r�o ��vLw r%p r�p ��vWj y�{��Zy�{ck gxk4r%o�� ���Dl z {J` j �yir����{5QIYks�� � �C�c�%�,g-n � lLgxw g j k{�k �0k p giu�{cp j y vLw r%��� gxu j o�{cqWp r�uF{cp j yTp g}�LpT{coW{�� ��k j k;j o�p l�{cpQp gi�LpQj o7j p k g�� s�j k�{co�gio0p j w g k gxuF{%o�p j yr%�K` gxyipx�;{coWhlW{%k�p w}{%oLk yxgioWhLgxhGu7qLy}lr�sQp lWg7k �0o�p}{cyxp j y�{�� � �9��r]�%gxw oLgxhGyxr%oLk p w}{cj o0p k�p l�{cp�y�� {cqLk gk p w qWyxp qWw g�{chWlLgxw gxk7p r��7k qLw s {cyxgFyxqWgik7��j �cgFqWk�r%o�� ��j oLyxj hLgxo0p}{���p w}{%yigxk7r%s k gxuF{co0p j y � j o7�0j oL�9r�sp gi�0p��5l m��{�� � �%w gxoZ�Z���,}��0� m��{�� � �%w gxoZ�Z�c��}%�Jn � qLp�j p�j k�y�� g�{cw�p lW{%p�l�qWuF{coqLoWhLgxw k p {%oLhWj oW��r�s�p gi�0plLj oW�%gxk�yxw qWyxj {�� � �9r%o Q SIotQVqIY sWY L rJNK\+{%oLh �#�VotrJY �tQV\-QV\+r%op lLg7vW{%w p�r%s�p lWg7w gx{%hLgxw {ck�fTg�� ��{ck�p lLghW{%p}{�j p k g�� s�{%kQgxoWyirLhLgxhFj o�p lLg4p gi�Lp��Qm pQj k�oLr�pQp lWg4k p w qWyxp qWw g4r%s�p lWg4p g}�LpT{�� r%oWg �LqLp�r%sZp lLg@\IY rJZ��p lW{%pD� g�{%hLk4w g�{%hLgxw k w j �%l0p��

�%d%f )�f*lVfIcWg*o b���'wf*l-e ( -&)�l , --g� ( )* '�( l^e ( o*l ( ) ), --g . cte ( -&)�^o�o^f*l l �,}

�5+�����;%E6C � U=+� C %;�A-C�:&= �M;%C��G;%:

�WqLw p lLgxwx�0p gi�Lp k4lW{]�%g�uF{co0���0j oLhLk r%s)vLw r%vZgiw p j gxkT��gxk j hLgxk ��gxj oL��p r�vLj y�{�� � � gi�0p k4yx{%o���g+y}l�{cw}{cyI)p gxw j ¤xgxhZ�%hLgxk yxw j �Zgih�{coWh y�{%p gx��r%w j ¤igxh j o o0qLuFgiw r�qLk;fT{���k��%j4r�oLg�r�sLp lLg�yxw j p giw j {4{cw g�j oLhWgivZgioWhLgxo0pr%sQg�{cy}lnr�p lLgxw^H�k r%u�g r�s;p lLgxu {cw g f�g�{��n{coWh9qWoLw g�� j {%�7� gWH�{�� �){cw g oLr�p+{cvWv7� j y�{c�7� g�p r�{�� �Cj p giuFk��� gi�Lp k�y�{con�Zgd�c{%�%qWgc�C{c�Lk p w}{cyxpx�Z� gx�0{�� �WhLj k yxqLk k j r�oLkx��u�r�oLr,� r��%qWgikx��j � � qWk p w}{cp gxhZ�WhWj (7yxq7� px��k lWr%w px�w gxv�gxp j p j �%gc��� qWyxj hC��vZgiw k qW{%k j �%g%�%s rLyiqWk gihC�%qLoL��w}{cu�uF{%p j y�{�� �xk y}lLj ¤xr%vWlLw gxoLj y%��{coLoWr��0j oL�W�coLgxf k vLw j o�px�rW_ZgioWk j �%g%��r��Lk r�� gxp gc�Qp w gxoLhW�'� {coWh�k rs r%w p lZ�G|n{co0�Gr�s p lWgik g�p �0v�gxk7r�s y}l�{cw}{cyxp gxw j k p j yxk�{cw gk}{�� j gxo�p s r�w w g�{%hLgxw ki��{%oLh qVr&�� O���g qLk gxh9j o9w gip w j g��c{��Zyxr%o0p g}�Lp k��¢4oWh!f lWgio s qLw p lLgxw�u�rLhW{�� j p j gik7yxr%u�g9j o�p rv�� {��%� {u�r�w g9�%gxoWgiw}{��D�0j gif/u�qWk pF��g9p}{��%gxoZ�

�Wr%w�j oWk p}{%oLyxg%��gi�Lv�gxw j uFgio0p k3f j p l {%qLhWj r/h�{cp}{c��{ck g j oLhWg}�Lj oL�/j o��cr,� �cg oWr%p3r�o7� � { p gi�w)p qW{��Fw gxvLw gxk gxo0p}{cp j r%o r%s9p lWg k v�r��%gxo hW{%p}{0���LqWp�p ��vZg r%s9k vZgigxy}l=�/hWj {�� r%�L�Fu�r%oWr�� r%�W��gxp y��l m�j u���gxw3QIYvs�� � �C���%�,g0�U��{%w hC�C������}Jn?z lW{%p g��%gxw�hLj u�gxoLk j r%oWk�r%s8�c{%w j {%p j r�o�y�{coG��gF{%yiyxgxvLp gxh�{ck�%{�� j hns r%w {%o{cw g�{Fr�w {Fk gxp�r%sTp gi�Lp ki�)j p+j k�y�� gx{%w+p lW{%p {Fu�r%oWrJ) u�r0h�{��)p gi�Lp�w gxvWw gxk gxo�p}{%p j r�o¥�f lW{%p g��%gxwTj p�j ki�W{coLhFlWr�f�g��%gxw f�g�� ��j pQj k�hWgik j �%oWgxh�� k j u�v7� �7f j � �WoWr%p���g�{%�7� g p r�y�{cvWp qWw g4uFr%w gp lW{%o¥�cgxw �nk j u�v�� g�y}lW{cw}{%yip gxw j k p j yxk+r�s�{Fp gi�0px�){coLh�p l0qLk�f j � �)q7� p j uF{cp g�� �Fyxr%oWk p w}{%j o�p lWg�qLp j � j p �r%s;p lWg�u�{cp y}lLj oL��s qLoWyxp j r�oW{�� j p ���

�5+�� � C�08F6A^2 � � 0826F�� E6= A^:&;%E6C %C@08F6C �

��j �%gxo�p lWgm�%{cw j {cp j r%oFj oFhWj _Zgiw gxo0pTp �0v�gxk r%s=�0oLrcfD� gxhW�%g {c�Zr%qLp p g}�Lpx�Lf�g�qWoLhWgiw k p}{coWh�p lW{%pTp gi�Lp k�%j �%g�uF{%o���g�{%y}l�j oGp lWgxu�k g�� �%gxk�f�g�{���k j �%o�{�� k�p rnp lLgFw g�{chLgxw��ne0p j � �Qp lWg�w g�{chWgxwv` qLhW�%gxk�p gi�Lp k|0qLj yr�,� ��{coLh!gI(�yxj gio0p � ����z lW{%p7j k7p lLg9yxr%oWoLgxyxp j r�o���gxp f�gxgxo!p gi�0pF{coWh�w gx{%hLj oL�gi�0vZgiw j gxoLyxg]qz lW{%pTy�� qWgik y�{coFfTg {ckTk ��k p gxu hWgxk j ��oLgxw k8�LoWh9{coWhFqLp j � j ¤ig]q z rcf y�{%oFf�g�u�gxw ��g+k g��%gxw}{��ZfTgx{���0oLrcfD� gxhW�%g k r�qLw yxgxk4p r�uF{��%g k j uFv7� g+v�r,� {cwTr�w oLg�{cw ) v�r,� {%w#` qWhL�%uFgio0p krq� qLp�p lLg7hLgxyxj k j r�oLk+uF{%hLg��0�nqLk gxw km�Eg��%gxoj s;p lLgx�n��r�j �;hLrcf o�p r9{FvZr�� {cw � f j � �)w g�{ch7 �r�w

� fTr%o a p7w g�{ch� G{cw g9uF{chWg�����fT{��Gr�sU` qLhL��u�gxo�p k�r%o!{�w g�� {%p j �%g�� �GlLj �%l�� g��%g��4r%s�{c�Lk p w}{cyxp j r%oZ�¢ w gx{%hLgxwFf j � �%` qLhW�%g�{p g}�Lp�{%yxyir�w hLj oL�Gp rGj p kF{cqWp lLgxo�p j yxj p �c� j p k�k qLj p}{c�Wj � j p �%�Tj p k |�q�{�� j p �c�4{ckv�gxw yxgij �%gxhZ�zg�u7qLk p4s r%w uF{�� j ¤xg4p lLg k qL�R` gxyxp j �cg7{ck v�gxyxp k+r%s)p gi�0p4y�{cp gx�%r�w j ¤�{cp j r%o=��¢4oWh9j o�vWw}{cyxp j yxg%�Ls r�w

k ��k p gxu>hLgxk j �%oZ��f�g�oWgigxh�p r�j o��cgxk p j ��{cp g�lWr�f p r�yxw g�{cp g9{%oLh�uF{��%g�qLk g�r�s k g��%gxw {�� hLj _�gxw gxo�pj oLhWg}�Lj oL��u�gxp lLr0hWk k j u7q7� p}{coLgxr�qLk � ���¢4oWh�p r�qLoWhLgxw k p {%oLh9w gx{%hLj oL�7��gxp p gxwx�Lf�g�u�qWk p�l�{��%g {�fT{x�Fr�sCqLoLhWgxw k p}{coWhLj oL�7w g�{chWgxw k4{coWh

qLk gxw kQ�Zgip p gxw���zg y�{coWoLr�p;hLj k yxqLk k�w g�{%hLj oL��j o7p lLg4{%�Lk p w {%yxp��Qm o7s {cyxpx���%gxoLgxw}{��WhLgxk j �%oLk�{%w gD� j �%g�� �oLr�pQp r���g qLk gxs q7�Wj o��LqLj � hLj oW�4qWk}{c�7� g k �0k p gxu�k��;p}{%j � r�w j oW�4k �0k p gxu�k�p r {+k v�gxyxj �Ly4k gip�r%s��%r0{�� k;f j � �vLw r��W{c��� ����g+�Zgip p gxw�� � qLp p r7�%gxpTlWgiw g�f�g oLgxgxh9p r7k ��k p gxuF{cp j ¤xg�p lWg {cy�|0qLj k j p j r%oFr�s=�0oLrcfD� gihW�%g{c�Zr%qLp+qWk gxw kx�Zp}{ck �0kx�C{coWhn��r�{�� k��m� g�{%hLgxw k+yxr%u�g�j onuF{co0�9k l�{cv�gxkx�Z�WqLp�p lWgx�n{cw g�oLr�p�� j �%g�� ��p r��g lW{%vLlW{�¤�{cw h9r%w4hLj k r%w �0{coLj ¤xgxhZ�?zg�f j � �Z��g�{c��� g p r7qWoLhWgiw k p}{coWh9p w gxoLhWk+{coWh9p ��vWj yx{��Cy�{ck gxk4j sf�g p w ���

�,� ��bPc^d%e fVg��wi

�5+�����C � = 26F � �� � �

¢�vLj yxp qWw gQk}{���k;u�r�w gQp l�{co�{ p lWr%qLk}{%oLh f�r�w hLk�� � qLj � hLj oL�4{ k ��k p gxu3s r�w){%yiyxgxk k j oW�+oLr%oK) � j oW�%qLj k p j yhW{%p}{ f j � ��s r0yxqLk;r�o�k g��cgxw}{��LvWw r��7� gxu�k)p lW{%p)u�qWk p)�ZgT{chWhLw gxk k gxh�s r%w)p gi�0p q�{��L{%oLh�r�p lLgxwU� j oL�%qWj k p j yk ��k p gxu�k�{ck4fTg�� � �8zg hWr�oWr%p4lW{]�%g w gxyxr%qWw k g�p r�p lLg k lWr%w p ) yxqWp4f�r%w hWk+{W_�r%w h9qWk��D¢4oWhnp lWj ki�Wj os {cyxpx�WuF{��F��g p r7r�qLw4��gxoLg��Lp���p lWg�s {%yip4p lW{%p p gi�0p4yxr%oWk j k p k4r%s;w g�{chWj � ��j hWgio0p j �W{c��� g�f�r%w hLk+f j p lr%���0j r�qLk � �nw gx�%q�� {%wm� r0y�{��QhLgxv�gxoLhWgxoLyxj gik�p r9gx{%y}lGr%p lLgxw yir�q7� h��g�k}{cj hp r9lW{]�%g�� g�{ch'� {coW�%q�{c�%ggxoL��j oWgxgiw j oL�+qLv�p lLg�j u�vWw {%yxp j y�{���vW{%p l�r�s0yxr�u�v�r%k j p j r%oW{��%k gxuF{%o�p j yxk��;|nr%k pU� j �%g�� �%�cp gi�0p;w gxp w j g��%{��{coWhnp gi�Lp�{cyxyxgik k�yx{%oLoWr%p4��g�qLoLhWgxw k p r0r0h�j on{co0��w g�{��)fT{���qWo�p j �)u�r%w g �%gxoLgxw}{��U|0qLgxk p j r%oLkx��g�� ���j uF{c��g�{%yiyxgxk kx�Wl�{��%g ��gxgxo9qWoLhLgxw k p r0r0h9f�g�� �CgxoLr�qL�%lnp r�lW{]�%g ��gxgxonv�r%k gxhZ�� lLg�qWp j � j p �4r%sLp lLg�oLr�p j r�o�r�sLlLr%uFgir�k giu7�%�cj o�p w r0hLqWyxgih7{c��r��%gc�%��gxyxr%uFgik;{�� ��p lWg�u�r�w gQy�� g�{cw gxw

j sQfTg7w}{cj k g7r%qWw�v�gxw k vZgiyxp j �%g7��gx�%r%oWhGp l�{cp�r%s�p gi�0p w gxp w j g��c{��;p rn{cp p gxu�vLp j oL��w gxp w j g��%{��;r%sToLr%oK)p gi�0p qW{���hLrLyiqWu�gxo�p k���m p j k p lLgFp {%k ��r�s8� j oL�%qWj k p k�p r9uF{��%g�r��,�0j r%qWk p lLg�yxr%oWoLgxyxp j r�oG��gxp f�gxgiovLj yxp qLw g�{coLh9p gi�0p��kj rW) r%oLg g�� k g�f j � � �

�5+��� �5:#;%C�> CD98037-4603;�A-= 2

zg�oLgxgxh�p r�k p qLhW�Fp gi�Lp ki�Wk �0k p gxu�kx��{coLh�qWk giw k w g�{chWj oW�7� � lLg.�Lw k p {%oLh�p lLg.� {ck pTr%sCp lLr�k g�p lWw gxgk p qLhL��r��R` gxyxp k+{cw g {cw ��qW{c��� ��� j oL��qLj k p j ym|0qLgxk p j r�oLk�� � lLg k gxyxr%oLhnuF{��F��g��zg�oLgxgxh�p r7qWoLhLgxw k p}{coLhnp gi�Lp k ��gxp p gxw��?zGg�r%����j r%qWk � �FoLgxgxh6[ rJZVQ�p l�{co9p lWg+k �0o�p}{cyxp j y {coWh

k gxuF{co0p j ynu�r0hLg�� k�r%s+p r0h�{x��y�{co rW_�gxw�qWk�� zgnoLgxgxh { �IQIY Y QIZ�k giu�{co0p j y9p lWgir�w ��p lW{%o!f�r�w hr0yxyxqLw w gxoLyxgxk��8zg�{�� k r�oLgxgxh9p r7k p qWhL�Fu�r�w g@X�� r��Vs���p gi�Lp qW{��CvLlWgioWr%u�gxo�{�w {%p lLgxwTp l�{co�p lLg.� r0y�{��j oLs r�w u�{cp j r%oFr�w ��{coWj ¤x{%p j r�o�{%oLhn{%w ��qLu�gxo0p k p qLyxp qLw g�� � rFp lWj k gxoLhnf�g oLgxgxhn�%r0rLh9{%oLh9w g�� j {%�7� gk ��o0p}{cyxp j y�{co�{�� �0k j k.��p lLgFk r%w p�r%s p r0r,� k�p lW{%p7{cw gF��gxj oW�nuF{chWgF{]�%{cj � {c�7� g7p r0h�{x���sz lLj � g�p lLgj u�u�gxhLj {%p gFqLp j � j p �r%s4p lLgxk g9p r0r�� k�s r%w7j oWs r%w uF{%p j r�ow gxp w j g��%{��TvLqWw v�r%k gxk7j k7qWoLy�� gx{%wx�Qp lLgx��{cw g{c�Wk r�� qLp g�� ��oWgxyigxk k}{cw �9s r%w4{co0�Fs qWw p lWgxw k p gxvLk��zg9oLgxgxh!p rqWoLhWgiw k p}{coWh {ck v�gxyxp kFr%sm� {coL��qW{%�%g�qLk gnp lLw r%qW�%l�k p qLhWj gikFr�s4p lWg9vLw}{cyxp j yxg�r�s

l0qLuF{%os|0qLgxk p j r�o{coLk f�gxw j oL��r�qLp k j hWge� {%��r%w}{%p r�w j gxk4w}{%p lWgxw4p l�{conk p qLhW�nr%sQu�r0hWg�� k+r%s?|0qLgxk p j r�o{coWk f�gxw j oW��j o�u�r0hLg��Zf�r�w � hWk��1zg�oWgigxh9p r�qLoWhLgxw k p}{%oLh9lWr�f�qLk gxw k4yxr%u7�Lj oLg.� {%w �%g�{%u�r%qWo�p k r�shW{%p}{4j o�p r {4k j u�v7� g ` qLhL��u�gxo�pQr%sWw g�� g��%{coWyxg���zg oLgxgxh7p r+qLoWhLgxw k p {%oLh�p lLgTyxr�oLyxgxvLp;r�sWw g�� g��%{coLyxg��gxp p giw��¢4oWh�{cs p gxwZvWw r]�0j hLj oL�D�%{cw j r%qWkZfT{���k)r%sLgioWw j y}lWj oL� p lLgQw gxvLw gxk gio0p}{cp j r%o r�s�p gi�Lp kx�%{%oLh gxoLw j y}lLj oL�

r%qWw�qLoWhLgxw k p}{%oLhLj oW��r�s�qLk gxw k {%oLhp lWgxj w�oWgxgihWkx�Cp}{ck �0kx�){%oLh�%r�{�� ki�Cf�g�u�qLk p j u�vLw r��cg7l�qWuF{coK)uF{%y}lLj oLg4hLj {�� r��L�%�0�7�LqWj � hWj oL��k g�{cw y}lFk �0k p gxu�kTp lW{%pQyxr%vZg4f j p lFk qWy}lFgxoLw j y}lLgxhFw gxvLw gxk gxo0p}{cp j r%oLk��

Page 15: Basics of Information Retrieval - Statistics and Linguistics

� � �? "&� �����{�

l � g�� �0j oZ�Z�c�%�%�Wnj j y}lWr�� {ckj|7� � g�� ��j oZ�L���%�%�7�Z�r~+gxk j ��o � w j oLyxj v7� gxkZs r�wC�?� gxyxp w r%oLj y � gi�Lp qW{����4gik r�qLw yxgik��m o,�%gxk p j �0{cp j oL� u4k gxw k�{%oLh<u4k gxk4r%s;eLy}lLr,� {%w � ��m oLs r�w u�{cp j r%o7 ��;m o<j4j yxr�� gxp p {�t {�� ¤xrJ)� {%w j �,¢+o0p r%oLj r #C{%u�v�r,� � j �%{%oLh�|n{%w p l�{ � {�� uFgiwx�0gxhLj p r%w kx�jy��RZIZVQINtY TV\V\��tQV\DL N yUrJ[ po �RY sWY L rJNPs�� �L NRX��RL \IY L qV\��vTIN��8rJN r&�RZ8r ���8rJNPs�� O��5s�� 4wQIZr�Pmm� q0f�gxwx��~+r%w hLw gxy}l�p��

l � g�� �0j oZ�Z�c�%�,�Jnj j y}lWr�� {ck^|7� � g�� �0j oZ�F�c�%�,���¥� ¢+o�r��%giw �0j gif r%s�w gxk q7� p k�s w r�u%�4qLp �%gxw k^aCj o��%gxk p j ��{J)p j r�oLk4r�s;j o�p gxw}{cyxp j �cg�j oLs r�w uF{cp j r%o�w gxp w j g��%{�� 7� m o L \��Ks�� L �^L NRX � � � �^QVqIY ��qVqVQV\V\0�^rJZ �� \IY[yUQINtY �RZ�� TIN%�^rJZI[,sWY L rJN��vQV\-r&�RZVqVQV\����kZ r-qVQVQ OWL NRXJ\ r �8Y �tQ����tY � ��NtN �Ks��0y�� L NtL qrJN #L �^Z sWZ*� �kowo � L q sWY L rJNK\8r ���8sWY s��kZVr-qVQV\V\IL NRX%�LvLv=�W�,gc�0�%�L�WtTlW{cuFvW{cj ��oR) u4w ��{co�{��u oWj �cgxw k j p ��r%s)m � � j oLr%j kTeLy}lLr0r,�Cr%s;~Cj �Lw}{cw ��{coWh9m oLs r�w uF{cp j r%o9e0yxj gioWyxg��

l � gioWoLgxp px�C�c��}0�-n|�~ � gioWoLgxp p��G���,}0�,��� m o�p gxw}{cyxp j �%g��Lj �7� j r%��w {%vLlWj y7k g�{cw y}l�{%k�{ny}lW{�� � gxoL��g�p rnj oR)p gxw s {cyxg�hWgik j �%o� 7�;m o�~+r%opz�{�� �%giwx�LgxhLj p r%wx�tTINtY QIZ sRqIY L �WQ �^L � � L r XWZ sIo��RL qD\-Q sWZVq%�������tQ� \-QIZ !yUrJ[�o �KY QIZDTINtY QIZ �IsRqVQi�LvWvZ�C�x�W���7�7¢m�;m � eZ��|9r�o�p �%{�� g%�Pj gxf |%gxw k gx���

l � gioWoLgxp px�C�c��}%�Wn|~ � gioWoLgxp p�� �c��}%�7� � � lLg9qLk gxw�j o0p gxw s {cyxg�j o�j o0p gxw {%yxp j �%g�k ��k p gxu�k 7� ���vT ���C�}�� ��g%�����������

l � w rLhLhW{L�Z�c�%��tWn� gxoLo0� � w r0hWhW{7�)�c�%�,t��D� ��j u�uFj g |nr%w gm� a � lW{%p ��Zm o � gxp gxw e0gxj v�g�� ��gxhLj p r%wx��� Z rJ[�3sWY s��kZ rJY QVqIY L rJN6Y r �3N r��$� Q O-XRQ��6sRq%�RL N QV\��tj4r�w k p gxhLp kx��eLp r0yr��lWr�� u��

l tTqWp p j oL�6QIYks�� � �C�c�%�%�Wn~+r%qL�,� {ck k�tTqLp p j oW�L�Z~e� m�{%w ��gxwi�v|�{%o � gxhLgxw k gxoC�){coLh |%r�lLo � q7�%gx���7�c�%�%�7� � eLy�{cp )p gxw%����{cp lLgxw��P¢/t8� qLk p gxw ) ��{ck gxh�¢+vLvLw r0{cy}l�p r � w rcf k j oL��~){cw ��g ~+rLyiqWu�gxo�p7tTr,� )� gxyxp j r%oLk ��7m o��UZVr-qVQVQ OWL NRXJ\ r �8Y �tQ �! Y �5TINtY QIZINPsWY L rJNPs���yUrJN%�^QIZ QIN qVQ rJN"�DQV\-Q sWZVq%�sWNPO��8Q��WQ�� rVoP[ QINtY%L N5TIN%�^rJZV[,sWY L rJN��vQIY ZIL Q��Js�� �WtTr�v�gxoLl�{c�%gxoC��~+gioWuF{cw ���7¢+qL��qLk p��¢4t | eLm ��m �.�

l t {�� ¤xr,� {%w j%QIYvs�� � �Z�����c�wnj j yxr�� gxp p}{9t {�� ¤ir,� {cw j �U¢+o�p r%oWj r-#C{cuFv�r�� � j �){coLh�|n{%w p l�{ � {�� u�gxwi�;gxhLj p r%w k��G�����c�7�y��RZVZVQINtY%TV\V\��tQV\@L N¹yUrJ[�o �RY sWY L rJNPs�� �L NRX��RL \IY L qV\��vTVN#�3rJN r&�RZ r ���8rJNPs�� O��5s�� 4wQIZr�mm� q0f�gxwi��~+r�w hLw gxy}l�p��

l ~+gxgxw f�gxk p gxw,QIYks�� � �Z�c�%�,tJne0yxr%p p ~+gigxw f�gxk p giwx�4eLqLk}{co � �1~+qWuF{cj kx�8��gxr%w �%gpz �1�WqLw oW{%kx� � lWr%uF{%k,mP�Q~){coK)

k j k��d�%$tr&�RZINPs��#r �@Y �tQ ��[ QIZIL q sWN � r-qIL QIY �,�^rJZ�TVN%�^rJZI[,sWY L rJN � qIL QIN qVQi�L�W��� ���0�x���,t,}��l ~+qWuF{cj k3QIYvs�� � �Z������}Wn

e0qLk}{%o � ��~+qWuF{cj kx� � r0hLhd¢e�c~Cgxp k y}lWgc��|nj y}l�{cg��0~?��~Cj p p uF{%oZ�c{coWh � lLr�uF{ck#mP��~){coK)hW{cqWgxw��7������}��p� ¢+qLp r%u�{cp j y�tTw r%k k ) ~){coW�%q�{c�%gP� gxp w j g��%{��%u k j oL�9~C{%p gio0p�e0gxuF{%o�p j ym oLhLgi�Lj oL�� ��;m o�&3rJY QV\.�VZ rJ[ �����DT �WoPZIL NRX �{�J[�otr-\IL �K[�rJN y�Z r-\V\Ip sWNRX��Ks-XRQ'�tQ SWYsWNPO �WotQVQVq%�'�DQIY ZVL Q��Js�� ��e0p}{coWs r%w h<u oWj �cgxw k j p �c��t {�� j s r�w oLj {���¢m¢m¢+mr�

l �Qo7����j k px�C�c��}��Jnj j � k+�;w j ���Qo7����j k p��+�c��}%�7�� �L NRX��RL \IY L q �tY �&� L \IY L qV\��T|nr%qWp r�oZ� � lLg z {%�%qLg%� j4gip lWgiw )� {%oLhWk��

l ��{c�0{coZ�C���,�%�Jn|%r0g��C~?����{c��{%oZ�T���,�%�7�m� � lLg �%_�gxyxp j �%gxoLgxk k+r%s;{ j r�oLk �0o�p}{cyxp j y.¢+vWvLw r�{%y}l�p r�¢4qK)p r�uF{cp j y � lWw}{ck g�m oLhWg}�Lj oL��s r%wD~+r0yxqLuFgio0pD�4gip w j g��c{�� ���$tr&�RZINPs��#r ��Y �tQ ��[ QIZVL q sWN� r-qIL QIY �,�^rJZ�TVN%�^rJZI[,sWY L rJN � qIL QIN qVQi�L��t�� ���]gc�W�������

l ��w j k lLuF{%oZ�Z�����%�Wn�4{�� vLl ��w j k lLuF{%oZ� ������g�� � � lWg j �3u k �0k p gxu s r�w9|<u+tU) �0�+r�wpz lLgxw gWa k9p lLge0�0o�p}{���q] 7��m o � gxp l�e0qLoWhLlWgij u9�WgxhLj p r%wx�(�kZ r-qVQVQ OWL NRXJ\ r ��Y �tQ�)JY �*� � y��

l ��w j k lLuF{%o9{coWhne0p gxw � j oW�L�Z������tJn�4{�� vLl � w j k lLu�{co {%oLh�|%r%lWoOeLp gxw � j oL�7� ���%�,t��%� m oWs r%w uF{cp j r%oO�)�Lp w}{cyxp j r�oO{coWhe0gxuF{co0p j y9tTr%oLk p w}{cj o0p k ���m o z {%oLk m�{%w � ��w gxoC�QgxhLj p r%wx�%�kZVr-qVQVQ OWL NRXJ\5r �GY �tQ � �WY �TVNtY QIZVNPsWY L rJNPs��[yUrJN%�^QIZVQIN qVQ<rJN�yUrJ[�o �KY sWY L rJNPs�� �L NRX��RL \IY L qV\i� z g�� k j o7�0j �1�;j o7� {coWhZ�¢4qW�%qWk p���m t t ~��

l z {coWk gioC�C�c�%�,}Jn� w gx��gxo z {coWk gxo=� ������}�� � ¢+o g}�Lv7� r�w {%p r%w ��k p qLhL�!r�s�m � j o�p gxw}{cyxp j r%o!s r�wFqWk gxwj o0p gxw s {%yxg9hLgxk j �%o7 ��!m o+�kZ r-qVQVQ OWL NRXJ\6r � Y �tQ �, Y � TINtY QIZINPsWY L rJNPs��^yUrJN%�^QIZ QIN qVQ6rJN�vQV\-Q sWZVq%�<sWNPO�� Q��WQ�� rVoP[ QINtY%L N5TVN%�^rJZI[,sWY L rJN��DQIY ZVL Q��Js�� � � lLj � {chWg�� vWlLj {0� � gxoWoLk �,� )�c{%oLj {0�{|%q7� ����¢4t | e0m ��m �d� � r�k p gxw vLw gxk gxo�p}{cp j r%oC�Lf j p l9{%�Lk p w {%yxpTj oFvWw rLyigxgxhLj oW�%k��~Zr�oL���%gxw k j r�on{��%{cj � {c��� g+{%k���e0m t e � gxy}lLoWj y�{��U� gxv�r�w p � ��}�� t%���

l z {cw w j kx�Z���,g��Wn#Zg�� � j � z {cw w j k��T���,g��7�.� ~Cj oL��qLj k p j y � w}{coWk s r%w uF{cp j r%oWkTs r�wTm oLs r�w uF{cp j r%o�� gxp w j g��c{�� 7�m o-�kZVr-qVQVQ OWL NRXJ\ r �6Y �tQ<TINtY QIZINPsWY L rJNPs��¨yUrJN%�^QIZ QIN qVQ�rJN � qIL QINtY L xkqGTIN%�^rJZI[,sWY L rJNW�zG{ck lLj oW�%p r%oC��~�tm�

l z {cw uF{%oZ�C���%�L�^n~+r%oLo�{ z {cw uF{%oZ�L�c�%�L���=� z r�f��%_�gxyip j �%g�j k)eLqK(7�0j oW�,q] 7��$tr&�RZINPs��Kr �UY �tQ �@[ QIZIL q sWN� r-qIL QIY �,�^rJZ�TVN%�^rJZI[,sWY L rJN � qIL QIN qVQi�L�0��� }c�W��g��

l z g�{cw k px�C���%�%�%�tn|n{cw p j z g�{cw k p��7�c�%�%��{����}tTr%o0p g}�Lp.¢+oLhGe0p w qLyxp qLw g7m o¥¢+qLp r%u�{cp gxh'�Lq�� � ) � gi�Lp4m oK)s r%w uF{cp j r%o(¢+yxyxgik k 7��~+r0yxp r%w�r%s � lWj � r�k r%vLl0� � lLgxk j ki�ku4oLj �%gxw k j p �Gr�s4t {�� j s r�w oLj {0�� gxw �cg�� gx�%��t {�� j s r�w oWj {��

l z g�{cw k px�C���%�%��{Wn|n{cw p j z g�{%w k p��+�����c�%�=�e� |nq7� p j ) � {%w {%�%w}{cvWl9eLgx�%u�gxo0p {%p j r�o�r�sQ�)�Lv�r%k j p r%w � � gi�Lp ��m o��UZVr-qVQVQ OWL NRXJ\3r �@Y �tQ.� NPO���NtN �Ks��(� QVQIY L NRXGr ��Y �tQ���\V\-r-qIL sWY L rJN��^rJZ yUrJ[�o �RY sWpY L rJNPs�� #L NRX��KL \IY L qV\i�W~){ck+tTw qLk gxki� j4gxf3|9gi�Lj yirW�®|%qLoWg���¢4t ~?�

/� / �10� ���2�3 g0�

l z g�{cw k px�C���%�,}Jn|n{cw p j z g�{cw k p�� �c�%�,}�� � � gi�Lp � j � j oL����eLgi��u�gxo�p j oL� � g}�Lp�j o0p r|nq7� p j ) � {%w {%�%w}{cvWle0qL�Wp r%vLj y � {ck k}{c�%gxk 7�¨yUrJ[�o �RY sWY L rJNPs�� #L NRX��RL \IY L qV\i�W���

l z {coWk gio�{%oLh<m�{%w � ��w gxoC�Z������}Wn� w gx��gxo z {coWk gio�{coWh |%qWk k jvm�{%w � ��w gxo=�9����������� m o�p gxw}{cyxp j �0j p �{coWhm o0p gxw {%yxp j r�o7 7�m o � w gx��gxo z {coWk gioC�WgxhLj p r%wx�(�UZVr-qVQVQ OWL NRXJ\8r �54kL X �RY �'�64 %7��8�<rJZ54-\%�trVo�rJN � \-QIZTVNtY QIZ �IsRqVQV\3L N#�@L XWL Y s�� #L �^Z sWZVL QV\i�WvLv=�����W���%��~59{%oL�%lWr�� u�gxoZ�W�1�TtTm |(�

l z g�{cw k p4{%oLh � � {cqWo�px�Z�c�%���Jn|n{cw p j z g�{cw k p7{coLh�tTlWw j k p j {co � � {%qLo0p����c�%�������}e0qW�Lp r%vWj y�e0p w qLyxp qLw j oL�ns r%we�Wq7� � )� gxoW�%p l<~+r0yxqWu�gxo�p�¢+yxyxgxk k ���m o+�kZVr-qVQVQ OWL NRXJ\6r �GY �tQ � )JY � TINtY QIZVNPsWY L rJNPs��^yUrJNtp�^QIZ QIN qVQ rJN#�DQV\-Q sWZ q%�<sWNPO��8Q��WQ�� rVoP[ QINtYUL N5TIN%�^rJZV[,sWY L rJN#�vQIY ZVL Q��Js�� � � j p p k �WqLw �%lC�� gxoWoLk �,� �%{coWj {L�®|%qLoWg���¢4t |�e0m ��m �d�

l z gxh7� qLoWh QIYks�� � ����t�t,tJn� qLw j h z gxh�� qWoLhC��¢+w j � j w �%r�� {0�F{coWh�m {�� gxw �%r�| �{%w �cg�� j oZ���,t�t�t7� � ¢4k v�gxyxp kGr�se0f�gxhLj k l�|9r�w vWlLr,� r��%�F{%oLhne0gxuF{%o�p j yxk s w r�u {co9m oLs r�w uF{cp j r%o�� gxp w j g��c{�� � gxw k v�gxyI)p j �%g� 7� � gxy}lWoLj y�{��Qw gxv�r%w px�U~+gxvW{cw p u�gxo0p�r%s�m oWs r%w uF{cp j r%oe0yxj gxoLyxg%� � {cuFv�gxw g,u4oWj )�cgxw k j p �c� � {%u�v�gxw gc���;j o7� {coWhZ�

l z j � �%QIYvs�� � �Z������gWnz j � � z j � � �C~C{%w w �e0p g�{chZ�;|n{%w �¥� r�k gxoWk p gxj oZ�;{%oLh(� gir�w �%g��WqLw oW{%k��9������g7�'� � gxyI)r%u�u�gxoWhLj oL�G{coWh!���%{�� q�{cp j oL�tTlLr�j yigxk�j o!{ �+j w p q�{��4tTr%uFu�qLoWj p �r�s@u k g� 7�!m o� �R[,sWN8� sRqIY rJZV\5L N�yUrJ[�o �RY L NRX �{�-\IY QI[8\��}y:�DT<; = �}yUrJN%�^QIZVQIN qVQ*�UZVr-qVQVQ OWL NRXJ\i�vLvZ�C�c�c�%�0��tL�%��~+gxo,�%gxwx��tTr,� r%w}{chWrL�7¢+vWw j � �7¢4t |'�

l z {-` j �yxr�� �{<QIYvs�� � �Z������gWn���%{ z {-` j �yxr�� �{L� z {%oW{Fe7�%r%qLu�{�� r]���{0�C{coLh � gip w�e0�0{�� � ���c�%�,g�� � � lLg��+w �0{coLj ¤�{cp j r%o{coLh u4k g7r%s�m oLs r�w uF{cp j r%o=�D¢4o¥¢+qWp r�uF{cp j y � w r0yxgihWqLw g7s r%w � r%vWj yV) �Wr0yxqLk+m hLgxo0p j �K)yx{%p j r�o7 ��^yUrJ[�o �RY sWY L rJNPs�� #L NRX��RL \IY L qV\i�W�0�,� �0�x�0�,g��

l eLvW{cw yr�}|%r�oLgxk4{%oLh<m {��c�C�c��}��Jnm�{%w gxo e0v�{cw yr�£|%r%oLgxk�{coWh!|n{%w p j o m {����3���,}%��� �L NRX��RL \IY L qV\<sWNPO6TVN%�^rJZI[,sWY L rJN� qIL QIN qVQ��?¢4y�{%hLgxu�j y � w gxk kx�Pj4gxf ��r%w ���

l eLvW{cw yr�}|%r�oLgxk4{%oLh<m {��c�C�c��}��Jnm�{%w gxo�eLvW{cw yr� |%r%oWgxk7{coWh�|n{%w p j o m {��������,}%���<�}~Zj oL��qLj k p j yxk�{%oLh�m oWs r%w uF{cp j r%oe0yxj gioWyxg��P¢ � r%k p k yxw j vWp ���m o�~+r�oW{�� hG�D�UzG{�� �cgxwx� z {coLk m {cw � �%w gxoZ�;{%oLh�|n{%w p j om�{��%�ZgxhLj p r%w kx�:&@sWY �RZ s�� sWNRX��Ks-XRQ8L N<TIN%�^rJZI[,sWY L rJN��vQIY ZIL Q��Js���p%�DQIZ \ otQVqIY L �WQV\,sWNPO�@L ZVQVqIY L rJNK\=�^rJZ6�vQV\-Q sWZVq%���We7��w j vLp r�wi��e0p r0yr�0lLr,� us�

l |%qWk p gxk r%o�{coWh<m {cp ¤%�Z������gWn|%r%lLoGe��v|%qWk p gxk r%oG{coWhe7� {]�%{F|'� m {cp ¤��7�c�%�,g��p� � gxy}lLoWj y�{�� � gxw u�j oLr,� r��%��� k r�u�g� j oW�%qLj k p j y�vWw r%v�gxw p j gxk�{coLh {co�{�� ��r%w j p lWu s r�w7j hLgxo�p j �Ly�{%p j r�oGj o�p g}�Lp�� 7�<&@sWY �RZ s�� sWNRX��Ks-XRQ64kNRXWL N QVQIZIL NRX%���,� ���L��}7�

l eLvW{cw yr�}|%r�oLgxkx�C����}��Jnm�{%w gxoGeLvW{%w yr� |%r�oLgxk����c��}����'� ¢ k p}{cp j k p j y�{��;j o�p gxw vLw gxp}{cp j r%or%s�p gxw u k v�gxyxj �Wyxj p �{coLhnj p k4{%vLv7� j y�{cp j r%o�j o9w gxp w j g��c{�� 7�>$tr&�RZINPs��#r ��� r-q��R[ QINtY sWY L rJNW�W���7� �%�x�0�,t��

g%� / / �60 ���2�3

l eLvW{cw yr�}|%r�oLgxkx�C���%���Jnm�{%w gxoGeLvW{%w yr� |%r�oLgxk��9�����%�7�¥� z l�{cp j k�p lWg7w r,� g7r�skj+~ � j o � gi�0pe� gxp w j g��%{�� q] 7�m o � r�u�g�� e0p w ¤x{�� �crcf k ��j �FgxhLj p r%wx�*&@sWY �RZ s��� sWNRX��ts-XRQ�TVN%�^rJZI[,sWY L rJN�DQIY ZVL Q��Js�� �mm� q0f�gxwi� � r%k p r%o=�

l |�{%y�|0qLgxu�j on{coWh � ¤xr%q7�%gxw uF{coWoZ�)�����%�JntTlLw j k�|�{%y�|0qLgxu�j o�{%oLh��?�%g�� �0o � ¤xr%q7�%gxw uF{coWoZ� �����%��� �Vj+~ � s r%w3p gxw u�c{%w j {%o�p�gi�Lp w}{%yip j r%o=� eL��oWgxw ���3�Zgip fTgigxo |9r%w vWlLr�� r��%�%�7~Cgi�0j yxr%o {%oLh eL��o0p}{��7 7�m o � r�u�g�� e0p w ¤x{�� �crcf k ��j �FgxhLj p r%wx�*&@sWY �RZ s��� sWNRX��ts-XRQ�TVN%�^rJZI[,sWY L rJN�DQIY ZVL Q��Js�� �mm� q0f�gxwi� � r%k p r%o=�

l m��{�� � �%w gxoZ�Z���,}��Wn��qLoWoLg��%m��{�� � �%w gxoZ�7�c��}��7���r~+gxgivt {%k gc� � g}�Lp�e0qLw s {%yig%�){%oLh�m oLs r�w uF{cp j r%o�e0p w qLyI)p qWw g� ��>&8rJZ OWL q1$tr&�RZINPs��#r � �L NRX��RL \IY L qV\i�Z�,� �x�0��������}7�

l m��{�� � �%w gxoZ�Z���,}%�Wn��qLoWoLg��%m��{�� � �%w gxoZ�7�c��}%�7�3TINtN Q%�6?s�� �#LkY Q SWY �.7kZ O6r-q%� �tY L � �!� ��e0p qWhLgxo�p � j p p gxw}{cp qWwi�~ZqWoLhZ�

l z {coWkDm {cw � �%w gxoZ�C���,}�gJnz {%oLkUm {cw � �%w gxoZ�Z���,}�g7��� � gi�0p�tTr%oWoLgi�0j �0j p ��{%oLhPzr%w h��Ww g�|0qLgxoLyx�P~+j k p w j �LqWp j r�o7 ��m o z 9{��c{%o�� j oW�%��r�u9�LgihWj p r�wx� �tY �&� Q8sWNPO@�PQ SWY%A �tY �KOWL QV\voPZVQV\-QINtY Q O,Y r�&�L � \64kZIL 44UN4F�-L \IY ��e7��w j vLp r�wi��e0p r0yr�0lLr,� un�We0fTgihWgxoZ�

l z {coWkDm {cw � �%w gxoZ�C���,}%�Jnz {%oLk5m {cw � �%w gxoZ� ����}���� � z r�u�gxr%k gxu����C��o p lLg�~Cj oL��qLj k p j yxk�r�s�m oWs r%w uF{cp j r%o� gxp w j g��c{�� 7��m o(~+r%oW{�� h��D�ZzG{�� �%gxwx� z {coWk3m�{%w � ��w gioC�C{coLhG|n{%w p j o m�{��%�CgihWj p r�w ki�&@sWY �RZ s�� sWNRX��Ks-XRQ�L N TIN%�^rJZI[,sWY L rJN'�DQIY ZVL Q��Js�� p��DQIZV\ otQVqIY L �WQV\@sWNPO.�@L ZVQVqIY L rJNK\!�^rJZ�vQV\-Q sWZVq%���We7��w j vLp r%wx��e0p r0yr�0lLr�� u��

l z {coWkDm {cw � �%w gxoZ�C���,��}Jnz {%oLk8m {cw � �%w gxoZ�9���,��}7�'�}|n{��0j oL�s� r0r0h�u k g�r�s � rLr%w � w}{coLk � {cp j r%oWk 7� TVNtY QIZVNPsWpY L rJNPs��B�#rJZ��R[C7kN5TVN%�^rJZI[,sWY L rJN��NPO��8r-q��K[ QINtY sWY L rJNW�Z�c���

l m {cw � �%w gxoZ�C���%�,tJn|%qLk k jkm�{%w � ��w gio=�9������t7�(� ¢+o(¢m� ��gx�Lw}{�s r%we� gxyxr%u�uFgioWhW{%p j r�oLk 7� � gxy}lLoWj y�{��8� gI)v�r%w p+�]}��0�We0�0k � {%�Z��~+gxvW{%w p u�gxo0pTr%s)tTr%uFvLqLp gxw {coWh9e0�0k p gxu/e0yxj gxoLyxgxki��eLp r0yr��lWr�� uu oWj �cgxw k j p �c�Ze0p r0yr�0lLr,� u9�We0f�gxhLgxo=�

l m {cw � �%w gxoZ�C���%�%�%�tn|%qLk k jkm�{%w � ��w gio=�n���%�%�7�(�Vj4gif k ��w r�qLv�t8� qWk p gxw j oL� � {ck gxh��+o u4k giw � gil�{��0j r%w.�¢��4giyxr�u�u�gxoLh�{cp j r%o�¢m� �%gx�Lw}{� 7� � gxy}lWoLj y�{���� gxv�r�w p � �%�,t,tc�L�Ce0m t e��Ce0p r0yr�0lLr�� u9�e0f�gxhLgxoC�Z�Lgx�Ww q�{cw ���

l m {cp ¤%�C�����%�Jne�� {��%{5m {cp ¤��n���%�����(�r~+j k p w j �LqWp j r�onr%sTyxr%o0p gxo�p�f�r�w hWk�{coWhGvLlLw}{%k gxk�j o�p gi�Lp�{coWh� {%oL��qW{c��g�u�r0hWg�� � j oL�, 7��&@sWY �RZ s�� sWNRX��Ks-XRQ64UNRXWL N QVQIZIL NRX%�W�7� �]gc�0��t7�

l m�r0gxoLgxuF{%oLon{coLh � g�� ��j oZ�C�����%�Jn| �qWw ��gxo<m�r0gxoLgxuF{%oLo�{coWh6j j y}lWr�� {ck�|7� � g�� �0j oZ�����%�����P� ¢ t {ck gP�Lr�w m o0p giw}{%yip j r%o=�¢ e0p qLhW�Gr%s+m o�p gxw}{cyxp j �%g9m oLs r�w u�{cp j r%o��4gip w j g��c{�� � gxlW{]��j r%w�{%oLh!��_Zgiyxp j �%gioWgxk k ��

Page 16: Basics of Information Retrieval - Statistics and Linguistics

rVoP[ QINtY%L NGTIN%�^rJZV[,sWY L rJN*�vQIY ZVL Q��Js�� �LvLv=�W�,t�g��L�0�c�0��#CqLw j y}lZ�We0f j p ¤xgxw � {%oLhZ�7¢+qL��qLk p��¢4t | eLm ��m �.�

l m {cw � �%w gxo9{%oLhs�Lw}{%o7¤ �gxoZ�C������}Wn|%qLk k jkm {cw � �%w gxoG{%oLh m+w j k p r%s gxwd�Ww}{co�¤ �gxo=���c�%��}7��� �Qgiw ��r�k j p �{%oLhGm o0p gxw s {cyxgp~+gI)k j ��o7 7� � giy}lWoLj y�{���� gxv�r%w p4�L�We0m t eZ�

l m�j gis gxwx�Z�c���,tJn�Lgxw gxoLy6m�j gxs giwx� gihWj p r�w��3�c����t7��� �tQV\IY L rJNK\6sWNPO���NK\4�kQIZ \�� � gxj hLg�� �D~+r�w hWw giy}l0px�z r,� � {%oLh=�

l m�r%k �%gxoLoLj gxu�j �Z�c�%���Jnm+j u�u�r�m�r%k �%gioWoLj gxu�j � �����%�7�4� �)j oWj p g9k p {%p g9uFr%w vLlWr�� r%���Gj o!j oWs r%w uF{%p j r�o�w gI)p w j g��c{�� 7��&3sWY �RZ s�� sWNRX��Ks-XRQ64kNRXWL N QVQIZIL NRX%�L�7�

l m�w}{%{cj ` {coWh � r%l7� uF{%oLoC���c�%���Jnzgxk k g��Dm�w {�{cj ` {%oLh�� gxo �gxg � r%l7� uF{%oLo=�G�����%�7�C� �+j gxf j oL�e0p gxu�u�j oL��{ckP�4giy�{�� ��;oWlW{coWyxgiuFgio0p 7�+m o"�UZVr-qVQVQ OWL NRXJ\,r �@Y �tQ � =WY � TINtY QIZINPsWY L rJNPs��0yUrJN%�^QIZ QIN qVQ rJN��DQIp\-Q sWZ q%�6sWNPO'�8Q��WQ�� rVoP[ QINtYkL N5TIN%�^rJZI[,sWY L rJN#�vQIY ZVL Q��Js�� � #��qLw j y}lZ�Ze0f j p ¤xgxw � {%oLhZ�Z¢4qK)�%qLk p���¢4t |�e0m ��m �d�

l z {coWkDm {cw � �%w gxon{coLhs~+r%o�{�� hpzG{�� �%gxwx�C���,��tJnz {%oLkDm {cw � �%w gxo�{%oLh�~+r%o�{�� h���zG{�� �%gxw��T�����,t��m� � lLg � r,� ��p gi�0p4eL��k p gxu�)?¢ j4gxf~+gik j �%oFs r%w�{ � gi�Lp8� gxp w j g��%{���eL��k p gxu� 7�Zm op�Lgxw gxoLy�m+j gxs gxwx��gxhLj p r%wx��� �tQV\IY L rJNK\�sWNPO��NK\4�kQIZ \���� gxj hWg�� ��~+r%w hLw gxy}l0pi� z r,� � {%oLhZ�

l m�j u���gxw3QIYvs�� � �C���%�,gJn~+r%oW{�� h�m�j u���gxwx�Q~Z�0oLo�z j � yir��Z���Ww}{coWyij oWgFtTlWgxoZ�T{coLh � lLr�uF{ck�|9r%w}{%oZ�G������g��� e0vZgx{��%giw�eLgx�%u�gxo0p {%p j r�o�s r%w � w rcf k j oW�.� gxyxr%w hLgxhP¢+qLhWj r� 7�Lm o'� �K[,sWN��#sRqIY rJZ \vL NyUrJ[�o �RY L NRX �{�-\IY QI[8\���y:�vT�; = �,yUrJN%�^QIZ QIN qVQ¨yUrJ[�oKsWNtL rJNW��vLv=�L�0�c���L�0���L��~+gxo��%giwx�tTr�� r%w}{chWrL��¢4vWw j � �7¢4t |'�

l ~){cl0p j oWgxoZ�C�������Wn� j uFrn~){cl0p j oLgxoZ��c�%�,���C� � lLg5u4k g�r%s4{coGm oWhLgi� � gxw u tTr�w vWqLk7p r'~+g��cg�� r%v�{com oLhLgi�Lgxw ��Qm o��kZ r-qVQVQ OWL NRXJ\8r ��Y �tQ yUrJN%�^QIZVQIN qVQ3rJN¹yUrJ[�o �RY sWY L rJNPs�� �L NRX��RL \IY L qV\3L NY �tQ6&3QIY �tQIZ�� sWNPOJ\��

l ~CqLlWoZ�C���,g�}Wnz {%oLk � gxp giwn~CqLlLo=� ���,g�}7� � ¢ eLp}{cp j k p j y�{���¢+vWvLw r�{%y}l p r�|9gxy}l�{coLj y�{�� �QoLyxr0hK)j oW��{coLh�k gx{%w y}lLj oL��r%s ~Cj p giw}{%w ��m oWs r%w uF{%p j r�o7 7�5T�>� $Kr&�KZVNPs��vr �.�DQV\-Q sWZVq%��sWNPO�8Q��WQ�� rVoP[ QINtY �Z��� ��t%�c�0�L�]}��

l ~CqLlWoZ�C���,g��Wnz {%oLk � gxp gxw ~CqLlWoZ���c��g��7��� � lLgm¢+qLp r%u�{cp j y+tTw gx{%p j r�oFr%s)~Cj p gxw}{cp qLw gm¢+�Lk p w}{cyxp k ��T %� $tr&�RZVNPs���r ���vQV\-Q sWZVq%�5sWNPO��8Q��WQ�� rVoP[ QINtY �W�7� �]g����W�c��g7�

l ~CqLlWoZ�C���,g%�Wnz {%oLk � gip gxw9~CqLlLo=� ����g����%� ¢+qLp rJ) �QoLyxr0hLj oW��r%se~+r0yxqLu�gxo0p k�s r�wFm oWs r%w uF{cp j r%o� gxp w j g��c{��;e0�0k p giuFk ���m o|(� � r�{�¤%��gxhWj p r�wi�:� r^ORQIZIN+�KZVQINPOJ\3L N"�8r-q��K[ QINtY sWY L rJNW�vLvZ�W��g��7g���� � giw �0{cu�r�o � w gik kx�Z~Zr�oLhLr�oZ�

|n{c��o�qWk9|9gxw �%g�� � �c�%�%�7� � NPORQIZV\IY sWNPOWL NRX�sWNPO�QIN �KsWN qIL NRX Y Z sWNK\�� sWY L rJN �8�5oKsWZIps�� � Q��@Y Q SWY3oPZ r-qVQV\V\IL NRX�� ~+gxvW{%w p u�gxo0p9r%s�tTr%u�vWqLp gxwn{coWh�m oLs r%w uF{%p j r�o�e0yxj gxoLyxg%�~Zj o7� �r%vWj oL�%k qWoLj �%gxw k j p gxpi��~Cj o7� �r%vWj oW�L��e0f�gxhLgxo=�

l |ngiw �%g��vQIYks�� � �C���%�%�Wn|n{c��o�qWk�|9gxw �cg�� � � gxw o0p<j4j � k k r�oZ��{coWh3~C{%w ks¢4lWw gio0��gxw �7� ���%�%�7��� ¢ � lLw}{%k gI)� gxp w j g��c{��0eL��k p gxu � {%k gih7r�oP� gxyiqWw w gxoWyig� ��0m o'�UZVr-qVQVQ OWL NRXJ\Dr �UY �tQ � QVqVrJNPO���NtN �ts���<rJZ 4-\%�trVo rJN+PQIZ*� sWZ XRQ yUrJZ otrJZ s%�tm��%r%p rL�®|�{cv�{coZ�

l � {cw hZ�C������}Jn~+r%qL�,� {ckez ��� {cw hZ�����%�,}�� � e0vZgigxy}lK) � {ck gxh�m oWs r%w uF{%p j r�o(� gxp w j g��%{���s r�we~+j ��j p}{��~Zj �Lw}{%w j gxk 7�Cm o#&3rJY QV\!�VZVrJ[ ������T��WoPZIL NRX �{�W[�otr-\IL �R[�rJN y�ZVr-\V\Ip sWNRX��ts-XRQ��tQ SWYsWNPO �WotQVQVq%�'�DQIY ZVL Q��Js�� ��e0p}{coWs r%w h<u oWj �cgxw k j p �c��t {�� j s r�w oLj {���¢m¢m¢+mr�

l � {cw hn{coLh¥� gxk oWj �W�C�c�%�%�Wn~+r%qL�,� {ck�z �Z� {cw h{coLh � lWj � j vs�4gik oWj ���������%��� � eLqLvWv�r%w p+s r%w4m o0p gxw {%yxp j �%g�~+r0yxqR)u�gxo�p4e0g�� giyxp j r%o�j o9tTw r%k k ) ~){coW�%q�{c�%g�m oLs r�w u�{cp j r%o � gxp w j g��%{�� ��#TVN%�^rJZI[,sWY L rJN*�kZVrJpqVQV\V\IL NRX sWNPO�� sWNPs-XRQI[ QINtY �W�,g�� ���%���L��}����

l � {ck k r%oWoLg�{cq�{%oLhn~Cj p u�{coZ�Z�c�%�%�Wn� gx��gxyiy�{�|7� � {ck k r%oWoLg�{cq�{coLh�~+j {%oLg |7�;~Zj p uF{%oZ�F�c�%�����(� m o0p gxo0p j r�oR) �W{%k gih�eLgi�W)u�gxo�p}{cp j r%o=� z qLuF{%oC� g�� j {c�Lj � j p �{%oLh tTr%w w g�� {cp j r%o�f j p l ~Cj oW�%qWj k p j y�tTqWgik �� m o�UZVr-qVQVQ OWL NRXJ\�r �kY �tQ5� � \IY ��NtN �Ks���� QVQIY L NRX r �vY �tQ �@\V\-r-qIL sWY L rJN��^rJZ[yUrJ[�o �RY sWY L rJNPs�� #L NRX��RL \IY L qV\i��tTr�� qLu7�LqLkx���+lWj rW�{|%qWoLg���¢4t ~��

l � r%w p gxwx�C�����,tJn|'���1� � r�w p gxw��W�c���,t��=� ¢+o�{�� ��r%w j p lLuOs r�wCk qt(���k p w j vWvLj oL�, 7���UZVr XWZ sW[7�����7� �c��t������,}��

l � r%vZr]�0j y {%oLh�z j � � gip px���c�%�%�Wn|9j w �cr � r%vZr]�0j y�{%oLh � gxp gxwmz j � � gxp p��+���%������� � lLg�g^_�gxyxp j �%gxoLgxk k�r%sQk p gxu�uFj oW�7s r�woW{cp qWw {�� ) � {%oL�%q�{c��g�{cyxyxgxk k p r9e�� r��cgxoWg7p gi�Lp qW{��QhW{%p {� 7��$Kr&�KZVNPs��Ur �8Y �tQ��@[ QIZIL q sWN� r-qIL QIY �,�^rJZ�TVN%�^rJZI[,sWY L rJN � qIL QIN qVQi�L�0��� �,�c�%�0�%�,t��

l � r�k g {%oLhntTqWp p j oL�W�Z�c�%�%�Wn~�{coLj g��+�8�8�4r%k g�{coLh ~+r%qW��� {ck k �.� tTqLp p j oW�7� �����%���f� �+{co7�0j oL�Gs r%wGu k}{%�Lj � j p ����;oWlW{coWyxgih��4gip w j g��c{��Qs r%w�eLlLr%w pe��qLgxw j gxk �� � gxy}lLoWj y�{��8� gxv�r%w pd¢+vWv7� g � gxy}lLoWj yx{��� gxv�r%w p4o�qWu���gxw ���%�L�7¢+vLv�� g tTr%u�vWqLp gxw m oWy�� ��tTqLv�gxw p j oWrL��t {�� j s r�w oWj {��

l � gx�0oW{%wi�C�c�%�%�Wn|%gI_Zw gx��tm�Z� gx�0oW{%w����c�%�c��� � ¢+o¥¢4qWp r%uF{%p j y�|ngxp lWr0hnr�s1�)j oLhWj oL� � r�vLj y � r�qLoLhK){cw j gik ���m o+�UZVr-qVQVQ OWL NRXJ\<r � Y �tQ#� NPO���NtN �Ks���� QVQIY L NRX�r � Y �tQ ��\V\-r-qIL sWY L rJN��^rJZyUrJ[�o �RY sWY L rJNPs�� #L NRX��RL \IY L qV\i��~C{%k4tTw qWk gikx� j4gxf3|9gi�Lj yxrW�®|%qLoLg���¢4t ~��

l � j oW�%��r�u9�Z����},gJnz 9{��c{%o'�4j oW�%��r�u9�ZgxhLj p r%w��F����},g�� �tY �&� Q sWNPO �tQ SWY6A �tY �KOWL QV\@oPZ QV\-QINtY Q O5Y r*&@L � \4UZIL 4�4UN4F�-L \IY ��e��0w j vWp r�wx�We0p r0yr�0lLr,� u9�WeLf�gxhLgxoZ�

l � gxk oLj yr��QIYks�� � �C�����c�Wn� {%q7��� gxk oLj yr���Wj4gxr%vLl0�0p r�kCm {%yxr]�%r%qC�%|9j p gxk l eLqLy}lW{��W� � gxp giw � gxw �%k p w �r%u9�c{%oLh�|%r%lWo� j gih�� �������c�7��� � w r�qLv�~ZgxoLk��U¢+o��+v�gxoP¢4w y}lWj p gxy}l0p qWw g s r%w;tTr,� � {%��r%w}{cp j �%g1�)j � p giw j oL�r%s j4gxp oLgxf k 7�Zm o��UZVr-qVQVQ OWL NRXJ\�r �vY �tQ��¨y:�yUrJN%�^QIZ QIN qVQ@rJN yUrJ[�o �RY QIZ � �-owotrJZVY Q OyUr-rVotQIZ sWY L �WQ#�<rJZ54c��tTlW{cvZg�� z j � � �Kj4r%w p lnt {cw r�� j oW{L�7��yip r���gxw���¢4t |(�

/� / �10� ���2�3 g�g

l � r���gxw p k r�on{coWh9eLvW{cw yr�}|%r�oLgxkx�C�c��}%�Wne��Q�8�?� r%��gxw p k r%o�{coWh m {cw gxo�eLvW{cw yr� |%r%oWgxk������,}%���<� � g�� g��c{%oLyxg zgxj ��l�p j oL�nr�se0g�{cw y}l � gxw uFk ��@$tr&�RZINPs��vr �,Y �tQ �3[ QIZVL q sWN � r-qIL QIY ���^rJZ TIN%�^rJZV[,sWY L rJN � qIL QIN qVQi���}�� ���%�c�W�������

l � r���gxw p k r�on{coWh9eLvW{cw yr�}|%r�oLgxkx�C�c�%�%�Wne��L�D��� r%��gxw p k r%o�{coWhGm {cw gxo�e0v�{cw yr� |%r�oLgxk��������%�����}e0j u�v�� g%��vWw r��%gxo9{cvLvWw r�{cy}lWgxkp rnp gi�Lp ) w gxp w j g��%{�� 7� � gxy}lWoLj y�{��8� gxv�r%w p ��g��0�)tTr�u�vLqWp gxw�~C{%��r%w}{%p r�w �c�#u4oWj �%gxw k j p �r%sQt {cu7�Lw j hL�%g%�Wt {cu7�Lw j hL��gc���;oW��� {coWhZ�

l � r�k g {%oLhneLp g��%gxoLkx�)�c�%�%�Wn~�{coLj g����8�m� r%k g�{coWh3tTqLw p�e0p g��cgxoWk������%������� �D) � f j o=�C¢�~Zj ��l�p f�gxj �%l0p��;oK)�%j oLg�s r%w�m o�p gxw}{cyxp j �cg,u4k g� ���m o'~+r�oLoW{ z {cw uF{coC��gxhLj p r%wx�:�UZVr-qVQVQ OWL NRXJ\,r �3Y �tQ Y ��tQ SWY��DQIY ZIL Q��Js��.yUrJN%�^QIZVQIN qVQi�Pj+{%p j r�oW{��Cm oWk p j p qLp g�r%s�e0p}{coWhW{%w hWk�{coLh � gxy}lWoLr�� r��%�%�� {cj p lLgxw k �LqLw �W�W|n{%w �,� {coWhZ�Pj4r��cgxu7��gxw��

l eW{�� p r%on{coLh�¢m� � {%oZ�Z�����c�wn��gxw {%w hOeL{�� p r%o {%oLh |�{cuFgikp¢m� � {%oZ� �����c�7� � ¢4qWp r%uF{%p j y � g}�Lp�~+gxyxr%u�v�r�k j p j r%o{coLh�e0p w qLyxp qLw j oL�, 7� m o-�kZ r-qVQVQ OWL NRXJ\ r �<Y �tQ"�WZ O TINtY QIZINPsWY L rJNPs���yUrJN%�^QIZVQIN qVQ rJNTVNtY Q�� � L XRQINtY �1�� Y L [ Q OWL s TIN%�^rJZV[,sWY L rJN��DQIY ZIL Q��Js�� �{�-\IY QI[8\8sWNPO��6sWNPs-XRQI[ QINtY �LvLv=����0�,t0�Pj gxf ��r%w �W���+yxp r%�Zgiw��

l eW{�� p r%on{coLh � qWyr�,� gx�%�C�c���,�Jn��gxw {%w h�eL{�� p r%o�{coWh�tTlLw j k p r�vLlLgxw � qLyr��� gx���)���,���7��� � gxw u ) zgxj ��l�p j oL�m¢+vLvWw r�{cy}lWgxkj o ¢+qLp r%u�{cp j y � g}�Lps� gxp w j g��c{�� 7��TVN%�^rJZI[,sWY L rJN8�kZVr-qVQV\V\IL NRX�sWNPO@�6sWNPs-XRQI[ QINtY ��c�7� g0���c��g��%���

l eW{�� p r%on{coLh � qWyr�,� gx�%�C�c�%�,tJn��gxw {%w hneW{�� p r%o�{coWh�tTlLw j k p r�vLlLgxw � qWyr�,� gx��� ������t7�P� m uFvLw r]�0j oL�Fw gxp w j g��c{��Cv�gxw s r%w )uF{coWyigF���w g�� g��%{coLyxg�s gxgxhL��{cyr�� 7�"$Kr&�KZVNPs��vr � Y �tQ ��[ QIZVL q sWN � r-qIL QIY ���^rJZ8TIN%�^rJZVp[,sWY L rJN � qIL QIN qVQi�L�L� � � ��� ���,���0����}7�

l eL��{�� � �Z���,��tJn� gxp w�e0�0{�� � �G�����,t�� � � g�� g��c{%oLyxgFr�s � r�vLj y�{coWh��Lr0yxqWk�s r%we¢+qLp r�uF{cp j yp�+qWgik p j r%o¢4oWk f�gxw j oW�� 7��m o'�Wgxw gioWy m�j gis gxwx�ZgxhLj p r%wx��� �tQV\IY L rJNK\ sWNPO ��NK\4�kQIZV\��Z� gxj hLg�� �Z~+r�w )hLw gxy}l�px� z r�� � {coWhZ�

l eLp w ¤�{�� �%rcf k �0jvQIYks�� � �C�����%�Jn� r%u�g�� eLp w ¤�{�� �%rcf k �0j ��~Zr�qLj k g1��qWp lLw j gc�'|%qLk k jRm {cw � �%w gxoZ�Q|%j u3~Cgij k p gxoLk oLj hLgxwx�,�W{%oL�~Zj oZ�Q|%r%k g � gxw g�¤V) t {%w ��{�� � rL� � w rc� e0p w}{ck ¤xlLgxj u9�Q|%j odzG{%oL�L�%{coWh�|%r%oez j � hWj oW�7�0�����%���� j+{cp qLw}{��W~){coL��qW{%�%g4m oLs r%w uF{%p j r�oP� gxp w j g��%{�� � � �4��tU) ge� gxv�r%w p 7��m o ~+r%oWoW{ z {cw )uF{coC�ZgxhLj p r%wx�:�UZVr-qVQVQ OWL NRXJ\,r �3Y �tQ Y �<�PQ SWY>�DQIY ZIL Q��Js��0yUrJN%�^QIZVQIN qVQi� j+{cp j r%o�{��)m oK)k p j p qLp g r%s;eLp {%oLh�{cw hLk+{coWh � gxy}lLoWr�� r%���c����{cj p lLgxw k �WqLw �L��|n{%w ��� {coWhZ�tj4r��%giu7��gxw��

l eLp w ¤�{�� �%rcf k �0jvQIYks�� � �C�������Jn� r%u�g��ne0p w ¤�{�� �%r�f k �0j �v|%qWk k j%m {cw � �%w gxoZ��|%r%k g � gxw g�¤I) t {%w �W{�� � rL� � {ck j � {cv�{co�{cj oLgxoZ�{coLhMj4�%o � j � � �O�c�%�,����� j+{cp qWw {��4~){coW�%q�{c�%gnm oLs r%w uF{%p j r�o��4gip w j g��c{�� � � �4��tU) }� gxv�r%w p 7�m oC~+r%oWoW{ z {cw uF{%oZ�QgxhLj p r%wx�>�kZ r-qVQVQ OWL NRXJ\<r �,Y �tQ��^Y � �PQ SWY��DQIY ZIL Q��Js��yUrJN%�^QIZ QIN qVQi� j+{cp j r%o�{��)m oWk p j p qLp g7r%sTe0p}{%oLhW{%w hLk {coWh � gxy}lLoWr�� r%���c�U��{cj p lLgxw k �WqLw �L�|n{cw ��� {coLhC�Pj4r]�%gxu���gxw��

g%� / / �60 ���2�3

l eLlW{cw h�{coW{%oLhn{%oLhn|�{cgxkx�C������gJnu vZgioWhLw}{�e0lW{%w hW{co�{coWhO{coLh � {%p p j�|n{%gxk�� ������g7� � eLr0yxj {��4m oLs r%w uF{%p j r�o<�)j � p gxw )j oW�7�.¢�� ��r%w j p lWu�k4s r�w.¢4qWp r%uF{%p j oW��� zGr%w h�r%sT|nr%qWp l� � �� m o�� �R[,sWN@� sRqIY rJZV\ L NyUrJ[�o �RY L NRX �{�-\IY QI[8\���y:�vT*; = �,yUrJN%�^QIZ QIN qVQ5�UZVr-qVQVQ OWL NRXJ\i�0vLvZ�W�0�]tc�0�L�]}0��~+gxo��%giwx�tTr�� r%w}{chWrL��¢4vWw j � �7¢4t |'�

l eLuF{chW` {0�Z�c�%���Jn�Lw}{co��7e0uF{%hJ` {��C�c�%�����1� �4gip w j g���j oL� tTr�� � r0y�{cp j r%oWk)s w r%u � gi�0p���� � �D¢4t � 7��yUrJ[ po �RY sWY L rJNPs�� �L NRX��RL \IY L qV\i�C����� �x���c�W��}�}��

l eLv�r0gxw w j �C���%�%�Wn¢4oWk g�� u eLv�r0gxw w j �7�����c�7�p� m oLs r�tTw �0k p {�� � m o0p gi��w}{cp j oL���;�W{cyxp {coWh � {cw p j {��;|�{cp y}lR)j oW�'¢+vLvWw r0{cy}lWgikFp lLw r�qL� �+j k qW{�� j ¤�{cp j r%o� 7��m o+�UZVr-qVQVQ OWL NRXJ\<r �GY �tQ#�WZ O6TVNtY QIZVNPsWpY L rJNPs��,yUrJN%�^QIZVQIN qVQ rJN TINtY Q�� � L XRQINtY5�1��� Y L [ Q OWL sGTIN%�^rJZI[,sWY L rJN@�vQIY ZVL Q��Js�� �{�-\IY QI[8\sWNPO��6sWNPs-XRQI[ QINtY �LvLv=������}c�0���%�0�Pj4gif ��r�w ������yip r���gxw��

l eLj oW�%l�{��UQIYvs�� � �Z������gWn¢4uFj p�e0j oL��lW{�� �,��gxw}{cw h�eW{�� p r%oZ�0|n{%oLhW{%w�|9j p w}{0��{%oLhFtTlLw j k � qWyr�,� gx���)������g��1� � j �w)r%p gxh(~+rLyiqWu�gxo�p�~CgioW�%p l�j4r%w uF{�� j ¤�{%p j r�o7 7� � gxy}lWoLj y�{��8� gxv�r%w p � �4��gJ) ��g%�,t0�U~+gI)vW{cw p u�gxo0p r�s;tTr%u�vWqLp gxw4eLyxj gxoWyig%��tTr�w oWg�� �#u4oWj �%gxw k j p �%�Wm p lW{%y�{0�Pj4gxf ��r�w ���

l eLp w ¤�{�� �%rcf k �0j �C�����c�%�tn� r%u�g���eLp w ¤�{�� �%rcf k �0j �;���%�%�7�8� � qWj � hWj oW� {�~Cgi�0j y�{���~+r�uF{cj o�|�{cv�s w r%u � gi�0p tTr%w )v�r%w}{� ��0m o��UZVr-qVQVQ OWL NRXJ\Dr �UY �tQ �! Y �@TINtY QIZINPsWY L rJNPs���yUrJN%�^QIZVQIN qVQvrJN�yUrJ[�o �RY sWY L rJNPs�� #L NRX��RL \IY L qV\i�Pm+�%r%p rW�{|�{cv�{coC��¢4qW�%qWk p��Wm t t ~?�

l eLp w ¤�{�� �%rcf k �0j �C�����%�Jn� r%u�g��9e0p w ¤x{�� �crcf k ��j ��gxhLj p r%w�� �c�%�����>&@sWY �KZ s�� sWNRX��ts-XRQDTIN%�^rJZV[,sWY L rJN��DQIY ZVL Q��Js�� �mm� q0f�gxwi� � r%k p r%o=�

l eLp w ¤�{�� �%rcf k �0j;{coLhszG{coW�L�Z�c�%���Jn� r%u�g��neLp w ¤�{�� �%rcf k ��jQ{coWhz|%j oszG{coW�7�������%�7��� ¢ eLg�� s ) ~Cg�{cw oLj oL�Gu oWj �cgxw k}{��QtTr%oK)yigxvWp4e0v�r�p p gxw 7�)m o#�kZVr-qVQVQ OWL NRXJ\3r ��Y �tQ � )JY �,TVNtY QIZVNPsWY L rJNPs��=yUrJN%�^QIZ QIN qVQ3rJN yUrJ[ po �RY sWY L rJNPs�� �L NRX��RL \IY L qV\i�Pm����gxoLlW{]�0oZ�Z~+gioWuF{cw ���7¢+qL��qLk p��Wm t t ~?�

l eW{�� p r%on{coLh��T{coW�L�C�c��}%�Wn��gxw {%w hneW{�� p r%on{coWhntm�Ze����T{coW�7�+���,}%�7�e�r�+onp lWg�e0vZgiyxj �Ly�{%p j r�o9r%s � gxw u ��{�� qLgxkj o�¢+qLp r%u�{cp j y+m oLhWgi�0j oL�, 7�5$Kr&�KZVNPs���r ���8r-q��R[ QINtY sWY L rJNW�W�%�7� ��gL�+�F�,}%�7�

l � r,��qWoW{%��{RH m fT{x��{%uF{�� �%�Wn� {��%gxoLr��Lq � r,��qWoW{%��{�{coWh7|�{��%r%p r�m fT{���{cuF{7�C���%�%�7�?� � g}�LpQy�{cp gx�%r�w j ¤�{cp j r%o���{ck gxhr%o f�gxj �%l0p gihOj o,�%gxw k g�hWr0yxqLu�gxo0pFs w g�|�qWgioWyx�, �� � gxy}lLoWj y�{��.� gxv�r�w p9�c� � ��t�t,t0�%�~+giv�{cw p u�gxo�p9r%s7tTr%u�vWqLp gxw9eLyij gxoLyxg%� � r,���%r!m oLk p j p qWp g�r�s � gxy}lLoWr�� r%���c� � r��0�%rL�|�{cvW{%oZ�

l ��{%y}lLg��W�)���,}�gWn|%r%k gxs ��{cy}lWg���������},g���� e0r�u�g�w giu�{cw ��k�r%o�s qLoLyxp j r%o�{��;hLj {�� gxyxp k4r�sQk p {%oLh�{cw h¥� {coR)�%qW{%�%gxk 7� m o z 9{��c{%o¥� j oL�%�Zr%u9�WgihWj p r�wx� �tY ��� Q sWNPO@�PQ SWY%A �tY �KOWL QV\DoPZVQV\-QINtY Q O Y r&�L � \64UZIL 4�4kN4F�-L \IY �We7��w j vLp r%wx��eLp rLyr��lWr�� u9�We0f�gxhWgio=�

l �Qr0r�w lLgxgxk4{%oLh � j yxg%�C���%���Jn��� � gxo��Qr0r�w lWgxgik�{%oLh�~�{�f o � j yig��C�c�%�%�7�?� � �4�QtU) �.��qLgxk p j r�oP¢+oLk f�gxw j oW� � w {%yr�, ��

Page 17: Basics of Information Retrieval - Statistics and Linguistics

j4{%p j r�oW{�� m oLk p j p qWp gnr%s�eLp}{coLh�{cw hLk�{%oLh � gxy}lLoWr�� r%���c��� {cj p lLgxw k �LqWw �W� |�{cw �,� {%oLhZ�j r��%gxu���gxw��

l zG{�� �cgxwx�C�����%�Wn~+r%oW{�� h��D�?zG{�� �%gxw�� �c�%�%�7� � tTr�u�vLqWp {%p j r�oW{��1� j oL��qLj k p j yFp gxy}lLoWj |0qLgxkFj o�{%o�r%oK)� j oWg�k �0k p giu�s r%w9p gi�0p qW{�� {co�{�� ��k j k 7� m o-�kZ r-qVQVQ OWL NRXJ\�r �<Y �tQ"�wO�TINtY QIZINPsWY L rJNPs��yUrJN%�^QIZ QIN qVQ,rJN¹yUrJ[�o �KY sWY L rJNPs�� #L NRX��RL \IY L qV\i��e�9{coL�0{-) e �{%���%�Ce0fTgihWgxoZ�CeLgxvLp gxu���gxw��m t t ~��

l zG{�� �cgxwx�C���,�0�-n~+r%oW{�� h��D��zG{�� �%gxw����c���L��� � tTr%o0p w j �WqLp j r%oWk�r%s m oWs r%w uF{%p j r�o�e0yxj gxoLyxg%��tTr�u�vLqK)p {%p j r�oW{�� ~Cj oW�%qWj k p j yxki� {coLhC¢+w p j �Wyxj {��Tm o0p g�� � j �%gxoLyxg� 7� $Kr&�RZINPs��Dr �GY �tQ ��[ QIZVL q sWN� r-qIL QIY �,�^rJZ�TVN%�^rJZI[,sWY L rJN � qIL QIN qVQi�W����� �%�,}c�0�%�����

l zG{�� �cgxwx�C�����0�-n~+r%oW{�� h��8�,zG{�� �%gxw��)�����0�,�1� � lLg+�Qyir,� r%�%��r%sZ~C{%oL�%q�{c��g� ��Wm o j4j yir,� gip p}{+t {�� ¤ir,� {cw j �¢4o0p r%oWj r #C{cu�vZr�� � j �0{coWh�|n{%w p l�{ � {�� u�gxwx�0gxhLj p r%w kx�!y��RZIZ QINtY#TV\V\��tQV\@L N yUrJ[�o �RY sWpY L rJNPs�� #L NRX��KL \IY L qV\��kTIN��8rJN r&�RZ r �5� rJNPs�� O@�5s�� 4wQIZ��tm.� q�fTgiwx��~+r�w hWw giy}l0p��

l zG{�� �cgxwx�Pm {cw � �%w gxoZ�W{coWh<m�{��%�C���,}%�Jn~+r%oW{�� h!�8�8zG{�� �%gxwi� z {%oLkGm�{%w � ��w gioC� {coLh |�{cw p j o m {x�%� gxhLj p r%w k��3���,}%�7� &@sWY p�RZ s�� sWNRX��Ks-XRQ L N TIN%�^rJZV[,sWY L rJN+�DQIY ZVL Q��Js��@p��DQIZ \ otQVqIY L �WQV\ sWNPO��3L Z QVqIY L rJNK\¨�^rJZ�vQV\-Q sWZVq%����e��0w j vWp r%wx�WeLp rLyr��lWr�� u��