data clustering: a review - catch-all...

69

Upload: phamdieu

Post on 15-Mar-2018

213 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

����������� ����������������� ������� ��!

"�#%$&#('*),+.-/0+ 132,+ 45)6-8769:);9=<0>?-,+ @*<BADCE+ 9GF)6-3H/I#KJL#M/ON5A%9PFQK-*H�+ )6-RQ.-*C=9S+ 9TN;9=<VUBW?7�1;+ <,-*1X<)6-3HYZ# '[#M\(] F6-5-^_2*<8` 2,+ U07[9:);9=<0>?-,+ @;<,A%CT+ 9PF

acbed*fPgPh=iGjek*l&jefMgGm*hnd;k*fGd*oBh=iPpqjefGh=r s:butEfPfGj v3s:tSgPjewTk�wEx(o3tSg gPh:iPk*f?y%wTz*fPh=iPpTtSgPjewTk*f:{3r3tSgGtLj gGh=|_f�{qwTicxKh�tSgPd*iPh}p~h:s��gPwTiGf���jek~gPwLlTiGwTd*o;f?yKs=bed*fPgPh=iGf����Z��m*hns=bed*fPgPh=iGjek*l&o*iGwTz;beh:|�m3tEf�zBh=h:k tEr*r*iPh=fGfGh=r jek |�tEk~�_s=wTkXgPh��qgPf}tEk;r z~�iGh=fPh�tEiPs�m*h=iGfMjek�|�tEk~�_r*jefPs:jeo;bejek*h=f��~gGm;jefMiGh��3h=s�gGf�j gPfMz*iGw~tEr tEo*oBh:tEb[tEk*r�d*fPh=xKd*bek*h=fPf�tEf�wTk;h�wEx[gPm*h}f gGh=o*f�jekh��;o;bewTi�tSgPwTiP��r3tSgGtVtEk3tEb �qfGjef:����w��Mh�p~h=i�{[s:bed;fPgPh:iPjek*l�jef?t�r*j �Ls:d;b g?o*iGwTz*beh=|�s=wT|�z*jek*tSgGwTiPjutEbeb ��tEk*r�r*j �,h=iP�h=k*s=h=f�jekLtEfPfGd*|_oqgGjewTk*f�tEk*rLs=wTk~gGh��XgGf�jek�r*j �,h=iGh=k~g�s=wT|_|�d;k*j gGjeh=f(m3tEfZ|�tEr*hcgPm*hMgGiGtEk*fPxKh=i�wEx,d*fPh=xKd*b*lTh=k*h=iPjess=wTk*s=h=o;gGf�tEk*r�|_h�gPm*wXr*wTbewTlTjeh=f�fPbew���gPwLwXs=s:d;i�����m;jefMo3tEoBh:i�o*iPh:fPh=kXgPf�tEk�w�p~h=i p;jeh���wEx(o3tSg gGh=iPk�s=bed*fPgPh=iGjek*l|_h�gGm;wqr*fMxKiGwT|�t�f g�tSgPjefPgPjes:tEb6o3tSg gGh=iPkViGh=s=wTlTk*j gPjewTk�oBh=iGfGoBh=s�gGj p~hT{*��j gPm�t�lTw~tEb[wEx(o*iPw�pqjer*jek*l�d;fGh�x%d;b[tEr;pqjes=htEk*r8iGh�xKh:iPh=k*s=h:fngPw xKd*k*r3tE|_h=k~g�tEb�s=wTk*s=h:oqgGf�tEs:s=h=fGfPjez*beh�gPw gPm*h_z*iPw~tEr�s=wT|_|�d;k*j g���wExMs=bed*f gGh=iGjek;l�o*iGtEs=gPj �gPjewTk*h=iGf��_�8h_o*iPh=fGh=kXg&t gGtS�qwTk*wT|&�8wEx�s=bed*fPgPh=iGjek*l�gGh=s�m;k*je�qd;h:fLtEk*r�jer;h:k~gPj xK�8s=iGwTfPfP��s=d;g gGjek;l�gGm;h:|_h=f�tEk*riGh=s=h=kXg�tErqpTtEk*s=h=f����8hLtEbefGw�r*h=fGs=iPjez,h&fGwT|_h�je|_oBwTiPgGtEkXg}tEo*o*bejes:tSgGjewTk;f�wEx�s=bed*fPgPh=iGjek*l tEbelTwTiGj gPm*|_f�fPd*s�m�tEfje|�tElTh}fPh:lT|_h=k~g�tSgPjewTk6{3wTzq�Ph=s�g�iGh=s=wTlTk*j gGjewTk5{BtEk*r�jekqx%wTiP|�tSgGjewTk�iGh�gPiGjeh�pTtEbD�aMtSgGh=lTwTiPjeh:f?tEk;r8�qd*z;� h=s�g?��h=fGs=iGjeoqgGwTiPf��� �� ¡V¢ £&¤5¥§¦(¨5©Eª%«6¬§­¯®~©T°6¤6±[¤5².¤B¬5ª.®q³=´��MµZtSg gGh=iPk�¶�h=s=wTlTk*j gGjewTkX·¸8¹:º~»�¼ ½ �q �� ¡;� ¾L¢ ¿�À*©�©�®qÁT«�Â�®qÃT¤B¬6«�ªe©Tªu¤5«5´��[acbed*f gGh=iPjek*l*�X �� ¡;� ÄL¢ ¿�À*©:©S®qÁT«�Â_®;ÃT¤B¬5«�ªu©Eª.¤5«5´��5Å�o*o*bejes:tSgPjewTk*f ·Æ ¹TÇ�ÈBÉ;Ê�»:Ë�Ì(Í.½�ÍK¹~Î �Z�?� ¾;� ¾�¢ Ï=«6Ð�¤,ÁT¥�À*©Eª.¤5«�Ñ5©�¤,ÁSÀ3¬B®�À,«[±¯Â_®X©SÁTªu®qÒqÀ,²u´��} �kqx%wTiP|�tSgGjewTk§�qh:tEiGs�m�tEk*r§¶�h��gPiGjeh�pTtEb ·�Æ ¼ Éq½�Ê�»�Ë�Í.ÎqÓ �; �� Ô;� Õ ¢ Ö�Á�©Eªu×ZÃXª.À,²ZÏ=«B©�®*²K²%ªu¬,®;«[ÃT®X´��ZØ[h:tEiPk*jek*lS·�Ù ÎB¹TÚ�¼ »�º�ÓX»?Û�Ü�Ý�ÉqÍK½�Í.ÊDÍK¹TÎ

�qh=s�gGjewTkOÕ;�eÞ�jef�z3tEfGh=r0wTk�gPm*h�s�m3tEo;gPh=i�ßG �|�tElThV�Xh:lT|_h=k~g�tSgPjewTkRà�fPjek*l8acbed*fPgPh=iGjek*lTá�z~��Å�� â��(ã~tEjek0tEk*rµ(� ã3�[äZb �qk*k6{ Û�ºTåEæTÎBÜ�»:½�ÍKΧç�ÇLæ�ÓX»Oè�ÎBºX»:Ë�½�Ê�æTÎBºTÍKÎqÓXéVÛëê[»:½�ÊD½�Ü�ì;Ë�Í í�Ê�í=¹TË�Û�î:Ë�ÍK»�¼�ïM¹T½�»�Î�í�»�¼ º y%â��(ðcw����~h=itEk*r�ñ?�TÅ�mXdE�Pt;{~h:r;f�� ��{ sò Þ:óTóTÕn �ô�ô�ô0acwT|_o*d;gPh=iM�qwXs=jeh�g��Lo*iPh:fPf�{XtEk*r�jef�d*fPh:r�zX��o,h=iP|_jefGfGjewTk�wExBgGm;h� �ô�ô�ôacwT|_o*d;gPh=i��Xwqs=jeh�g��~�ñ�tE|_hT�(Å�k*jeb[â��*ãXtEjekÅ�r;r*iGh=fGf:� ��h=o3tEiPgP|_h=kXg�wEx?acwT|_o*d;gPh=i��qs=jeh=k*s=h~{MõVjes�m*jel~tEkO�XgGtSgGhVà�k*j p~h=iGfPj g��~{cÅnöqÞ=Ä��8h=bebef_��tEbebD{�ôctEf gØ�tEk*fPjek*l*{BõV �Ä~÷T÷TÔEÄ�à}�qÅñ�tE|_hT�Zõ§� ñ?�*õVd*i g��Å�r;r*iGh=fGf:�M��h=o3tEi gG|_h=k~g�wEx�acwT|_o*d;gPh=i}�Xs:jeh=k*s=h&tEk*rVÅ�d;gGwT|�tSgPjewTk6{B �k*r;jutEk� �k*fPgPj gGdqgGh�wEx��qs=jeh:k;s:hT{5ðMtEk*l~tS�bewTiGh}¡TÕTø_ø;Þ:Ô;{3 �k*r*jutñ�tE|_hT�(µ(� ã*�*ä(b �;k;kÅ�r;r*iGh=fGf:�Z��h=o3tEiPgP|_h=kXgcwEx[ô�beh=s�gPiGjes:tEb5ô�k*lTjek*h=h=iGjek*l*{q��m*h?ù�m*jew&�XgGtSgPh?à�k*j p~h=iGfPj g��~{*acwTbed*|&z*d*f:{*ù}�úÄ~¾TÔ;Þ:øà}�Xŵ(h=iG|_jefGfPjewTkngGw}|�tEûTh�r*jelTj g�tEb;wTiZm*tEiGr�s=wTo*jeh=fZwEx,o3tEiPgZwTiZtEbeb;wExBgPm*jef��MwTiGûnxKwTiZoBh=iGfPwTk3tEb*wTi(s=butEfGfPiGwXwT|üd*fPhMjeflTi�tEk~gPh:r?��j gGm;wTd;g�x%h=h�o*iGw:p;jer*h=rngPm3tSg(s=wTo*jeh=f(tEiGh�k;wEg�|�tEr*h�wTi6r*jefPgPiGjez*dqgGh=rnx%wTi6o*iGwEv*g[wTi�r*jeiGh=s�g�s=wT|_|_h=iGs=jutEbtEr;pEtEkXgGtElTh�tEk*r8gPm3tSg?s=wTo*jeh=f?fGm*w:�ýgPm*jefnk*wEgPjes:h�wTk8gPm*h�v3iPfPgno*tElThLwTinjek*j gPjutEb�fPs:iPh=h:k8wEx�t�r*jefGo;but:��tEbewTk*l��j gGm gGm*hnxKd*beb[s=j gGtSgGjewTk6��acwTo~�;iPjelTmXgPf�xKwTi�s:wT|_oBwTk*h=k~gGf�wExZgPm*jef��MwTiGû�w���k*h=r�z~��wEgPm*h=iGf�gGm*tEkVÅ�a�õþ|�d*f gzBh_m*wTk*wTiPh:r5��Å�z*fPgPi�tEs�gPjek*l���j gGm�s=iGh=r*j g�jef?o,h=iP|_j gPgPh=r6����wVs=wToX��wEgPm*h=iP��jefGhT{�gPwViGh=o*d*z;bejefGm6{[gPwVoBwTfPg�wTkfGh=i p~h:iPf�{TgPwniGh=r*jef gGiPjez*d;gPh�gPw?bejefPgPf�{TwTiZgGwnd;fGh�tEkX��s=wT|_o,wTk;h:k~gcwEx,gPm*jefZ�cwTiGû�jekLwEgGm;h:iZ�MwTiGûXf�{~iPh=�qd*jeiPh=f�o*iPjewTifGoBh=s=j v3s�oBh:iP|_jefGfPjewTk�tEk;rBÿSwTiLt�xKh=h~��µ(h:iP|_jefGfPjewTk*fn|�t:��zBh�iGh=�Xd*h=fPgPh:r�x%iPwT| µ�d;z*bejes:tSgGjewTk*f&��h=o;g:{ZÅ�aMõ �k*sT�e{3Þ:¡;Þ:¡?ðciGw~tEr;�Mt:�~{qñ�h�� � wTiPû,{Xñ � Þ:øTøT¾TÕ?à��qÅ&{Ex%tS���&Þ}yDÔ;Þ:Ô~�Z÷TÕTóS� øEÄ~÷;ÞT{qwTi������ ����������������������������*�

Page 2: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

� � �! #"$ &%('�)#*,+�-. #/0 1-3254#6�78',*�9;: %, �<>= 75*5*

X X

Y Y

(a) (b)

x xx

xx 1 1

1

x x

11

2 2

x x 2 2

x x x

xx

x

xx

x

x

xxx

x

x

x

x

x

x

3 3 3

3

4

44

4

4

4

44

4

4

44

4 44

x

x

x

x

x

x

x

x 6

6

6

7

7

7

7

6

x x x

xx

xx

4 5 55

5

55

ä(jel*�5ÞT��}tSg�tLs=bed*f gGh=iPjek*l*�

?�h=k*h=i�tEb[��h=iP|_f���acbed*fPgPh=iGjek*lÅ�r;r*j gGjewTk*tEbMâ}h��8�8wTiPr*f�tEk;r§µ�m;i�tEfGh=f:�Lacbed*f gGh=i�tEk3tEb �qfGjef:{�d*k*fPd*oBh:i p;jefPh=r�beh:tEiGk*jek*l*{[fGje|_jebutEiGj g���jek*r*jes=h=f�{h��;o;bewTi�tSgPwTiP��r3tSgGt_tEk3tEb �;fPjef�{;jek*s=iGh=|_h=kXgGtEb[s=bed*fPgPh=iGjek*l*{;s=bed*fPgPh=iGjek*l_tEo;o*bejes:tSgGjewTk*f:�

@ #�QDJ}^BA�`DCL>0E�^�Qu`VJ@ # @ /8U,9S+ @*);9S+ UZ-FHG5I�GDGKJ�G,LNM&O�PQO$RSJ�T&UWV�LNPXU�O$Y;GKJZM.[(\ Y^]�R&I�PNJS_`G,]S]�LXPQ[�G,I�PN\KJ�OWa5U�PXI�bSUWVcPXJ;GDT&UWO�PN_KJ^]Sb�GKO�Ud\KV!GKO]�GKV�IB\KecI�bSUWPXV8\KJ&f�LNPXJSU.\K]gU�VG5I�PN\KJ1O�hiFHG5IGjG,J�GKLXM&O�PNOi]SV�\&[�UWT&RSV�UWOB[�G,Jlk1U^T&PN[b�\,I�\ Y;PXmWUWTnGKOU�PXI�b�U�VoU(p&]SLN\KVG5I�\KV�Mq\ Vo[(\KJSr�V�YsG,I�\KV�MKa>k�G O�U�Tt\ JjI�b�UDGvu5GKPXLQG,kSPNLNPwIxMs\Ke$G,]�]SV�\ ]SV�PNG,I�UBY;\&T&UWLNOe�\KV.I�bSUyTSG5IGzO�\KRSV[(U a{kSRSI^Gn| U�M}U�LNU�Y;U�J>IqPNJ~kg\,I�b�IxM>]gUWOq\,eo]SV�\&[(U�T&RSV�UWOt���obSU(I�bSU�V.e�\KVbZMZ]1\KI�bSU�O�PQOie�\ V�YsG,I�PN\KJz\ V8T&U�[(PQO�PN\KJ&f�YsG,|ZPNJS_>��PQO8I�bSUq_KV�\KRS]�PXJS_t\KVD[(LQGKO�O�PXr1[�G,I�PN\KJn\Ke�Y;UWG5fO�RSV�UWY;U�J>I�OBk�GKO�UWTy\KJnUWPwI�bSU�V^��P��o_ \>\&T&J�UWO�Oxf�\,e�f�rSIoI�\�Gs]1\>OxI�RSLQG5I�U�T�Y;\ZTSU�L�\ Vq��PXP��oJ�G,I�RSVG,L_KV�\KR�]SPXJ�_ O3��[(LNR�OxI�U�V�PXJ�_>��V�U�u UWG,LNUWTyI�bSV�\KRS_ bzG,J�GKLXM&O�PNOWhB��LXR�O�I�UWVHGKJ�G,LNM&O�PQOoPQOoI�bSU.\ V�_>G,JSPNmWG,fI�PN\KJs\Ke�G3[(\ LXLNUW[(I�PN\KJ;\,e�]�G,I�I�UWV�J1OB��R1O�R�GKLXLNM^V�UW]SV�U�O�UWJ>I�UWT^GKO�GDuKU�[�I�\ V!\,e�Y;UWG O�R�V�UWY^UWJ>I�OWaK\KVGj]g\KPNJ>I8PNJlGjYqRSLXI�PQT&PXY;UWJ�O�PN\KJ1G,L0O�]�G [(Uv��PXJ>I�\�[(LNR�O�I�UWV�OBk�GKO�UWTn\ JzO�PNY;PXLQG,V�PXIxMKhB��J>I�RSPwI�PXu U�LNMKa]�G,I�I�UWV�J1OD�oPwI�bSPXJ~Gyu5G,LNPQT}[�LXR1OxI�U�V3G,V�U;Y;\KV�U;O�PNY^PNLQG,VDI�\nU�GK[b}\,I�bSU�VDI�b�G,J}I�b�U�M�GKV�U^I�\�G]�G,I�I�UWV�J�k1UWLX\ JS_KPNJS_�I�\}GzT&PX�gUWV�UWJ>I^[(LNR�O�I�UWVWhl�BJ~U(pSGKY^]�LXUj\KeB[(LNR�O�I�U�V�PNJS_zPQO.T&UW]SPN[(I�U�T~PNJ�$PX_ RSV�Ul�Kh���bSU�PXJ�]SR&Is]�G5I�I�UWV�J�O^G,V�U�O�bS\5�oJ~PNJ��$PN_KRSV�Ul�>��G>�3G,J1T�I�bSU�T&U�O�PNV�U�T�[�LXR�O�I�UWV�OG,V�UDO�bS\5�oJ�PXJ��$PX_ RSV�U^�>��k1�(h!�iUWV�U a>]g\KPNJ>I�O�kgU�LN\KJS_ PXJ�_.I�\qI�bSU3O�G,Y;UH[�LXR1OxI�U�VoG,V�U8_ PXu U�JtI�bSUO�G,Y;UqLQG,kgU�L�h.��bSU^u5G,V�PXU�IxM�\,e�I�UW[bSJ�PN�>RSU�OBe�\ V8V�U�]�V�U�O�UWJ I�PXJ�_�TSG,I�GSa�Y;U�GKO�RSV�PNJS_�]SV�\vp&PNY;PwIxM��O�PNY^PNLQG,V�PwIxMS�.k1U�Ix��UWU�J�TSG5IG�UWLXUWY;U�J>I�OWa�GKJ�T~_ V�\ RS]SPNJS_}T�G5I�G�U�LNU�Y;UWJ IO;b�GKO^]SV�\&T&R�[�UWT�GV�PN[b�G,J�T�\,e�I�U�Jn[(\ J&e�R�O�PXJ�_;G O�O�\KV�I�Y;UWJ Io\Ke$[(LNR�O�I�UWV�PNJS_;Y;U(I�b�\ZT�O�h��IjPNO;PNY;]1\ V�IG,J>I;I�\�RSJ�T&UWV�O�I�GKJ�T�I�bSUzT&PX�gUWV�UWJ�[(U�kgU(Ix�dU�UWJ�[�LXR�O�I�UWV�PNJS_���R�J�O�R�]1UWV�uZPQO�U�T

[(LQGKO�O�Pwr1[WG5I�PX\ J1�HG,J�T}T&PQO�[�V�PNY;PXJ�GKJ>I.G,J�GKLXM&O�PNO;��O�RS]gU�V�uZPNO�UWT�[(LQGKO�O�Pwr1[WG5I�PX\ J1��h;��J�O�R�]1UWV�uZPQO�U�T[(LQGKO�O�Pwr1[WG5I�PX\ J�a{�dUjG,V�Uj]SV�\5uZPNTSUWT}�oPwI�b~Gz[(\ LXLNUW[(I�PN\KJ�\KeD�N K¡¢(�N¢�£���]�V�U�[(LQGKO�O�PXr�UWT1�H]�G5I�I�U�V�J�OG,J1T^I�bSUi]�V�\ kSLXUWY¤PQOcI�\3LQG,kgU�L1G3JSU��oLNMqUWJ�[(\ RSJ>I�UWV�U�T�aKM U(I�RSJ�LNGKk1UWLXU�T�a ]1G5I�I�U�V�J�hc��MZ]SPQ[�GKLXLNMKaI�b�Uj_KPNuKUWJ}LQG,kgU�LNUWT���¥�¦� 5§�¨�§�¨Z©W�`]�G5I�I�U�V�J�O3GKV�UsR1O�U�TlI�\zLNUWG,V�J}I�bSU�T&UWO�[(V�PX]SI�PN\KJ�O`\Ke�[�LNG O�O�UWO�obSPQ[bqPNJqI�RSV�J^GKV�UdR�O�UWT.I�\DLQG,kgU�LSG8JSU���]�G5I�I�U�V�J�h$��J.I�bSUi[�G O�Ud\,e�[(LNR�O�I�U�V�PNJS_�avI�bSU�]SV�\ kSLNU�YPQOiI�\t_KV�\KR�]lGj_ PXu U�Jz[(\ LXLNUW[(I�PN\KJz\Ke!RSJSLQG,kgU�LNUWTl]�G5I�I�U�V�J�O8PXJ>I�\tY;UWGKJSPXJ�_,e�RSL0[(LNR�O�I�U�VOWh8��JlG

Page 3: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '�6�'H«�= 2(¬�6�­W4Q)#*(®>¯g��°S­�±�) ­�² � ³

O�U�J�O�UKa$LNGKk1UWLNOqG,V�UjGKO�O�\&[�PNG,I�UWT��oPXI�b�[�LXR�O�I�UWV�O.G,LQO�\1a{kSRSI3I�bSU�O�U�[�G5I�U�_ \KV�MzLNGKk1UWLNOqG,V�Ul£K ,¥� £5¦�§�´5¢�¨�µSI�b�G5IiPQOWaZI�bSUWM�G,V�UD\Kk&IG,PNJSUWTyO�\KLNU�LNMse�V�\ Y¶I�b�U3TSG5IGSh��LXR�O�I�UWV�PNJS_}PNO^R�O�U(e�R�LoPXJ�O�UWuKU�VG,LdU(p&]SLN\KVG5I�\KV�M�]1G5I�I�U�V�J�GKJ�G,LNM&O�PQO�ac_ V�\ RS]SPNJS_�a!TSUW[(PQO�PX\ J

YsG,|ZPNJS_`G,J�T^YsGK[bSPNJSUoLNUWGKV�JSPNJS_DO�PXI�R1G5I�PN\KJ1OcPXJ1[(LNR�T&PNJS_3TSG5IGHY^PNJSPNJS_�aZT&\&[(R�Y^UWJ>I!V�U�I�V�PXUWuvGKL�aPNY;GK_KU;O�UW_KY;U�J>IG5I�PN\KJ}G,J�T�]�G,I�I�UWV�J�[(LQGKO�O�Pwr1[WG5I�PX\ J�hq�B\5��UWuKU�V�a�PXJ}YsG,JZMlO�R�[b}]SV�\ kSLNU�YsO�aI�b�U�V�U!PNO�LXPXI�I�LXU�]SV�PN\KV�PNJ&e�\ V�YsG5I�PX\ Js��¢�·¸© ·Na,O�I�G,I�PQOxI�PN[WG,LKY;\&T&UWLNO��Gvu5G,PNLNGKkSLNU0GKk1\ R&I�I�bSU�TSG,I�GoG,J1TI�b�UHT&U�[(PQO�PN\KJSf�YsG,| U�V!YqR�O�IdYsG,| U8G Oce�U��¹GKO�O�RSY;]&I�PX\ J�OdG,kg\KR&I�I�bSUDTSG5IG.G O�]g\ O�O�PNkSLNUKh0��I�PNORSJ�TSU�V�I�bSU�O�U8V�U�OxI�V�PQ[�I�PX\ J�OcI�b�G5I�[(LNR�OxI�U�V�PXJ�_.Y;U(I�bS\&T&\KLN\K_ MqPQO!]�GKV�I�PN[�RSLQG,V�LXM;G,]S]�V�\ ]SV�PQG5I�U�e�\KVI�b�UHU�p&]SLX\ V�G,I�PN\KJj\Ke�PNJ I�U�V�V�UWLNG,I�PN\KJ�O�bSPN]�OdG,Y;\KJS_.I�bSU`TSG,I�Gq]1\ PXJ>IO�I�\;Y;GK|KUHG,J�G O�O�UWO�O�Y^UWJ>I��]gU�V�b�GK]�O�]SV�U�LNPXY;PNJ�G,V�MS��\Ke{I�bSU�PNViO�I�V�R�[�I�RSV�U h��bSUdI�U�V�Y»º¸[(LNR�OxI�U�V�PXJ�_�¼5PQO{R1O�U�T.PNJ^O�U�u U�VG,L>V�U�O�U�G,V[b3[(\ Y^YqRSJSPXI�PNUWO$I�\HT&U�O�[�V�PNkgUdY;U�I�bS\&TSO

e�\KV0_ V�\ RS]SPNJS_i\,egRSJSLQG,kgU�LNUWTqTSG5IGSh{��b�UWO�Ud[�\KY;Y.RSJ�PwI�PXU�O{b1GvuKU�TSPw��U�V�U�J>I$I�U�V�Y;PXJ�\KLN\K_KPNUWO$G,J1TGKO�O�RSY;]&I�PN\KJ�O$e�\ VcI�b�Ui[(\KY;]g\KJSUWJ>I�Oc\Ke1I�bSUi[(LNR�O�I�U�V�PNJS_D]SV�\&[�UWO�OcG,J�TqI�b�Ui[(\KJ>I�U(pZI�OcPNJ;�obSPQ[b[(LNR�O�I�UWV�PNJS_`PQO!R�O�UWT�h0��bZR�OWa �dU�e�GK[�UiG3T&PNLXUWY^YsG`V�U�_>G,VT&PNJS_BI�bSUBO�[(\ ]1Ui\Ke1I�bSPQO�O�RSV�u U�M h$��bSU]SV�\&T&R�[�I�PX\ Jj\,e�G3I�V�RSLNM;[�\KY;]SV�U�bSUWJ�O�PXu UBO�R�V�u U�M^��\ RSLNTjk1UDG3Y;\KJZRSY;UWJ IG,L�I�GKO�|;_KPNuKUWJ;I�bSUO�bSU�UWViYsGKO�Oi\,ecLNPwI�U�VG5I�RSV�U`PNJnI�bSPNO8G,V�UWG�hd��bSU^GK[W[(UWO�O�PXkSPNLNPwIxM�\,e0I�bSUqO�RSV�uKUWMtY;PN_Kb>I8G,LQO�\sk1U�>RSUWO�I�PN\KJ1G,kSLNU!_KPNuKUWJ`I�b�U�JSUWUWTDI�\BV�UW[(\ J�[(PNLNU!uKUWV�MDT&PX�gUWV�UWJ I0uK\&[WG,kSRSLQG,V�PNUWO�GKJ�T3GKO�O�RSY;]&I�PN\KJ�OV�U�_ GKV�TSPXJS_^[(LNR�O�I�U�V�PNJS_;PXJyI�b�U`uvGKV�PN\KR1Oo[(\KY;YqRSJSPXI�PNUWOWh��bSUD_K\ GKL1\Ke�I�bSPNOd]�GK]1UWVoPNO�I�\;O�RSV�uKUWMqI�bSU`[(\ V�UH[(\KJ1[(U�]SI�OoG,J1TsI�U�[bSJSPQ�>RSUWOdPNJtI�bSUDLNGKV�_ U

O�RSk�O�U(Iq\Kei[(LNR�OxI�U�V;G,J�GKLXM&O�PNO3�oPwI�b~PwIO.V�\Z\,IO3PNJ�OxIG5I�PNO�I�PQ[�O^G,J�T�TSUW[(PQO�PX\ J�I�bSUW\KV�MKhz½�bSUWV�UG,]�]SV�\ ]SV�PNG,I�UKa�V�U(e�UWV�UWJ�[(U�OH�oPXLNLck1UsYsG T&U^I�\�|KUWMl[(\ J�[(UW]&I�ODG,J1TzI�UW[bSJSPQ�>RSUWO`GKV�PQO�PXJS_�e�V�\KY[(LNR�O�I�UWV�PNJS_;Y;U(I�b�\ZTS\KLN\K_KMsPNJyI�bSU`YsG [bSPXJ�UHLNUWGKV�J�PXJS_sGKJ�Tt\KI�bSUWVi[(\ Y^YqRSJSPXI�PNUWOWh��bSU3G,R�TSPXUWJ�[(UD\,e$I�b�PNOo]1G,]gU�ViPNJ�[(LNR�T&U�O�]SVGK[�I�PwI�PX\ JSU�VO�PNJ�I�bSU`]�G,I�I�UWV�J�V�UW[�\K_KJ�PwI�PX\ J�G,J1T

PNY;GK_KUzGKJ�G,LNM&O�PQOs[(\ Y^YqRSJSPXI�PNUWOz���obS\~O�bS\KRSLQT�uZPXUW�¾PXItGKOtG�O�RSY;YsG,V�PNmWG5I�PX\ J�\Ke3[(RSV�V�UWJ>I]SVGK[(I�PQ[(U��(a�]SVGK[(I�PXI�PN\KJSUWV�ODPNJlI�bSUsYsGK[bSPNJSU;LNUWG,V�JSPNJS_n[(\ Y^YqRSJSPXI�PNUWOs���obS\zO�b�\KRSLQTluZPNU��¤PwIGKOoGsO�J�GK]�O�b�\,Ii\,ecGs[(LN\ O�U�LNMjV�U�LQG5I�UWTtr�U�LQT��oPwI�bnG;V�PQ[b�bSPNO�I�\ V�Mt\,e0��UWLXLXf�R�J�T&U�VO�I�\Z\&TjI�UW[b&fJSPQ�>RSUWO��aSGKJ�TjI�bSUDkSV�\ GKTSU�V�G,R�T&PNU�J1[(UH\,e$O�[(PNU�J>I�Pwr1[8]SV�\,e�U�O�O�PX\ J�G,LQOH���obS\;O�b�\KRSLQTtuZPNU��¿PXIBGKOG,JjG [�[�UWO�O�PNkSLNUoPXJ>I�V�\&T&R�[(I�PN\KJ^I�\.G3Y;G,I�RSV�U�r�UWLNT;I�b�G5I�PNO�Y;GK|ZPXJS_`PNY;]1\ V�IG,J>I�[�\KJ>I�V�PXk�R&I�PN\KJ�OI�\s[�\KY;]SR&I�PXJS_jGK]S]SLNPN[WG5I�PX\ JyGKV�U�GKO��h

@ # À�EMU�Á3ÂBU(-*<B-;9=C&U,W});E}]eN*C=9=<,A +.-*40^M)*C(Ã��M>]�PN[WG,L�]�G,I�I�UWV�J�[(LNR�O�I�UWV�PNJS_sGK[(I�PNu>PXIxMjPNJZuK\KLNuKU�O�I�bSUDe�\ LXLN\5�oPXJ�_;O�I�UW]�O`Ä Å ÆvÇ�È�x�v��]�G5I�I�U�V�J�V�UW]SV�UWO�U�J>I�G,I�PN\KJÉ��\K]SI�PN\KJ�GKLXLNM�PNJ�[(LNR�T&PNJS_�e�U�G5I�R�V�UnU�p>I�V�G [�I�PX\ J�GKJ�T1Ê5\KVjO�U�LNUW[�f

I�PN\KJ1�(a��Ë �yT&U(r�J�PwI�PX\ Jy\Ke$G^]�G,I�I�UWV�J�]SV�\vp&PXY;PXIxMsY;UWGKO�RSV�U`G,]S]SV�\K]�V�PQG5I�UBI�\qI�bSU3TSG,I�G;T&\KYsGKPXJ�a��Ì>�y[(LNR�OxI�U�V�PXJ�_q\ Vo_KV�\KRS]SPNJS_1a��ÍZ�yTSG5IG^GKk�O�I�VGK[�I�PX\ J���Pwe0JSU�U�T&UWT1��a�GKJ�T��Æ �yGKO�O�U�O�O�Y;U�J>Id\Ke{\ R&I�]SRSIq��PXe$J�U�UWTSUWT��(h�$PX_ RSV�U;Ë�T&U�]�PN[(I�O`GtIxM>]�PN[WG,LcO�U��>RSU�J�[�PXJ�_t\,e�I�bSU^r�VO�I8I�bSV�UWUq\Ke�I�bSUWO�U^O�I�UW]�OWa�PXJ1[(LNR�T&PNJS_yGe�U�U�T&k�G [|n]�G5I�b��obSUWV�U^I�bSU;_KV�\KRS]SPNJS_y]SV�\Z[�UWO�OB\ R&I�]�R&I.[(\ RSLNT}G5��UW[(I3O�RSk1O�U�� R�U�J>I8e�U�G5I�RSV�UU(pZI�V�G [�I�PN\KJ�G,J1T�O�PXY;PNLNGKV�PXIxMt[�\KY;]SR&IG5I�PN\KJ1O�hÎo 5¥�¥�¢�¦�¨~¦�¢�Ïg¦�¢�Ð�¢�¨�¥� 5¥�§�Ñ5¨nV�U(e�U�VOHI�\yI�bSUsJZRSY.kgU�V3\Ked[�LNG O�O�UWOWa�I�b�UsJ>R�Y.kgU�V3\KedGvu5G,PNLNGKkSLNU

]�G,I�I�UWV�J1O�a>G,J�T^I�bSUiJZRSY.kgU�V�a,IxMZ]gUKaZG,J�T;O�[�GKLXUo\KegI�bSUoe�U�G5I�R�V�U�O!Gvu5G,PNLNGKkSLXUdI�\`I�bSU8[(LNR�OxI�U�V�PXJ�_G,LN_K\ V�PXI�b�Yyh^ÒZ\KY;U;\,e!I�bSPQODPXJ&e�\ V�YsG,I�PN\KJlYsGvMnJS\KI`k1Us[(\ J>I�V�\KLNLNGKkSLXUqkZMnI�bSU;]SVGK[(I�PXI�PN\KJSUWVWhÓ{¢� ,¥�Ô&¦�¢�Ð(¢��X¢Õ�¥�§�Ñ,¨8PQO�I�bSUd]SV�\&[�UWO�O�\,eSPQT&UWJ I�Pwe�MZPNJS_iI�bSUdY^\>OxI$U(��UW[(I�PNuKU�O�RSk�O�U(I$\,e&I�bSU�\ V�PN_KPNJ�G,L

Page 4: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

Ö � �! #"$ &%('�)#*,+�-. #/0 1-3254#6�78',*�9;: %, �<>= 75*5*

FeatureSelection/Extraction

PatternGrouping

ClustersInterpatternSimilarity

Representations

Patterns

feedback loop

ä(jel*�3Ô;�þ�XgGtElTh=f�jek�s=bed*fPgPh=iGjek*l*�

e�UWG,I�RSV�UWO3I�\zR1O�UjPNJ~[(LNR�O�I�UWV�PNJS_�hlÓ{¢ 5¥�Ô&¦�¢�¢�× ¥�¦� KÕ�¥�§�Ñ,¨zPNO3I�bSUtR�O�Ut\,ei\KJ�Us\KV.Y;\ V�U;I�V�GKJ�Oxfe�\KV�YsG5I�PX\ J�O`\,edI�b�UjPXJ�]SR&I.e�U�G5I�RSV�U�ODI�\l]SV�\&T&R1[(UsJSUW�»O�G,LNPNU�J>I`e�UWG,I�RSV�UWOWh�Ø�PwI�bSU�Vq\KV`kg\,I�b\,e�I�bSU�O�U.I�UW[b�JSPN�>RSU�OD[�G,Jlk1U^R�O�UWTnI�\�\ k&I�GKPXJ�G,J�GK]S]SV�\K]SV�PQG5I�UqO�U�IH\Kece�UWG5I�RSV�UWOBI�\yR�O�U^PNJ[(LNR�O�I�UWV�PNJS_�hÎo 5¥�¥�¢�¦�¨;Ï�¦�Ñ�× §�Ù^§�¥�ÚHPNOdR�O�R�GKLXLNMjY;UWG O�RSV�UWTtkZMtGqTSPNO�I�GKJ�[(UHe�RSJ�[(I�PN\KJ�T&U(r1JSUWT�\KJy]�G,PNVO�\Ke

]�G,I�I�UWV�J1O�h��Ûu5G,V�PXU�IxMt\Ke0T&PQO�I�G,J1[(U3Y;UWG O�R�V�U�OoG,V�U`PXJnR�O�U`PNJ�I�bSU3u5GKV�PN\KR�OB[(\KY;YqRSJSPXI�PNUWO3ĸÜZµÅ ÆSµ�Í���Ç�h`�»O�PNY;]SLNU^T&PQO�I�G,J1[(U^Y^U�GKO�RSV�U.LNPX| U.I�bSU^Ø�R�[(LNPQT&UWGKJ�T&PQOxIG,J�[�Uq[WG,Jl\Ke�I�UWJlkgU^R1O�U�TI�\`V�U(Ý1UW[�I�TSPNO�O�PNY;PXLQG,V�PXIxM3k1U�Ix��UWU�J^Ix�d\H]1G5I�I�U�V�J�OWaK�obSUWV�U�GKO0\,I�bSU�V!O�PNY^PNLQG,V�PwIxM3Y;U�GKO�RSV�U�Oc[�GKJkgU`R�O�U�T�I�\j[b�GKV�G [�I�UWV�PNm�U8I�b�U.[(\ J�[(UW]&I�R�GKL�O�PNY;PXLQG,V�PXIxMjk1U�Ix��UWU�J�]�G,I�I�UWV�J1O3Äw��Ì Ë5Ç�h!F8PNO�I�GKJ�[(UY;UWG O�RSV�UWO�GKV�U`T&PQO�[�R�O�O�U�TtPNJzÒZUW[(I�PN\KJyÍ�h��bSUH©K¦�Ñ5Ô�Ï�§�¨>©HO�I�U�]y[�GKJsk1UH]1UWV�e�\ V�Y;U�TsPXJ�G3JZRSY.kgU�Vd\,e���GvM&O�h0��bSU8\KR&I�]SR&Io[(LNR�OxI�U�V�PXJ�_

��\ VH[�LXR1OxI�U�V�PXJS_>O��B[�GKJlkgUqb�GKV�T���G�]�G,V�I�PXI�PN\KJz\Ke!I�b�U^TSG,I�G�PXJ>I�\t_KV�\KR�]�O��i\KV8e�RSm�mWM~���obSUWV�UUWG [bz]�G,I�I�UWV�Jlb�GKOHGju5G,V�PQG,kSLNU.T&UW_KV�U�U3\Ke�Y;U�Y.kgU�VO�bSPX]lPXJ�UWGK[bn\KecI�bSU^\KRSI�]SR&I`[(LNR�O�I�UWV�O��h�iPNU�VG,V[bSPQ[�GKL�[(LNR�OxI�U�V�PXJ�_;GKLX_ \KV�PwI�bSYsO�]SV�\ZTSR�[(U3G;JSU�OxI�UWTnO�U�V�PXU�O�\,ec]�GKV�I�PwI�PX\ J�O�k�GKO�UWTy\ J�G[(V�PXI�U�V�PN\KJ^e�\KV�Y^UWV�_ PXJ�_`\KV�O�]SLNPwI�I�PNJS_q[�LXR�O�I�UWV�O�k�GKO�UWT^\ JjO�PNY;PXLQG,V�PwIxM h$ÞcGKV�I�PwI�PX\ J�G,L1[(LNR�OxI�U�V�PXJ�_G,LN_K\ V�PXI�b�Y;ODPQT&UWJ I�Pwe�M�I�b�Us]�G,V�I�PXI�PN\KJ}I�b1G5I.\ ]&I�PNY;PXmWUWOj��R�O�R1G,LNLXM�LX\&[�GKLXLNMS�DGn[(LNR�O�I�U�V�PNJS_z[(V�PwfI�UWV�PN\KJ�h��8TST&PXI�PN\KJ�GKL�I�UW[bSJ�PN�>RSU�Ooe�\KVBI�bSU._KV�\KRS]SPNJS_s\ ]1UWV�G,I�PN\KJnPNJ�[(LNR�T&U3]�V�\ k�G,kSPNLNPNO�I�PQ[jÄ Ë&�(ÇG,J1Tj_KVG,]�b&f�I�bSU�\ V�U�I�PQ[3ÄX�WÅKÅ,Ç�[�LXR1OxI�U�V�PXJS_^Y;U(I�bS\&TSO�h!��b�U8u5G,V�PNU(IxM;\,e{I�UW[b�JSPN�>RSU�O�e�\KV�[(LNR�OxI�U�Ve�\KV�YsG5I�PX\ J�PQOoT&UWO�[(V�PNk1U�T�PNJnÒZUW[(I�PN\KJzÆ&hßq ,¥� 3  ¡�Ð�¥�¦� KÕ�¥�§�Ñ5¨`PQO$I�bSU�]SV�\&[(UWO�O{\,e1U�pZI�VGK[�I�PXJ�_HGHO�PNY;]SLNU�GKJ�T.[�\KY;]�G [�IcV�UW]SV�UWO�U�J>I�G,I�PN\KJ

\,ecGsTSG,I�GsO�U(IWh��iUWV�U a�O�PXY;]SLNPN[�PwIxM�PNOBU�PXI�bSUWVoe�V�\KYàI�bSU3]gU�VO�]gUW[(I�PNuKU`\Ke0GKR&I�\ Y;G,I�PQ[`G,J�GKLXM&O�PNO��O�\�I�b1G5I{G�YsGK[b�PXJSU�[�G,JD]gU�V�e�\KV�Y¿e�RSV�I�b�U�V�]�V�\&[(U�O�O�PNJS_�U(áj[(PNU�J>I�LNMS��\KV�PwI�PQO�bZRSYsG,JSf�\ V�PNU�J>I�U�T��O�\qI�b�G,IdI�bSU`V�U�]SV�UWO�U�J>I�G,I�PN\KJj\ k&I�GKPXJ�UWTjPQO�UWG O�M^I�\;[�\KY;]SV�U�bSUWJ�TtGKJ�T�PXJ>I�R�PwI�PXu U�LNMtG,]S]gUWGKLwfPNJS_>�(hc��JtI�bSU3[(LNR�O�I�U�V�PNJS_^[�\KJ>I�U�pZIWaSGqIxMZ]SPN[WG,L�TSG,I�G^G,k�O�I�VGK[(I�PN\KJ�PNOoG;[(\ Y;]�GK[(I�T&U�O�[�V�PN]&I�PX\ J\,e8UWGK[b�[(LNR�OxI�U�V�acR�O�R�G,LNLXM�PNJ~I�U�V�Y;O^\Ke8[(LNR�O�I�U�V^]SV�\,I�\,IxMZ]1U�O.\ V.V�U�]SV�UWO�U�J>IG5I�PNuKUt]�G5I�I�U�V�J�OO�R�[byG OdI�bSU3[�U�J>I�V�\KPQT}Ä Í1�(Ç�h�i\5�àPQOqI�bSUy\KR&I�]SR&Is\,eHG�[�LXR�O�I�UWV�PNJS_}G,LN_K\KV�PXI�bSYâU�u5GKLXR�G,I�U�T�ãä½�b�G,Is[b1G,VGK[�I�U�V�PXmWUWO3G

º _K\Z\&T�¼�[�LXR�O�I�UWV�PNJS_�V�U�O�RSLXI�GKJ�T¿G�º ]1\Z\ VW¼d\KJSUvãå�BLXL`[(LNR�O�I�UWV�PNJS_�GKLX_ \KV�PwI�bSYsOs�oPXLNL�aB�obSUWJ]SV�UWO�U�J>I�U�T��oPwI�bæTSG,I�GSao]�V�\&T&R�[�Ul[(LNR�O�I�UWV�Osç�V�UW_ GKV�T&LNUWO�Os\KeD�ob�U(I�b�U�V�I�bSU}TSG5IG~[(\ J IG,PNJ[(LNR�O�I�UWV�O8\KV8JS\,I�hB��e!I�bSU^T�G5I�GtT&\ZUWOH[(\KJ>IG,PNJl[(LNR�O�I�U�VOWagO�\KY;U.[�LXR�O�I�UWV�PNJS_yG,LN_K\KV�PXI�bSYsOiYsGvM\KkSI�G,PNJ�º k1U�I�I�UWVW¼0[(LNR�O�I�UWV�O3I�b�GKJ�\,I�b�U�VO�hz��bSU�GKO�O�U�O�O�O�Y;UWJ I3\KeiGz[(LNR�O�I�U�V�PNJS_z]SV�\&[(UWTSRSV�U ¼ O\KRSI�]SR&I�a&I�b�U�J�a&b�G OoO�UWuKUWV�GKL�e�G [(U(IO�h�è8JSUDPQO�GK[�I�R�G,LNLNMtG,JyGKO�O�U�O�O�Y;U�J>Id\Ke�I�bSU`TSG5IGqT&\ YsG,PNJVG5I�b�U�VDI�b1G,J�I�b�Ut[(LNR�O�I�U�V�PNJS_zG,LN_K\ V�PXI�bSYé]1UWVqO�U^ç�TSG5IG��obSPN[b~TS\nJS\,Iq[�\KJ>I�GKPXJ�[�LXR�O�I�UWV�OO�bS\KRSLQTyJS\,I8k1U3]�V�\&[(U�O�O�UWTykZM�Gs[�LXR1OxI�U�V�PXJS_jGKLX_ \KV�PwI�bSY�h���bSUqOxI�R�T&My\,eiÕ(�#ÔZÐ�¥�¢(¦`¥�¢�¨g£K¢�¨gÕ�Ú5a�obSUWV�UWPXJ.I�bSUoPNJS]SR&I!TSG,I�GHG,V�U�U�pSG,Y;PXJ�UWT.I�\DO�UWUdPXe�I�bSU�V�UdPNOcGKJ>M`Y;UWV�PXI0I�\DGH[�LXR1OxI�U�VcG,J�GKLXM&O�PNO]SV�PX\ V�I�\s\ JSU`k1UWPXJ�_j]1UWV�e�\ V�Y;U�T�aSPQOiG;V�UWLNG,I�PNuKUWLXMjPNJ�G [�I�PNuKU`V�UWO�UWGKV�[byG,V�UWG;G,J1T��oPNLNL�JS\KIik1U[(\ J�O�PNT&UWV�U�Tne�RSV�I�b�U�V`PNJlI�bSPNO.O�RSV�uKUWMKh^��bSU;PXJ>I�UWV�U�OxI�UWTlV�U�GKT&UWVHPQODV�U(e�U�V�V�UWTnI�\�Ä Í>êSµ{ËKë5Ç0e�\KVPNJ&e�\KV�YsG5I�PN\KJ�h

Page 5: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '�6�'H«�= 2(¬�6�­W4Q)#*(®>¯g��°S­�±�) ­�² � ì

í �wÔZÐ¥�¢�¦�´5 5�#§�£,§�¥�Ú�G,J1G,LNMZO�PQO�avkZM3[(\ J I�V�G OxI�avPNO�I�bSU�GKO�O�UWO�O�Y;U�J>I$\,e1G8[(LNR�OxI�U�V�PXJ�_B]SV�\&[(UWTSRSV�U ¼ O\KRSI�]SR&I�hcèBe�I�U�J`I�bSPQO{GKJ�G,LNM&O�PQO�R�O�UWO$GiO�]1U�[(PXr1[�[�V�PXI�UWV�PN\KJ`\KeS\K]&I�PXYsGKLXPXIxM�µ5bS\5��UWuKUWVWaWI�bSU�O�Ud[(V�PwfI�UWV�PQG`G,V�UiR�O�R�GKLXLNMqGKV�V�PXu UWT;G5IdO�RSkSîxUW[�I�PXu U�LNMKh0�iUWJ�[(U a LNPwI�I�LNUBPNJ;I�bSU8�dGvMq\,e0º _K\KLQT;OxIG,J�T�G,VTSO�¼U(p&PQOxIHPXJ�[(LNR�OxI�U�V�PXJ�_tU(pS[�U�]&IHPXJz�dU�LNLXf�]SV�UWO�[(V�PNk1U�TnO�RSk�T&\ Y;GKPXJ1O�hiï!GKLXPQT&PXIxMnGKO�O�U�O�O�Y;U�J>I�O8G,V�U\KkSîxUW[�I�PXu UnÄ Í&Ü�Ç!G,J�T�GKV�U^]1UWV�e�\ V�Y;U�TzI�\zT&U(I�U�V�Y^PNJSU;�obSU�I�bSUWV`I�bSU;\ R&I�]SRSI3PNO`Y;U�G,JSPNJS_,e�R�L�h�ð[(LNR�OxI�U�V�PXJ�_yO�I�V�R�[�I�RSV�U.PQO8u5GKLXPQTzPXe�PXID[WG,JSJ�\,IDV�U�GKO�\KJ�GKkSLXMyb�Gvu U.\&[�[�RSV�V�UWTzk>Mn[b�GKJ�[(U^\KVGKO8G,JzGKV�I�Pwe�G [�IB\KecGt[(LNR�OxI�U�V�PXJ�_tG,LN_K\ V�PXI�bSY�h�½�bSUWJlOxIG5I�PNO�I�PQ[�GKL{G,]�]SV�\>GK[bSU�OdI�\y[(LNR�OxI�U�V�PXJ�_G,V�U3R�O�UWT�a1u5G,LNPQTSG5I�PX\ JnPNOHGK[W[(\KY;]SLNPQO�bSU�T�kZMy[WG,V�U(e�RSLNLXMnGK]S]SLNM>PNJS_tO�I�G,I�PQOxI�PN[WG,L{Y^U�I�bS\&TSOHG,J1TI�U�OxI�PXJ�_lbZMZ]1\KI�bSU�O�U�O�hz��bSUWV�UyG,V�U;I�bSV�U�UtIxMZ]1U�O.\Ke�u5GKLXPQTSG5I�PX\ J�O�I�R�T&PNUWOWhl�BJ¹¢�× ¥�¢(¦�¨� 5��G OxfO�UWO�O�Y;U�J>Io\,e0u5G,LNPNTSPwIxMt[�\KY;]�GKV�U�OdI�bSU`V�UW[�\5uKU�V�UWTtOxI�V�R�[(I�RSV�UHI�\jGKJ� DÏg¦�§�Ñ5¦�§�O�I�V�R�[(I�RSV�UKhc�iJ§�¨�¥�¢�¦�¨g 5��U�p&GKY;PXJ�G,I�PN\KJ}\,eduvGKLXPQT&PXIxMzI�V�PNUWOHI�\�TSU(I�UWV�Y;PNJSUsPXe�I�bSUjOxI�V�R1[�I�R�V�U;PQO`PXJ>I�V�PNJ�O�PN[WG,LNLXMG,]�]SV�\ ]SV�PNG,I�Use�\ V.I�bSUnTSG5IGSh��é¦�¢(�X ,¥�§�´5¢qI�U�OxIs[(\ Y;]�G,V�UWO3Ix��\}OxI�V�R�[(I�RSV�UWO^G,J1T~Y;UWG O�RSV�UWOI�b�U�PNVoV�UWLNG,I�PNuKUBY;UWV�PXIWhc��J�TSPN[�UWO�R�O�UWTte�\KVdI�b�PNOo[�\KY;]�G,V�PQO�\ JtG,V�UHTSPNO�[(R�O�O�UWT�PXJ�T&U(IG,PNL�PXJ�Ä Å Æ&µÍZÜvÇ�aSGKJ�TyG,V�UHJ�\,IiT&PQO�[�R�O�O�UWT�e�RSV�I�b�U�VoPNJ�I�bSPQOo]�G,]gU�V�h

@ # ñ ^_2*<§>�C:<,A�ò C`C�+.] <,Á3Á )�)6-*H09T2;<sA�U(] <VUBW�ó ô>ÂB<,AK9S+ C�<��bSU�Gvu5GKPXLQG,kSPNLNPwIxM8\,e&O�R�[b3G�u5G OxI{[�\KLNLXU�[�I�PX\ JH\KeS[(LNR�OxI�U�V�PXJ�_iG,LN_K\KV�PXI�bSYsO�PNJDI�bSU�LXPXI�UWV�G,I�RSV�U![�GKJUWG O�PNLNMy[�\KJ&e�\ RSJ�TlGjR�O�UWVHG,I�I�U�Y;]&I�PNJS_�I�\yO�UWLXU�[�IHGKJlG,LN_K\ V�PXI�b�Y¾O�RSPXI�G,k�LXU.e�\KV8I�bSUq]SV�\ kSLNU�YG5Iib1G,J�T�h���J�Ä ÍKÍKÇ�aSGsO�U(Ii\Ke0G T&Y;PNO�O�PXkSPNLNPwIxMt[�V�PXI�UWV�PQG;T&U(r1JSUWT�kZMlÄ êS��Ç�G,V�UHR1O�U�TtI�\j[(\ Y^]1G,V�U[(LNR�O�I�UWV�PNJS_lGKLX_ \KV�PwI�bSYsO�h���bSUWO�U�G T&Y;PNO�O�PXkSPNLNPwIxM�[(V�PwI�U�V�PNGnGKV�Usk1GKO�UWT�\KJ�Èy�����DI�bSUjYsG,J�JSU�VPNJ}�ob�PN[b�[(LNR�O�I�U�VO`G,V�U^e�\KV�Y;UWT�ad��ËK�BI�bSUjOxI�V�R1[�I�R�V�U;\,edI�b�UjTSG5IGSa�GKJ�T���Ì �DO�U�J1O�PXI�PNuZPwIxMz\KeI�b�U�[(LNR�O�I�UWV�PNJS_zI�UW[bSJ�PN�>RSUtI�\�[b1G,JS_ UWODI�b�G5IsT&\lJ�\,I^G,�gU�[�IqI�bSUyOxI�V�R�[(I�RSV�Ut\KeoI�bSUyTSG5IGSh�i\5�dU�u U�V�aoI�b�U�V�U�PQO�JS\�[(V�PwI�PN[WG,LDG,J�GKLXM&O�PNOy\,e^[(LNR�OxI�U�V�PXJ�_�GKLX_ \KV�PwI�bSYsO�T&U�G,LNPXJ�_��oPXI�bæI�bSUPNY^]g\KV�I�GKJ>Io�>RSU�OxI�PX\ J�OoO�R�[bnGKO

õ¶ö �i\5�÷O�b�\KRSLQTjI�bSU3TSG,I�G^k1U`J�\KV�Y;GKLXPNm�U�T�ã�øõ¶ö ½�bSPQ[byO�PNY^PNLQG,V�PwIxMjY;U�GKO�RSV�UDPQOoG,]S]�V�\ ]SV�PQG5I�UBI�\;R�O�U`PNJnG^_KPNuKU�J�O�PwI�R�G5I�PX\ J1ã�øõ¶ö �i\5�÷O�b�\KRSLQT�TS\KYsG,PNJ�|ZJS\5�oLNUWTS_KUHk1U`R&I�PXLNPNm�UWT�PNJnG^]�G,V�I�PQ[(RSLQG,Vo[�LXR�O�I�UWV�PNJS_;]SV�\KkSLNU�Yjã�øõ¶ö �i\5��[�GKJjG`u5G,V�MqLQG,V�_KUiT�G5I�G`O�U(ID��O�GvMKa>G`Y;PXLNLXPN\KJs]1G5I�I�U�V�J�O�0k1UH[(LNR�O�I�U�V�UWT;U�áj[(PNU�J>I�LNMSãWø��bSUWO�U3PQO�O�RSUWOib�GvuKU`Y;\,I�PXu5G,I�UWTyI�bSPQOBO�RSV�u U�M a�G,J�T�PXI�O8G,PNYùPQOoI�\j]SV�\5uZPNT&U3G;]gU�VO�]1U�[�I�PNuKU

\KJjI�bSUHOxIG5I�U8\,e�I�bSU8GKV�I�PNJ�[�LXR1OxI�U�V�PXJS_.Y^U�I�bS\&T&\ LX\ _KM;G,J�TtG,LN_K\KV�PXI�bSYsOWh�½�PXI�b�O�R�[btG3]1UWV�fO�]1U�[�I�PNuKU a>GKJsPXJSe�\KV�Y^U�T;]SVGK[�I�PwI�PX\ JSU�V�O�bS\ RSLQT;k1UHG,kSLNU�I�\.[�\KJ&rgT&U�J>I�LNM;GKO�O�U�O�O0I�bSUiI�V�G T&U�\K��O\,e�T&PX��U�V�U�J>I�I�UW[bSJSPQ�>RSUWO�G,J�T;R�LwI�PXYsG5I�U�LNM;Y;GK|KUBG.[(\KY;]gU(I�U�J>I�T&U�[(PQO�PN\KJs\ JjGDI�U�[bSJSPQ� R�UB\KVO�RSPwI�U`\,e{I�UW[b�JSPN�>RSU�O�I�\;UWY^]�LX\5MjPNJnG^]�G,V�I�PQ[(RSLQG,VoGK]S]SLNPN[WG5I�PN\KJ�h��bSU�V�U`PNOBJS\j[(LNR�O�I�UWV�PNJS_;I�U�[bSJSPQ�>RSUDI�b�G,IBPQOiRSJSPNuKUWV�O�G,LNLNMtG,]S]�LXPQ[�GKkSLXU`PNJnRSJ�[�\5uKUWV�PNJS_qI�bSU

u5G,V�PXU�IxMt\KecO�I�V�R�[(I�RSV�UWOB]SV�U�O�UWJ>IiPXJzYqRSLXI�PQT&PXY;UWJ�O�PN\KJ1G,L{T�G5I�GtO�U�I�OWh���\KV8U(pSG,Y;]SLNUKag[(\KJ1O�PQT&U�VI�b�UqIx�d\,f�T&PNY;U�J�O�PX\ J�G,LcTSG,I�GyO�U�I.O�b�\5�oJlPNJ}�$PN_KRSV�U�� ��G>��h;úi\KI`GKLXL![�LXR1OxI�U�V�PXJS_�I�U�[bSJSPQ�>RSUWO[�GKJnRSJ�[�\5uKU�V8G,LNL�I�b�Uq[(LNR�O�I�UWV�OB]SV�U�O�UWJ>IBbSU�V�U3�oPXI�bzU��>R�G,L�e�GK[(PNLNPwIxM agkgUW[WG,R�O�U.[�LXR�O�I�UWV�PNJS_tGKLwf_K\ V�PXI�b�Y;O0\Ke�I�UWJ;[�\KJ>I�GKPXJ^PNY^]�LXPQ[(PXI�GKO�O�RSY;]&I�PN\KJ�OcGKk1\ R&I![(LNR�O�I�U�V�O�b�GK]1U�\ VcY.RSLXI�PN]SLNU(f�[(LNR�OxI�U�V[(\ J&r�_ RSV�G,I�PN\KJ�Odk�G O�U�Tt\ JtI�bSU3O�PXY;PNLNGKV�PXIxMjY;UWG O�RSV�UWO�GKJ�Ty_KV�\KRS]SPNJS_;[(V�PwI�U�V�PNGqR�O�UWT�h�iRSYsG,J1OB]gU�V�e�\KV�Y¾[�\KY;]gU(I�PXI�PNuKUWLXM��oPXI�b}G,R&I�\KYsG5I�PN[3[�LXR1OxI�U�V�PXJS_t]SV�\&[�UWT&RSV�UWOBPXJzIx��\tTSPwf

Y;U�J�O�PN\KJ�OWa�kSRSI;Y;\>OxIsV�UWG,L�]SV�\Kk�LXUWY;O;PNJZuK\ LXu U�[(LNR�O�I�UWV�PNJS_}PXJ�bSPN_KbSUWVsT&PXY;UWJ�O�PN\KJ1O�h���IsPNOT&PXáj[(RSLXI;e�\KV;bZRSYsG,J�O.I�\}\Kk&IG,PNJ�GKJ�PNJ I�RSPXI�PNuKUyPXJ>I�UWV�]�V�U�I�G5I�PX\ J�\Ke8TSG5IGzUWY.kgUWTST&U�T�PNJ�GbSPN_Kb&f�T&PNY;U�J�O�PX\ J�G,L&O�]�GK[�UKh$��J^G TST&PXI�PN\KJ�a TSG5IG8b1G,VT&LXMDe�\ LXLN\5�~I�bSU ö PQT&UWGKLNøHO�I�V�R�[�I�RSV�U�Oo��¢�·¸© ·XûbZMZ]1UWV�O�]SbSUWV�PQ[�GKL�aSLNPNJSUWGKV��O�bS\5�oJ�PXJz�$PN_KRSV�Uj� hd��bSPQOiU�p&]SLNGKPXJ1O�I�bSU.LNGKV�_ U`J>R�Y.kgU�Vi\Kec[�LXR1OxfI�UWV�PNJS_nG,LN_K\ V�PXI�b�Y;OH�obSPQ[b�[(\KJ>I�PXJZRSU^I�\nGK]S]1U�G,V`PNJ}I�bSU;LNPwI�U�VG5I�R�V�U µ�UWG [b�J�U��»[(LNR�OxI�U�V�PXJ�_

Page 6: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ü � �! #"$ &%('�)#*,+�-. #/0 1-3254#6�78',*�9;: %, �<>= 75*5*

G,LN_K\ V�PXI�b�Y¶]1UWV�e�\ V�YsOoO�LXPN_Kb>I�LNMjkgU(I�I�U�ViI�b�GKJtI�bSU`U(p&PQOxI�PXJS_;\ JSUWO�\ JyG;O�]1U�[(PXr1[`T&PQOxI�V�PNkSR&I�PX\ J\,e0]�G,I�I�UWV�J1O�h��IBPNOiUWO�O�UWJ I�PNGKL�e�\KViI�bSU3R1O�UWVi\,e!Gs[(LNR�O�I�UWV�PNJS_jG,LN_K\ V�PXI�b�YàJS\,I8\KJSLNMjI�\sb�GvuKU3G^I�bS\KV�\KRS_ b

RSJ�TSU�VOxIG,J�T&PNJS_�\,e3I�bSU�]�G,V�I�PQ[(R�LNGKVtI�UW[bSJSPQ�>RSU}k1UWPXJS_�R&I�PXLNPNm�UWT�a8kSRSInGKLNO�\�I�\�|>J�\5�äI�bSUT&U�I�G,PNLQO�\Ke�I�bSUHT�G5I�Gq_ G,I�bSUWV�PNJS_q]SV�\&[�UWO�OdGKJ�TsI�\qb1GvuKU8O�\KY;UDT&\KYsGKPXJ�U(p&]1UWV�I�PNO�UKµZI�bSUDY;\KV�UPNJ&e�\KV�YsG5I�PN\KJ;I�bSUBR1O�UWV�b�G O!G,kg\KR&I�I�bSUHTSG5IG3G5I�b�G,J�T�aKI�bSUBY;\KV�UiLNPX| U�LNM.I�bSUBR1O�UWV!��\ RSLQT;k1UI�\�O�R�[�[�U�UWTlPXJ�GKO�O�UWO�O�PNJS_jPXI�OHI�V�RSU;[(LQGKO�OHOxI�V�R�[(I�RSV�U�Ä Å>ÆvÇ�h3��bSPNO`TS\KYsG,PNJlPNJ&e�\KV�YsG5I�PX\ Jl[�GKJG,LQO�\tkgUqR�O�UWTlI�\�PXY;]SV�\5uKU.I�bSUs�>R�GKLXPXIxM�\,e!e�U�G5I�R�V�U^U(pZI�VGK[(I�PN\KJ�a�O�PXY;PNLNGKV�PXIxMn[(\ Y^]�R&I�G,I�PN\KJ�a_KV�\KR�]SPXJ�_�a&G,J�T�[�LXR�O�I�UWVoV�UW]SV�UWO�U�J>I�G,I�PN\KJ�ÄX�WÌ Å5Ç�h�i]S]SV�\K]�V�PQG5I�UB[(\ J�OxI�V�GKPXJ>IO!\KJ;I�bSUDTSG5IG3O�\ RSV[(UB[WG,JskgU8PNJ�[(\ V�]g\KVG5I�UWT^PNJ I�\qGq[(LNR�OxI�U�V�PXJ�_

]SV�\&[(UWTSRSV�U hyè8JSUsU�p&GKY;]SLXUs\Ke�I�bSPQO3PQOsÙ^§w×K¥�Ô&¦�¢j¦�¢�Ð�Ñ,�#´W§�¨Z©lÄX�Wë Ì5Ç�a��obSUWV�UWPXJ�PXI.PNO.GKO�O�RSY;U�TI�b1G5IoI�b�UDT�G5I�G;GKV�UDT&VGv�oJte�V�\KYýGqY;PwpZI�RSV�U`\Ke$GKJ�RSJ�|>J�\5�oJ�JZRSYqk1UWVo\,e$TSU�J�O�PwI�PXU�O`��\Ke�I�U�JGKO�O�RSY;UWT�I�\�kgUzY.RSLXI�PNu5G,V�PNG,I�UlþDGKR�O�O�PQG,J1�(h¿��bSUz[(LNR�O�I�U�V�PNJS_�]SV�\KkSLNU�Yÿb�U�V�UnPNO;I�\�PNTSU�J&fI�PXe�M�I�bSU�JZRSYqk1UWV;\,eBY;PXp>I�RSV�Uy[�\KY;]1\ JSU�J>IOqGKJ�T�I�bSU�]�G,VG,Y;U(I�U�VO3\KeBUWG [b�[(\ Y^]g\KJ�U�J>IWh��bSU}[(\KJ1[(U�]SIt\,e�£ ¢(¨�Ч�¥�Úl[�LXR�O�I�UWV�PNJS_�GKJ�T�G~Y;U�I�bS\&T&\ LX\ _KM~e�\ V�T&U�[(\ Y^]g\ O�PXI�PN\KJ¿\KeHe�U�G5fI�R�V�UBO�]�G [(UWOBÄw�vÆvÇ�b�G O�GKLNO�\`k1UWU�JsPNJ�[(\ V�]g\KVG5I�UWT^PNJ I�\DI�VGKT&PXI�PN\KJ1G,L�[�LXR�O�I�UWV�PNJS_3Y;U�I�bS\&T&\ LX\ _KMKaMZPXUWLNTSPXJS_sG^I�UW[bSJSPQ�>RSUHe�\KVoU�p>I�V�G [�I�PXJS_;\5u U�V�LNGK]S]SPNJS_q[�LXR�O�I�UWV�OWh

@ # ���n+ C:9=U[AKFØ!u U�J�I�b�\KRS_ b�I�bSU�V�UnPQOjG,J�PNJ�[(V�UWG O�PNJS_�PXJ>I�U�V�UWO�IjPXJ�I�bSUzR�O�Un\,e`[(LNR�O�I�U�V�PNJS_�Y;U(I�b�\ZT�OjPNJ]�G,I�I�UWV�JtV�U�[(\K_ JSPXI�PN\KJlĸÜ�Ç�aZPXYsG,_ Ui]SV�\&[(UWO�O�PXJS_yÄw�����,ÇgG,J1TsPXJSe�\KV�Y;G,I�PN\KJjV�U(I�V�PNU�u5GKL$ÄX��ÆS�Kµg��Æ,Å,Ç�a[(LNR�O�I�UWV�PNJS_lb1GKO.GlV�PQ[b~bSPQO�I�\KV�M}PXJ�\,I�b�U�V;T&PNO�[(PN]SLNPXJ�UWOyÄ Å>ÆvÇdO�R�[b�G O.k�PX\ LX\ _KMKa0]�O�M&[bSPQG5I�V�MKa]�O�M&[bS\KLN\K_ MKa�GKV�[b1G,U�\ LX\ _KM a!_KUW\KLN\K_KM a�_ U�\K_ V�GK]SbZMKa�GKJ�T�YsG,V�|KU(I�PXJ�_�h÷èBI�bSU�VsI�U�V�YsOsY;\KV�U\KV^LNUWO�OqO�MZJS\KJZMZY;\KR�O.�oPwI�b�[(LNR�O�I�UWV�PNJS_lPNJ�[�LXR�TSU�Ô&¨�ÐÔ�Ï�¢�¦�´W§QÐ�¢£��X¢ 5¦�¨�§�¨Z©�Ä Å>ÆvÇ�a�¨�Ô&Ùs¢(¦�§�Õ 5�¥� �×ZÑ5¨�Ñ5Ù^Ú�ÄX�vÜ5Ì,Ç�ac´5¢Õ(¥�Ñ5¦���Ô� 5¨1¥�§�� 5¥�§�Ñ5¨~ÄX��Í>Ì5Ç�a�G,J�T��X¢ 5¦�¨1§�¨>©l¡�ÚlÑK¡(Ð�¢(¦�´5 5¥�§�Ñ5¨~ÄX�WÌ>ËvÇ�hq��bSUr�UWLNT�\KeBO�]1G5I�PQG,LdG,J�GKLXM&O�PNO3\,ei]g\KPNJ Iq]�G5I�I�U�V�J�OyÄw�vÆ,Ì,Ç�PNO^G,LQO�\nV�UWLNG,I�UWT}I�\�[�LXR�O�I�UWVqGKJ�G,LNM&O�PQO�h��bSU�PNY^]g\KV�I�GKJ�[(U�G,J1T�PNJ>I�U�VT&PQO�[�PX]�LXPNJ�G,V�M�J�G,I�RSV�U�\KeH[�LXR�O�I�UWV�PNJS_�PQO;U�uZPNTSU�J>IqI�bSV�\KRS_ b�PXI�Ou5GKO�IoLXPXI�UWV�G,I�RSV�UKh�ýJZRSYqk1UWVq\Keik1\Z\K|&Oq\KJ�[�LXR1OxI�U�V�PXJS_lb�GvuKUjkgU�UWJ�]SR�kSLXPQO�bSUWT¹Ä Å>Æ&µdÜ&µ�ë ËSµB�5ÜvÍ�µ�ÆS�Kµ�Æ5Í�µ

�WÌ,Ç�aZPNJyG TST&PXI�PN\KJtI�\;O�\ Y^UHR�O�U(e�RSL�GKJ�T�PXJ&Ý1RSU�J>I�PQG,L�V�U�uZPNU��¿]�GK]1UWV�OWhc�ÉO�RSV�uKUWM;\,e�I�bSU`OxIG5I�U\,edI�b�UtG,V�I`PXJ~[�LXR�O�I�UWV�PNJS_~Õ�§�¦�Õ ��WÅZÜ5ë��dG O`V�UW]1\ V�I�UWT�PXJ�Ä Í>Æ5Ç�ht�ý[(\KY;]�GKV�PQO�\KJl\Kedu5GKV�PN\KR�O[(LNR�O�I�UWV�PNJS_�GKLX_ \KV�PwI�bSYsOse�\KVy[(\ J�OxI�V�R1[�I�PNJS_�I�bSUlY;PNJSPNY;GKL`O�]�GKJSJSPNJS_�I�V�UWU�G,J1T�I�bSU�O�b�\KV�IO�]�G,JSJ�PXJS_�]�G,I�b}�dG OH_KPNuKU�J}PNJ�ÄX��Ë ËvÇ�hs��LNR�O�I�U�V3GKJ�G,LNM&O�PQO8�dG O`G,LQO�\�O�R�V�u U�MKU�TnPNJ�ÄX�� Ì5Ç�h^�V�U�uZPXUW�à\,e8PXYsG,_ U�O�U�_ Y^UWJ>I�G5I�PX\ J�kZM~[(LNR�O�I�UWV�PNJS_l��GKO^V�U�]g\KV�I�U�T�PXJÉÄX����,Ç�h���\ Y;]�G,V�PNO�\KJ1O\,eiu5GKV�PN\KR�O.[(\KYqkSPNJ�G5I�\KV�PNGKL!\K]&I�PXY;PNmWG,I�PN\KJ�O�[bSU�Y;U�O�a0k�G O�U�T�\KJ~U�pZ]gU�V�PNY^UWJ>I�OWa$b1GvuKUskgU�U�JV�U�]g\KV�I�UWT�PNJ�ÄX�WÌ Ì5Ç�G,J1T�Ä Í,Ç�h

@ # � ` Nq9T] +.-*<��bSPQO$]�G,]gU�V0PQO{\ V�_>G,JSPNm�U�T3GKO{e�\ LXLN\5�iO�h$ÒZUW[(I�PN\KJsËi]SV�UWO�U�J>IO{T&U�r�JSPXI�PN\KJ�O0\KeSI�UWV�YsO{I�\HkgUdR1O�U�TI�b�V�\ RS_KbS\ R&I�I�bSU�]�G,]gU�V�h$Ò&UW[�I�PX\ JqÌ8O�RSY;YsG,V�PNm�UWO{]�G,I�I�UWV�JqV�UW]SV�UWO�U�J>I�G,I�PN\KJ�a�e�UWG,I�RSV�U�U�pZI�VGK[�fI�PN\KJ�a0GKJ�T}e�UWG,I�RSV�UtO�U�LNUW[(I�PN\KJ�hnï!GKV�PN\KR�OqG,]S]�V�\>GK[bSU�OHI�\nI�bSU�[�\KY;]SR&IG5I�PN\KJ�\Keo]SV�\vp&PNY;PwIxMkgU(Ix�dU�U�Js]1G5I�I�U�V�J�O!GKV�UiT&PQO�[(R�O�O�U�T;PXJtÒ&UW[�I�PX\ JsÍ�hcÒZUW[(I�PN\KJtÆH]SV�UWO�U�J>IO!GDI�G,p&\KJS\ Y.M3\Ke�[�LXR1OxfI�UWV�PNJS_nG,]�]SV�\>GK[bSU�O�a�TSUWO�[(V�PXkgUWOHI�bSUsYsG5îx\KVHI�UW[bSJSPQ�>RSUWODPNJ�R�O�UKa{GKJ�T}T&PNO�[(R1O�O�UWODUWY^UWV�_ PXJ�_I�U�[bSJSPQ�>RSUWO�e�\ VB[(LNR�O�I�UWV�PNJS_;PXJ1[(\KV�]g\KVG5I�PNJS_;JS\ J&f�JZRSY;UWV�PQ[D[(\KJ1OxI�V�GKPXJ>I�OoGKJ�T�I�bSUq[(LNR�OxI�U�V�PXJ�_\,eHLNGKV�_ UyO�U(IO;\,eH]�G5I�I�U�V�J�OWh�Ò&UW[�I�PX\ J�ê�T&PQO�[(R�O�O�U�O;G,]S]SLNPQ[�G5I�PX\ J�O^\,eD[(LNR�OxI�U�V�PXJ�_}Y;U�I�bS\&TSOI�\�PXYsG,_ UlG,J1G,LNMZO�PQOtG,J1T�TSG5IG�Y;PXJSPNJS_�]SV�\ kSLNU�YsO�h �$PNJ�G,LNLNMKa8ÒZU�[�I�PX\ J÷Ü}]SV�UWO�U�J>I�OtO�\ Y^U[(\ J�[(LNR�T&PNJS_;V�U�YsG,V�|&O�h

Page 7: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '�6�'H«�= 2(¬�6�­W4Q)#*(®>¯g��°S­�±�) ­�² � �ÀZ#DCoóc\�Q%J�Q ^�Qu`VJn7R"�J�C Jn`_^c"�^�Qe`VJ��bSUDe�\ LXLN\5�oPXJ�_.I�U�V�Y;OBG,J�T�JS\,IG5I�PX\ J��oPNLXL�k1U`R�O�UWTtI�b�V�\ RS_KbS\ R&I�I�bSPQOo]�GK]1UWVWh

õ �÷ÏS ,¥�¥�¢�¦�¨z��\KV� (¢ ,¥�Ô&¦�¢q´5¢Õ(¥�Ñ5¦�a0ÑK¡(Ð(¢�¦�´5 5¥�§�Ñ5¨�ag\KV.£  5¥�Ô&ÙD����PQOBGsO�PXJ�_KLNUDT�G5I�G;PXI�UWYùR1O�U�Tk>MtI�bSUq[(LNR�OxI�U�V�PXJ�_jG,LN_K\KV�PXI�bSY�h!��IoIxMZ]SPQ[�GKLXLNM�[�\KJ�O�PNO�I�Oi\,ecG;uKUW[(I�\ Vo\,e��jY;UWG O�RSV�U�Y;UWJ IO�È��� ����������������v��h

õ ��bSUtPNJ�T&PNuZPNT&R1G,LoO�[WG,LQG,V.[�\KY;]g\KJSUWJ IO ��!H\,eBGz]1G5I�I�U�V�J"�æGKV�Ut[WG,LNLXU�T# (¢ 5¥�Ô&¦�¢(Ðs��\KVn 5¥%$¥�¦�§�¡�Ô&¥�¢(Ð���hõ �sPNOdI�bSUt£5§�Ùs¢�¨SÐ�§�Ñ5¨� 5�#§�¥�Ú`\,e$I�bSU`]1G5I�I�U�V�J�\ Vo\,e{I�bSU`]�G,I�I�U�V�J�O�]�G [(UKhõ �»Ï� 5¥�¥�¢�¦�¨~Ð�¢�¥��oPNLXL�k1UyT&U�JS\KI�U�T"&'�)(�� � �����*�,+.- hn��bSU0/ I�b ]�G5I�I�UWV�J�PNJ1&â�oPNLXL�k1UT&U�JS\KI�U�T2� ! � �3� !34 � �������� !34 � ��h0��J;Y;GKJZM.[�G O�U�OcGD]�G5I�I�U�V�JsO�U�IcI�\DkgUB[(LNR�O�I�U�V�UWTqPQOcuZPXUW��U�TGKOoG,J65876�qÏ� 5¥�¥�¢(¦�¨�Ù; ,¥�¦�§w× h

õ � Õ(�N vÐÐ�aiPXJ�I�bSUlGKk�OxI�V�G [�I�adV�U(e�UWV�OsI�\�G�O�I�G,I�Uz\KeDJ1G5I�R�V�U�I�b�G5It_ \5uKUWV�J�O^I�bSUz]�G,I�I�U�V�J_KU�J�U�VG5I�PN\KJ}]SV�\&[(UWO�O`PNJ~O�\ Y;Uj[�GKO�UWOWh:9n\KV�Uj[(\ J�[(V�U(I�U�LNMKa{Gn[�LNG O�O.[�G,J�kgUjuZPNU��dUWT�GKO3GO�\ RSV�[�U�\Ke�]�G5I�I�UWV�J�O{�obS\>O�UdT&PNO�I�V�PNkSR&I�PN\KJqPXJ.e�UWG,I�RSV�UdO�]�G [(U�PQO$_K\5u U�V�JSUWTDkZM`GB]�V�\ k�G,kSPNLNPwIxMT&U�J�O�PXIxMtO�]gUW[�Pwrg[BI�\^I�bSU`[(LQGKO�OWh!��LNR�O�I�UWV�PNJS_qI�UW[b�JSPN�>RSU�OoG5I�I�U�Y;]&I�I�\^_ V�\ RS]t]1G5I�I�U�V�J�OoO�\I�b�G,I�I�b�Ud[�LNG O�O�UWO�I�bSU�V�U�kZMD\KkSI�G,PNJSU�T`V�U�Ý�UW[(I�I�b�UdT&PX��U�V�U�J>I{]�G,I�I�U�V�J3_KUWJSU�VG5I�PX\ JH]�V�\&[(U�O�O�UWOV�UW]SV�U�O�UWJ>I�UWTtPXJyI�bSU`]�G5I�I�UWV�JnO�U(IWh

õ<;  5¦�£`[(LNR�O�I�U�V�PNJS_^I�UW[b�JSPN�>RSU�OiGKO�O�PX_ JyGnÕ��X vÐÐ3�X  ¡�¢��>=?!$I�\sUWGK[b�]�G,I�I�U�V�J�O@�,!�a1PNTSU�J>I�PXe�MZPXJS_PwIO3[(LQGKO�O�hs��bSUjO�U(I3\Ke�GKLXLcLQG,kgU�LQODe�\ V3G�]1G5I�I�U�V�J�O�U�IA& PQOCBD�E(�=3��������F= + ->a��oPXI�bG=?!IH( ���J�JJK�ML�->a&�obSU�V�UALjPQO�I�bSU`JZRSY.kgU�Vo\Ke0[�LXR�O�I�UWV�OWhõ Ó�ÔN�O��Úq[�LXR�O�I�UWV�PNJS_�]SV�\&[(UWTSRSV�U�ODGKO�O�PN_KJlI�\�UWG [b�PNJS]SR&I3]1G5I�I�U�V�JP�,!BGte�VGK[(I�PN\KJ�GKLcT&U�_ V�UWU\,e0Y^UWY.kgU�VO�b�PX]�Q�!SRDPNJ�UWGK[by\KRSI�]SR&IB[�LXR1OxI�U�VUT1hõ � £5§QÐ�¥� 5¨�Õ�¢}Ùs¢ vÐ�Ô&¦�¢l��G�O�]gUW[(PQG,LNPNmWG5I�PX\ J�\,e3G�]SV�\vp&PXY;PXIxM�Y;U�GKO�RSV�Uv�;PQO�G�Y;U�I�V�PN[~��\KV� R1GKO�Pwf�Y;U(I�V�PQ[W��\KJ�I�bSUDe�U�G5I�RSV�U`O�]�GK[�UDR�O�U�T�I�\s�>R�G,J>I�PXe�MjI�bSU3O�PXY;PNLNGKV�PXIxMs\,e0]�G5I�I�UWV�J�OWh

ñZ#�YB"c^�^8ó�A}JzA0ócY$A0ó(7�óMJ}^c"c^�Qu`VJ@Vq\gó["�^�>�A0óV7�ó.WSó�E�^�Qe`�JXVE"�J�Cü\1ó["c^�>dA$ó^óZY�^BA�"!E.[^�Qe`VJ

��bSUWV�UiGKV�UoJS\3I�bSUW\KV�U(I�PQ[�GKLS_KR�PNT&UWLXPNJSU�O!�obSPQ[bjO�R�_K_KU�OxI0I�bSU8GK]S]SV�\K]SV�PNG,I�U�]�G,I�I�UWV�J1O�G,J1T.e�U�G5fI�R�V�U�O�I�\sR�O�U`PNJzG^O�]gUW[(PXr1[3O�PXI�R�G,I�PN\KJ�h!��J1T&U�U�T�aSI�bSU3]�G,I�I�UWV�J�_ U�JSUWV�G,I�PN\KJt]�V�\&[(U�O�O�PQOi\Ke�I�UWJJS\KIsTSPXV�UW[(I�LNM~[(\KJ>I�V�\ LXLQG,kSLNUKµ�I�b�UyR1O�UWVW¼ O^V�\ LXUyPXJ�I�b�Un]�G5I�I�U�V�J�V�U�]�V�U�O�UWJ IG5I�PX\ J~]SV�\Z[�UWO�O^PNOI�\l_ G5I�bSU�VDe�G [�IO.G,J1T}[�\KJ5îxU�[�I�RSV�U�O.GKk1\ R&I`I�bSU�TSG5IGSa$\K]&I�PX\ J�G,LNLXM�]1UWV�e�\ V�Yée�UWG,I�RSV�UtO�U�LNUW[�fI�PN\KJ�G,J�TnU�pZI�VGK[�I�PX\ J�a�G,J�TzTSUWO�PX_ JnI�bSU^O�R�k�O�U��>RSU�J>I8UWLXUWY;U�J>I�O8\,ecI�bSU^[�LXR1OxI�U�V�PXJS_�O�M&O�I�U�Y�h\dUW[WG,R�O�Uo\,e�I�b�U8T&PXáj[(RSLXI�PNUWOdO�R�V�V�\KRSJ1T&PXJ�_`]�G5I�I�U�V�JsV�U�]SV�UWO�U�J>I�G,I�PN\KJ�aKPwIdPNO�[(\KJZu U�JSPNU�J>I�LNMqG OxfO�RSY;UWT;I�b�G5IdI�bSU8]�G5I�I�UWV�JjV�U�]�V�U�O�UWJ IG5I�PX\ JsPNOdGvu5G,PNLNGKkSLXUB]SV�PN\KV�I�\^[(LNR�OxI�U�V�PXJ�_�h0úi\KJ�U(I�b�U�LNUWO�O�aGy[�G,V�U(e�R�L$PNJZuKU�OxI�PX_>G5I�PN\KJ�\,e!I�bSUsGvu5G,PNLNGKkSLXUqe�UWG,I�RSV�UWODGKJ�TlGKJ>MzGvu5GKPXLQG,kSLNUqI�VG,J�O�e�\KV�YsG5I�PN\KJ1O��UWuKUWJyO�PXY;]SLNU`\KJ�UWO��[WG,JyMZPXUWLNT�O�PX_ JSPwrg[�G,J>I�LXMsPNY;]SV�\5u UWT�[(LNR�OxI�U�V�PXJ�_^V�UWO�RSLXI�OWh!�÷_K\Z\&Tt]�G,I�fI�UWV�J�V�U�]SV�UWO�U�J>I�G,I�PN\KJ�[�G,J�\,e�I�U�J�MZPXUWLNT�G�O�PNY;]SLNU�GKJ�T�UWGKO�PNLXM~R�J�T&U�VO�I�\Z\&T�[�LXR�O�I�UWV�PNJS_1µ�G]g\>\ V�]1G5I�I�U�V�JjV�U�]SV�UWO�U�J>I�G,I�PN\KJsYsGvM;MZPXUWLNT�G.[(\ Y;]SLXU�pj[(LNR�OxI�U�V�PXJ�_.�obS\>O�UBI�V�RSU8O�I�V�R�[�I�RSV�UBPXeT&PXáj[(RSLXIB\KVBPXY;]g\ O�O�PNkSLNU`I�\jT&PQO�[(U�V�J�h��$PX_ RSV�U3ÌsO�bS\5�iOiGsO�PNY^]�LXU3U�pSG,Y;]SLNUKh���b�U3]1\ PXJ>IOiPNJI�b�PNOcË,F�e�UWG,I�RSV�U�O�]�G [(U�GKV�UdG,V�V�GKJS_KU�T8PNJ.G8[(RSV�uZPXLNPXJ�UWG,V$[(LNR�O�I�U�V$\,e�GK]S]SV�\vp&PXYsG5I�U�LNMH[�\KJ�O�I�GKJ>IT&PQOxIG,J�[�Uoe�V�\KY¤I�bSUi\ V�PN_KPNJ�h$��e�\KJSUi[b�\>\>O�U�O��dG,V�I�U�O�PQG,Js[�\>\ V�TSPXJ�G,I�U�O0I�\3V�U�]�V�U�O�UWJ IcI�bSUi]�G,I�fI�UWV�J1O�aSYsGKJ>M�[(LNR�OxI�U�V�PXJ�_jG,LN_K\KV�PXI�bSYsO��d\KRSLQTtkgU3LNPX| U�LNMsI�\;e�VG,_ Y;U�J>IoI�bSU3[�LXR1OxI�U�ViPNJ>I�\;Ix�d\\KVHY;\KV�Uq[�LXR�O�I�UWV�ODO�PXJ1[(U.PXI`PNOHJS\KID[�\KY;]�G [�IWhD��exa�bS\5�dU�u U�V�a1\ JSU^R�O�U�O8G�]g\KLQG,VD[(\Z\KVT&PNJ�G5I�UV�U�]SV�UWO�U�J>I�G,I�PN\KJye�\KV8I�b�Uq[(LNR�O�I�UWV�OWagI�bSUqV�G T&PXR1OB[(\Z\ V�T&PNJ�G,I�U3U�pZb�PXkSPXI�OBI�PN_Kb>I`[(LNR�O�I�U�V�PNJS_tG,J1TG^\KJSU�f�[�LXR1OxI�U�ViO�\KLNR&I�PN\KJyPNO�LNPN|KU�LNMsI�\sk1U`U�GKO�PXLNMj\KkSI�G,PNJSU�T�h

Page 8: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

] � �! #"$ &%('�)#*,+�-. #/0 1-3254#6�78',*�9;: %, �<>= 75*5*

..

.

..

...

.

..

......

.

..

. ..

.

...

.

..

... .

..

.

. .. .

..

...

..

.

..

..

..

..

. ..

..

.

..

.

..

.

..

...

.

.

.

.

..

..

...

...

. ..

...

.. .

....

..

.

. ..

...

.

..

.. .

.

.

..

..

..

..

. .

...

..

..

...

.

.

.

.

..

.

.

. ...

.

..

..

..

..

..

. ..

..

.

.. .

.

.

..

.. .

..

..

. ..

.

..

...

...

. . .

..

.

.

.

..

.

.. ..

.

..

..

.

.. .

..

..

.. .

.

. ..

.

.

. ..

.

.

.. .

.. . .

..

. ..

. . ...

.

..

.. . .

..

.

.

..

... .. .

. ..

...

. ..

.

...

.. ..

..

..

.

.

.. .

..

. .

ä(jel*�:¾;�ŧs=d*iPpqjebejek*h:tEi6s=bed*f gGh=i6��m*wTfPh�oBwTjek~gGf�tEiPh�tEo;o*iGw:�;je|�tSgPh=b �}h=�qd;jer*jefPgGtEkXg6x%iPwT|IgGm;h�wTiPjelTjek6����j �,h=iGh=k~go3tSg gGh=iPk�iGh=o*iGh=fPh:k~gGtSgGjewTk*f�y%s=wXwTiGr*jek*tSgGh&fP�qfPgPh:|_f����MwTd*ber�s:tEd*fPh&s=bed*f gGh=iPjek*l_tEbelTwTiGj gPm*|_f�gGwL�qjeh=ber�r*j �,h=iGh=k~giGh=fPd*b gGfMxKwTiMgGm*jef�r3tSgGt�y%fPh=h}gGh��Xg����

��]�G5I�I�UWV�J3[WG,J`Y;UWG O�RSV�UcU�PXI�b�U�V{G�]�b>M&O�PN[WG,L,\ k&îxUW[(I���¢�·¸©>·NaKGo[b�G,PNV��g\KV�GKJ3G,k�O�I�VGK[(I�JS\,I�PX\ J��¢�·¸©>·Na�GtO�IxM>LNU3\Ke!�oV�PXI�PNJS_>�(h8�8OBJS\KI�U�TzG,kg\5uKU a�]�G,I�I�UWV�J1OBG,V�U3V�U�]SV�UWO�U�J>I�UWTn[(\ JZuKU�J>I�PX\ J�G,LNLXMGKOHYqRSLwI�PNTSPXY;U�J1O�PN\KJ�GKL0uKUW[(I�\ V�OWa��obSU�V�U.U�GK[b�TSPXY;U�J1O�PN\KJ�PNODGyO�PNJS_KLNUqe�UWG5I�RSV�UyÄ Í Å,Ç�h3��bSU�O�Ue�UWG,I�RSV�UWOo[WG,Jyk1U`UWPwI�bSU�Vi�>R�GKJ>I�PXI�G5I�PXu UD\KVi�>R�G,LNPXI�G5I�PXu UKhc�S\ VoU(pSG,Y;]SLNUKa&PXe@^�¢(§w©`_Z¥�GKJ�T�ÕÑ5�XÑ,¦G,V�U^I�bSUjIx��\ye�UWG,I�RSV�UWODR1O�U�T�a�I�bSU�J���Ëa�b�v¡(�N KÕOcW�HPQODI�bSUjV�U�]SV�UWO�U�J>I�G,I�PN\KJ�\,eoG�kSLNG [|z\KkSîxUW[�I�oPXI�bqË���RSJSPXI�O{\,e&��UWPX_ b>IWh{��b�Uce�UWG,I�RSV�UWO{[�G,J`kgU�O�RSk�T&PXuZPQT&UWT3PXJ>I�\iI�bSU�e�\KLNLX\5�oPNJS_�IxMZ]1U�O�ĸÜ5ë,Ç�È�x�v��d8R�G,J>I�PXI�G,I�PNuKU8e�UWG,I�RSV�UWOWÈ

��G ����\KJ>I�PXJZRS\ R�OduvGKLXR�UWO3��¢W·¸©>·Na��dU�PN_Kb>I�(h��k1�yF8PNO�[(V�U(I�UHu5GKLXRSU�O`��¢�·¸© ·Na1I�b�U`J>R�Y.kgU�Vo\,ec[(\ Y;]SR&I�UWV�O��h��[W����J>I�UWV�u5G,L�u5GKLXRSU�O`��¢�·¸© ·Na�I�bSU3TSRSV�G,I�PN\KJy\,ecG,JyU�u U�J>I�(h

��Ë ��d8R�G,LNPwIG5I�PXu UBe�U�G5I�R�V�U�O�È��G ��úi\ Y;PXJ�GKL�\KVoRSJ�\KVT&U�V�UWT�a���¢W·¸©>·Nag[�\KLN\KV���h��k1�nè8VT&PXJ1G,LS��¢�·¸©>·Na5Y^PNLNPwIG,V�MBVG,JS|8\KV��>R�G,LNPXI�G5I�PXu UcU�u5G,LNR�G,I�PN\KJ�O�\Ke I�U�Y;]1UWV�G,I�RSV�Ui� ö [(\Z\KLQø\KV ö bS\,Iø ��\KViO�\KRSJ1TtPNJ>I�U�J1O�PXIxM�� ö �>RSPNU(I�ø^\ V ö LN\KR�TSø>��hd8R�GKJ I�PwI�PNG,I�PNuKUce�U�G5I�RSV�U�O{[WG,J3kgUdY^U�GKO�RSV�UWTD\KJqGiVG5I�PN\BO�[�GKLXUH���oPXI�bqGiY^U�G,JSPNJS_Ke�RSLZV�U�e�U�V�U�J�[�U

u5G,LNRSUKa1O�R�[b�GKOdI�U�Y;]gU�VG5I�R�V�Uv��a&\KVo\ J�J�\KY;PXJ1G,L�\ Vd\ V�TSPXJ�GKL�O�[WG,LNUWOWhè8JSU`[�G,JnGKLNO�\qR1O�U3O�I�V�R�[�I�RSV�UWTte�UWG5I�RSV�UWO3ÄX�WÌ>ËvÇ��obSPQ[b�GKV�UHV�U�]SV�UWO�U�J>I�U�T�G OdI�V�U�U�O�a&�obSUWV�U

I�b�Ul]�GKV�UWJ IyJS\&T&UlV�U�]�V�U�O�UWJ IOtG�_ U�JSUWV�GKLXPNmWG,I�PN\KJ�\,e3PXI�O�[bSPNLQT�JS\&T&UWOWh¤��\KV�U(pSG,Y;]SLNUKaBG]�GKV�UWJ IoJS\&T&U ö uKUWbSPQ[(LNUWøqY;GvM�k1UqGq_ U�JSUWV�GKLXPNmWG,I�PN\KJy\,ec[bSPNLNT&V�U�J�LQG,kgU�LNUWT ö [WG,VO�ø�a ö kSR�O�UWO�øSaö I�V�R1[|ZO�øSa{G,J�T ö Y;\KI�\KV[(M&[�LXU�O�h ø»�SRSV�I�bSUWVWa{I�b�UsJS\&T&U ö [WG,VO�øy[(\ RSLQT�kgUtG�_ U�JSUWV�GKLXPNmWG,I�PN\KJ\,ec[�GKV�O�\Ke{I�bSU`IxMZ]gU ö �{\5MK\,IGKø�a ö �S\ V�TSø�a ö \dU�J�mWøSa�¢�¥�Õ(hd�Û_KUWJSU�VG,LNPXmWUWTtV�UW]SV�U�O�UWJ>I�G5I�PX\ J�\Ke]�G,I�I�UWV�J1O�aK[WG,LNLXU�TsÐ�Ú5Ùs¡�Ñ,�#§�ÕDÑK¡3e�¢Õ(¥�Ð{��GKO{]SV�\K]g\ O�UWT3PNJàÄ Í>ËvÇ�hcÒZMZY.kg\KLNPN[�\Kk&îxU�[�IOcG,V�UdT&U�r�JSU�TkZMnGsLX\ _KPQ[�GKL{[(\ J5îxRSJ�[(I�PN\KJz\KecU�uKUWJ>I�OWhB��bSUWO�U.UWuKUWJ IOiLNPXJ�|yu5GKLXRSU�O8GKJ�Tye�UWG,I�RSV�UWO8PNJz�obSPQ[bI�b�UBe�U�G5I�R�V�U�O�[�GKJsI�GK|KUi\ JSUB\ V�Y;\KV�UBu5GKLXRSU�O�GKJ�TjGKLXL�I�bSUH\Kk&îxU�[�IO�JSUWUWTsJ�\,I�kgUDT&U(r�J�UWTs\ JI�b�U3O�GKY^U`O�U(Ii\Ke�e�UWG,I�RSV�UWOWh��IDPQOH\,e�I�U�J}uvGKLXR1G,kSLNU.I�\�PNO�\KLQG5I�Uq\ JSLXM�I�bSU;Y;\ O�IDT&U�O�[�V�PN]&I�PXu U^GKJ�TlT&PQO�[(V�PXY;PNJ�G5I�\KV�M�e�U�G5f

I�R�V�U�O�PNJjI�bSUHPXJS]�R&IiO�U�IWaSG,J1TjR&I�PXLNPXmWUBI�bS\ O�U8e�UWG5I�RSV�UWO�U(pS[(LNR�O�PXu U�LNM^PNJ�O�RSk�O�UW�>RSUWJ>I�GKJ�G,LNM&O�PQO�h�SU�G5I�RSV�U�O�U�LNUW[�I�PX\ J.I�UW[bSJ�PN�>RSU�O{PQT&UWJ I�Pwe�M^G8O�RSk�O�U(Ic\Ke�I�b�UdU�p&PNO�I�PNJS_He�UWG,I�RSV�UWO{e�\KVcO�RSk�O�UW�>RSUWJ IR�O�UKa,�ob�PXLNU�e�UWG,I�RSV�U�U�pZI�VGK[�I�PX\ J.I�UW[bSJ�PN�>RSU�Oc[(\KY;]SRSI�U�JSU���e�UWG,I�RSV�UWO$e�V�\KYÛI�bSU�\KV�PX_ PXJ1G,L&O�U�IWh��J}U�PXI�bSUWV.[�G O�U a�I�bSUs_ \ G,L0PQOHI�\�PNY^]�V�\5u U^[�LNG O�O�Pwrg[�G5I�PX\ Jl]gU�V�e�\KV�YsG,J�[�U^GKJ�T1Êv\ VH[�\KY;]SR&IG5fI�PN\KJ1G,LiU�ás[�PXUWJ�[(M hæ�SU�G5I�RSV�UzO�U�LNUW[(I�PN\KJ�PNOtG���UWLXLXf�U�p&]SLX\ V�U�T�I�\K]SPQ[�PXJ�O�I�G,I�PQOxI�PN[WG,Li]�G,I�I�U�V�JV�UW[(\ _KJSPXI�PN\KJ�Ä Í Å5Ç�µ�b�\5��UWuKU�V�a&PNJzGj[(LNR�O�I�U�V�PNJS_j[(\ J I�U(pZIq��§�·�¢W·Na�LQGK[|ZPXJ�_;[�LNG O�OiLNGKk1UWLNOie�\KVi]�G,I�fI�UWV�J1O��(aiI�b�Ule�U�G5I�R�V�U}O�UWLXU�[�I�PN\KJæ]SV�\&[�UWO�OtPQOt\Ke.JSU�[(UWO�O�PwIxMÛ K£"_�ÑWÕyG,J1T¿Y;PX_ b>I�PNJ>u \KLNuKUlGI�V�PQG,LXf�GKJ�TZf�U�V�V�\ V�]SV�\&[(U�O�O��obSUWV�U`u5GKV�PN\KR�OoO�RSk�O�U(IOo\,e$e�UWG,I�RSV�UWOBG,V�UDO�U�LNUW[(I�U�T�aSI�bSU`V�U�O�R�LwI�PXJS_

Page 9: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '�6�'H«�= 2(¬�6�­W4Q)#*(®>¯g��°S­�±�) ­�² � f]�G,I�I�UWV�J1O3[(LNR�O�I�U�V�UWT�a$GKJ�T�I�bSUj\ R&I�]�R&I.U�u5GKLXR�G,I�U�T�R1O�PNJS_zG�u5G,LNPNTSPwIxM}PXJ1T&U(p�ht��J~[�\KJ>I�VGKO�IWaO�\KY;Ui\,e�I�bSUi]g\K]SRSLQG,V�e�UWG,I�RSV�UoU(pZI�VGK[(I�PN\KJs]SV�\&[(U�O�O�UWOo��¢W·¸©>·Na&]SV�PXJ�[�PX]1G,L�[�\KY;]1\ JSU�J>IO�G,J1G,LNM fO�PNO`ĸÜZ��Ç���T&\;JS\,IiT&UW]1UWJ�Ty\KJyLNGKk1UWLXU�T�T�G5I�G^G,J1T�[WG,Jyk1U`R�O�UWTyT&PNV�U�[�I�LXM hhgiUWT&R�[(I�PN\KJy\,e{I�bSUJZRSY.kgU�Vd\,e�e�UWG5I�RSV�UWO�b�GKOdG,JtG TST&PXI�PN\KJ�GKL1kgU�J�U(rSI�a&J�G,Y;U�LNM^I�bSUDG,k�PXLNPwIxM^I�\.]SV�\&T&R�[(U8\KR&I�]SR&II�b1G5IB[�GKJ�kgU`uZPNO�R�GKLXLNMjPNJ�O�]gUW[(I�U�T�kZMtG;bZRSYsGKJ�h��#_7cQD/úQW3"iA�Q ^�i /yó["�7c>dA$ó(7ÒZPNJ�[(U}O�PNY;PXLQG,V�PXIxM�PQOte�RSJ�TSGKY^UWJ>I�G,L8I�\�I�b�U�T&U�r�JSPXI�PN\KJæ\Ke.G�[�LXR�O�I�UWVWa8G~Y;UWG O�RSV�Uz\Ke`I�bSUO�PXY;PNLNGKV�PXIxM�kgU(Ix�dU�UWJnIx�d\s]�G5I�I�U�V�J�OHT&VGv�oJ�e�V�\KY¾I�bSUqO�G,Y;U`e�U�G5I�R�V�U^O�]�G [(U3PQOiU�O�O�U�J>I�PNGKL�I�\Y;\ O�IB[(LNR�O�I�U�V�PNJS_;]SV�\&[�UWT&RSV�UWOWhh\�U�[�GKR�O�UD\Ke{I�bSU`u5G,V�PXU�IxMj\,e{e�UWG5I�RSV�UDIxM>]gUWOoGKJ�T�O�[WG,LNUWOWa>I�bSUT&PQOxIG,J�[�UjY;UWG O�RSV�Uz��\ V3Y;UWG O�RSV�UWO�HY.R1OxI.kgU�[b�\ O�U�J�[�GKV�U�e�RSLXLNMKhy��IqPQO3Y;\>OxI.[�\KY;Y;\KJ�I�\[�GKLN[�RSLQG5I�U.I�bSUn£5§QÐÐ�§�Ù^§��X 5¦�§�¥�ÚqkgU(Ix�dU�UWJnIx�d\t]�G,I�I�UWV�J1OBR�O�PNJS_�G�T&PNO�I�GKJ�[(UqY;UWGKO�RSV�UqT&U�r�JSU�T\KJ�I�bSU3e�U�G5I�RSV�UqO�]�G [(U hd½}U.�oPNLNL�e�\&[(R1Oi\KJ�I�bSU.�dU�LNLXf�|ZJS\5�oJnT&PQOxIG,J�[�U3Y;UWG O�RSV�UWOiR�O�U�Tye�\KV]�G,I�I�UWV�J1O��obS\ O�UHe�UWG5I�RSV�UWOoG,V�U`G,LNL�[(\ J I�PXJZRS\ R�OWh��bSU`Y;\ O�I�]g\K]�RSLNGKVoY;U(I�V�PQ[He�\KVi[(\ J>I�PNJ>R�\KR�O�e�UWG,I�RSV�UWO�PQO�I�bSU2jdÔ�Õ��#§�£K¢ 5¨�£5§QÐ�¥� 5¨�Õ�¢

�Nk>��� ! �F� R �l� m �noqp � �3� !34 oIr � R�4 o � kKs��t k �vuq� ! r � R uqk��

�obSPQ[b�PNOoG;O�]1U�[(PQG,L�[�G O�Us�xw.�DËK��\Ke{I�bSUA9nPNJS|K\5�iO�|ZPgY;U�I�V�PN[��y���� ! �F� R �z� m �noKp �,{ � !34 oIr � R�4 o { y s

��t y �vuq� ! r � R u�yZ���bSU`Ø!R1[(LNPNT&U�G,J�T&PQOxIG,J�[�UHb1GKOoG,JyPNJ I�RSPXI�PNuKU3G,]�]1U�G,L�GKO�PXIiPNOo[�\KY;Y;\KJSLNMjR�O�UWTtI�\;UWuvGKLXR1G5I�UI�b�U^]�V�\vp&PNY^PXIxM�\,e�\ k&îxUW[(I�OHPNJlIx�d\�\ VBI�bSV�U�U(f�T&PNY;U�J�O�PX\ J�G,L0O�]�GK[�UKh3��I`�d\KV�|ZO8�dU�LNL$�ob�U�J�GTSG,I�G;O�U�Iob�GKO ö [(\KY;]�G [�Iø.\ V ö PNO�\KLQG5I�UWTSø^[(LNR�O�I�UWV�ODÄX��Ë,Å,Ç�hc��bSU`T&VGv�ok�G [|qI�\jT&PNV�U�[�IoR�O�UH\KeI�b�U|9nPNJS|K\5�iO�|ZP&Y^U�I�V�PN[WOcPQOcI�b�UoI�UWJ�T&U�J1[(M.\Ke�I�bSUiLQG,V�_KU�OxI�f�O�[�GKLXU�T`e�U�G5I�R�V�U�I�\3T&\KY;PNJ�G5I�U�I�bSU\,I�bSU�VOWhdÒZ\ LXR&I�PX\ J�O�I�\;I�bSPQOi]SV�\Kk�LXUWYýPNJ�[(LNR�T&U3J�\KV�Y;GKLXPNmWG,I�PN\KJy\,e$I�bSUq[(\KJ>I�PXJZRS\ R�Ode�UWG,I�RSV�UWO��I�\lGn[(\ Y;Y^\ J�V�GKJS_KUs\ V`uvGKV�PQG,J1[(U��H\ V3\,I�bSU�V.��UWPX_ b I�PXJ�_zO�[bSUWY;UWOWh~}�PNJSU�G,V.[�\KV�V�UWLNG,I�PN\KJG,Y;\ JS_ze�U�G5I�R�V�U�Oq[WG,J�GKLNO�\�T&PQO�I�\KV�IsT&PNO�I�GKJ�[(U�Y;UWGKO�RSV�UWOWµ!I�bSPNO;T&PQO�I�\KV�I�PN\KJ�[�G,J�k1UnG,LNLNU�uZPwfG5I�UWTlk>MnGK]S]SLNM>PNJS_yGt�obSPXI�UWJSPNJS_tI�V�GKJ�O�e�\KV�Y;G,I�PN\KJ�I�\tI�bSU^T�G5I�Gt\KVHkZMyR1O�PNJS_�I�bSU;O��>R�GKV�U�T9zGKb�G,LQG,JS\ kSPQOdTSPNO�I�GKJ�[(U �Z�}�3�,!F����R���� �3�,! r ��Rv���|� � ���,! r ��R��F�U��obSUWV�UDI�bSU.]�G,I�I�U�V�J�O��,!�GKJ�T:��R.G,V�U3GKO�O�R�Y^U�TyI�\jkgU3V�\5�¹u UW[(I�\KVOWaSG,J�T��æPQOoI�b�U.O�GKY;]SLXU[(\5u5GKV�PQG,J�[�U0Y;G,I�V�PwpH\,eZI�b�U!]�G5I�I�UWV�J�O�\KV�I�bSU!|ZJS\5�oJ`[(\5u5GKV�PQG,J�[�U0Y;G,I�V�PwpD\,eZI�bSU!]�G,I�I�UWV�J`_ U�J&fU�VG5I�PX\ J.]SV�\&[(U�O�OWµ������FJ�J �0G O�O�PN_KJ�O0T&PX�gUWV�UWJ>I0�dU�PN_Kb>IO�I�\`T&Pw��U�V�U�J>Ice�U�G5I�R�V�U�O{k1GKO�UWTq\KJqI�bSUWPXVu5G,V�PNGKJ�[(U�O�G,J�T�]�G,PNV��oPNO�U8LNPNJSUWGKVi[(\KV�V�U�LQG5I�PN\KJ1O�h$�iU�V�UKa�PwIoPQO�PXY;]SLNPN[�PwI�LXMyGKO�O�R�Y^U�TjI�b�G5IB[�LNG O�O[(\ J�T&PXI�PN\KJ�GKL$TSU�J�O�PwI�PXU�ODG,V�U.RSJSPNY;\&TSG,LcG,J1Tl[b�GKV�G [�I�UWV�PNm�U�T�kZMnY.RSLXI�PQT&PNY^UWJ�O�PX\ J�G,LcO�]SV�U�GKT�a§�·�¢�·�I�b�G5IsI�bSUzT&U�J1O�PXI�PNUWOsGKV�U�Y.R�LwI�PXu5G,V�PQG5I�UzþDGKR�O�O�PQG,J�h���bSUnV�U�_KR�LNGKV�PNm�U�T"9zG,b1G,LQG,JS\ kSPNOT&PQOxIG,J�[�UB��GKO�R�O�UWTjPNJ�ÄX��ËKÅ5Ç1I�\^U(pZI�VGK[(I�bZMZ]1UWV�UWLXLNPX]1O�\ PNTSGKL1[�LXR�O�I�UWV�OWh�goUW[�U�J>I�LNMKa&O�U�u U�VG,L�V�U(fO�UWG,V[bSUWV�O�Ä Å��Sµ>Í ë,Ç�b�Gvu UoR�O�U�TqI�bSUH�BG,R1O�T&\ V��yT&PNO�I�GKJ�[(UoPNJtGD]g\KPNJ>I�O�U�I�YsG5I[bSPXJ�_3[(\KJ>I�U(pZIWhÒZ\KY;U;[(LNR�OxI�U�V�PXJ�_yGKLX_ \KV�PwI�bSYsOB�d\KV�|n\KJ}GtYsG5I�V�PXpz\,ed]SV�\vpZPNY;PwIxM�u5G,LNRSU�O8PNJ�O�I�U�GKT�\,e�\ J

I�b�UB\KV�PN_KPNJ�G,LS]1G5I�I�U�V�JtO�U(IWh0��IdPNO�R�O�U(e�RSLgPXJ�O�R�[b�O�PXI�R�G,I�PN\KJ�O!I�\q]SV�U�[(\ Y^]�R&I�UBGKLXL1I�b�U +��+ � �F�k]�GKPXV��oPNO�UoT&PQOxIG,J�[�UouvGKLXR�UWO0e�\ V0I�bSU�5y]�G,I�I�UWV�J1OcG,J�T;O�I�\KV�UdI�bSUWY¤PNJsGs��O�MZY^Y;U�I�V�PN[��$Y;G,I�V�Pwp�h

Page 10: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

�q� � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

��\KY;]SR&IG5I�PN\KJ�\,e0T&PNO�I�GKJ�[(U�Odk1U�Ix��UWU�Jt]1G5I�I�U�V�J�Od�oPwI�byO�\KY;UH\KVoG,LNLge�UWG,I�RSV�UWOdkgU�PNJS_qJ�\KJ&f[(\ J>I�PNJ>R�\KR�OBPNOH]SV�\KkSLNU�YsG,I�PQ[3O�PNJ�[�U.I�bSUqT&PX��U�V�U�J>I8IxMZ]gUWO8\,e!e�U�G5I�RSV�U�O8GKV�U.JS\,ID[(\KY;]�GKV�GKkSLNUG,J1T���GKOqG,J�U(pZI�V�U�Y;UsU�p&GKY;]SLXUv�8I�bSUtJS\,I�PX\ J}\Keo]SV�\vp&PNY;PwIxMzPQO3U��gU�[�I�PXu U�LNMlkSPNJ�G,V�M>f�u5GKLXRSU�Te�\KV�JS\KY;PNJ�G,LXf�O�[�GKLXU�Tqe�UWG5I�RSV�UWOWh$úB\KJSU�I�bSUWLXU�O�OWaK]SVGK[(I�PXI�PN\KJSUWV�Oo��UWO�]1U�[(PQG,LNLXMqI�b�\ O�UoPXJsYsGK[b�PXJSULNUWG,V�JSPNJS_�a��obSU�V�U3Y;Pwp&U�TZf�IxMZ]gU`]�G5I�I�UWV�J�O8G,V�U3[(\ Y^Y;\ J1��b�Gvu UDTSU�uKUWLX\ ]1U�T�]SV�\vpZPNY;PwIxM�Y;UWG5fO�RSV�U�O!e�\ V�bSU(I�U�V�\K_KUWJSU�\ R�OcIxMZ]gUD]�G5I�I�U�V�J�OWh$�÷V�UW[�U�J>IdU�pSG,Y;]SLNUBPQOHÄX�WÅ>ÆvÇ�a �ob�PN[by]SV�\K]g\ O�UWO�G[(\ Y.kSPNJ�G,I�PN\KJ;\,e�G`Y;\&T&PXr�UWT�9nPNJS| \5�iO�|ZPSY;U(I�V�PQ[�e�\ V�[(\ J I�PXJZRS\ R�O0e�U�G5I�R�V�U�O�G,J1TsG`T&PNO�I�GKJ�[(Uk�G O�U�TD\KJ3[(\ RSJ>I�O���]g\K]SRSLQG5I�PX\ J1��e�\ V�JS\ Y;PXJ�GKL G,I�I�V�PNkSR&I�U�O�h$��u5G,V�PXU�IxM8\Ke&\,I�b�U�V�Y;U�I�V�PN[WO�b�Gvu UkgU�U�JsV�U�]g\KV�I�U�T^PXJzÄ Í�� µ ÅS��ÇSe�\KV�[(\KY;]SRSI�PNJS_`I�b�UBO�PNY;PXLQG,V�PXIxM3k1U�Ix��UWU�Js]�G,I�I�U�V�J�OcV�U�]SV�UWO�U�J>I�U�TR�O�PXJ�_;�>R�GKJ>I�PXI�G5I�PXu U`GKO��dU�LNL�GKOo�>R�G,LNPXI�G5I�PXu UHe�UWG5I�RSV�UWOWhÞcG5I�I�U�V�J�O.[WG,J�GKLNO�\zkgU�V�U�]�V�U�O�UWJ I�UWT�R�O�PNJS_�O�I�V�PXJ�_l\KVqI�V�U�UyOxI�V�R1[�I�R�V�U�OtÄX�K��Ë5Ç�h�Ò>I�V�PNJS_ O

G,V�UiR�O�UWTtPXJ�O�MZJ>I�G [�I�PQ[B[�LXR1OxI�U�V�PXJS_yÄ ê Å5Ç�h0Ò&U�uKUWV�GKL�Y;UWG O�R�V�U�O!\,e�O�PNY^PNLQG,V�PwIxM;kgU(Ix�dU�U�J�OxI�V�PNJS_ OG,V�UnT&UWO�[(V�PNk1U�T�PNJÛÄw�WÍ,Ç�h¿� _K\Z\&T�O�RSY;YsG,V�M~\KeDO�PXY;PNLNGKV�PXIxM~Y;UWG O�R�V�U�O;k1U�Ix��UWU�J�I�V�U�U�O;PNO_KPNuKUWJ�kZM�Ä Ëa�N�5Ç�h��ù[(\ Y^]1G,V�PNO�\KJ}\,eBO�MZJ IGK[(I�PQ[jG,J�T�O�I�G,I�PQOxI�PN[WG,LdG,]S]SV�\ G [bSUWOHe�\ V.]�G,I�I�U�V�JV�UW[(\ _KJSPXI�PN\KJ�R1O�PNJS_�O�U�u U�VG,L�[�V�PXI�UWV�PQGn��GKO.]SV�U�O�UWJ>I�UWT~PXJ ÄX�Wë��(Ç�G,J�T�I�bSU�[(\KJ1[(LNR�O�PN\KJ���GKOI�b1G5I8O�MZJ IGK[(I�PQ[8Y;U�I�bS\&TSO8G,V�UHPNJ&e�UWV�PN\KViPNJ�U�u U�V�MtGKO�]1U�[�I�h���bSUWV�U�e�\KV�UKaS�dU3T&\sJS\KIB[(\KJ1O�PQT&U�VO�M>J>IGK[�I�PN[HY;U(I�bS\&TSO�e�RSV�I�b�U�VoPNJ�I�bSPQOo]�G,]gU�V�h��bSU�V�UqGKV�U.O�\KY;U^T&PNO�I�GKJ�[(UqY;UWGKO�RSV�UWO8V�UW]1\ V�I�UWT�PNJzI�bSUqLNPXI�U�VG5I�RSV�U�ĸÜKÜZµ0��� ÆvÇ{I�b�G,I8IG,| U

PNJ I�\lGK[W[(\ RSJ>I3I�bSU�U(��UW[(Iq\,eBO�RSV�V�\ RSJ�T&PNJS_n\ V.JSUWPX_ b>kg\KV�PNJS_n]1\ PXJ>IO�hl��b�UWO�UtO�R�V�V�\KRSJ1T&PXJ�_]g\KPNJ IOqGKV�U�[�G,LNLNUWTæÕÑ5¨1¥�¢�× ¥�PNJæÄX�WÌ Ë5Ç�h���bSUyO�PNY^PNLQG,V�PwIxM}k1U�Ix��UWU�J�Ix�d\z]g\KPNJ>I�O2�,!8GKJ�TG��R a_KPNuKUWJtI�bSPQOi[(\ J I�U(pZIWa&PQO�_KPNuKUWJ�kZMq�

���,!M�F��R�����Q0���,!��F��R����{�q��obSUWV�U���PQOHI�b�U;[�\KJ>I�U�pZIs��I�bSUsO�U(I`\,e�O�R�V�V�\KRSJ1T&PXJ�_t]g\KPNJ IO��(hsè8J�UqY;U(I�V�PQ[;T&U(r1JSUWT�R�O�PXJS_[(\ J>I�U(pZIdPNO!I�bSU^ÙqÔ&¥�Ô� 5�1¨g¢�§w©�_�¡Ñ5¦3£5§QÐ�¥� 5¨gÕ¢8�39zú8FH�(a&]SV�\K]g\ O�UWT;PNJlÄ Ü Ü�Ç�aK�obSPQ[bjPQO�_ PXu U�JskZM���#�z�3�,!*����Rv�������~���,!��F��R����1�#�~�3��R��F�,!��q��obSUWV�U��#�����,!��F��R��cPQOcI�bSUiJSUWPX_ bZk1\ V!JZRSY.kgU�V!\Ke���Ro�oPXI�btV�U�O�]gUW[(I!I�\��,!�hc�{PN_KR�V�U�OcÍ.G,J1T;Æ_KPNuKUnGKJ�U�p&GKY;]SLXU h���J��{PN_KR�V�UnÍ1a�I�bSUnJSUWGKV�U�OxIsJSUWPX_ bZk1\ V^\KeD�äPQO�\Ha�GKJ�T�\H¼ OsJSU�G,V�UWO�IJSUWPX_ b>kg\KVoPQOi�.h1ÒZ\�a��#�~�3� ���^���<�#�~�3�0���H�U� �DGKJ�T�I�bSU29zúBF k1U�Ix��UWU�Jn�ÛG,J�T:\æPNOË&hq�i\5�dU�uKUWVWa.�#�~�����O�`���ý�.kSRSI����~���I�M�q���ðËSa�G,J�TzI�bSUWV�U�e�\KV�U����#�l�3���O�`�|�¤Ìb��$PX_ RSV�U8Æ`��GKO�\Kk&IG,PNJSUWT;e�V�\KY¶�$PN_KRSV�UiÍ.kZMsGKT�T&PXJ�_`I�bSV�U�U8JSU��æ]1\ PXJ>I�OdFqa>ØBa>GKJ�Tj�dh>úB\5����#�z�����O�`�2�ùÌ~��G O3kgU(e�\ V�Uv��a0kSR&I����#�z���A���^� �äÆ&hz��b�U09zúBF¾kgU(Ix�dU�UWJ~�ýG,J1T\Éb�G O8PNJ�[�V�U�GKO�UWTzkZMnPNJ>I�V�\ZTSR�[(PNJS_�GKTST&PXI�PN\KJ1G,L0]1\ PXJ>IO�a�UWuKU�JlI�bS\ RS_Kb}�»G,J�TP\Ûb�GvuKUqJS\,IY;\5uKU�T�h$��b�U�9zú8FÉPNO�JS\,I�G3Y;U(I�V�PQ[.��PwIoT&\ZUWO�JS\KIdO�G5I�PQO�e�MqI�bSU8I�V�PNGKJS_KLNUiPNJSUW�>R�GKLXPXIxMnÄ Ë����5Ç���h��J�O�]�PwI�Us\,edI�bSPQO�a 9zúBFýb�GKODkgU�UWJ�O�R�[W[(U�O�O�e�RSLNLXM}G,]S]SLNPNUWT}PXJ�O�U�u U�VG,Lc[(LNR�O�I�U�V�PNJS_nG,]S]SLNPQ[�G5fI�PN\KJ1O`Ä Ü,ë5Ç�h!��bSPNO�\ k�O�U�V�uvG,I�PN\KJyO�RS]�]1\ V�IO�I�bSU`uZPNU��o]g\KPNJ>IdI�b�G5IoI�bSU3T&PQO�O�PNY^PNLQG,V�PwIxMtTS\>U�O�JS\,IJSUWUWT�I�\;kgU3GqY;U�I�V�PN[Kh½}G,I�G,J1G,kgUK¼ OdI�bSUW\KV�U�Yà\Ke{I�bSU`RS_KLNMtT&R1[|>LNPNJS_nÄw��Å ËvÇ�O�I�G,I�UWOWÈ��J�O�\,e�G,V0GKO{�dU�R�O�U�Gor�JSPXI�UoO�U(I0\,e�]�V�U�T&PN[WG5I�UWO�I�b�G,I0GKV�Ud[�G,]1G,kSLNU�\Ke1T&PQOxI�PXJS_ RSPQO�b&fPXJ�_^GKJ>M^Ix�d\q\ k&îxUW[(I�Od[(\ J�O�PQT&UWV�U�T�a>I�bSUHJZRSY.kgU�V�\,e{]SV�U�T&PQ[�G5I�UWOdO�b1G,V�UWTjkZMsG,JZMIx��\sO�R�[by\Kk&îxU�[�I�O�PQOi[�\KJ�O�I�GKJ I�a&PXJ1T&U�]gU�J�TSU�J>Ii\,e$I�bSU3[b�\KPQ[(UD\,e$\Kk&îxU�[�I�OWh

��bSPNO0PNY;]SLNPXU�O0I�b�G,IcPwI!PQO0]1\>O�O�PNkSLXUdI�\HYsGK|KUoG,JZMDIx�d\DGKV�k�PwI�V�GKV�MD]�G,I�I�UWV�J1O0UW�>R�G,LNLNM.O�PNY;PXLQG,VkZM�U�J�[�\ZTSPXJS_tI�bSUWY �oPwI�b�G�O�R&áj[�PXUWJ I�LXM�LQG,V�_KU3JZRSYqk1UWV8\Ke!e�UWG,I�RSV�UWOWh8�8ODGt[(\ J�O�UW�>RSU�J1[(UKaG,JZMBIx��\iGKV�kSPXI�VG,V�Mo]�G,I�I�UWV�J1O�G,V�U0UW�>R�GKLXLNM8O�PXY;PNLNGKVWa�RSJSLNUWO�O��dU!R�O�U!O�\ Y;U!GKTST&PXI�PN\KJ1G,LKT&\ YsG,PNJPNJ&e�\KV�YsG5I�PN\KJ�h0��\KVoU�p&GKY;]SLXU a&PXJyI�bSU3[�G O�UH\,ec[(\ J�[(UW]&I�R�GKL�[(LNR�O�I�U�V�PNJS_nÄw��Ì ËvÇ�a>I�bSU3O�PNY^PNLQG,V�PwIxM

Page 11: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ���

A

B

C

X

X

1

2

ä(jel*�*Ä*��ÅütEk*r�ðItEiGhn|_wTiPh�fPje|_jebutEi�gGm*tEkVůtEk*r�a��

A

B

C

X

X

1

2

DF E

ä(jel*�3¡;��Å�x.gPh:i�t�sGm3tEk*lTh?jek�s=wTk~gGh��Xg�{,ð�tEk;r�aItEiPhn|_wTiGh}fPje|_jebutEi�gPm3tEk�ð�tEk*r Å&�

Page 12: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

��� � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

x x x x x x x x x x x x x x

x x x x x x x x x x x x x x

x

x

x

x

x

x

x

x

x

x

xx

x x x x xx

x

x

x

xxxxxxx

xxxx

xx

A

B

C

ä(jel*�3Õ;� acwTk*s=h:oqgGd3tEb�fPje|_jebutEiGj g���z,h�g��Mh=h=k�oBwTjekXgPf��kgU(Ix�dU�U�J:� ! GKJ�T6� R PQOoT&U(r1JSUWT�GKO�

�3�,!F����R����<Q0�3�,!F����R��*¡��F�{�K��obSUWV�U�¡�PQO3G�O�U(I3\,e�]SV�U(f�T&U(r1JSUWT}[(\ J�[(UW]&I�OWhj��bSPQO`JS\,I�PX\ J�PNODPNLXLNR�O�I�VG5I�UWT}�oPwI�b}I�bSUjb�U�LN]\,eD�$PX_ RSV�U�êSh��iUWV�U a!I�b�U�Ø�R�[(LNPQT&UWGKJ�T&PQO�I�G,J1[(Uyk1U�Ix��UWU�J�]1\ PXJ>I�Os�äGKJ�T�\àPNO^LNUWO�O^I�b�GKJI�b1G5I`k1U�Ix��UWU�J8\ G,J1T��8h��B\5��UWuKU�V�a�\ G,J1T�� [�G,J}kgU^uZPNU��dUWT}GKO ö Y;\ V�U;O�PNY;PXLQG,VøtI�b�GKJ� G,J1T�\ýk1U�[�G,R1O�U�\ýGKJ�T��¶kgU�LN\KJS_}I�\�I�bSUzO�G,Y;Uz[(\ J�[(UW]&Iz��U�LNLNPX]�O�U��;GKJ�T��äk1UWLX\ JS_ OI�\nGyT&PX�gUWV�UWJ I`[(\ J�[(UW]&Ij��V�UW[(I�G,J�_KLNU���hq��bSUs[(\KJ1[(U�]SI�R�GKL0O�PNY^PNLQG,V�PwIxMnY;UWG O�R�V�U^PNO8I�bSU;Y^\>OxI_KUWJSU�VG,L�O�PXY;PNLNGKV�PXIxM;Y^U�GKO�RSV�UKh$½�U`T&PQO�[�R�O�OdO�U�u U�VG,L1]SV�GK_KYsG5I�PN[BPNO�O�RSUWOdGKO�O�\&[�PNG,I�UWTj�oPwI�b�PXI�OR�O�UDPXJzÒZU�[�I�PN\KJzÆShX� �Kh�Z#iE�W�>�7�^8ó�A�Q%J�¢ ^8ó�E��LJ�QS£�>�ó(7F8Pw��U�V�U�J>IBG,]�]SV�\>GK[bSU�O!I�\s[(LNR�OxI�U�V�PXJ�_;T�G5I�G;[WG,Jyk1U3T&U�O�[�V�PNkgUWTy�oPwI�byI�bSUDbSUWLX]�\,e$I�b�U`bSPXUWV�fG,V[bZM^O�bS\5�oJjPNJt�$PN_KRSV�UDÜj��\,I�bSU�VdIG5p&\KJS\ Y;U(I�V�PQ[oV�UW]SV�UWO�U�J>I�G,I�PN\KJ�Oc\Ke{[(LNR�O�I�UWV�PNJS_.Y;U�I�bS\&TZf\KLN\K_ M�GKV�U`]g\ O�O�PNkSLNUKµg\KRSVOoPQOik�G O�U�Ty\KJ�I�b�UqT&PQO�[�R�O�O�PN\KJ�PNJ�Ä Å>ÆvÇ���ho�dIiI�bSU3I�\K]nLNU�uKUWL�a�I�bSUWV�UPQO�G3T&PQO�I�PNJ�[�I�PX\ Jsk1U�Ix��UWU�JjbSPNU�VG,V[bSPQ[�GKLSG,J�T;]�GKV�I�PwI�PX\ J�G,L1G,]S]SV�\ G [bSUWOo��bSPNU�VG,V[bSPN[WG,LSY;U�I�b&f\&TSOH]SV�\ZTSR�[(U;GtJ�UWO�I�UWT�O�UWV�PNUWOH\Ke�]�G,V�I�PXI�PN\KJ1O�a��obSPNLNUq]�GKV�I�PwI�PX\ J�G,L0Y;U(I�bS\&TSOH]SV�\ZTSR�[(U^\KJSLNM\KJ�U���h3��b�UqIG5p&\KJ�\KY.M�O�bS\5�oJlPNJ��$PN_KRSV�UsÜjY.R1OxIDk1U;O�RS]S]SLNU�Y;U�J>I�UWT�k>MzGyT&PQO�[�R�O�O�PN\KJz\Ke[(V�\ O�O�f�[�R&I�I�PXJS_�PNO�O�RSUWOqI�b1G5IsYsGvM¿��PNJ�]SV�PNJ�[(PN]SLNU��^G5��UW[(IsGKLXLo\KeiI�b�U�TSPw��U�V�U�J>IjG,]S]�V�\>GK[bSU�OV�U�_ GKV�TSLXU�O�O�\,e$I�bSUWPXVo]�LNG [(U�Y;UWJ IiPNJyI�bSUDIG5p&\KJ�\KY.M h

õ �i_K_ LX\ Y;U�VG5I�PNuKU�´WÐ�·»T&PNu>PQO�PXu UKÈ���bSPQO�G O�]gUW[(I�V�U�LQG5I�U�OjI�\�GKLX_ \KV�PwI�bSY;PN[nO�I�V�R�[�I�RSV�U�G,J1T\K]gU�VG5I�PN\KJ�h��iJ�G,_ _KLN\KY;U�VG5I�PXu UtG,]�]SV�\>GK[b~kgU�_ PXJ1O;�oPwI�b�U�GK[b�]1G5I�I�U�V�J�PNJ�G�T&PQO�I�PNJ�[�I��O�PXJS_ LXU�I�\ J1��[�LXR1OxI�U�V�G,J�TjO�R�[W[(UWO�O�PXu U�LNM^Y;UWV�_ UWO�[�LXR1OxI�U�VO!I�\K_KU�I�bSUWV�R�J I�PXL�GqOxI�\K]S]SPNJS_;[(V�PwfI�U�V�PN\KJ�PNOBO�G,I�PQOxr�U�T�h�� T&PNu>PQO�PXu UHY;U�I�bS\&TnkgU�_ PXJ�Oi�oPwI�bzG,LNL�]�G5I�I�UWV�J�OiPXJzGsO�PXJ�_KLNU3[(LNR�OxI�U�VG,J�T�]1UWV�e�\ V�YsOoO�]SLNPwI�I�PNJS_sRSJ>I�PNL�G;OxI�\K]S]�PXJS_j[�V�PXI�UWV�PN\KJ�PNOiY^U�IWh

õ 9n\KJS\KI�bSU�I�PQ[^´�Ð�·c]g\KLNM>I�bSU�I�PQ[,È!��bSPQOoGKO�]gUW[�IoV�U�LQG5I�UWO�I�\qI�bSU3O�UW�>RSUWJ>I�PQG,L�\KVoO�PXYqRSLwIG,JSUW\KR�OR�O�Ut\,e�e�UWG,I�RSV�UWO.PXJ�I�bSUt[(LNR�O�I�UWV�PNJS_z]SV�\&[(U�O�OWh69z\ O�IqG,LN_K\ V�PXI�bSYsO3GKV�Us]g\KLNM>I�bSU�I�PQ[,µcI�b�G5IPNOWadGKLXLde�U�G5I�R�V�U�O;U�J>I�UWVsPXJ>I�\}I�bSUn[(\KY;]SRSI�G5I�PX\ J�\KeHT&PQO�I�G,J1[(UWO;kgU(Ix�dU�UWJ�]1G5I�I�U�V�J�OWa�G,J1TT&UW[�PNO�PX\ J�OoG,V�UDk�GKO�UWT�\KJ�I�b�\ O�UDTSPNO�I�GKJ�[(U�O�h!�ÛO�PXY;]SLNU`Y;\KJS\KI�bSU�I�PQ[DG,LN_K\KV�PXI�bSYàV�U�]g\KV�I�U�TPXJæĸÜ�Ç�[(\ J�O�PQT&UWV�ODe�U�G5I�RSV�U�O.O�UW�>RSUWJ I�PNGKLXLNM�I�\lT&PNuZPNTSUjI�b�Uj_KPNuKUWJ~[(\KLNLNUW[�I�PX\ J�\,eo]�G,I�I�UWV�J1O�h��bSPNO.PNO.PXLNLNR�OxI�V�G,I�U�T�PXJ��$PN_KRSV�Utë�h��BU�V�UKa$I�b�Ut[(\ LXLNUW[(I�PN\KJ�PQO.T&PNuZPNT&U�T�PNJ I�\nIx�d\n_KV�\KRS]�O

Page 13: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ��³Clustering

Partitional

SingleLink

CompleteLink

Hierarchical

SquareError

GraphTheoretic

MixtureResolving

ModeSeeking

k-meansMaximizationExpectation

äZjel*�3öq�Å�gGtS�qwTk*wT|&��wExZs=bed*fPgPh=iGjek*l_tEo;o*iGw~tEs�m;h:f:�

X

1 11

111

1111

1

1 1 11

22

2222

2 2 2

3 3

33 3 33 33

33333

3

33 3

3

4 4

444

4 4 44

44

44

44

222222

2

22

1

1111

11

1 11

V

H

H2

1

X2

1

ä(jel*�3÷;�õVwTk;wEgGm*h�gPjes&o*tEiPgPj gGjewTk3tEb6s:bed;fPgPh:iPjek*l*�

R�O�PNJS_;e�U�G5I�R�V�U����5µ�I�bSU`u U�V�I�PQ[�G,L�kSV�\ |KUWJ�LNPXJ�U`ï PNOoI�bSU.O�U�]1G,VG5I�PNJS_;LNPXJSU h�Ø�GK[b�\,e$I�bSU�O�U[(LNR�OxI�U�VO;PNOse�RSV�I�bSU�V�T&PXuZPQT&UWT�PNJ�T&UW]1UWJ�T&U�J>I�LXM�R�O�PNJS_�e�U�G5I�R�V�U:� k a�GKOjT&UW]SPQ[�I�U�T�k>M~I�bSUkSV�\ |KUWJ¿LXPNJSU�O~¤��lG,J�T�¤ k hà��bSU}Y;G,îx\KV�]SV�\ kSLNU�Y �oPXI�b¿I�bSPQOyGKLX_ \KV�PwI�bSY PNOtI�b1G5I�PwI_KU�J�U�VG5I�U�O^Ë � [(LNR�OxI�U�VO.�ob�U�V�U6�}PQO.I�bSU�T&PXY;UWJ�O�PN\KJ1G,LNPwIxM�\KeiI�bSUy]�G,I�I�UWV�J1O�h~��\KV^LNGKV�_ UuvGKLXR�UWO3\Ke����3��¥ä��N��PQO`IxMZ]SPQ[�GKL�PNJ~PNJ&e�\KV�YsG5I�PN\KJ�V�U(I�V�PNU�u5G,L�G,]S]SLNPQ[�G5I�PX\ J�OtÄX��ÆKÅ5Ç���a�I�bSUJ>R�Y.kgU�V.\Ke�[�LXR1OxI�U�VO3_KUWJSU�VG5I�UWT�kZMlI�bSPNOqG,LN_K\ V�PXI�bSY PNOqO�\nLQG,V�_KU^I�b�G5I3I�bSU�T�G5I�GnO�U(IqPNOT&PXuZPQT&UWTyPNJ>I�\;RSJSPNJ>I�U�V�UWO�I�PNJS_ LXMtO�YsG,LNL�G,J1Tje�VG,_ Y^UWJ>I�UWTy[(LNR�O�I�UWV�OWh

õ �BG,VT�´�Ð�·je�RSm�mWMgÈ3�»b1G,VT�[�LXR�O�I�UWV�PNJS_nG,LN_K\ V�PXI�b�Y G,LNLX\&[�G,I�U�O8U�GK[b}]�G5I�I�UWV�J}I�\nG�O�PXJS_ LXU[(LNR�OxI�U�V�T&RSV�PXJ�_3PwIO�\ ]1UWV�G,I�PN\KJjGKJ�TsPNJjPwIO�\ R&I�]�R&IWh!�¿e�RSm�mWMj[(LNR�OxI�U�V�PXJ�_3Y;U(I�b�\ZTtGKO�O�PN_KJ�OT&U�_ V�UWUWO!\Ke�Y;U�Y.kgU�VO�bSPX]tPXJtO�U�u U�VG,L�[�LXR1OxI�U�VOcI�\qUWG [bsPXJS]�R&Id]1G5I�I�U�V�J�hc��e�RSmWm�Mj[�LXR�O�I�UWV�fPXJS_3[WG,JskgUB[(\ JZuKU�V�I�U�T3I�\3GDb�G,VT;[(LNR�O�I�U�V�PNJS_`kZM^G O�O�PX_ JSPNJS_DUWGK[b^]�G,I�I�UWV�J;I�\DI�bSU8[(LNR�OxI�U�V�oPwI�b�I�bSU`LQG,V�_KUWO�I�Y^U�GKO�RSV�UH\Ke{Y;U�Yqk1UWV�O�bSPN]�h

õ FBU�I�U�V�Y;PXJ�PNO�I�PQ[B´WÐ�·0OxI�\&[b�GKO�I�PQ[,È���b�PNO{PNO�O�RSU�PQO$Y^\>OxI$V�UWLXUWu5G,J>I�I�\B]�GKV�I�PwI�PX\ J�G,LZG,]S]�V�\>GK[bSU�OT&UWO�PX_ JSUWTtI�\s\ ]&I�PNY;PXmWU`GsO��>R�GKV�U�TjU�V�V�\KVde�RSJ�[(I�PN\KJ�h!��bSPQOo\ ]&I�PNY;PXm�G5I�PN\KJ�[�GKJ�kgU3GK[W[(\ Yqf

Page 14: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

� Ö � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

X

ABC D E

F G

Cluster1Cluster2

Cluster3

X

1

2

äZjel*�*ó;�µZwTjek~gPf�x%tEbebejek*l�jek gPm*iGh=hns=bed*fPgPh=iGf:�]SLXPQO�bSUWT.R�O�PNJS_BI�VGKT&PXI�PN\KJ�GKL,I�UW[bSJSPQ�>RSUWO{\KV{I�b�V�\ RS_Kb3GBV�GKJ�T&\KYÛO�UWGKV�[bD\,e�I�bSUdOxIG5I�U�O�]�GK[�U[(\KJ1O�PQOxI�PXJ�_^\Ke$GKLXL�]g\ O�O�PXkSLNUDLNGKk1UWLXPNJS_>O�h

õ ��J�[(V�U�Y;U�J>IG,Li´WÐ�·yJS\KJ&f�PNJ�[(V�U�Y;U�J>IG,L�È.��bSPQO`PNO�O�RSUjG,V�PNO�UWOD�ob�U�J�I�b�Uj]�G5I�I�UWV�J�O�U(I3I�\nk1U[(LNR�OxI�U�V�UWT�PQO�LNGKV�_ UKaBGKJ�T¿[(\ J�O�I�VG,PNJ IOj\ J¿U(p&UW[�R&I�PN\KJ¿I�PNY^U}\KVyY;U�Y;\KV�M�O�]�G [(U}G5��UW[�II�bSUjGKV�[bSPXI�U�[�I�RSV�U^\,edI�b�UjG,LN_K\KV�PXI�bSY�hs��bSU;UWGKV�LNMzbSPQOxI�\KV�Mn\,eo[(LNR�O�I�U�V�PNJS_�Y^U�I�bS\&T&\ LX\ _KMT&\ZUWOoJS\KIB[(\ J IG,PNJ�YsGKJ>M�U(pSG,Y;]SLNUWOi\,ec[(LNR�OxI�U�V�PXJ�_;GKLX_ \KV�PwI�bSYsOoT&UWO�PN_KJSU�TtI�\s��\ V�|s�oPXI�bLNGKV�_ UqTSG,I�GyO�U�I�OWa�kSR&IDI�bSUsG T&uKUWJ ID\,edTSG5IGtY;PNJSPXJ�_yb1GKOBe�\ O�I�U�V�UWTzI�bSUsT&UWuKUWLX\ ]SY;U�J>IH\Ke[(LNR�OxI�U�V�PXJ�_DGKLX_ \KV�PwI�bSYsO{I�b�G,I!Y^PNJSPNY;PXmWU�I�bSUoJZRSYqk1UWV!\,e�O�[WG,J�O{I�bSV�\ RS_KbqI�b�Uo]�G5I�I�U�V�JsO�U�IWaV�U�T&R�[(UDI�bSU3JZRSYqk1UWVB\,ec]�G,I�I�U�V�J�OoU(pSGKY^PNJSU�TyTSRSV�PNJS_jU�p&UW[(RSI�PN\KJ�aS\ ViV�UWT&R�[�UDI�bSU^O�PNm�U`\KeTSG5IG^O�I�V�R�[(I�RSV�UWO�R�O�UWTyPNJtI�bSU3G,LN_K\ V�PXI�b�Yy¼ O�\K]gU�VG5I�PX\ J�OWh��[(\ _KUWJ I�\ k�O�U�V�uvG,I�PN\KJDPNJ Ä Å>ÆvÇKPQO�I�b�G,I�I�b�U�O�]gUW[�Pwrg[�G5I�PX\ J3\,eSGKJ3G,LN_K\KV�PXI�bSY¹e�\KV$[(LNR�OxI�U�V�PXJ�_

R�O�R�G,LNLNMjLXU�GvuKU�Od[�\KJ�O�PQT&U�VG,kSLNU8Ý�U(p&PNkSPXLXIxMtPNJ�PXY;]SLNU�Y;UWJ IG5I�PX\ J�h�Z# @ �n+ <,AD),A�132,+ 1X)6]ZEn]eN;C:9=<BA +.-;4�"L] 45U[A + 9T2>Á�C��bSU�\K]gU�VG5I�PN\KJ�\KeBGzbSPNU�VG,V[bSPQ[�GKL�[(LNR�O�I�U�V�PNJS_lG,LN_K\ V�PXI�b�Y PQO.PNLNLXR�O�I�VG5I�UWT�R1O�PNJS_zI�bSUjIx�d\,fT&PNY;U�J�O�PX\ J�G,L$TSG5IGsO�U�IBPNJz�{PN_KR�V�U.Å�ho��bSPNOir�_KR�V�U3T&UW]SPQ[�I�O8O�UWuKUWJn]�G5I�I�U�V�J�OoLQG,kgU�LNUWTn�.a�\Ha�8a1Fqa1ØBa1�da1GKJ�Tzþ¤PXJ�I�bSV�U�U.[�LXR�O�I�UWV�OWh��ÛbSPNU�VG,V[bSPN[WG,L�GKLX_ \KV�PwI�bSYýMZPNU�LQTSOiGl£ ¢(¨�£5¦�Ñ�©,¦� 5ÙV�U�]SV�UWO�U�J>I�PNJS_�I�bSU!JSU�OxI�UWTD_KV�\KR�]SPXJ�_o\,e&]�G5I�I�UWV�J�O�G,J�T`O�PXY;PNLNGKV�PXIxMBLNU�u U�LQO�G,I��obSPQ[b`_KV�\KRS]SPNJS_>O[b�GKJS_KU h���T&UWJ�T&V�\K_ V�GKY¹[(\ V�V�UWO�]g\KJ�T&PNJS_�I�\oI�bSUdO�UWuKUWJ`]1\ PXJ>I�O{PNJ.�$PX_ RSV�U�Å3��\ k&I�GKPXJSU�TDe�V�\KYI�b�U�O�PXJS_ LXU�f�LNPNJS|HGKLX_ \KV�PwI�bSY»Ä Å>ÆvÇ���PNO$O�bS\5�oJ`PXJq�{PN_KR�V�Ui���Sh$��bSU�T&UWJ�T&V�\K_ V�GKYæ[�GKJ3k1U�kSV�\K|KUWJG5IiT&PX��U�V�U�J>IiLXUWuKUWLNOdI�\sM>PNU�LQTyT&Pw��U�V�U�J>IB[�LXR�O�I�UWV�PNJS_>O�\Ke{I�bSU3TSG,I�GSh9n\ O�I�bSPNU�VG,V[bSPQ[�GKL�[(LNR�O�I�U�V�PNJS_qGKLX_ \KV�PwI�bSYsO�G,V�Uiu5G,V�PQG,J>I�O�\,e�I�bSU8O�PXJ�_KLNU(f�LXPNJS|nÄw�5Ü5Ì,Ç�aZ[(\ Yqf]SLNU(I�U(f�LXPNJS|lÄX�� Å5Ç�aSG,J�T�Y;PXJSPNY.R�Yqf�u5G,V�PNGKJ�[(U;ÄX�WÅS� µ��WÌZÜ�Ç�G,LN_K\ V�PXI�bSYsOWhcèBe{I�bSU�O�U a&I�b�U3O�PNJS_KLNU(fLNPXJS|;G,J1Ts[(\KY;]SLNU(I�U(f�LXPNJS|;G,LN_K\ V�PXI�bSYsO!GKV�UoY;\>OxI�]g\K]�RSLNGKVWh0��bSU�O�UoIx�d\.GKLX_ \KV�PwI�bSYsOcT&Pw��U�VdPNJI�b�Uq��GvMyI�bSUWMl[b�G,VGK[(I�UWV�PNm�UDI�bSUsO�PNY;PXLQG,V�PwIxM�kgU(Ix�dU�UWJ�G�]�G,PNV8\Ke�[(LNR�O�I�UWV�OWh`��JzI�bSUsO�PNJS_KLNU(fLNPXJS|�Y;U(I�bS\&T�a0I�b�UyT&PQO�I�G,J1[(UjkgU(Ix�dU�UWJ�Ix��\�[(LNR�OxI�U�VO3PQO3I�bSUlÙ^§�¨�§�Ù^Ô&Ù¾\,eoI�b�U�T&PQOxIG,J�[�UWOkgU(Ix�dU�U�J^G,LNL&]�G,PNVO�\Ke1]�G,I�I�UWV�J1O$TSV�Gv�oJ`e�V�\KY I�bSUdIx�d\8[(LNR�O�I�UWV�O���\ JSU�]�G5I�I�UWV�J.e�V�\ YÉI�bSUdr�VOxI[(LNR�O�I�UWVWavG,J�THI�bSU!\KI�bSUWV�e�V�\ Y¿I�bSU�O�UW[�\KJ�T��(h���JDI�b�U�[(\ Y^]�LXU�I�U(f�LNPXJS|DG,LN_K\ V�PXI�b�Yya�I�bSU�T&PNO�I�GKJ�[(UkgU(Ix�dU�U�J�Ix�d\^[�LXR�O�I�UWV�O�PQOdI�b�U^Ùs �× §�Ù^Ô&ÙÛ\,e0G,LNL�]�G,PNV��oPQO�UHT&PQO�I�G,J1[(UWO�kgU(Ix�dU�UWJ�]1G5I�I�U�V�J�O�PNJI�b�U;Ix��\z[�LXR�O�I�UWV�OWhs��J�U�PXI�bSUWV.[�G O�U a�Ix�d\z[(LNR�OxI�U�VO`G,V�U;Y^UWV�_ UWTlI�\�e�\ V�Y G�LQG,V�_KUWV`[(LNR�OxI�U�Vk�G O�U�T;\KJjY;PNJSPXYqRSY¶T&PQOxIG,J�[�U8[(V�PXI�U�V�PQGSh0��bSU8[�\KY;]SLNU(I�U�f�LNPNJS|^GKLX_ \KV�PwI�bSYð]SV�\&T&R1[(UWO!I�PN_Kb>I�LNM

Page 15: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ��ì

A B C D E F G

Si

milarity

ä(jel*�6Þ:ø;����m*hnr;h:k;r*iGwTlTiGtE|ëwTz;gGtEjek*h=rVd*fGjek;l&gPm*h?fGjek*lTbeh���bejek*û�tEbelTwTiPj gGm;|V�

X

Y

11

1

1

1

111

1

2

2

2

2

22

ä(jel*�6ÞTÞT��M�MwLs=wTk*s=h=k~gGiPjes�s=bed*f gGh=iPf��kg\KRSJ�T;\ V![(\ Y^]1GK[�I�[�LXR1OxI�U�VOoÄw�WÍ,Ç�h$��bSUiO�PNJS_KLNU(f�LXPNJS|^G,LN_K\KV�PXI�bSY�a,kZMq[�\KJ>I�VGKO�IWa,O�R&��U�VO0e�V�\KYGt[b1G,PNJSPXJ�_�U��gU�[�IsÄw�WÍN�5Ç�hH��IDb1GKOHGsI�UWJ�T&UWJ�[(M�I�\�]SV�\&T&R�[�U^[�LXR�O�I�UWV�OBI�b1G5I`G,V�UqO�I�VG,_K_ LXMy\KVU�LN\KJ�_ G5I�UWT�h���bSU�V�U`G,V�UDIx��\s[(LNR�O�I�UWV�O�PNJz�$PX_ RSV�U�OD��Ë;GKJ�T}�WÌ;O�UW]�G,VG5I�UWT�kZM�G ö kSV�PQT&_KU�øq\KeJS\ PNO�M.]�G,I�I�U�V�J�O�h0��bSUBO�PNJS_KLNU(f�LXPNJS|^G,LN_K\KV�PXI�bSY ]�V�\&T&R�[�UWO!I�bSUB[�LXR1OxI�U�VO!O�b�\5�oJ^PNJj�$PX_ RSV�U`��Ë&a�obSUWV�U�GKO^I�b�Ul[(\ Y^]�LXU�I�U(f�LNPXJS|�G,LN_K\ V�PXI�bSY \Kk&IG,PNJ�O;I�bSUz[(LNR�O�I�U�V�PNJS_~O�b�\5�oJ�PNJ¿�$PX_ RSV�U��WÌSh��bSUB[�LXR1OxI�U�VO!\KkSI�G,PNJSU�T;k>MqI�b�UB[(\ Y^]�LXU�I�U(f�LNPXJS|;G,LN_K\ V�PXI�b�Y¤G,V�UiY;\KV�Ui[(\ Y;]�GK[(I!I�b�GKJ;I�bS\>O�U\KkSI�G,PNJSU�T¿kZM�I�bSU�O�PXJS_ LXU�f�LNPNJS|�G,LN_K\KV�PXI�bSY�µDI�b�U}[�LXR�O�I�UWV�LNGKk1UWLXU�T �}\Kk&IG,PNJSUWTæR�O�PNJS_�I�bSUO�PXJS_ LXU�f�LNPNJS|zG,LN_K\ V�PXI�bSY PQODU�LN\KJ�_ G5I�UWT�k1U�[�GKR�O�U^\,edI�b�U^J�\KPQO�Mz]1G5I�I�U�V�J�OHLNGKk1UWLXU�T öO¦ ø�hq��bSUO�PXJS_ LXU�f�LNPNJS|^GKLX_ \KV�PwI�bSYðPNO�Y;\KV�UBuKUWV�O�G5I�PXLNUoI�b�G,JsI�bSU8[�\KY;]SLNU(I�U(f�LXPNJS|sG,LN_K\ V�PXI�bSY�a>\,I�bSU�V��oPNO�UKh�S\ V.U�p&GKY;]SLXU a0I�bSUyO�PNJS_ LXU�f�LNPXJ�|�GKLX_ \KV�PwI�bSYâ[�G,J�U�pZI�VGK[�IqI�bSUy[(\ J�[(UWJ I�V�PQ[j[�LXR�O�I�UWV�O^O�bS\5�oJPNJ��$PX_ RSV�Ut�K�.kSR&IDI�bSU;[(\ Y;]SLXU�I�U�f�LNPXJ�|�GKLX_ \KV�PwI�bSYä[�G,J�JS\,I�hH�B\5��UWuKU�V�a1e�V�\ YäGt]SVG,_KYsG,I�PQ[uZPXUW�o]1\ PXJ>I�a$PXIqb1GKO3kgU�UWJ~\Kk1O�UWV�u UWT�I�b�G,I.I�bSU�[�\KY;]SLNU(I�U�f�LNPNJS|}GKLX_ \KV�PwI�bSY ]SV�\&T&R1[(UWO.Y;\KV�UR�O�U(e�RSL�bSPXUWV�GKV�[b�PXU�O�PNJ�YsG,JZMtG,]�]SLXPQ[�G,I�PN\KJ�O�I�b�G,JyI�b�U3O�PNJS_KLNU(f�LNPXJS|�G,LN_K\KV�PXI�bSY Ä Å Æ5Ç�h§~¨�¨�©3ª�«"¬Z­�®°¯±3²�¬#³�±3´ ¨�©�¬�µO¶U±�´�·�¸2©�¹»º¯¬Z­�±3´ ¨P§~©3¨�ª>­�±3¯¼ «�x�v�yÞ!LQGK[(UoU�GK[bs]�G,I�I�U�V�JjPXJtPwIO�\5�oJj[�LXR�O�I�UWVWh!��\KJ1OxI�V�R�[(I�G3LNPQOxId\,e�PXJ>I�U�V�]�G5I�I�U�V�JjT&PQOxIG,J�[�UWO

e�\KV!G,LNL�T&PQO�I�PNJ�[�I!RSJ�\KVT&U�V�UWTq]�G,PNVO0\,e�]�G5I�I�U�V�J�OWaKG,J1T^O�\KV�I0I�bSPQOcLNPNO�I!PNJ;G O�[�U�J�TSPXJS_D\ V�T&UWVWh��Ë ��Ò>I�UW]sI�bSV�\KR�_Kb;I�b�U8O�\KV�I�UWT^LNPNO�I�\Ke�T&PQOxIG,J�[�UWOWaKe�\ V�Y;PNJS_`e�\KV�UWG [bjT&PNO�I�PNJ�[(IdT&PQO�O�PNY^PNLQG,V�PwIxM

uvGKLXR�U~� o Gl_ V�GK]Sb�\KJ~I�bSUy]�G5I�I�UWV�J�Oq�obSUWV�U�]�G,PNV�O.\,eB]1G5I�I�U�V�J�O^[(LN\ O�U�V3I�b�G,J�� o G,V�U[(\KJ�JSUW[(I�UWT�kZM~Gz_KVG,]�b�UWTS_KUKh���eDG,LNL�I�bSU�]�G5I�I�UWV�J�O;GKV�U�Y^UWY.kgU�VO^\,e8G}[(\ JSJSUW[(I�U�T

Page 16: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

��ü � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

1 1

111

1

1 11

11

11 11

2

22

22

2

22

2 2

2

X

11

11

1

1 2

2

2

2

2

22

* * * * * * * * *

1

X2

ä(jel*�5Þ:Ô;��Å�fPjek*lTbeh���bejek*û&s:bed;fPgPh:iPjek*l�wEx�t�o3tSg gPh:iPk�fPh=gcs:wTk~gGtEjek*jek*l�g��Mw&s=butEfGfGh=f}y ÞntEk*r�Ô~��s=wTk*k*h=s�gPh:r�zX��ts�m3tEjek wExZk*wTjefP��o3tSg gPh:iPk*f&y¾½T���

_KVG,]Sb�a&O�I�\ ]�h�èBI�bSUWV��oPQO�UKa&V�U�]gUWG5I�I�bSPNOBOxI�U�]�h��Ì>�y��bSU�\KR&I�]SR&I�\Ke�I�b�UiG,LN_K\KV�PXI�bSY PQOcGDJSU�OxI�UWTqbSPXUWV�GKV�[bZM`\Keg_ V�GK]Sb�O$�obSPQ[b;[WG,J^k1Ui[�R&I�G5I

GHTSUWO�PXV�UWTqT&PNO�O�PXY;PNLNGKV�PXIxM3LNU�uKUWLZe�\KV�Y;PXJS_`GH]�GKV�I�PwI�PX\ Jy��[(LNR�OxI�U�V�PXJ�_>�{PNTSU�J>I�PXr�UWT^kZM.O�PXY;]SLNM[(\KJ�JSUW[(I�UWTy[(\ Y;]1\ JSU�J>I�O�PNJyI�bSU3[�\KV�V�U�O�]g\KJ1T&PXJ�_q_ V�GK]Sb�h§~¨�¨�©3ª�«"¬Z­�®°¯±3²�¬#¸2ª�«"¿ ©�¬N¯�¬NµM¶U±�´�·1¸2©3¹ º¯¬Z­�±3´ ¨À§~©3¨�ª>­�±3¯¼ «

�x�v�yÞ!LQGK[(UoU�GK[bs]�G,I�I�U�V�JjPXJtPwIO�\5�oJj[�LXR�O�I�UWVWh!��\KJ1OxI�V�R�[(I�G3LNPQOxId\,e�PXJ>I�U�V�]�G5I�I�U�V�JjT&PQOxIG,J�[�UWOe�\KV!G,LNL�T&PQO�I�PNJ�[�I!RSJ�\KVT&U�V�UWTq]�G,PNVO0\,e�]�G5I�I�U�V�J�OWaKG,J1T^O�\KV�I0I�bSPQOcLNPNO�I!PNJ;G O�[�U�J�TSPXJS_D\ V�T&UWVWh

��Ë ��Ò>I�UW]sI�bSV�\KR�_Kb;I�b�U8O�\KV�I�UWT^LNPNO�I�\Ke�T&PQOxIG,J�[�UWOWaKe�\ V�Y;PNJS_`e�\KV�UWG [bjT&PNO�I�PNJ�[(IdT&PQO�O�PNY^PNLQG,V�PwIxMuvGKLXR�U~� o Gl_ V�GK]Sb�\KJ~I�bSUy]�G5I�I�UWV�J�Oq�obSUWV�U�]�G,PNV�O.\,eB]1G5I�I�U�V�J�O^[(LN\ O�U�V3I�b�G,J�� o G,V�U[(\KJ�JSUW[(I�UWT�kZM�G�_KVG,]Sb�U�T&_KU h���eBG,LNLcI�bSU�]�G5I�I�UWV�J�OqG,V�UsY;U�Y.kgU�VO3\KeiGz[(\ Y^]�LXU�I�U�LNM[(\KJ�JSUW[(I�UWT�_KVG,]�b�aSOxI�\K]�h

��Ì>�y��bSU3\KRSI�]SR&IH\,ecI�bSUqGKLX_ \KV�PwI�bSYýPQO8GjJSUWO�I�U�TnbSPNU�VG,V[b>Mt\,e!_KVG,]�b�Oo�obSPQ[bz[�GKJzk1Uq[(R&IG5ItG~T&U�O�PNV�UWT�T&PQO�O�PXY;PNLNGKV�PXIxM�LNU�u U�Loe�\ V�Y;PNJS_~G�]�GKV�I�PwI�PX\ JÛ��[(LNR�O�I�UWV�PNJS_>�sPNT&UWJ>I�PXr�UWT�kZM[(\KY;]SLNU(I�U�LNMt[(\ JSJSU�[�I�U�T�[�\KY;]g\KJSUWJ IOoPNJtI�bSU3[(\ V�V�UWO�]1\ J�T&PNJS_^_KVG,]Sb�h

�iPNU�VG,V[bSPN[WG,LcG,LN_K\ V�PXI�b�Y;ODGKV�U^Y;\KV�U^u U�VO�G,I�PNLXUqI�b1G,J}]�G,V�I�PXI�PN\KJ�GKL!G,LN_K\ V�PXI�bSYsOWh^��\KVDU(pZfG,Y;]SLNUKaZI�bSU`O�PNJS_ LXU�f�LNPXJ�|j[(LNR�OxI�U�V�PXJ�_^GKLX_ \KV�PwI�bSY»��\ V�|&O���UWLXL�\ J�TSG,I�G^O�U�I�Oo[(\ J>I�G,PNJSPNJS_.J�\KJ&fPQO�\KI�V�\K]SPQ[0[(LNR�OxI�U�VO�PNJ�[(LNR�T&PNJS_o�dU�LNLwf�O�UW]�G,VG5I�UWT�a�[b�G,PNJ&f�LXPN|KU aWGKJ�TD[(\KJ1[(U�J>I�V�PQ[0[(LNR�OxI�U�VO�a��obSUWV�U�GKOGtIxM>]�PN[WG,L0]�G,V�I�PXI�PN\KJ1G,LcG,LN_K\ V�PXI�bSY O�R�[b�G O8I�bSU�L>f�Y^U�G,J�ODGKLX_ \KV�PwI�bSYä��\ V�|&O8��UWLXL0\KJ�LXMn\ JTSG,I�GnO�U(I�ODb1Gvu>PNJS_nPQO�\KI�V�\K]SPQ[^[(LNR�OxI�U�VOjÄX��ÍN�,Ç�h�è8J}I�bSUs\,I�bSU�V3b1G,J�T�a{I�b�U;I�PNY^U�G,J�T�O�]�GK[�U[(\ Y;]SLXU�p&PwI�PXU�OlÄ ÌKë5Ç8\,eDI�bSU�]�G,V�I�PXI�PN\KJ1G,LBGKLX_ \KV�PwI�bSYsOjG,V�U�IxMZ]SPN[WG,LNLXM�LX\5�dU�VjI�b�GKJ�I�bS\>O�Uz\KeI�b�UqbSPNU�VG,V[bSPQ[�GKL{G,LN_K\ V�PXI�b�Y;OWhD��I`PNOH]g\ O�O�PNkSLNU3I�\�T&UWuKU�LN\K]�bZM>k�V�PQTzG,LN_K\ V�PXI�b�Y;O^ÄX�WÌKë,Ç{I�b�G5IU(p&]SLN\KPXI�I�bSU`_ \Z\ZTte�UWG,I�RSV�UWO�\Ke$kg\,I�bn[�G5I�U�_ \KV�PXU�O�hÁ ±3¬Z­�®°­�Â`¼»±�Â�®b©@§~¨�¨�©3ª�«"¬Z­�®°¯±3²�¬#¸2©3¹ º�¯�¬N­�±�´»¨8§0©�¨�ª�­�±�¯�¼»«�x�v�n��\KY;]SR&I�UjI�b�Ut]SV�\vp&PXY;PXIxM�YsG5I�V�PXp~[(\ J IG,PNJSPNJS_nI�b�U�T&PQOxIG,J�[�UtkgU(Ix�dU�UWJ~UWG [b~]�G,PNV.\Ke

]�G5I�I�U�V�J�OWhc��V�UWG,I�U�GK[by]�G5I�I�UWV�J�GKOoG;[(LNR�O�I�UWVWh��Ë �y�{PNJ�TjI�bSUHY;\ O�I�O�PXY;PNLNGKV�]1G,PNV�\Ke{[(LNR�O�I�U�VOdR�O�PXJS_.I�bSUH]SV�\vp&PXY;PXIxM^YsG,I�V�Pwp�h�9nU�V�_KUBI�bSU�O�U

Ix��\`[(LNR�O�I�UWV�O0PNJ>I�\D\KJSUi[�LXR1OxI�U�V�h ÃB]gTSG,I�U�I�bSUo]SV�\vpZPNY;PwIxM.Y;G,I�V�Pwp.I�\`V�U(Ý�U�[�IcI�b�PNOcY;UWV�_ U\K]gU�VG5I�PN\KJ�h

Page 17: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � �q�

1 1

111

1

1 11

11

11 11

2

22

22

2

22

2 2

2

X

11

11

1

1 2

2

2

2

2

22

* * * * * * * * *

1

X2

ä(jel*��Þ:¾;�Åýs=wT|_o*beh�gGh���bejek*û�s=bed*fPgPh=iGjek*l�wExct�o*tSgPgPh=iGk�fGh�gns=wTk~g�tEjek*jek;l�g��Mw�s=butEfGfPh:f�yPÞ�tEk*r�Ô~��s=wTk*k;h:s�gPh=rz~��t&s�m3tEjek�wEx(k;wTjefP��o3tSg gGh=iGk;f&y¾½T�����Ì>����e0GKLXL�\ k&îxUW[(I�OoG,V�UDPXJ�\ JSU`[(LNR�OxI�U�V�aSOxI�\K]�h!Ø�LNO�UKa&_ \.I�\jOxI�U�]nË&h\dG O�U�T^\KJ;I�b�Ui�dGvM.I�bSUB]SV�\vp&PNY;PwIxMqY;G,I�V�Pwp^PNO�RS]�TSG5I�UWTsPNJjOxI�U�]tËSa G`u5G,V�PNU(IxM.\Ke�G,_K_ LX\ Y^fU�VG5I�PXu UsG,LN_K\KV�PXI�bSYsO`[�GKJ�k1UtTSUWO�PX_ JSUWT�hy�iPNU�VG,V[bSPQ[�G,L!TSPXuZPQO�PNuKUsG,LN_K\ V�PXI�b�Y;O`O�I�GKV�I3�oPXI�b~GO�PXJS_ LXUD[(LNR�O�I�UWVd\Ke$GKLXLgI�b�UH_ PXu U�J�\Kk&îxU�[�I�O�GKJ�Tt| U�UW]�O�]SLXPXI�I�PXJ�_qI�bSU`[(LNR�O�I�U�VOdk�GKO�UWTt\KJyO�\ Y^U[(V�PXI�U�V�PN\KJ�I�\;\Kk&IG,PNJyG^]�GKV�I�PwI�PX\ J�\,e$O�PNJS_KLNU(I�\KJ�[(LNR�OxI�U�VO�h�Z# ÀþYZ)BA%9S+ 9S+ U(-3)6],"L] 45U[A + 9T2>Á�C��]�GKV�I�PwI�PX\ J�G,LS[�LXR1OxI�U�V�PXJS_3GKLX_ \KV�PwI�bSY \ k&I�GKPXJ�O�GHO�PNJS_KLNUo]�G,V�I�PXI�PN\KJ;\Ke1I�bSUBTSG,I�GDPNJ�OxI�UWG Tq\Ke�G[(LNR�O�I�UWV�PNJS_.O�I�V�R�[�I�RSV�UKa&O�R1[bjGKO�I�bSUHT&U�J�TSV�\ _KVG,Y ]�V�\&T&R�[�UWTskZMsG3b�PXUWV�GKV�[bSPQ[�GKL&I�U�[bSJSPQ�>RSUKhÞcG,V�I�PXI�PN\KJ1G,L0Y;U(I�b�\ZT�O`b�GvuKU;GKTSuvGKJ>I�G,_ UWOHPNJ�GK]S]SLNPN[WG5I�PX\ J�ODPXJZu \KLNu>PNJS_yLNGKV�_ UsTSG5IGyO�U(IOHe�\KV�obSPQ[b�I�bSUj[�\KJ�O�I�V�R�[(I�PN\KJ�\,eiGnT&UWJ�T&V�\K_KVG,YéPNO3[�\KY;]SR&IG5I�PX\ J�G,LNLXM�]SV�\KbSPNkSPXI�PNuKUKhy�¶]SV�\Kk&fLNU�Y G [�[�\KY;]�G,JZMZPNJS_tI�bSUsR�O�Us\,e�G�]�G,V�I�PXI�PN\KJ�GKL!G,LN_K\ V�PXI�bSY PQODI�bSUj[bS\KPQ[(U;\Ke�I�bSUsJZRSY.kgU�V\,e!T&U�O�PNV�UWTy\KR&I�]SR&I8[�LXR1OxI�U�VO�hd� O�UWY;PXJ�GKL�]�GK]1UWV.Ä Í>ê5Ç�]�V�\5uZPQT&UWO�_ RSPNT�G,J�[�U`\KJyI�bSPQOi| U�MyT&U(fO�PX_ J�T&UW[�PNO�PN\KJ�h}��bSUt]�GKV�I�PwI�PX\ J�G,L�I�U�[bSJSPQ�>RSUWOqR�O�R�G,LNLXM�]SV�\&T&R�[�Ut[(LNR�O�I�U�VOqk>M�\ ]&I�PNY;PXmWPXJS_Gj[�V�PXI�UWV�PN\KJye�RSJ�[(I�PN\KJlTSU(r�JSU�TnU�PXI�b�U�VBLN\&[�GKLXLNM}��\KJzGjO�RSk�O�U(I8\,ecI�b�U3]�G5I�I�UWV�J�O�o\ Vi_KLN\Kk1G,LNLXM��TSU(r�JSU�T�\5uKUWVDGKLXL�\,edI�bSUs]�G,I�I�U�V�J�O��(hy��\KYqkSPNJ�G5I�\KV�PNGKL!O�U�G,V[bl\,edI�b�UtO�U�I3\,e�]1\>O�O�PNkSLXUsLQG5fkgU�LNPXJS_>Oie�\ V8GKJn\K]&I�PXYqRSYäuvGKLXR�U.\,e!G�[(V�PwI�U�V�PX\ JyPQOH[(LNUWG,V�LNMy[�\KY;]SR&IG5I�PN\KJ1G,LNLXM�]SV�\ bSPNkSPwI�PXu UKh��J}]SV�G [�I�PN[�UKagI�bSUWV�U�e�\KV�UKa�I�bSUsG,LN_K\KV�PXI�bSYäPQOBIxMZ]SPQ[�GKLXLNMnV�RSJlYqRSLwI�PX]�LXU^I�PNY;UWOD�oPXI�b�T&PX�gUWV�UWJ IO�I�G,V�I�PNJS_tO�I�G,I�U�O8GKJ�T�I�b�U.kgUWO�ID[�\KJ&r�_ RSVG5I�PN\KJ�\ k&I�GKPXJSU�T�e�V�\KY G,LNL�\KecI�bSU^V�R�J�OBPQOiR1O�U�TlGKOI�b�U`\KR&I�]SR&IB[(LNR�O�I�UWV�PNJS_�hÆ&h¸Ë&hN�1Ä��(Ô� ,¦�¢£�jd¦�¦�Ñ5¦�Å8� ©>Ñ5¦�§�¥�_ZÙqÐ�·B��bSU�Y;\ O�I{PNJ I�RSPXI�PNuKU�G,J�TDe�V�UW�>RSUWJ>I�LNMHR1O�U�T3[(V�PwI�U�V�PX\ J

e�RSJ�[(I�PN\KJ~PNJ�]�GKV�I�PwI�PX\ J�G,Ld[(LNR�OxI�U�V�PXJ�_�I�UW[b�JSPN�>RSU�O3PQO`I�bSU�O��>R�G,V�UWT}U�V�V�\KV3[(V�PXI�U�V�PN\KJ�a$�obSPQ[bI�UWJ�TSOqI�\}�d\KV�|��dU�LNL��oPwI�b�PQO�\ LNG,I�UWT�G,J�T�[(\KY;]�G [�I;[(LNR�OxI�U�VO�h���bSU�O�� R1G,V�UWT�U�V�V�\KV3e�\ V^G[(LNR�O�I�UWV�PNJS_�B�\,e0G;]�G5I�I�U�V�J�O�U�I�& ��[(\ J IG,PNJSPNJS_�Æ [�LXR1OxI�U�VO���PQO

Ç k �%&:�FB��l� ÈnR p � +�Én ! p � uO� � R��! r  R u k ��obSUWV�UA� � R��! PNOBI�b�U /ËÊ3Ìs]�G,I�I�U�V�Jzk1UWLX\ JS_KPNJS_sI�\sI�b�UCTNÊ3Ìj[�LXR1OxI�U�VDG,J�T  R.PNOBI�bSU^[(UWJ I�V�\ PNT�\KeI�b�U|T�Ê3Ìj[(LNR�OxI�U�V�h

Page 18: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

�q] � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

��bSU2L>f�Y;UWG,J1OiG,LN_K\ V�PXI�bSYýPNOiI�bSU.O�PNY^]�LXU�OxI8GKJ�T�Y;\ O�IB[(\ Y^Y;\ JSLXMyR�O�UWT�G,LN_K\ V�PXI�b�YýU�Y^f]SLN\5MZPXJS_3G`O��>R�G,V�UWTqU�V�V�\KV![(V�PXI�U�V�PN\KJ�Äw�vË,ê5Ç�h$��I�OxIG,V�I�Oc�oPXI�bjGDVG,J�TS\KY PNJSPXI�PQG,L1]�G,V�I�PXI�PN\KJsG,J1T|KUWU�]�OD\ J�V�UWG O�O�PN_KJSPNJS_jI�bSUs]�G,I�I�UWV�J1OHI�\n[(LNR�O�I�U�VODk�G O�U�Tl\ JlI�bSUjO�PNY;PXLQG,V�PXIxMnk1U�Ix��UWU�J�I�bSU]�G,I�I�UWV�JsGKJ�TqI�bSUB[�LXR1OxI�U�V�[�U�J>I�UWV�O0RSJ>I�PXLgG`[(\KJZu U�V�_KU�J1[(U�[(V�PwI�U�V�PX\ JqPQOcY;U(I8��¢W·¸©>·Na>I�bSUWV�UoPQOcJS\V�UWGKO�O�PX_ JSY;U�J>I{\KegG,JZM`]�G,I�I�U�V�J.e�V�\KYÛ\ JSUd[�LXR1OxI�U�V0I�\DG,J�\,I�b�U�V�a,\KV{I�bSUiO��>R�G,V�UWT3U�V�V�\ V$[�UWGKO�UWOI�\�T&UW[�V�U�GKO�UDO�PN_KJSPXr1[�GKJ>I�LNM�G5e�I�U�VBO�\KY;U`JZRSYqk1UWVi\,ecPXI�U�VG5I�PX\ J�O��h���bSU L>f�Y^U�G,J�OBG,LN_K\KV�PXI�bSYPQOc]1\ ]SRSLQG,V!kgUW[WG,R�O�UoPXI�PNO�UWG O�M`I�\3PNY^]�LXUWY^UWJ>I�G,J�T^PXI�O!I�PNY^U8[(\KY;]SLNU(p&PXIxM.PQOUÍ;��5��(aZ�obSU�V�U�5PQOdI�bSUDJZRSY.kgU�Vo\Ke{]�G,I�I�U�V�J�O�hc�÷YsG5îx\ Vd]�V�\ kSLXUWYà�oPXI�b�I�bSPQOoG,LN_K\ V�PXI�bSY¶PQOdI�b1G5IoPwIiPQOoO�U�J�O�PwfI�PNuKU�I�\DI�bSU8O�UWLXU�[�I�PN\KJ;\KegI�bSUoPNJSPwI�PNGKL�]�GKV�I�PwI�PX\ JsG,J�T^YsGvMq[�\KJZuKUWV�_ U�I�\3GDLX\&[�GKLSY;PXJ�PXYqRSY¤\KeI�b�U8[(V�PXI�U�V�PN\KJ^e�RSJ�[(I�PN\KJju5G,LNRSU8Pwe�I�bSUBPNJSPXI�PQG,Lg]�G,V�I�PXI�PN\KJsPQO!JS\KI�]SV�\K]gU�V�LXM;[bS\>O�UWJ�h$�$PN_KRSV�U3�WÍO�bS\5�iO`O�UWuKUWJ�Ix�d\,f�T&PNY;U�J�O�PX\ J�G,Lc]1G5I�I�U�V�J�OWhj��eo��UjO�I�GKV�I3�oPXI�b�]�G,I�I�U�V�J�O3�3a \Ha�G,J�T~�¤GKOI�b�U^PNJSPXI�PQG,L!Y;U�G,J�ODG,V�\KR�J�Tz�obSPQ[b�I�bSUsÌ�[(LNR�O�I�U�VODG,V�Uqk�RSPXLXIWa�I�bSUWJ���U^U�J�T}RS]}�oPXI�b�I�bSU]�GKV�I�PwI�PX\ J�(N(���->a.(�\Hag�|->a.(�Fqa�Øia��da1þ2-N-3O�bS\5�oJ�kZMjUWLXLNPX]1O�U�O�h���b�U3O��>R�GKV�U�TjU�V�V�\KVo[(V�PwI�U(fV�PX\ Jyu5GKLXRSU`PQOoYqR�[b�LNGKV�_ U�Vde�\KVoI�bSPQOo]�G,V�I�PXI�PN\KJyI�b�G,J�e�\ V�I�bSU3kgUWO�IB]�GKV�I�PwI�PX\ J�(N(��.a>\Hag�|- a(�Fqa�Ø�- a�(v�da�þ2-�-tO�bS\5�oJ�kZM�V�U�[�I�GKJS_KLNUWOWa��obSPQ[b�M>PNU�LQTSODI�bSUj_ LX\ k�G,L0Y;PXJ�PXYqRSY u5GKLXRSUs\KeI�b�U.O��>R�GKV�U�TtUWV�V�\KVo[�V�PXI�UWV�PN\KJye�RSJ�[(I�PN\KJye�\KV8Gs[(LNR�OxI�U�V�PXJ�_j[(\KJ>IG,PNJSPXJ�_qI�bSV�U�U3[(LNR�O�I�UWV�OWh���bSU[(\ V�V�UW[(I�I�bSV�U�U(f�[(LNR�O�I�UWV�O�\KLNR&I�PX\ J�PQO�\Kk&IG,PNJSUWT�kZMt[bS\Z\ O�PNJS_�a>e�\KVoU�pSG,Y;]SLNUKaS�3a1F.a�GKJ�Ty��GKOI�b�U`PXJSPXI�PQG,L{[(LNR�OxI�U�VoY;UWGKJ�OWh³�Î�¹ ®°­�¬ZÏ<Ð|­`­�ª>­:¸ ©�¹»º¯¬Z­�±3´ ¨8ÑÒ¬Z¯¼ ª,Ï�x�v��ÒZU�LNUW[(IDGKJzPXJ�PwI�PNGKLc]�G,V�I�PXI�PN\KJz\Ke!I�b�Uq]�G,I�I�U�V�J�OH�oPwI�b}GjrSp&UWTzJZRSYqk1UWVD\,e�[�LXR�O�I�UWV�OHG,J1T

[(LNR�OxI�U�Vi[�U�J>I�UWV�OWh��Ë �y�BO�O�PN_KJzU�GK[b�]�G5I�I�U�V�JzI�\�PXI�O`[�LX\>O�U�OxID[(LNR�O�I�U�V`[�U�J>I�UWVDGKJ�Tl[�\KY;]SR&I�U.I�bSU;JSU��¤[(LNR�OxI�U�V

[(U�J>I�U�VOHG O8I�bSUs[(UWJ>I�V�\KPQTSOH\,e!I�bSUj[(LNR�O�I�U�VOWh goU�]gUWG,IDI�bSPQO`OxI�U�]}RSJ>I�PNL�[(\ JZuKU�V�_KUWJ�[(U.PNOGK[bSPNU�u UWT�a�§�·�¢�·Na�RSJ>I�PNL�I�bSU3[(LNR�O�I�U�VBY^UWY.kgU�VO�b�PX]yPNOBOxIG,kSLNUKh

��Ì>�69nU�V�_KUyG,J�T�O�]SLNPXIs[�LXR1OxI�U�VOqk1GKO�UWT~\ J�O�\KY;UybSU�RSV�PQOxI�PN[�PXJSe�\KV�Y;G,I�PN\KJ�a�\K]&I�PX\ J�G,LNLXM�V�U(f]1U�G5I�PNJS_sO�I�U�]zËSh L µOÑÒ¬�®b´ º�¸2©�¹»º¯¬Z­�±3´ ¨8§0©3¨�ª�­`±3¯¼ «

�x�v�n��bS\Z\ O�UPL�[(LNR�O�I�UWV�[(UWJ>I�U�VOsI�\�[�\KPNJ�[(PQT&Ul�oPXI�bÓL�V�GKJ�T&\ Y^LNM>f�[b�\ O�U�J�]�G5I�I�U�V�J�O�\KV:LV�GKJ�T&\KY;LNMjT&U(r1JSUWTy]g\KPNJ IOoPNJ�O�PQT&UHI�b�U`b>MZ]gU�V�uK\ LXRSY;U`[(\ J>I�G,PNJSPNJS_qI�bSU`]�G,I�I�U�V�J�O�U(I�h

��Ë �y�BO�O�PN_KJyUWG [b�]�G,I�I�U�V�JtI�\qI�bSU3[(LN\ O�UWO�Ii[(LNR�O�I�U�Vi[�U�J>I�UWVWh��Ì>�6goUW[�\KY;]SR&I�U8I�bSU3[(LNR�O�I�UWVi[(U�J>I�U�VO�R�O�PNJS_^I�b�U3[(RSV�V�UWJ>Io[�LXR1OxI�U�VoY;U�Yqk1UWV�O�bSPN]�O�h��ÍZ����e�G.[(\ JZuKU�V�_KUWJ�[(Ui[�V�PXI�UWV�PN\KJsPQO�JS\,IdY^U�IWaZ_K\3I�\qO�I�UW]�Ë&hc��MZ]SPN[WG,Lg[(\KJZu U�V�_KU�J1[(Ui[(V�PXI�U�V�PQG

G,V�UK�JS\.��\KV�Y;PNJSPNY;GKLQ��V�U�GKO�O�PN_KJ�Y^UWJ>I�\,e&]�G5I�I�UWV�J�O�I�\iJ�U���[(LNR�O�I�U�V$[(UWJ I�U�VO�a�\KV{Y;PXJSPNYsG,LT&UW[�V�U�GKO�U8PNJnO��>R�GKV�U�TjU�V�V�\KV�h

ÒZU�u U�VG,L>uvGKV�PQG,J>IO�ĸÜ�Ç&\,e�I�bSU�L>f�Y;UWG,J1O{GKLX_ \KV�PwI�bSYÉb�GvuKU�k1UWU�J^V�UW]1\ V�I�UWT`PNJ.I�bSU�LXPXI�UWV�G,I�RSV�UKhÒZ\ Y^Ut\,eoI�b�U�Y G5I�I�U�Y;]&IqI�\}O�UWLXU�[�IqGn_ \Z\ZT�PNJSPXI�PQG,Ld]�G,V�I�PXI�PN\KJ~O�\nI�b�G5IqI�bSUyG,LN_K\KV�PXI�bSY PNOY;\KV�UlLNPX| U�LNM�I�\�r�J�T¿I�bSU}_KLN\Kk�GKL8Y;PNJSPNY.RSYåu5GKLXRSU hà�iJS\KI�bSUWV�uvGKV�PQG5I�PX\ J¿PQOtI�\�]gU�V�Y;PwIO�]SLXPXI�I�PXJ�_^GKJ�TsY;U�V�_KPNJS_.\Ke�I�bSUHV�UWO�RSLwI�PXJ�_q[(LNR�O�I�UWV�OWh$��MZ]SPQ[�G,LNLNMKa&G.[�LXR�O�I�UWV�PQOdO�]SLNPXId�obSUWJtPXI�Ou5G,V�PNGKJ�[(U^PQOHGKk1\5u U^Gy]SV�U(f�O�]1U�[(PXr�UWTzI�bSV�UWO�bS\KLQTlGKJ�TlIx��\�[(LNR�O�I�U�VODG,V�UqY;UWV�_ UWTz�ob�U�J�I�bSUT&PQOxIG,J�[�U!kgU(Ix�dU�U�J3I�bSUWPXV0[(UWJ I�V�\ PNT�O�PNO{kgU�LN\5��GKJS\,I�bSU�V{]SV�U(f�O�]gUW[�Pwr�U�THI�bSV�UWO�bS\ LNT�h ÃBO�PXJ�_iI�b�PNOu5G,V�PNGKJ>IWa�PXI3PNO3]1\>O�O�PXk�LXU^I�\n\ k&I�GKPXJ}I�bSUs\K]&I�PXYsGKLc]�G,V�I�PXI�PN\KJ�O�I�G,V�I�PNJS_ye�V�\KYéGKJ>M�G,V�kSPwI�V�GKV�MPNJSPwI�PNGKL�]1G,V�I�PXI�PN\KJ�a0]SV�\5uZPNT&U�T�]SV�\K]gU�V3I�bSV�UWO�bS\KLQT�u5G,LNRSUWOqG,V�UtO�]gUW[�Pwr1UWT�hl��b�Ut�dU�LNLwf�|ZJS\5�oJ��Ò�èHFi�c�$�¶ÄX�Wê5Ç�GKLX_ \KV�PwI�bSYàUWY^]�LX\5M&O�I�bSPQO�I�UW[bSJSPQ�>RSU`\,e$Y;U�V�_KPNJS_sG,J�TyO�]�LXPXI�I�PXJS_j[�LXR1OxI�U�VO�h��e8��Ò1èHFi�c�{�äPQO;_KPNuKUWJ~I�bSU ö U�LNLNPX]�O�UWø�]�GKV�I�PwI�PX\ JSPXJ�_�O�bS\5�oJ�PXJ��$PX_ RSV�U}��Í�G O^GKJ�PNJSPXI�PQG,L

Page 19: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � �qf

X

X

ABC D E

F G

2

1

äZjel*�5Þ=Ä*���m;h�Ôq��|_h:tEk*f�tEbelTwTiGj gPm*|�jef�fGh=k*fGj gPj p~h}gPw�gGm;h�jek;j gGjutEb5o3tEiPgPj gGjewTk5�

X

B

AC D

E

F

G HI

edge with the maximum length

2

2

6 2.3

4.5

2 22

X2

1

ä(jel*�5Þ:¡;� à�fGjek*l�gGm;hn|_jek*je|�tEbBfGo3tEk*k;jek*l�gPiGh=h}gGwLxKwTiG| s=bed*f gGh=iGf:�

]�GKV�I�PwI�PX\ JSPXJ�_�aSPXIi�oPXLNL�]�V�\&T&R�[�UHI�bSU3\ ]&I�PNYsG,L�I�bSV�U�U(f�[(LNR�O�I�UWVo]�G,V�I�PXI�PN\KJSPNJS_1h!��Ò�èHFi�c�$�Û�oPNLXLr�VOxI{Y^UWV�_ U0I�bSU�[(LNR�OxI�U�VOh(��A-�G,J�T�(`\Ha¸�|-!PNJ>I�\i\ JSU![(LNR�O�I�U�V{k1U�[�GKR�O�U0I�bSU�T&PQO�I�G,J1[(U!kgU(Ix�dU�UWJI�b�U�PNV;[�U�J>I�V�\KPQTSOqPNO^O�Y;GKLXLoGKJ�T�I�bSU�J�O�]SLNPXIqI�bSUy[�LXR1OxI�U�V6(�Fqa ØBa �da¸þ2-}���obSPN[b�b�G OqGlLNGKV�_ Uu5G,V�PNGKJ�[(Uv��a&PNJ>I�\^Ix��\s[�LXR�O�I�UWV�OI(vF.a Ø�-3GKJ�T#(v�da þ2->h�iJS\KI�bSUWV$u5GKV�PQG5I�PX\ J3\,e1I�bSU�L>f�Y^U�G,J�O0GKLX_ \KV�PwI�bSYÉPXJZuK\ LXu UWO$O�UWLXU�[�I�PXJS_DGBTSPw��U�V�U�J>I![(V�PwI�U�V�PX\ J

e�RSJ�[(I�PN\KJzGKLwI�\K_KU�I�bSUWVWh���bSUt£5Ú5¨� 5Ù^§�ÕsÕ(�#ÔZÐ�¥�¢(¦�§�¨Z©3GKLX_ \KV�PwI�bSYé���ob�PN[b�]gU�V�Y^PXI�OBV�UW]SV�UWO�U�J>I�G,fI�PN\KJ1O`\,I�bSU�V`I�b�G,J}I�bSUj[(UWJ I�V�\ PNT Â�Õ e�\ V`UWG [b�[�LXR1OxI�U�V��H�dG OD]SV�\ ]1\>O�U�TlPNJ�Ä ÍZ�5Ç�a{GKJ�T�Äw��ë��5ÇT&U�O�[�V�PNk1U�OjG�T&MZJ�GKY^PQ[n[(LNR�O�I�UWV�PNJS_�G,]S]�V�\>GK[b�\Kk&IG,PNJSUWT�kZM~e�\ V�YqRSLNG,I�PNJS_}I�bSU�[(LNR�OxI�U�V�PXJ�_]SV�\KkSLNU�YðPNJjI�b�Uie�VG,Y;U��d\KV�|.\Ke�Y;G,p&PXYqRSY^f�LNPX| U�LNPXb�\>\&T;U�OxI�PXYsG5I�PX\ J�h0��bSUBV�U�_ RSLNGKV�PNm�U�T�9zG5fb�GKLNGKJS\KkSPQO�T&PQOxIG,J�[�U`�dG O�R1O�U�T�PNJ ÄX��ËKÅ5Ç�I�\;\ k&I�GKPXJ�bZMZ]1UWV�UWLXLNPX]1O�\ PNTSGKL�[(LNR�OxI�U�VO�hÆ&h¸Ë&h¸ËÒÖ�¦� Ïb_�$×._�¢�Ñ,¦�¢�¥�§�Õ í �#ÔZÐ�¥�¢(¦�§�¨Z© ·B��bSUiY;\ O�I!�dU�LNLwf�|ZJS\5�oJ._ V�GK]Sb&f�I�bSUW\KV�U(I�PQ[�T&PNu>PQO�PXu U

[(LNR�O�I�UWV�PNJS_�GKLX_ \KV�PwI�bSY PNOyk�G O�U�T�\KJ�I�bSU�[(\KJ1OxI�V�R�[(I�PN\KJ�\Ke3I�bSU�Ù^§�¨�§�Ùs 5�8Ð�Ï� 5¨1¨�§�¨Z©�¥�¦�¢¢�39�Ò&�i�d\,e{I�bSU`TSG,I�G�Äw��ÅKÅ,Ç�GKJ�TjI�bSU�JnT&UWLXU�I�PNJS_^I�bSU�9lÒS�¿UWTS_KUWO��oPXI�b�I�b�UHLQG,V�_KU�OxI�LNU�JS_KI�b�OI�\�_ U�JSUWV�G,I�UyY^\ V�U�[(LNR�O�I�UWV�OWh��$PN_KRSV�U}��Æ�T&U�]SPQ[�IO^I�bSU#9�Ò&�à\ k&I�GKPXJSU�T~e�V�\KY JSPXJ�U�Ix�d\,fT&PNY;U�J�O�PX\ J�G,L�]1\ PXJ>I�OWhU\dMtk�V�U�G,|ZPXJ�_.I�bSU3LNPXJS|�LNGKk1UWLXU�Tz�dF �oPXI�bnG;LXUWJS_,I�b�\,ecê;RSJSPXI�O3��I�bSUUWTS_KUD�oPwI�b�I�bSU`YsG,pZPNY.R�YýØ!R�[�LXPQT&U�G,JyLXUWJS_,I�b1��a�Ix��\s[(LNR�O�I�UWV�O`�*(��3a�\8a1�|-.GKJ�T�(�Fqa�Øia��daþ^a&�3aZ�O-v��G,V�UB\ k&I�GKPXJSU�T�hc��bSUDO�U�[(\KJ1Tj[(LNR�O�I�U�V�[�GKJjkgUBe�RSV�I�b�U�V�T&PXuZPQT&UWTtPXJ>I�\.Ix�d\q[�LXR�O�I�UWV�OkZMjkSV�UWGK|>PNJS_^I�b�U`UWT&_ UDØ����obSPQ[b�b�GKOoG^LNU�JS_KI�by\,e0Í�h¸Æ.R�JSPwIO�h

Page 20: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

��� � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

��bSU�b�PXUWV�GKV�[bSPQ[�GKLKG,]�]SV�\>GK[bSU�O�G,V�U�GKLNO�\BV�U�LQG5I�UWTHI�\8_ V�GK]Sb&f�I�bSUW\KV�U(I�PQ[c[(LNR�O�I�UWV�PNJS_�h0ÒZPNJS_KLNU(fLNPXJS|^[(LNR�O�I�U�VOcG,V�UoO�R�kS_KVG,]Sb1O0\,egI�bSUoY;PNJSPXYqRSY¤O�]�GKJSJSPNJS_DI�V�U�U�\,egI�b�UiTSG5IGsÄ Ü,Å5ÇS�obSPQ[bsG,V�UG,LQO�\qI�bSU.[�\KJSJSU�[�I�UWT�[(\ Y^]g\KJ�U�J>I�O3ĸÜ,Æ5Ç�h���\KY;]SLNU(I�U�f�LNPNJS|t[(LNR�O�I�UWV�OiGKV�UDYsG5p&PNYsG,L�[�\KY;]SLNU(I�UO�RSkS_KVG,]�b�O;Ä ÜKÆvÇ�G,J1T}GKV�U;V�U�LQG5I�UWTlI�\�I�b�UsJS\&T&Uj[(\ LX\ V�GKkSPXLNPXIxMn\,e�_KVG,]Sb�O;ÄX��Ë5Ç�hj��bSUsYsG,p>fPNY;GKL�[�\KY;]SLNU(I�U�O�RSk�_KVG,]Sb���GKO.[�\KJ�O�PQT&U�V�UWT�I�b�UtOxI�V�PQ[�I�UWO�IqT&U�r�JSPXI�PN\KJ~\KeoGl[(LNR�OxI�U�VqPXJ¿Ä ë5ÇG,J1TÛÄw�vÆa�5Ç�h � _ V�GK]Sb&f�\KV�PXUWJ I�UWT�G,]�]SV�\>GK[b�e�\KV�JS\KJ&f�bSPNU�VG,V[bSPQ[�G,LiO�I�V�R�[(I�RSV�UWO�G,J�T�\5u U�V�fLQG,]S]SPNJS_}[(LNR�OxI�U�VO.PQO^]SV�UWO�U�J>I�U�T�PXJ÷Äw�WÍ>Æ5Ç�h���bSUnßq¢��X 5Ô&¨� 5Ún©,¦� �Ïb_���FHþ`�qPQOq\ k&I�GKPXJ�UWT�kZM[(\ JSJSU�[�I�PNJS_sG,LNLgI�bSU`]1G,PNV�Od\,e$]1\ PXJ>IOdI�b�G,IoGKV�UHïc\KV�\KJ�\KP�JSU�PN_KbZkg\KVO�h0��bSU`FDþ [�\KJ>I�GKPXJ�O�GKLXLI�b�UiJSU�PN_KbZkg\KV�bS\Z\&T3PNJ&e�\KV�YsG5I�PN\KJs[�\KJ>I�GKPXJSU�T.PNJ;I�b�U�9lÒ&��G,J�TqI�bSUoV�UWLNG,I�PNuKU�JSUWPX_ b>kg\KV�bS\Z\&T_KVG,]�b��3gBú8þ`�`ÄX�WëKÍ,Ç�h�Z# ñ /�+ ô*9TN5AD<sA�<XC:UZ] @B+.-*4�)6-*H�/�U�H,<�[�7[<q<,Ã*+.-*4§"L] 4,U[A + 9T2 Á�C��bSUiY;PXpZI�RSV�UiV�UWO�\KLNu>PNJS_`G,]�]SV�\>GK[b.I�\.[�LXR�O�I�UWV�G,J1G,LNMZO�PQOcb�GKO!k1UWU�JjGKT�T&V�U�O�O�UWT^PNJjGDJZRSY.kgU�V\,e{�dGvM&OWh{��bSUHRSJ�T&UWV�LNMZPXJ�_qGKO�O�RSY;]&I�PN\KJjPQO�I�b�G,I�I�bSU8]1G5I�I�U�V�J�O�I�\qk1UD[(LNR�O�I�U�V�UWTtG,V�U8T&VGv�oJe�V�\KY \KJSUz\Ke.O�UWuKUWV�GKLBT&PQOxI�V�PNkSR&I�PX\ J�O�aiGKJ�T�I�b�Ul_K\>G,LiPQOtI�\~PQT&U�J>I�Pwe�M�I�b�Ul]�GKV�GKY^U�I�UWV�Os\KeUWG [byGKJ�T���]gU�V�b�G,]1O���I�bSU�PNViJZRSY.kgU�V�hU9n\>OxIi\Ke{I�bSU3�d\KV�|sPXJ�I�bSPQOiG,V�UWG^b�G OoGKO�O�RSY;U�TtI�b�G5II�b�UjPXJ1T&PXuZPQT&R�GKL�[(\ Y;]1\ JSU�J>I�O.\,edI�bSU�Y;PwpZI�R�V�UtTSU�J�O�PwIxM}G,V�UtþDG,R�O�O�PNGKJ�a$GKJ�T}PXJ~I�bSPQO.[WGKO�UI�b�U.]�GKV�GKY^U�I�UWV�OB\,e0I�bSU^PNJ�T&PNu>PQT&R�GKL0þDGKR�O�O�PQG,J�O8G,V�U`I�\tk1U^UWO�I�PNYsG5I�U�TnkZMtI�bSU^]SV�\&[�UWT&RSV�UKh�{V�G T&PwI�PX\ J�G,L�GK]S]SV�\ G [bSUWO�I�\jI�bSPQOo]SV�\KkSLNU�YùPXJZu \KLNuKUD\Kk&IG,PNJSPNJS_z��PXI�UWV�G,I�PNuKU�LNMS��G;YsG5p&PXYqRSYLNPX| U�LNPXbS\Z\&T�UWO�I�PNY;G,I�U`\Ke�I�b�U`]�G,VG,Y;U(I�U�V�uKU�[�I�\KVO�\Ke{I�bSU3[(\ Y;]1\ JSU�J>IiT&U�J1O�PXI�PNUWO3Ä Å Æ5Ç�h9n\KV�U�V�UW[�U�J>I�LNMKavI�bSUoØcp&]1U�[�IG5I�PN\KJ29zG5p&PNY^PNmWG,I�PN\KJy��ØU9���GKLX_ \KV�PwI�bSY¶��G8_KU�J�U�VG,LXf�]SR�V�]g\ O�UYsG5p&PNY.RSY»LNPX| U�LNPXbS\Z\&TjGKLX_ \KV�PwI�bSY Ä Ì Å5Çge�\KV�Y;PQO�O�PNJS_,f�TSG5IG3]SV�\Kk�LXUWY;O�cb1GKO�k1UWU�J�GK]S]SLNPXU�T;I�\I�b�Us]SV�\ kSLNU�Y \Ke�]�GKV�GKY^U�I�UWVHU�OxI�PXYsG,I�PN\KJ�hs�ðV�U�[(UWJ I`kg\Z\K|�ÄX�WÌKÍ,Çc]SV�\5u>PQT&U�OHGKJ}G [�[�UWO�O�PNkSLNUT&U�O�[�V�PN]&I�PN\KJy\,e$I�b�U`I�U�[bSJSPQ� R�UKh!��JyI�b�U.ØU9ée�V�GKY;U��d\KV�|gaZI�bSU`]�GKV�GKY^U�I�UWV�Od\,e$I�b�U.[(\ Y^]g\,fJSUWJ I�T&U�J1O�PXI�PNUWO�G,V�UiRSJ�|>J�\5�oJ�a>G O�GKV�UiI�bSUHY;Pwp&PNJS_.]�GKV�GKY;U(I�UWV�OWa GKJ�T;I�bSUWO�UHGKV�UBUWO�I�PNY;G,I�U�Te�V�\KY I�bSUj]�G,I�I�U�V�J�O�hy��bSUjØU9 ]SV�\&[(U�T&RSV�U^kgU�_ PXJ1O3�oPXI�b�G,J�PNJSPwI�PNGKL�U�OxI�PXYsG5I�Us\,e�I�b�Us]�G5fVG,Y;U(I�U�V;uKU�[�I�\ V^GKJ�T�PwI�U�VG5I�PNuKUWLXM�V�UWO�[(\ V�U�O3I�bSU�]�G5I�I�UWV�J�O;GK_ G,PNJ�O�IqI�bSU�Y;PwpZI�R�V�UnT&UWJ�O�PXIxM]SV�\&T&R�[(U�TtkZMsI�bSU`]�GKV�GKY^U�I�UWVdu UW[(I�\KV�h0��bSUDV�U�O�[�\KV�UWTj]1G5I�I�U�V�J�OoG,V�U8I�bSUWJyR1O�U�TjI�\^R�]gTSG,I�UI�b�UH]1G,VG,Y;U(I�U�VdUWO�I�PNY;G,I�U�O�h0��J�Gq[�LXR�O�I�UWV�PNJS_;[(\ J I�U(pZIWaZI�bSU`O�[�\KV�UWO�\,e�I�bSUD]�G5I�I�UWV�J�O`���obSPQ[bUWO�O�U�J>I�PQG,LNLXM�Y;UWGKO�RSV�U`I�b�U�PNVBLNPX| U�LNPXbS\Z\&T�\,eckgU�PNJS_�TSV�Gv�oJye�V�\KY¾]�G,V�I�PQ[(RSLQG,V8[(\KY;]g\KJSUWJ>I�Oi\KeI�b�UsY^PXpZI�RSV�U��D[WG,J�kgUsu>PNU��dUWT}GKO3bSPXJ>IO3G5IDI�b�Ut[(LQGKO�OD\,e�I�bSUj]1G5I�I�U�V�J�hj��bS\>O�U;]�G,I�I�UWV�J1O�a]SLQGK[�UWT���kZMnI�bSU�PNV.O�[(\KV�UWO�8PXJ�Gy]�GKV�I�PN[�RSLNGKV3[(\ Y^]g\KJ�U�J>IWa{��\ RSLNTlI�b�U�V�U(e�\KV�U;k1UsuZPNU��dUWT�GKOkgU�LN\KJS_ PXJS_^I�\qI�bSU3O�G,Y;U`[(LNR�OxI�U�V�húi\KJ�]�G,VG,Y;U(I�V�PQ[�I�UW[bSJSPQ�>RSUWOze�\KV�T&U�J1O�PXIxM>f�k�G O�U�TÛ[(LNR�O�I�U�V�PNJS_¿b�Gvu U�G,LQO�\æk1UWU�J¤TSU�uKUWLwf

\K]gUWT}Ä Å ÆvÇ�h$��J�O�]�PXV�UWT�kZM;I�bSU`ÞcG,V�m�UWJj�oPNJ�T&\5�æGK]S]SV�\ GK[b;I�\;JS\KJS]1G,VG,Y;U(I�V�PQ[BT&UWJ�O�PwIxMsU�OxI�PwfYsG5I�PX\ J�aZI�bSU`[�\KV�V�U�O�]g\KJ�TSPXJS_^[(LNR�O�I�U�V�PNJS_q]�V�\&[(U�T&RSV�UHO�UWGKV�[b�UWO�e�\KVokSPNJ�O��oPXI�byLNGKV�_ U8[(\ RSJ>I�OPNJ^GHY.R�LwI�PNT&PNY;U�J�O�PN\KJ�GKL&bSPNO�I�\ _KVG,YÛ\Ke�I�b�UoPXJS]�R&I!]�G5I�I�UWV�J;O�U�IWh!èBI�bSUWV!G,]S]�V�\>GK[bSU�O�PNJ�[(LNR�T&UI�b�U;GK]S]SLNPN[WG5I�PX\ J�\KedG,J�\,I�b�U�VD]�G,V�I�PXI�PN\KJ1G,L0\KVDbSPNU�VG,V[bSPQ[�G,L0[(LNR�O�I�UWV�PNJS_�G,LN_K\KV�PXI�bSY R�O�PNJS_yGT&PQOxIG,J�[�UDY^U�GKO�RSV�UHk1GKO�UWT�\KJ�GqJ�\KJS]�GKV�GKY;U(I�V�PQ[8T&UWJ�O�PwIxM�UWO�I�PNY;G,I�U h�Z# � J�<;)BAD<XC:9�J�<*+ 4Z2NØBU[A{En]eN;C:9=<BA +.-;4ÒZPNJ�[(Ud]SV�\vp&PXY;PXIxM8]SLQGvM&O{G8|KUWMDV�\ LXU!PNJ.\ RSV$PXJ>I�R�PwI�PXu U�JS\KI�PN\KJq\,e�GH[(LNR�OxI�U�V�avJSUWGKV�U�OxI�f�JSUWPX_ bZk1\ VT&PQOxIG,J�[�UWO3[WG,J�O�U�V�uKUsGKODI�bSUjk�G O�PQO`\Keo[�LXR1OxI�U�V�PXJS_n]�V�\&[(U�T&RSV�UWOWht�iJ�PXI�UWV�G,I�PNuKUs]SV�\&[(U�T&RSV�U��GKOc]SV�\K]g\ O�UWT;PNJzÄX��Ë,Ì,Ç�µ>PXI�GKO�O�PN_KJ1OcUWG [bsRSJSLQG,kgU�LNUWTs]�G,I�I�U�V�J;I�\`I�bSU8[�LXR�O�I�UWV�\Ke�PXI�O�JSU�G,V�UWO�ILQG,kgU�LNUWTzJ�U�PN_KbZk1\ V8]1G5I�I�U�V�J�a�]SV�\5uZPNT&U�T�I�b�U;TSPNO�I�GKJ�[(UqI�\�I�b�G,IHLQG,kgU�LNUWTlJSU�PN_KbZkg\KVHPNOHkgU�LN\5�GtI�bSV�UWO�bS\KLQT�h.��b�U^]�V�\&[(U�O�OH[(\ J>I�PNJ>R�UWOHRSJ>I�PNLcG,LNLc]�G5I�I�U�V�J�ODG,V�U.LQG,kgU�LNUWT�\KVHJS\�GKTSTSPwI�PX\ J�G,LLQG,kgU�LNPXJS_>OB\&[W[(RSV�h`��bSU.YqR&I�R�GKL0JSU�PN_KbZkg\KV�bS\Z\ZTzuvGKLXR�U���TSUWO�[(V�PXkgUWTlUWG,V�LNPXUWVBPNJzI�b�U^[�\KJ>I�U�p>I

Page 21: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ���\,ecT&PQOxIG,J�[�U`[(\KY;]SRSI�G5I�PX\ J1�d[�GKJ�GKLNO�\^k1U`R�O�UWT�I�\^_ V�\5�¹[(LNR�OxI�U�VOde�V�\ YàJSU�G,VoJSUWPX_ b>kg\KVOWh�Z# �þ\[N�ÙKÙ~F;E}]eN*C=9=<,A +.-*4�{V�G T&PwI�PX\ J�G,L$[(LNR�O�I�U�V�PNJS_�GK]S]SV�\ GK[b�UWOo_ U�JSUWV�G,I�U3]�GKV�I�PwI�PX\ J�OWµgPNJ�Gt]�G,V�I�PXI�PN\KJ�a1U�GK[bz]�G,I�I�U�V�JkgU�LN\KJS_>OHI�\�\KJSUsGKJ�Tl\ JSLNMz\KJSUs[�LXR�O�I�UWVWhs�BU�J�[�UKa�I�bSUs[(LNR�O�I�U�VODPNJ�Gyb�GKV�T�[(LNR�O�I�U�V�PNJS_nG,V�UT&PQO�îx\ PXJ>I�h��SR�m�m�My[(LNR�O�I�U�V�PNJS_;U(pZI�UWJ�TSO�I�bSPNOBJS\,I�PX\ JyI�\jGKO�O�\Z[�PNG,I�UHUWG [by]1G5I�I�U�V�J��oPwI�byUWuKUWV�M[(LNR�O�I�UWVjR�O�PXJS_~G�Y;UWY.kgU�VO�bSPN]�e�RSJ�[(I�PN\KJ ÄX�WÅKë,Ç�h¹��bSUz\KRSI�]SR&I�\,e`O�R�[b�GKLX_ \KV�PwI�bSYsO;PNOjG[(LNR�O�I�UWV�PNJS_�ack�R&I^J�\,I^Gl]�G,V�I�PXI�PN\KJ�h�½}U�_ PXu U�GlbSPX_ b&f�LXUWuKU�L�]�G,V�I�PXI�PN\KJ1G,L�e�RSm�mWM~[(LNR�OxI�U�V�PXJ�_G,LN_K\ V�PXI�b�Y¶k1UWLX\5�`h Ú ¹»ÛNÛaÜ�¸ ©�¹»º¯¬Z­�±3´ ¨À§0©3¨�ª�­`±3¯¼ «�x�v��ÒZU�LNUW[(I`GKJ�PNJSPXI�PQG,L0e�RSmWm�M�]�G,V�I�PXI�PN\KJ}\,e�I�bSU�� \Kk&îxU�[�I�ODPNJ>I�\�Æ [(LNR�O�I�U�VOHkZMlO�UWLXU�[�I�PXJS_

I�bSUI�E7�Æ Y;U�Yqk1UWV�O�bSPN]jYsG5I�V�PXp�Ã.h&�iJjUWLXUWY^UWJ>I�Ý !ÞR \Ke�I�bSPQOdY;G,I�V�Pwp;V�U�]SV�UWO�U�J>I�OcI�bSU_KVGKT&UH\,e$Y^UWY.kgU�VO�b�PX]�\,e$\Kk&îxU�[�I�� ! PNJ�[(LNR�OxI�U�V  R h!��MZ]SPQ[�GKLXLNMKa°Ý !SR H�Ä �>����Ç�h

��Ë �6ÃBO�PXJS_6Ã3a�r�J1TnI�b�Uqu5G,LNRSU^\,e�Gte�RSmWm�Mz[(V�PXI�U�V�PN\KJne�RSJ1[�I�PN\KJ�a�¢W·¸©>·.G��dU�PN_Kb>I�U�TzO��>R�GKV�U�TU�V�V�\ V�[(V�PXI�U�V�PN\KJje�R�J�[�I�PX\ J�aSGKO�O�\&[�PNG,I�UWTj�oPwI�btI�bSU`[(\KV�V�UWO�]1\ J�T&PNJS_.]�GKV�I�PwI�PX\ J�h�è8JSUH]1\>OxfO�PNkSLNU8e�R�m�m�My[(V�PwI�U�V�PX\ Jje�RSJ1[�I�PN\KJnPQOß k ��&:�Mày�z� án ! p � Ènoqp � Ý�!SR�uO�,! r  o u k ��obSU�V�U  o ��â á! p � Ý ! o � ! PQO�I�bSU L�Ê3Ìqe�RSmWm�M�[�LXR1OxI�U�Vi[(UWJ>I�U�V�hgoUWG O�O�PX_ J;]�G5I�I�U�V�J�O0I�\.[(LNR�O�I�UWV�O!I�\3V�UWT&R1[(UoI�bSPNO�[(V�PwI�U�V�PX\ J^e�RSJ�[�I�PX\ Jju5G,LNRSUBGKJ�T;V�U�[(\ Yqf]SR&I�UAÃ.h

��Ì>�6goU�]gUWG,IoO�I�UW]zË.R�J I�PXL�U�J>I�V�PXU�O�PXJ�ÃÛT&\;JS\KIB[b�G,J�_KUDO�PN_KJSPXr1[WG,J>I�LNMKh��J�e�R�m�m�M�[(LNR�O�I�UWV�PNJS_�adUWG [b�[�LXR1OxI�U�VjPQOjG�e�RSm�mWM�O�U(Ij\KeDGKLXLiI�bSUn]�G,I�I�U�V�J�O�h¹�{PN_KR�V�U���ê

PNLXLNR�O�I�VG5I�U�O�I�b�U.PQT&UWG�h���b�U3V�U�[�IG,JS_ LXU�O�U�J�[�LX\>O�U`Ix�d\ ö b1G,VTSø;[(LNR�OxI�U�VOiPNJ�I�bSUqTSG5IGSÈ@¤����( �N��Ëb��Ìb��Í>�Æ�-�GKJ�T�¤ k �ã(�êb��Ü���ëb��Åb- h��¾e�RSm�mWM�[(LNR�O�I�UWV�PNJS_�G,LN_K\ V�PXI�bSY Y^PN_Kb>Is]SV�\&T&R�[(UI�b�UlIx�d\�e�RSmWm�M¿[(LNR�O�I�UWV�O6äh�lG,J1T�ä k T&UW]SPN[(I�U�T¿kZM�U�LNLXPN]�O�UWOWhð��bSU�]�G5I�I�UWV�J�O��oPNLXLDb�Gvu UY;U�Yqk1UWV�O�bSPN]tu5G,LNRSUWO�PNJ�Ä �SaN�(Çge�\KVdUWGK[b�[(LNR�OxI�U�V�hc�S\KVdU(pSGKY^]�LXU aKe�RSmWm�Mj[�LXR�O�I�UWV�äh�B[(\ RSLNTjk1U[(\ Y;]�GK[(I�LNMtT&UWO�[(V�PNk1U�T�G O(>�������>� Å>�q����Ë°�M�b� ë �K�W��Ì>���>�¸ÜK�q�W��Í>�M�b� ê �q����Æb���b�¸ÆKÆK�q�W��êb�M�b�¸Ë,�q����Ü��M�b�¸Ë,�q����ë>���b� �K�K�W��Å>���>� �K�q-G,J1T~ä k3[(\ RSLQTtkgU3T&UWO�[(V�PNk1U�TyG O(>�x�N���>� �>�q�W��Ë°�M�b� � �q����Ì>���b� � �K�W��Í>���>�X�v�q����Æ°�M�b�N��Æ �q�W��êb�M�°� ÍZ�q����Ü����b� Ì Æ,�K�W��ë>���a� � �K�W��Åb���b� Å>�O-��bSU`\ V�T&UWV�U�Tj]�GKPXVO`��/O��å,!��dPNJyU�GK[b�[(LNR�O�I�U�VoV�U�]�V�U�O�UWJ IdI�b�U�/�I�b�]�G5I�I�U�V�J�G,J�TyPXI�O�Y;U�Yqk1UWV�fO�bSPX]luvGKLXR�U3I�\jI�bSU;[(LNR�O�I�U�V�å,!�h�}�G,V�_KUWViY;U�Yqk1UWV�O�bSPN]zu5G,LNRSUWOBPXJ�TSPN[WG5I�UqbSPN_KbSUWV8[(\ J&r1T&UWJ�[(UPNJ�I�bSU3GKO�O�PX_ JSY;U�J>Io\,e�I�bSU3]�G,I�I�U�V�JtI�\;I�bSU3[�LXR�O�I�UWVWh!�Éb1G,VT�[�LXR�O�I�UWV�PNJS_s[�GKJ�kgU`\KkSI�G,PNJSU�Te�V�\KYýGqe�RSmWm�Mt]1G,V�I�PXI�PN\KJyk>MtI�bSV�UWO�bS\ LNT&PNJS_qI�bSU`Y;UWY.kgU�VO�bSPN]�u5G,LNRSUKh�SRSmWm�MæO�U(InI�bSU�\ V�M���GKO�PNJSPXI�PQG,LNLXMæGK]S]SLNPXU�T¿I�\�[(LNR�OxI�U�V�PXJ�_�PNJ ÄX��ÆKë5Ç�h¾��bSU�kg\Z\K|¿kZM\dU�m�T&U�|æÄX�Wë,ÇiPNOtG�_ \Z\ZT�O�\KRSV[(U�e�\KVsYsG,I�U�V�PQG,Lo\KJ�e�RSmWm�M�[(LNR�OxI�U�V�PXJ�_�h���bSUnY;\ O�Ij]1\ ]SR&f

LQG,V3e�R�m�m�M~[�LXR1OxI�U�V�PXJS_}G,LN_K\ V�PXI�bSY PQO3I�bSUte�R�m�m�MGæf�Y;UWGKJ�O����$�X9l�.G,LN_K\ V�PXI�bSY ÄX�Wë,Ç�h}Ø!uKUWJI�b�\KRS_ b�PwIyPNOtk1U�I�I�UWVjI�b�G,J�I�bSUzb�GKV�T�LZf�Y;UWGKJ�OjGKLX_ \KV�PwI�bSY PNJæGvuK\ PNTSPXJS_�LN\&[�G,L8Y;PXJSPNYsGSa�$�X9â[WG,JnOxI�PXLNL{[�\KJZuKUWV�_ UBI�\sLX\&[WG,L�Y;PNJSPXYsGs\Ke{I�bSU.O��>R�G,V�UWT�U�V�V�\ Vi[(V�PwI�U�V�PX\ J�h���bSU3TSUWO�PX_ J\,e$Y;U�Y.kgU�VO�bSPX]�e�RSJ�[(I�PN\KJ�O�PQOdI�b�U`Y^\>OxIoPNY;]1\ V�IG,J>Id]�V�\ kSLXUWYàPNJte�RSmWm�Mt[�LXR1OxI�U�V�PXJS_1µST&PX�gUWV�fU�J>I.[bS\ PN[�UWO`PNJ�[�LXR�TSUsI�bS\>O�Usk1GKO�UWT�\KJ�O�PNY;PXLQG,V�PXIxM�T&U�[(\KY;]g\ O�PwI�PX\ J�Äw��ë5Ç�G,J1T�[(U�J>I�V�\ PNTSOD\Ke

Page 22: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

��� � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

X

Y

12

3 4

5 6

7

89

H 2H

FF

1

1 2

ä(jel*�6Þ:Õ;��ä3d`ç*ç�� s:bed;fPgPh:iPf��[(LNR�O�I�UWV�OWh^�ð_ U�JSUWV�GKLXPNmWG,I�PN\KJz\Ke�I�b�Uj�$�X9 G,LN_K\KV�PXI�bSY ��GKOH]SV�\K]g\ O�UWTlk>M�Äw��ë5Ç0I�bSV�\KR�_Kb�Ge�G,Y;PNLXM;\Ke�\ k&îxUW[(I�PNuKUoe�R�J�[�I�PX\ J�O�hc�¿e�RSm�mWM�æf�O�bSU�LNL1GKLX_ \KV�PwI�bSYðGKJ�TsG,JjG TSG,]SI�PNuKUiu5G,V�PQG,J>Ice�\KVT&U�I�UW[(I�PNJS_j[(PNV[(RSLQG,VoG,J1TtUWLXLNPX]SI�PQ[�G,L�k1\ RSJ�TSGKV�PNUWO���GKOd]SV�UWO�U�J>I�U�TtPNJ�Ä Ì ê5Ç�h�Z# è÷A�<KÂBAD<XC:<,-q9:);9S+ UZ-�U,W!En]eN*C=9=<BADC��JsG,]S]�LXPQ[�G,I�PN\KJ�O$�obSUWV�UdI�b�UoJ>R�Y.kgU�Vc\,e�[(LQGKO�O�UWO$\KV![�LXR�O�I�UWV�O$PNJsGHT�G5I�GDO�U(I!YqR�OxIckgUiT&PQO�[�\5u fU�V�UWT�aZG^]�GKV�I�PwI�PX\ Jt\Ke�I�bSU3T�G5I�G^O�U(I�PNOdI�bSUDU�J�T�]SV�\ZTSR�[�I�h0�BU�V�UKaSGq]�G,V�I�PXI�PN\KJ�_KPNuKU�OdGKJtPQT&UWGG,kg\KRSI�I�b�UHO�U�]�GKV�GKkSPNLXPXIxMq\Ke�I�bSUHTSG5IG3]g\KPNJ>I�O�PXJ>I�\^[(LNR�O�I�U�VOdG,J�Ts�ob�U(I�b�U�VdPwI�PNO�Y;UWGKJSPXJ�_,e�RSLI�\�UWY;]SLX\5M�G}O�RS]gU�V�uZPNO�UWT�[(LQGKO�O�Pwr�UWV^I�b�G,ItGKO�O�RSY;U�OsG�_ PXu U�J�JZRSY.kgU�Vs\KeD[�LNG O�O�UWO^PNJ�I�bSUTSG,I�GnO�U(IWh��i\5�dU�uKUWVWa�PXJ�YsG,JZMz\KI�bSUWV.G,]S]�LXPQ[�G,I�PN\KJ�OHI�b�G5I.PNJZuK\ LXu U^T&U�[(PQO�PN\KJ�YsG,|ZPNJS_�a�I�bSUV�UWO�RSLwI�PXJ�_q[(LNR�O�I�UWV�O�b�GvuKUiI�\^k1U8V�UW]SV�U�O�UWJ>I�UWTj\KV�TSUWO�[(V�PXkgUWTtPXJtG^[(\ Y;]�GK[(I�e�\KV�YðI�\^GK[bSPNU�u U£K ,¥� �  ¡�Ð�¥�¦� KÕ�¥�§�Ñ,¨�h�Ø!u U�J�I�b�\KRS_ b�I�bSU�[(\ J�OxI�V�R1[�I�PN\KJ�\KeiGl[(LNR�O�I�UWV.V�U�]SV�UWO�U�J>I�G,I�PN\KJ�PQOqGKJPNY^]g\KV�I�GKJ>I�OxI�U�];PXJjTSUW[(PQO�PX\ JqYsG,|ZPNJS_�a PwI!b1GKOcJS\KI!k1UWU�JsU�p&GKY;PXJSU�T;[(LN\ O�U�LNM3kZM.V�UWO�UWG,V[bSUWV�OWh��bSU^JS\,I�PX\ Jl\Ke�[(LNR�O�I�U�VDV�U�]SV�UWO�U�J>IG5I�PN\KJl�dG OBPNJ>I�V�\ZTSR�[(U�TzPNJ�Ä Æ&��Ç0GKJ�Tz��GKOHO�R�k�O�U��>RSU�J>I�LNMO�I�R�T&PNUWTyPNJ�Ä Í1�(Ç�G,J1T�ÄX�WÌ��(Ç�h0��b�U�MtO�RS_K_ UWO�I�U�TjI�bSUDe�\KLNLX\5�oPNJS_^V�UW]SV�UWO�U�J>I�G,I�PN\KJ�O�[bSUWY^U�O�È�x�v�6goU�]SV�UWO�U�J>I8Gt[(LNR�OxI�U�V8\,ec]1\ PXJ>IOBkZM�I�bSUWPXVD[(UWJ I�V�\ PNTy\ VBkZMyG�O�U�IB\,e�TSPNO�I�GKJ I8]1\ PXJ>I�O8PNJ

I�bSU3[�LXR�O�I�UWVWhc�$PN_KRSV�U;�vÜqT&U�]�PN[(I�O�I�bSUWO�UHIx��\;PQT&UWG O�h��Ë �6goU�]SV�UWO�U�J>I;[(LNR�OxI�U�VO^R�O�PNJS_}JS\&T&UWO^PNJ�G�[(LQGKO�O�PXr1[WG5I�PN\KJ~I�V�U�UKh���bSPNO^PQO;PXLNLNR�OxI�V�G,I�U�T~PNJ

�{PN_KR�V�U;�Wë�h��Ì>�6goU�]SV�UWO�U�J>I`[(LNR�O�I�U�VO8k>MlR�O�PNJS_�[(\ J5îxRSJ�[(I�PNuKU^LX\ _KPQ[�G,L$U(p&]SV�UWO�O�PX\ J�O�h3��\KVDU(pSGKY^]�LXU a�I�bSU

U(p&]SV�UWO�O�PN\KJ�Ä é � ¥æÌ,Ç�Ä é�k ê¹Ë5Ç{PNJl�$PX_ RSV�Uj�WëjO�I�GKJ�TSOie�\KViI�bSU.LN\K_ PN[WG,L�O�I�G,I�UWY^UWJ>I.º é �PNO�_ V�U�G5I�UWVdI�b�GKJ�Ì�¼� 5¨�£qº é k PQO�LXU�O�OdI�b�G,JzË&¼NhÃBO�U.\,ecI�bSUq[�U�J>I�V�\KPQT�I�\tV�U�]SV�UWO�U�J>IBGt[�LXR1OxI�U�VHPNOBI�bSUqY;\ O�I8]g\K]SRSLQG,VHO�[b�U�Y;UKh8��IH�d\KV�|&O

�dU�LNL��obSUWJ�I�bSUt[�LXR1OxI�U�VO3G,V�Uj[(\ Y^]1GK[�I3\ V3PQO�\KI�V�\K]SPQ[,hy�i\5�dU�uKUWVWa{�obSU�J�I�bSUt[�LXR�O�I�UWV�O.G,V�UU�LN\KJ�_ G5I�UWT�\KV3J�\KJ&f�PNO�\,I�V�\ ]SPQ[,a�I�bSU�J�I�bSPNOqO�[b�U�Y;U;e�G,PNLNO`I�\nV�U�]SV�UWO�U�J>IDI�bSUWY ]�V�\ ]1UWV�LNMKh���JO�R�[b�G}[�G O�U acI�b�UnR�O�Uy\,eDG�[(\KLNLNUW[�I�PX\ J�\Ke8kg\KRSJ�T�G,V�M�]1\ PXJ>I�O;PNJ�G�[�LXR�O�I�UWVj[�GK]&I�RSV�UWO^PXI�OO�b�G,]gUj�dU�LNL�hn��bSU�J>R�Y.kgU�V.\Keo]1\ PXJ>I�O.R�O�UWT}I�\lV�UW]SV�U�O�UWJ>I.Gz[(LNR�O�I�U�V^O�b�\KRSLQT�PXJ1[(V�UWGKO�UjGKOI�b�U3[(\KY;]SLNU(p&PXIxMj\,e0PXI�OoO�b�G,]gU`PXJ1[(V�UWGKO�UWOWh0��bSUDIx��\sT&PX��U�V�U�J>IoV�UW]SV�U�O�UWJ>I�G5I�PX\ J�OdPXLNLNR�OxI�V�G,I�U�TPNJz�{PN_KR�V�Us��ë^GKV�U`U��>RSPXu5GKLXUWJ I�h�Ø�uKU�V�Mj]�G,I�b�PNJzGs[(LQGKO�O�PXr1[�G,I�PN\KJ�I�V�U�UDe�V�\KYýI�bSU3V�\Z\,IiJS\&T&UI�\sG;LNUWG,e{JS\&T&U3[�\KV�V�U�O�]g\KJ�T�O�I�\sG^[�\KJ5îxR�J�[�I�PXu U3OxIG5I�UWY;U�J>IWh!�BJyPNY;]1\ V�IG,J>IoLXPNY;PwIG5I�PX\ Jy\Ke

Page 23: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ��³

X XBy Three Distant PointsBy The Centroid

*

*

* *

*

** *

*

*

*

*

*

*

1

X2 X2

1

ä(jel*�5Þ�öq�¶�h=o*iPh:fPh=kXgGtSgGjewTk�wExZt&s:bed;fPgPh:i�z~� oBwTjek~gGf:�

X0 1 2 3 4 5

0

1

2

3

4

5

|

|

|

|

|

|

|

|

|

|

|

|

|

| - - - - - - - - - -

22

2

22

2

2

33

33

33

3

3

333

1

1 11

1

1111

11 1

11 1

1

11

1

1

1

1

1

X < 3 X >3

1 2 3Using Nodes in a Classification Tree

Using Conjunctive Statements

X2

11: [X <3]; 2: [X >3][X <2]; 3:[X >3][X >2]1 1 2 1 2

11

X <2 X >22 2

ä(jel*�6Þ:÷;�þ¶�h=o*iPh=fGh=kXgGtSgPjewTkVwEx(s=bed*fPgPh=iGf�zX� t�s=butEfGfPj v3s:tSgGjewTk�gGiPh=h�wTi�z~��s:wTkS�Pd*k;s=gPj p~h?fPgGtSgGh=|_h=k~gGf:�I�b�U.IxMZ]SPQ[�GKL$R1O�Uq\,e!I�bSU^O�PNY^]�LXU;[(\ J5îxRSJ�[(I�PNuKU;[(\KJ1[(U�]SIHV�U�]SV�UWO�U�J>IG5I�PN\KJ1OoPNO8I�b�G5IHI�bSUWMz[�GKJT&U�O�[�V�PNk1UD\ JSLXMtV�U�[�I�GKJS_KR�LNGKVd\ VoPNO�\,I�V�\ ]SPQ[8[�LXR�O�I�UWV�O�PNJyI�bSUDe�U�G5I�RSV�U`O�]�GK[�UKhF8G,I�G;G,k�O�I�VGK[(I�PN\KJyPNO�R1O�U�e�RSL�PNJ�TSUW[(PQO�PX\ J�YsG,|ZPNJS_;k1U�[�GKR�O�UD\Ke{I�bSUDe�\KLNLX\5�oPNJS_1È

�x�v����I8_KPNuKU�OBGjO�PNY^]�LXU^G,J�TnPNJ>I�RSPXI�PNuKU^T&UWO�[(V�PN]&I�PN\KJz\Ke�[(LNR�O�I�U�VOi�ob�PN[bzPQO8UWGKO�M�e�\KVBbZRSYsGKJ[(\KY;]SV�U�b�U�J�O�PX\ JzÄw��Ì Ë5Ç�h$��Jjkg\,I�by[(\ J�[(UW]&I�R�GKLg[�LXR1OxI�U�V�PXJS_�Äw��Ì ËvÇ�G,J1TjO�MZYqk1\ LXPQ[B[�LXR�O�I�UWV�fPXJS_jĸÜ5ë,ÇSI�b�PNO�V�UW]SV�UWO�U�J>I�G,I�PN\KJ^PNO�\Kk&IG,PNJSUWT^�oPXI�bS\ R&I�R�O�PNJS_3G,JjG TST&PXI�PN\KJ�GKL�OxI�U�]�hc��bSU�O�UG,LN_K\KV�PXI�bSYsOD_KUWJSU�VG5I�U;I�bSU�[(LNR�OxI�U�VO.G O`��UWLXLdGKODI�bSU�PNVqTSUWO�[(V�PX]&I�PX\ J�OWhy�ùO�U�I.\,e�e�RSmWm�MV�RSLNUWOc[WG,JskgUo\Kk&IG,PNJSUWT^e�V�\KY e�RSm�mWMq[�LXR�O�I�UWV�O!\,e�G3TSG5IGDO�U�IWhc��bSUWO�UoV�RSLXU�O![�GKJ;k1UiR1O�U�TI�\;kSRSPNLNT�e�RSmWm�My[(LQGKO�O�PXr�U�VO�G,J�Tte�RSmWm�M�[�\KJ>I�V�\KLNLNU�VO�h

��Ë ����IdbSUWLX]1O�PNJ�G [bSPNU�uZPXJ�_qTSG,I�G^[(\KY;]SV�UWO�O�PX\ J;I�b�G,I�[WG,JtkgUHU(p&]SLN\KPXI�UWTje�RSV�I�bSUWVdkZMjG^[(\ Yqf]SR&I�UWV�ÄX�WÌ ë5Ç�hz�{PN_KR�V�Un��Å���G>�`O�bS\5�iO3O�G,Y;]SLNUWO3kgU�LN\KJ�_KPNJS_nI�\lIx��\z[b1G,PNJ&f�LNPN|KUt[�LXR�O�I�UWV�OLNGKk1UWLXU�T���GKJ�T�Ë&h��à]1G,V�I�PXI�PN\KJ�GKLd[�LXR�O�I�UWV�PNJS_zLNPN|KUjI�bSU�L>f�Y;U�G,J�OqG,LN_K\KV�PXI�bSYâ[�GKJSJS\,IO�UW]�G,VG5I�U;I�bSU�O�UsIx�d\lO�I�V�R�[�I�RSV�UWO3]�V�\ ]1UWV�LNMKhz��bSU�O�PNJS_KLNU(f�LNPXJS|�G,LN_K\ V�PXI�b�Yé�d\KV�|ZO3��UWLXL\KJ�I�bSPQOiTSG,I�GSa&k�R&IiPNOB[(\KY;]SRSI�G5I�PX\ J�G,LNLNMjU(p&]gU�J�O�PXu UKh!ÒZ\1aSG;b>MZkSV�PQT�GK]S]SV�\ GK[b�YsGvMsk1UR�O�U�T�I�\;U(p&]SLN\KPXIoI�bSUqT&UWO�PXVG,k�LXUD]SV�\K]gU�V�I�PNUWO�\Ke$kg\,I�b�I�bSUWO�U3G,LN_K\ V�PXI�b�Y;OWhc½}U3\Kk&IG,PNJyëO�RSk�[(LNR�O�I�UWV�OB\,ecI�b�UqTSG,I�GskZMyR�O�PNJS_tI�bSUy��[(\ Y;]SR&I�G,I�PN\KJ�GKLXLNMyU(áj[(PNU�J>I��L>f�Y^U�G,J�O8G,LN_K\KfV�PXI�bSY�h0Ø�G [b.\,e1I�bSU�O�UoO�RSk�[(LNR�OxI�U�VO0[�G,J^kgUdV�U�]�V�U�O�UWJ I�UWT.k>M3I�bSUWPXVc[(UWJ>I�V�\KPQTSO0GKOcO�bS\5�oJPXJ~�$PN_KRSV�Uz�WÅ1��G>��hzúi\5�ðI�bSU�O�PXJ�_KLNU(f�LXPNJS|�G,LN_K\KV�PXI�bSY [�G,J�kgU�GK]S]SLNPXU�T�\KJ�I�bSUWO�Ut[�U�J&fI�V�\KPQTSOiG,LN\KJ�U`I�\t[�LXR1OxI�U�ViI�bSU�Y PNJ>I�\�Ës_KV�\KRS]�OWho��bSU3V�UWO�RSLXI�PNJS_j_KV�\KR�]�OiG,V�U.O�bS\5�oJnPNJ�{PN_KR�V�U8�WÅ���k1��h$�iUWV�U a,G8TSG,I�GBV�U�T&R�[�I�PX\ J.PQO0GK[bSPNU�u UWT`kZMDV�UW]SV�UWO�U�J>I�PNJS_iI�bSU�O�RSk�[(LNR�O�I�UWV�Ok>MjI�bSUWPXVi[�U�J>I�V�\KPQTSOWh

Page 24: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

� Ö � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

1

1

1

1 2

2

2

2 1

1

1

1

2

2

X X

1 1 11

111

2

2

1

11

11

111

11

1

1

11

1 1 111

111

1

2

2 22

222

22

2

2

2

222

2

2 2 22

2

2 22

22

2 2

22

2

2111

1 111

111

(a) (b)1 1

X2 X2

ä(jel*�5Þ:ó;� ��tSg�t�s=wT|_o*iPh=fGfGjewTk�z~� s=bed*f gGh=iPjek*l*���Ì>����IBPXJ1[(V�UWGKO�UWOoI�bSU3U�áj[(PNU�J�[�M�\KecI�bSU.TSUW[(PQO�PX\ JnY;GK|ZPXJS_;IGKO�|�hd��J�Gs[(LNR�OxI�U�V�f�k1GKO�UWT�T&\&[�f

RSY;U�J>IjV�U�I�V�PXUWu5G,L�I�U�[bSJSPQ�>RSU~Äw�vÆ,Å,Ç�adG�LNGKV�_ Uy[�\KLNLXU�[�I�PN\KJ�\KeHT&\&[(R�Y^UWJ>I�OsPQOj[(LNR�O�I�UWV�U�TG,J�TnU�GK[bz\Ke!I�b�U^[�LXR�O�I�UWV�O8PQO8V�U�]�V�U�O�UWJ I�UWTnR1O�PNJS_tPXI�OD[�U�J>I�V�\KPQT�hD��Jl\ V�T&UWVBI�\tV�U(I�V�PNU�u UT&\&[(RSY;U�J>IO�V�U�LNU�u5G,J>I�I�\qG^�>RSU�V�MKa I�b�UH�>RSUWV�M;PQO�YsG5I[bSUWTt�oPwI�bjI�bSUH[�LXR1OxI�U�V�[(U�J>I�V�\ PNTSOV�G,I�bSUWV�I�b1G,J3�oPXI�b^G,LNLKI�bSUdTS\Z[�RSY;U�J>I�OWh0��bSPNO{bSUWLX]�O{PNJ.V�U(I�V�PNU�uZPXJ�_iV�UWLXUWu5G,J>I$T&\&[�RSY;U�J>I�OU(áj[(PNU�J>I�LNMKh;�iLQO�\yPNJ�O�UWuKUWV�GKL$GK]S]SLNPN[WG5I�PN\KJ1O8PNJZuK\ LXuZPNJS_�LQG,V�_KU;TSG,I�GyO�U�I�OWa{[(LNR�O�I�UWV�PNJS_yPNOR�O�U�TjI�\s]1UWV�e�\ V�YýPXJ�TSU(p&PXJ�_�a&�obSPQ[b�bSU�LN]�O�PNJyU�áj[(PNU�J>IBT&UW[�PNO�PN\KJyY;GK|ZPXJS_nÄ Í Ì,Ç�h�Z# ë "LAK9S+ ìZ1*+ )6]�J�<BN6AD)6]cJ�<~9%í?U[A�ÃXC&W U[A$En]eN;C:9=<BA +.-;4

�iV�I�PXr1[�PNGKLSJSU�R�V�GKLSJSU(Ix�d\KV�|&Oo���8úBúBO�oÄ ë,ÍKÇ1G,V�U�Y^\KI�PNu5G5I�U�T;kZM.kSPN\KLN\K_ PN[WG,L&JSUWRSV�GKL&JSU(Ix�d\KV�|&O�h�Bú8úBOcb1GvuKU�k1UWU�J;R�O�UWTqU(pZI�UWJ�O�PXu U�LNM3\5uKUWV{I�bSUo]�G OxIcI�bSV�UWUoT&UW[WGKT&U�O$e�\KVckg\,I�bs[�LNG O�O�Pwrg[�G5I�PX\ JG,J1Tz[(LNR�O�I�U�V�PNJS_�ÄX�Wê ëSµ�ÅKÅ,Ç�h`ÒZ\KY;Uq\,e!I�bSU.e�U�G5I�RSV�U�Oi\Ke!I�bSU;�Bú8úBO8I�b1G5I`G,V�U3PXY;]g\KV�I�GKJ IDPNJ]�G,I�I�UWV�J�[(LNR�O�I�UWV�PNJS_sG,V�UKÈ�x�v�y�BúBú8O$]SV�\&[�UWO�O�JZRSY;U�V�PQ[�G,L>uKU�[�I�\KVO�G,J1T.O�\BV�UW�>RSPNV�U!]1G5I�I�U�V�J�O{I�\8k1U�V�U�]SV�UWO�U�J>I�U�TDR�O�PXJS_

� R1G,J>I�PXI�G,I�PNuKU8e�UWG5I�RSV�UWO�\KJ�LXM h��Ë �y�BúBú8OiG,V�UHPXJSb�U�V�U�J>I�LNMt]�GKV�GKLXLNU�L�GKJ�T�T&PNO�I�V�PNkSR&I�U�Ty]SV�\&[�UWO�O�PNJS_;G,V[bSPwI�UW[(I�RSV�UWOWh��Ì>�y�BúBú8OjYsGvM�LXU�G,V�J�I�bSU�PNVtPNJ>I�UWV�[�\KJSJSU�[�I�PX\ J��dU�PN_Kb>IOjGKTSGK]&I�PNuKUWLXM÷Äw���S� µ.��Í Í,Ç�hÓ9z\KV�U

O�]gUW[�Pwr1[WG,LNLXM a,I�bSU�M;[�GKJjGK[�IdGKOc]�G,I�I�U�V�JsJS\KV�YsG,LNPXmWU�VOcG,J�T^e�U�G5I�R�V�UBO�U�LNUW[(I�\ V�OckZM^G,]S]SV�\,f]SV�PQG5I�U`O�UWLXU�[�I�PN\KJy\,e$��UWPX_ b>I�OWh

��\KY;]1U�I�PXI�PNuKUy��\KVB�oPXJSJ�U�V�f�IG,|KU�f�GKLXL��dJSUWRSV�GKL�JSU�Ix��\ V�|&O`ÄX����(Ç$GKV�U`\Ke�I�UWJzR�O�UWTyI�\�[(LNR�OxI�U�VPNJS]SR&I3TSG,I�GShD��J}[(\KY;]gU(I�PwI�PXu UqLNUWGKV�JSPNJS_1a�O�PNY^PNLQG,VH]�G5I�I�U�V�J�OHG,V�U._ V�\ RS]1U�TnkZM�I�bSU^JSU�Ix��\ V�|G,J1T~V�U�]SV�UWO�U�J>I�U�T�kZM~G�O�PXJ�_KLNUtRSJSPXIn��JSUWRSV�\ J1��h~��b�PNO^_KV�\KR�]SPXJ�_lPQOqT&\ JSU�G,R&I�\KYsG5I�PN[WG,LNLXMk�G O�U�T�\KJæT�G5I�G�[(\ V�V�U�LQG5I�PX\ J�O�h ½�UWLXLXf�|ZJS\5�oJ�U�pSG,Y;]SLNUWO�\,e.�Bú8úBOyR�O�UWT¿e�\KV�[(LNR�OxI�U�V�PXJ�_PNJ�[(LNR�T&U"îD\ bS\KJSUWJ�¼ O�LXU�G,V�JSPXJ�_�u UW[(I�\KVz�>R�GKJ>I�PNmWG5I�PX\ Jð��}Kï�dD��GKJ�TÉO�UWLwe�f�\KV�_ GKJSPNm�PNJS_�YsGK]��Ò1èI9l�zÄX�K�WÍ,Ç�aiG,J�T¿G TSG,]SI�PNuKUzV�UWO�\KJ�GKJ�[(UzI�bSUW\KV�M�Y;\&T&U�LQO}Ä Ë,Í,Ç�h ��bSU�GKV�[b�PwI�UW[�I�RSV�UWOj\KeI�b�UWO�Ul�Bú8úBOyG,V�UzO�PNY;]SLXU È}I�bSUWM�GKV�UzO�PXJ�_KLNU(f�LNGvM U�V�UWT�hÉÞcG5I�I�U�V�J�OsGKV�Uz]�V�U�O�UWJ I�UWT�G5ItI�bSUPNJS]SR&IqGKJ�T�G,V�UsGKO�O�\&[(PQG5I�UWT��oPwI�b�I�bSUs\ R&I�]�R&I.JS\&T&U�O�hy��bSUs��UWPX_ b>I�ODkgU(Ix�dU�U�J}I�bSUjPNJS]SR&IJS\&T&U�O`G,J�T�I�b�Us\KR&I�]SR&I3JS\&T&U�O`G,V�U^PXI�UWV�G,I�PNuKUWLXMz[b�GKJS_KU�T���I�bSPQO`PQO`[�GKLXLNUWT}LNUWG,V�JSPNJS_>�BRSJ>I�PNLG�I�UWV�Y;PNJ�G5I�PX\ J}[�V�PXI�UWV�PN\KJ�PNO`O�G5I�PNO�r�UWT�hj��\ Y;]1U�I�PXI�PNuKU;LXU�G,V�JSPNJS_�b�GKOHkgU�U�J}e�\ RSJ�T�I�\�U(p&PQOxIPNJlkSPN\KLN\K_ PN[WG,L�JSUWRSVG,L$JSU(Ix�d\KV�|&O�hH�i\5�dU�uKUWVWa�I�bSU^LNUWG,V�JSPNJS_j\ V8�dU�PN_Kb>IBRS]�TSG,I�U^]SV�\&[�UWT&RSV�UWOG,V�UB�>RSPXI�UDO�PNY;PXLQG,V�I�\.I�bS\>O�U8PXJyO�\ Y^U8[(LQGKO�O�PQ[�GKL1[(LNR�O�I�UWV�PNJS_qGK]S]SV�\ G [bSUWOWh{��\KV�U�pSG,Y;]SLNUKa I�bSUV�U�LQG5I�PN\KJ1O�bSPN]�k1U�Ix��UWU�J}I�b�U~L>f�Y^U�G,J�O.G,LN_K\KV�PXI�bSYéGKJ�T8}Kï�dàPQO3GKTSTSV�U�O�O�UWT}PNJ�ÄX��Í&Ü�Ç�h���bSULNUWG,V�JSPNJS_BGKLX_ \KV�PwI�bSYÉPXJ^�|g0��Y;\&T&U�LQO�PQO$O�PNY;PXLQG,V{I�\BI�bSUdLXU�GKT&UWV$[�LXR1OxI�U�V�PXJS_HG,LN_K\ V�PXI�bSY»ÄX�WÌKê,Ç�h

Page 25: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ��ì

��bSUBÒ�èI9¾_KPNuKU�O$GKJ;PXJ>I�R�PwI�PXu U�LNMqG,]�]1U�G,LNPXJS_HIx�d\,f�T&PNY^UWJ�O�PX\ J�G,LZYsG,];\,egI�b�UoY.RSLXI�PQT&PNY^UWJ&fO�PX\ J�G,LSTSG,I�GDO�U(IWa G,J�T^PXI!b�GKO0kgU�UWJ;O�R�[W[(UWO�O�e�RSLXLNM3R�O�UWTqe�\ VcuKUW[(I�\ V0�>R�GKJ>I�PNmWG5I�PX\ J^GKJ�T^O�]gU�U�[bV�UW[(\ _KJSPXI�PN\KJ�ÄX�K��ÍKÇ�h��i\5�dU�u U�V�a�LNPX| UjPwIO.O�UW�>RSUWJ I�PNGKL�[(\ RSJ>I�UWV�]�GKV�I�a�I�bSU�Ò�èI9 _ U�JSUWV�G,I�UWO`GO�RSk&f�\K]&I�PXYsG,Ld]�GKV�I�PwI�PX\ J�PXeiI�bSUyPNJSPwI�PNGKL���UWPX_ b IOqGKV�U�JS\,Is[bS\>O�UWJ�]SV�\ ]1UWV�LNMKh���RSV�I�bSU�V�a!PXI�O[(\ JZuKU�V�_KUWJ�[(UtPNO;[(\ J>I�V�\KLNLXU�T~kZM�u5G,V�PX\ R�O.]1G,VG,Y;U(I�U�VOqO�R�[b�G OqI�bSU�LNUWG,V�JSPNJS_lVG5I�UyGKJ�T�GJSUWPX_ b>kg\KV�bS\Z\&T;\,e�I�bSUB�oPNJSJSPNJS_.J�\ZTSUBPNJj�obSPQ[bjLXU�G,V�JSPNJS_`I�GK|KU�O!]SLQGK[�UKh0��I�PQO�]g\ O�O�PXkSLNUiI�b�G5IG`]�GKV�I�PN[�RSLQG,V!PNJS]SR&Id]�G5I�I�UWV�Jj[WG,J^r�V�UBT&PX�gUWV�UWJ I�\KR&I�]SR&I�R�JSPwIO�G,I�T&PX�gUWV�UWJ>I�PwI�U�VG5I�PX\ J�O�µ I�b�PNOkSV�PXJ�_ O�RS]�I�bSU;Ð�¥�  ¡(§��#§�¥�Ú`PQO�O�RSU`\,e0LNUWG,V�JSPNJS_sO�M&O�I�UWY;OWh���bSU3O�M&OxI�U�YùPNOiO�G,PQT�I�\skgU3OxIG,kSLNU`PXeJS\H]�G5I�I�UWV�JqPXJqI�bSUdI�V�GKPXJSPNJS_HTSG5IG8[b�GKJS_KU�O�PXI�O0[WG5I�UW_K\ V�M`G5e�I�U�VcGBr�JSPXI�U�JZRSY.kgU�V0\,e1LXU�G,V�JSPXJ�_PXI�U�VG5I�PX\ J�OWh0��b�PNO�]SV�\Kk�LXUWY¶PNOo[�LX\>O�UWLXMtG O�O�\&[(PQG5I�UWTs�oPXI�byI�b�UH]�V�\ kSLXUWYà\,e�Ïg�X 5Ð�¥�§�Õ�§�¥�Ú5a1�obSPQ[bPQO!I�bSU8GKkSPXLNPXIxM^\Ke�I�bSUDG,LN_K\ V�PXI�b�Y I�\qGKT�G,]&I!I�\.JSUW�æTSG,I�GSh0�S\ VdO�I�GKkSPNLXPXIxMKa I�bSUHLNUWG,V�JSPNJS_3VG5I�UO�bS\KRSLQT�kgUyTSUW[(V�UWG O�U�T}I�\�m�U�V�\�G O3PXI�UWV�G,I�PN\KJ�Oq]SV�\K_KV�UWO�O3GKJ�T�I�b�PNO;G5��UW[(I�O.I�bSUy]SLQGKO�I�PQ[(PXIxMKh��bSUs�|g0�ÛY;\&T&UWLNO`GKV�U^O�RS]�]1\>O�U�TzI�\�kgUsOxIG,kSLNU^GKJ�Tz]�LNG OxI�PN[�Ä Ë5Í,Ç�h3�i\5�dU�u U�V�a��|g0� JSU�I�OG,V�Uo\KVT&UWV�f�T&U�]gU�J1T&U�J>IWµKI�b�G,I�PQO�aZT&PX�gUWV�UWJ I�]�G,V�I�PXI�PN\KJ�O�G,V�Uo\Kk&IG,PNJSUWT^e�\ V�T&PX�gUWV�UWJ I�\KVT&U�VOcPNJ�obSPQ[bjI�bSUHT�G5I�GqPQO�]SV�UWO�U�J>I�UWTsI�\3I�bSUDJSU(I�h0�BLNO�\qI�bSUDO�PNm�UDG,J1TsJZRSY.kgU�V�\,e$[(LNR�OxI�U�VO�_ U�JSUWV�fG5I�UWTykZM�GKJ���g0�¹J�U(IBT&UW]1UWJ�T�\KJyI�b�U`uvGKLXR�U.[bS\ O�U�J�e�\KV�I�bSUj´�§w©,§��N 5¨gÕ¢^¥�_Z¦�¢(Ð�_SÑ,�X£5ag�obSPQ[bPQO�R1O�U�TsI�\sT&U�[(PQT&UH�obSU(I�bSU�VoGq]�G5I�I�U�V�JtPQOdI�\^kgUHG O�O�PX_ JSUWTjI�\^\KJSUH\,e�I�bSUDU(p&PQOxI�PXJ�_^[�LXR�O�I�UWV�O\KV�OxIG,V�I�G`JSUW�¿[(LNR�OxI�U�V�h$��RSV�I�bSUWVWa>k1\KI�b�Ò1èI9 G,J�Ts��g$��GKV�U8O�RSPXI�GKkSLNUoe�\KVdT&U(I�UW[�I�PXJ�_3\KJSLNMbZMZ]1UWV�f�O�]�bSU�V�PN[WG,Ld[(LNR�OxI�U�VOtÄ ë,ÍKÇ�h��àIx�d\,f�LQGvMKU�V`J�U(Ix�d\KV�|�I�b�G5I^U�Y;]SLN\5M&O.V�U�_ RSLNGKV�PNm�U�TG9zG5fb�GKLNGKJS\KkSPQO`T&PQOxIG,J�[�U;I�\nU�p>I�V�G [�I3bZMZ]1UWV�UWLXLNPN]�O�\ PNT�G,L![(LNR�O�I�UWV�OD��GKOD]SV�\K]g\ O�UWT�PNJ¿Äw�vË,Å5Ç�hj�iLNLI�b�UWO�U8�Bú8úBOdR�O�U8GDr�pZU�TsJZRSY.kgU�Vd\,e�\ R&I�]�R&IdJ�\ZTSUWO��obSPN[btLXPNY;PwI�I�bSUHJZRSY.kgU�Vd\,e�[�LXR�O�I�UWV�OI�b1G5IB[�GKJ�kgU`]SV�\&T&R�[(U�T�h�Z# ï÷ó6@;UZ]eNq9S+ UZ-*),AKF�"�Â>ÂBADU5)3132*<XC�W U[A$En]eN;C:9=<BA +.-;4Ø!u \KLNR&I�PN\KJ1G,V�MDGK]S]SV�\ G [bSUWOWa5Y;\,I�PNu5G5I�UWT^kZM3J�G5I�RSVG,L&U�u \KLNR&I�PN\KJ�a,YsG,|KU�R�O�U�\,e�U�u \KLNR&I�PN\KJ�GKV�M\K]gU�VG5I�\KVO�G,J�TyG^]1\ ]SRSLQG5I�PN\KJ�\Ke$O�\KLNR&I�PN\KJ�OdI�\s\Kk&IG,PNJtI�bSU`_KLN\Kk1G,LNLXMs\ ]&I�PNYsG,L�]�GKV�I�PwI�PX\ J�\KeI�b�UtTSG5IGShn�dG,J�T&PQTSG,I�UjO�\KLNR&I�PN\KJ�OHI�\nI�b�Uj[(LNR�OxI�U�V�PXJ�_n]SV�\ kSLNU�Y GKV�UsUWJ�[(\&T&U�T�GKO3[bSV�\KY;\KfO�\KY;UWOWhj��bSUsY;\ O�I.[(\ Y^Y;\ JSLXMlR�O�U�T}U�uK\ LXRSI�PN\KJ�GKV�Mn\ ]1UWV�G,I�\KVODG,V�UKÈ`O�U�LNUW[�I�PX\ J�a�V�UW[�\KYqkSPwfJ�G,I�PN\KJ�a�GKJ�TlYqR&I�G,I�PN\KJ�h^Ø�G [bnI�VG,J�O�e�\KV�YsOB\ JSU;\KVHY;\KV�UqPNJS]SR&I.[b�V�\ Y^\>O�\ Y;UWOiPNJ>I�\y\KJSU\KVDY;\KV�U;\KR&I�]SR&I3[bSV�\KY;\ O�\KY;U�O�h.�ðr�I�JSU�O�OHe�RSJ1[�I�PN\KJ�UWuvGKLXR1G5I�U�Tl\ J�G�[bSV�\KY;\ O�\KY;U^T&U(fI�UWV�Y;PNJSUWOoG;[bSV�\KY;\>O�\ Y^U ¼ O�LNPX| U�LNPXbS\Z\&T�\,e$O�RSV�uZPXuZPNJS_qPNJ>I�\;I�bSUDJSU(pZIi_KUWJSU�VG5I�PX\ J�h$½�U`_ PXu UkgU�LN\5�¹G^bSPN_Kb&f�LXUWuKUWL�T&UWO�[(V�PX]SI�PN\KJy\,ecG,JyU�uK\ LXRSI�PN\KJ�GKV�MjGKLX_ \KV�PwI�bSYàG,]S]�LXPNUWT�I�\s[�LXR�O�I�UWV�PNJS_1h§0´zÐ�²�ª�©3¹»¯±�ª�´ ®°­`Ü�§~©3¨�ª>­�±�¯�¼»«ñð%ª�­6¸2©3¹ º¯¬Z­�±3´ ¨�x�v�n��bS\Z\ O�U^GyVG,J�T&\ Y ]g\K]SRSLQG5I�PX\ J�\KedO�\KLNR&I�PN\KJ1O�hsØ�G [b�O�\KLNR&I�PN\KJ}bSUWV�Us[(\ V�V�UWO�]g\KJ�TSOBI�\

Gnu5G,LNPNT1LZf�]�GKV�I�PwI�PX\ J�\,eoI�b�U�TSG,I�GSh��BO�O�\&[(PQG5I�UtG�rSI�JSUWO�OquvGKLXR�Uj�oPwI�b~UWG [b~O�\ LXRSI�PN\KJ�h��MZ]SPQ[�GKLXLNMKaWrSI�J�UWO�O�PQO�PNJZuKUWV�O�U�LNMB]SV�\K]g\KV�I�PN\KJ1G,L5I�\iI�b�U�O�� R1G,V�UWTDU�V�V�\KV�u5G,LNRSU h{��O�\KLNR&I�PX\ J�oPwI�b�G;O�YsG,LNL�O��>R�GKV�U�TtUWV�V�\KVd�oPXLNL�b�Gvu UHG;LQG,V�_KUWV�r�I�JSU�O�Oou5GKLXRSU h

��Ë �6ÃBO�U`I�bSUqU�u \KLNR&I�PN\KJ�GKV�M�\K]gU�VG5I�\KVOoO�UWLXU�[�I�PN\KJ�a1V�UW[�\KY.k�PXJ�G,I�PN\KJnG,J1TnY.R&IG5I�PX\ J�I�\t_ U�J&fU�VG5I�UyI�bSUzJSU�p>I�]1\ ]SRSLQG5I�PN\KJ�\KeDO�\KLNR&I�PX\ J�O�hÉØ!u5GKLXR�G,I�UyI�b�UnrSI�J�UWO�Oju5G,LNRSUWOj\,eDI�bSU�O�UO�\ LXR&I�PX\ J�OWh

��Ì>�6goU�]gUWG,IoO�I�UW]zË.R�J I�PXL{O�\ Y^UHI�U�V�Y^PNJ�G,I�PN\KJn[(\ J�T&PXI�PN\KJyPNOoO�G5I�PNO�r�UWT�h��bSUzkgUWO�I�|ZJS\5�oJ�UWuK\ LXR&I�PX\ J�G,V�M�I�UW[bSJSPQ�>RSUWO�G,V�Uz_KUWJSU(I�PN[lG,LN_K\KV�PXI�bSYsOz��þD�BO�zÄ ëKëSµ3Ü5Ì,Ç�aU�u \KLNR&I�PN\KJzO�I�VG5I�U�_ PXU�O3��ØdÒ&O��.Äw��ê,ÍKÇ�agG,J�TnUWuK\ LXR&I�PX\ J�G,V�Mj]SV�\K_ V�GKY;Y^PNJS_z��Ø�Þ��3Ä ê>ÆvÇ�hHè8R&I8\KeI�b�UWO�U.I�bSV�UWU^GK]S]SV�\ G [bSUWOWa�þD�8OHb�GvuKUqk1UWU�J}Y^\>OxIHe�V�UW�>RSU�J>I�LXM�R�O�UWTlPXJ�[(LNR�O�I�U�V�PNJS_�h`��M>]�Pwf[�GKLXLNMKaSO�\KLNR&I�PX\ J�O�G,V�UHk�PXJ�GKV�MjO�I�V�PNJS_ OdPNJnþD�8O�hc��JnþD�BOWa�G;O�U�LNUW[�I�PX\ J�\ ]1UWV�G,I�\ V�]SV�\K]1G,_ G,I�U�O

Page 26: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

��ü � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

parent1

parent2

child1

child2

1 0 1 1 0 1 0 1

1 0 1 1 1 1 1 0

1 1 0 0 0 1 0 1

1 1 0 0 1 1 1 0

crossover point

ä(jel*�3ÔTø;� aciGwTfGfPw�p~h=i�wToBh:iGtSgGjewTk5�O�\KLNR&I�PN\KJ�O�e�V�\KYðI�bSUD[(R�V�V�U�J>I�_ U�JSUWV�G,I�PN\KJ;I�\3I�b�U8JSU�pZId_ U�JSUWV�G,I�PN\KJsk�G O�U�Ts\KJsI�bSU�PNVdrSI�J�UWO�O�hÒZUWLXU�[�I�PN\KJ�UWY^]�LX\5M&O�G;]SV�\Kk�GKkSPXLNPQOxI�PN[HO�[b�U�Y;U3O�\^I�b�G5IiO�\KLNR&I�PN\KJ�O��oPXI�b�bSPN_Kb�U�V�rSI�JSUWO�Oob�Gvu UG^bSPN_KbSUWVo]SV�\ k�G,k�PXLNPwIxMt\,e{_ U(I�I�PNJS_sV�UW]SV�\ZTSR�[(U�T�h��bSU�V�UBG,V�UBG`u5GKV�PNU(IxMq\,e�V�UW[(\ Y.kSPNJ�G,I�PN\KJ;\K]gU�VG5I�\KVO0PXJjR1O�U µ�Õ�¦�Ñ5Ð�Ð�Ñ,´v¢�¦cPNO�I�b�UBY;\ O�I�]g\K]&f

RSLQG,V�h0��V�\ O�O�\5u U�V�I�G,| UWO0GKO$PNJS]SR&I�G8]�GKPXVc\Keg[bSV�\KY;\ O�\KY;U�O���[WG,LNLXU�T.]1G,V�U�J>I�O��GKJ�Tq\KR&I�]SR&I�OcGJSUW�¿]�G,PNVd\,e{[bSV�\KY;\>O�\ Y^U�Oi��[WG,LNLXU�Tt[bSPNLQT&V�UWJj\KVd\,��O�]SV�PNJS_Z�!GKOdT&UW]SPN[(I�U�TjPNJ��$PX_ RSV�UHËa��h0��J�$PX_ RSV�UBËa�Sa>G`O�PNJS_ LXUo]g\KPNJ>I�[(V�\ O�O�\5u U�V$\K]gU�VG5I�PX\ JqPQO�T&UW]SPQ[�I�U�T�h0��I�U(pS[b�GKJS_KU�O$I�bSU8O�UW_KY;U�J>I�O\,e$I�b�U`]�G,V�U�J>I�OoG [(V�\ O�O�Gs[�V�\>O�O�\5uKUWV�]g\KPNJ>IWh!�S\ ViU(pSGKY^]�LXU a&PXJn�$PX_ RSV�U`Ë��SaZI�bSU`]�G,V�U�J>IOoG,V�UI�b�Udk�PXJ�GKV�M`O�I�V�PXJ�_ O�ºN���S�K���S���S�K¼WG,J�TjºN� ������K� ��S¼Nh���bSU�O�UW_KY;U�J>I�O$PNJ3I�bSUdIx��\8]�G,V�U�J>I�O$G5e�I�U�VI�b�Uq[(V�\ O�O�\5uKU�Vd]g\KPNJ I;��kgU(Ix�dU�UWJ�I�bSU`e�\ RSV�I�blGKJ�T�rSe�I�b�LX\&[�G,I�PN\KJ�O��G,V�U`U(pS[b�GKJS_KU�T�I�\j]SV�\,fT&R�[�U.I�bSUq[b�PXLQTl[bSV�\KY;\>O�\ Y^U�O�hAò�Ô&¥� 5¥�§�Ñ5¨�I�GK|KU�OBGKO8PNJS]SR&I`Gt[bSV�\KY;\>O�\ Y^U3GKJ�Tz\ R&I�]�R&I�OGt[b�V�\ Y^\>O�\ Y;U`k>Mn[�\KY;]SLNU�Y;U�J>I�PNJS_tI�bSU^kSPXIHu5G,LNRSU^G5IHGtV�GKJ�T&\ Y^LNMnO�UWLXU�[�I�UWTnLN\&[�G5I�PX\ JzPNJI�b�UoPXJS]�R&I�[bSV�\KY;\ O�\KY;UKh{�S\KVcU�pSG,Y;]SLNUKa5I�bSUiOxI�V�PNJS_^ºQ�K�K� �K� �K���¼�PQO0_KUWJSU�VG5I�UWT3kZM.GK]S]SLNMZPXJS_I�b�UtY.RSI�G5I�PX\ J�\K]gU�VG5I�\KV`I�\nI�bSUyO�U�[(\ J�T�kSPXIqLN\Z[WG5I�PX\ J�PXJ�I�bSU�O�I�V�PNJS_�ºQ��S� �K� �K���¼$��OxIG,V�I�fPNJS_�G,I8I�bSU.LNU(e�I���hA\d\,I�bl[(V�\ O�O�\5u U�ViGKJ�TnY.RSI�G5I�PX\ J�GKV�U.GK]S]SLNPXU�Tz�oPXI�b}O�\ Y^U.]SV�U�f�O�]gUW[(PXr�U�T]SV�\Kk�GKkSPNLXPXI�PNUWO��obSPQ[b�T&U�]gU�J�T�\ JtI�bSUDrSI�JSUWO�O�u5G,LNRSUWOWhþD�BOdV�UW]SV�UWO�U�J>I�]g\KPNJ>I�OdPXJtI�bSUDO�UWG,V[btO�]�GK[�U8G O�kSPNJ�GKV�MjO�I�V�PXJ�_ OdG,J�TsV�U�LNMs\KJjI�bSU`[(V�\ O�O�f

\5uKUWVD\K]gU�VG5I�\ VDI�\nU�pZ]�LX\ V�U^I�b�UtO�U�G,V[b�O�]�GK[�UKh09zR&I�G,I�PN\KJ�PQO`R�O�UWT}PXJ~þD�8O`e�\KV3I�bSUjO�G,| U\,e^[(\KY;]SLNU(I�U�JSU�O�OWaoI�b�G5I�PNOWaiI�\�YsGK|KU�O�RSV�UzI�b�G5I�JS\�]1G,V�Iy\Ke`I�bSU�O�U�G,V[bæO�]�GK[�UlPQOtLNU(e�IRSJSU�p&]SLX\ V�U�T�h0Ø�Ò&O!GKJ�TsØ�Þ�TSPw��U�V�e�V�\ Y I�b�UHþD�BO�PXJjO�\KLNR&I�PX\ J^V�U�]�V�U�O�UWJ IG5I�PX\ J^GKJ�T^IxMZ]1Ui\KeI�b�U^YqR&I�G,I�PN\KJ�\K]gU�VG5I�\ VBR�O�UWT�µ�Ø�Þ¹T&\ZUWOHJS\,IDR�O�U^G�V�UW[(\ Y.kSPNJ�G,I�PN\KJz\ ]1UWV�G,I�\KV�agkSR&I`\KJSLNMO�U�LNUW[�I�PX\ JsG,J�T^Y.RSI�G5I�PX\ J�hcØ�G [bq\KegI�bSUWO�U�I�b�V�UWUBG,]S]�V�\>GK[bSU�O{b1GvuKU�k1UWU�JsR�O�UWT^I�\3O�\ LXu UdI�bSU[(LNR�O�I�UWV�PNJS_t]�V�\ kSLXUWYäk>M�uZPNU��oPNJS_tPXIDG O8G�Y;PXJ�PXY;PNmWG5I�PX\ Jz\,e�I�bSU;O��>R�GKV�U�T�U�V�V�\ V8[�V�PXI�UWV�PN\KJ�hÒZ\ Y^Uy\,eoI�bSU�I�bSUW\KV�U(I�PQ[�GKL�PQO�O�RSU�OqO�R�[b�GKO.I�bSU�[(\ J>u U�V�_KUWJ�[(Us\KeiI�bSU�O�UyG,]S]�V�\>GK[bSU�O3�dU�V�UO�I�R�T&PNUWTyPNJ�Ä êKÍ,Ç�hþD�BO!]gU�V�e�\KV�Y»GD_KLN\Kk�GKLXPNm�U�T^O�UWGKV�[bqe�\KVdO�\ LXRSI�PN\KJ�Oc�ob�U�V�UWGKO!Y^\>OxI!\KI�bSUWV�[�LXR�O�I�UWV�PNJS_`]SV�\,f

[(U�T&RSV�UWO;]gU�V�e�\KV�YÿG}LX\&[�GKLXPNm�U�T�O�UWGKV�[b�h���J�G}LX\&[�GKLXPNm�U�T�O�UWGKV�[b�a�I�bSUnO�\KLNR&I�PN\KJ�\KkSI�G,PNJSU�TG5I.I�bSUlº JSU�pZIqPXI�U�VG5I�PX\ J�¼�\KeoI�bSUj]�V�\&[(U�T&RSV�UjPQO3PNJ�I�bSUtu>PQ[(PNJSPXIxM�\,e�I�bSUy[(RSV�V�U�J>I.O�\ LXRSI�PN\KJ�h��J�I�bSPQO`O�UWJ�O�UKa�I�b�U�LZf�Y;UWGKJ�ODG,LN_K\ V�PXI�bSY�a�e�RSmWm�Ml[�LXR1OxI�U�V�PXJS_�G,LN_K\ V�PXI�b�Y;OWa��Bú8úBO`R�O�UWTze�\KV[(LNR�O�I�UWV�PNJS_�aZu5G,V�PN\KR�O�G,JSJSU�G,LNPXJ�_qO�[bSU�Y;UWOH��O�U�UHkgU�LN\5�B��aSG,J1T;I�GKkSR�O�UWGKV�[btGKV�UHG,LNL1LN\&[�GKLXPNm�U�TO�UWG,V[bnI�UW[bSJSPQ�>RSUWOWh^��JlI�bSUj[�G O�U^\,eoþD�BOWa�I�bSUs[�V�\>O�O�\5uKUWV8G,J1TlYqR&I�G,I�PN\KJl\ ]1UWV�G,I�\ V�OH[�GKJ]SV�\&T&R�[(U�JSUW�¾O�\KLNR&I�PX\ J�O^I�b�G,ItG,V�Un[(\KY;]SLNU(I�U�LNM�T&PX�gUWV�UWJ>Ise�V�\ Y I�bSUz[�RSV�V�UWJ Is\ JSUWOWh�½�U

Page 27: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ���f(X)

XSS S S

1 23 4

X XX

X

ä(jel*�3Ô;ÞT�÷?�Å�f�oBh=iPxKwTiG|�lTbewTz3tEbejÞç=h=r�fPh�tEiPs�m6�PNLXLNR�O�I�VG5I�U3I�bSPQO8e�GK[�I8PXJl�$PN_KRSV�U^ËS�Kh�}�U(I8R1O8G O�O�RSY;U`I�b1G5IBI�bSUqO�[�GKLNGKV�ó PQOH[(\&T&UWTzR�O�PNJS_tGÆvf�kSPXI!kSPNJ�G,V�M.V�U�]SV�UWO�U�J>IG5I�PN\KJ�aKG,J�T^LNU(IXô»��G,J�T�ô k k1UoIx�d\`]g\KPNJ IOcPNJ;I�bSUi\ JSU(f�T&PNY;U�J�O�PX\ J�G,LO�UWG,V[b�O�]1GK[(U hy��b�UtT&UW[�PXYsGKL�u5G,LNRSUWO.\,e|ô��;GKJ�T"ô k GKV�UjëlG,J�T�Ì��sV�U�O�]gUW[(I�PNuKU�LNMKh���bSUWPXVkSPNJ�G,V�MzV�U�]SV�UWO�U�J>IG5I�PN\KJ1OHGKV�U�ô����õ������N�tGKJ�TGô k �ä�K�K� �K� h�}�U(I3R�O`GK]S]SLNMzI�b�UjO�PNJS_KLNU(f]g\KPNJ I`[(V�\ O�O�\5uKU�ViI�\�I�bSU�O�U;OxI�V�PNJS_>OB�oPXI�blI�bSUs[(V�\ O�O�\5uKU�ViO�PXI�Uqe�G,LNLXPNJS_yk1U�Ix��UWU�JzI�bSU;O�U�[(\KJ1TG,J1TjI�bSPXVTyY;\ O�IBO�PN_KJSPXr1[WG,J>Idk�PwIOiGKOoO�bS\5�oJyk1UWLX\5�`h

�S�Nö �N����K�NöX� �K�

��bSPQO;�oPXLNLi]SV�\&T&R�[�U�G}JSUW�ù]1G,PNV^\KeH]g\KPNJ>I�O;\ Vj[bSV�\ Y;\ O�\KY;UWO�ô�÷�G,J�Tzô.ønG OsO�bS\5�oJ�PNJ�$PX_ RSV�U;ËS�Kh3�iUWV�U a�ô�÷2�ù�S� �K� �.G,J�TÀô.ø��ý� ����N�ShD��bSUs[(\ V�V�UWO�]1\ J�T&PNJS_tT&U�[(PNYsG,L0u5G,LNRSUWOG,V�Uj�vÆjG,J1TlË5Í1a1V�UWO�]1U�[�I�PXu U�LNMKhHÒ&PXY;PNLNGKV�LNMKa�kZM�Y.R&IG5I�PNJS_tI�bSUqY^\>OxI`O�PX_ JSPwrg[�G,J>IBk�PwIDPXJzI�bSUkSPNJ�G,V�M.O�I�V�PXJ�_C���K� �K�8��T&UW[�PXYsGKL���Æ ��a5I�bSUokSPNJ�G,V�M.O�I�V�PXJS_;� �K�K� �H��T&UW[�PXYsGKLSÌS���{PQOc_KUWJSU�VG5I�UWT�h��bSU�O�UcîxR�Y^]1O�\ V!_ GK]�OckgU(Ix�dU�U�Js]g\KPNJ>I�O�PXJjO�R�[�[�UWO�O�PNuKUo_ U�JSUWV�G,I�PN\KJ�O�G,V�UoY.R�[bsLQG,V�_KUWV0I�b�GKJI�b�\ O�UH]�V�\&T&R�[�UWTykZMj\,I�bSU�ViGK]S]SV�\ G [bSUWOWhÞ0U�V�b�G,]�OqI�bSUzUWGKV�LNPNUWO�I;]1G,]gU�Vs\KJ�I�bSUnR�O�Un\,e3þD�BOse�\ Vj[(LNR�O�I�U�V�PNJS_�PNOzÄX��Í>Å5Ç�a��ob�U�V�U�G

þD�¶��GKO`R1O�U�T}I�\zY;PNJSPXY;PNm�UsI�bSU�O��>R�G,V�UWT�U�V�V�\KV`\,eiGn[�LXR�O�I�UWV�PNJS_1hy�BU�V�UKa0UWG [b}]g\KPNJ>I.\KV[bSV�\KY;\ O�\KY;U8V�UW]SV�U�O�UWJ>I�O�G.]1G,V�I�PXI�PN\KJy\,e � \KkSîxUW[�IO�PXJ>I�\�Æâ[�LXR�O�I�UWV�O�GKJ�TtPQO�V�U�]SV�UWO�U�J>I�U�TkZMyG0Ænf�G,V�MtOxI�V�PNJS_j\KecLXUWJS_,I�b���hi�S\ ViU(pSGKY^]�LXU ag[�\KJ�O�PNTSU�VBO�Pwp�]�G,I�I�UWV�J1OB�3a.\Ha��8agF.a�ØiaG,J1T}�÷G,J1T}I�bSUjO�I�V�PXJ�_���S�������Khj��bSPQO.O�PwpZf�kSPXI3kSPXJ1G,V�M��3Æñ�ýËK�DO�I�V�PXJ�_z[(\KV�V�UWO�]1\ J�TSOHI�\]SLQGK[�PXJS_yI�bSUsO�PXp�]�G,I�I�U�V�J�OHPXJ>I�\�Ix�d\�[(LNR�OxI�U�VO�hs��bSPQO`O�I�V�PXJS_�V�U�]SV�UWO�U�J>IO8G�Ix�d\,f�]�G,V�I�PXI�PN\KJ�a�obSUWV�Ui\ JSUB[�LXR�O�I�UWV�b�G OcI�bSUor�VOxI�aKI�bSPNV�T�aZG,J1TsO�PXpZI�bj]�G,I�I�U�V�J�O�GKJ�T^I�bSUHO�U�[(\ J�T;[(LNR�OxI�U�V�b�GKOI�b�U8V�U�YsG,PNJSPNJS_3]�G,I�I�U�V�J�O�h0��Jj\KI�bSUWV��d\KVTSOWa,I�bSUBIx�d\.[�LXR�O�I�UWV�OdG,V�U�(v�3a#�8a ��-HGKJ�T:(`\8a Fqa Ø�-��I�bSUiO�PwpZf�kSPwI!k�PXJ�GKV�MqOxI�V�PNJS_��S���S�K���iV�U�]SV�UWO�U�J>IO�I�bSUiO�G,Y;Ui[(LNR�O�I�U�V�PNJS_D\,e�I�bSUiO�Pwp^]�G5I�I�U�V�J�O��h½�bSUWJzI�b�U�V�UqG,V�U2Æ [(LNR�O�I�U�VOWa1I�bSU�V�UqGKV�U2Æ"ö`T&PX�gUWV�UWJ ID[bSV�\KY;\ O�\KY;UWOB[(\KV�V�UWO�]1\ J�T&PNJS_sI�\UWG [b�Ænf�]�G,V�I�PXI�PN\KJ�\Ke`I�bSU}TSG5IGShð��bSPNO�PNJ�[(V�UWG O�U�O;I�bSU}U(��UW[(I�PNuKU}O�U�G,V[b�O�]�G [(UlO�PXmWUlkZMG�e�G [�I�\ Vj\,eAÆ1öXhÛ�SR�V�I�bSU�V�aoPwe.[�V�\>O�O�\5uKUWV;PNO�G,]S]SLNPNUWT�\KJ�Ix�d\�_K\Z\&T�[bSV�\KY;\ O�\KY;U�O�a�I�bSUV�UWO�RSLwI�PXJ�_`\,��O�]SV�PNJS_3YsGvM.kgUiPNJ&e�U�V�PX\ V�PNJ;I�bSPQO!V�U�]�V�U�O�UWJ IG5I�PX\ J�h{��\KV�U�pSG,Y;]SLNUKaKLNU(I�(��.a \Ha#�|-G,J1T�(�Fqa ØBa ��-dk1U�I�bSU�[(LNR�O�I�UWV�O{PXJ.I�bSUd\K]SI�PNY;GKLZË5f�]1G,V�I�PXI�PN\KJ`\,e�I�bSU�O�PXp`]�G5I�I�UWV�J�O$[(\ J�O�PNT&UWV�U�TG,kg\5uKU h���bSU�[�\KV�V�U�O�]g\KJ1T&PXJ�_�[b�V�\ Y^\>O�\ Y;UWO�G,V�Uo�K� ����N��GKJ�T����N�S� �K�Kh�\dM8GK]S]SLNMZPXJS_8O�PNJS_KLNU(f]g\KPNJ Ii[�V�\>O�O�\5uKUWV�G5I�I�bSU`LX\&[WG5I�PN\KJ�k1U�Ix��UWU�J�I�bSUDI�bSPNV�TyG,J�Tte�\KR�V�I�byk�PwIo]g\ O�PwI�PX\ J�O�\KJ�I�bSU�O�U

Page 28: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

��] � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

Ix�d\~OxI�V�PNJS_ OWao�dUn_KU(I��K�K� �K� ��GKJ�Tz���N���N���}GKOj\K��O�]SV�PXJ�_~G,J�T�kg\,I�bæ[(\ V�V�UWO�]1\ J�T�I�\�GKJPNJ&e�U�V�PX\ V�]1G,V�I�PXI�PN\KJ�h¶��bSU�O�U}]SV�\KkSLNU�YsO�b�GvuKUzY;\KI�PNuvG,I�U�T¿V�UWO�UWG,V[bSUWV�O;I�\�TSUWO�PX_ J¿k1U�I�I�U�VV�U�]SV�UWO�U�J>I�G,I�PN\KJyO�[bSUWY;UWOoG,J1T�[�V�\>O�O�\5uKUWV�\K]gU�VG5I�\KVO�h��JlÄw��Å5Ç�a GKJsPXY;]SV�\5uKU�TqV�U�]�V�U�O�UWJ IG5I�PX\ J;O�[bSUWY^UBPNO�]SV�\ ]1\>O�U�T�aK�ob�U�V�UBG,JjG TST&PXI�PN\KJ�GKL1O�U�]&f

G,VG5I�\KVDO�MZYqk1\ LcPNODR�O�UWT�GKLX\ JS_��oPXI�b}I�bSU;]�G5I�I�U�V�J�LNGKk1UWLNOHI�\�V�UW]SV�U�O�UWJ>IDGy]�GKV�I�PwI�PX\ J�h�}�U(II�b�UqO�U�]�GKV�G,I�\KV8O�MZY.kg\KL$kgU.V�U�]SV�UWO�U�J>I�U�T�kZM ¦ hB��bSUWJnI�bSU;[bSV�\KY;\ O�\KY;U3�B�d� ¦ \�FHØ¿[(\ V�fV�UWO�]1\ J�TSO�I�\qG;Ëvf�]�GKV�I�PwI�PX\ J:(��3a#�8a �U-DG,J�T#(�\Ha F.a Ø�->h Ã8O�PNJS_qI�bSPQOdV�UW]SV�U�O�UWJ>I�G5I�PX\ Js]1UWV�Y;PXI�OI�b�U�YàI�\sYsG,]yI�bSU3[�LXR1OxI�U�V�PXJS_;]SV�\Kk�LXUWYàPXJ>I�\jGq]gU�V�Y.RSI�G5I�PX\ J�]�V�\ kSLXUWYùO�R�[b�GKOdI�b�UDI�VGvu fU�LNPNJS_�O�G,LNUWO�YsG,J�]SV�\KkSLNU�Yâ�obSPQ[b�[WG,J~kgU�O�\ LXu UWT�kZM�R�O�PNJS_lI�bSUy]1UWV�YqR&I�G,I�PN\KJ�[�V�\>O�O�\5uKUWV\K]gU�VG5I�\KVODÄ Ü,Ì5Ç�h���bSPQOiO�\ LXRSI�PN\KJ�G,LQO�\sO�R&�gUWV�Ooe�V�\ Yý]gU�V�Y.R&IG5I�PN\KJ�V�UWT&R�J�TSG,J1[(MKh!��b�U�V�U3G,V�UÜ,ËqU�� R�PXu5G,LNU�J>IB[bSV�\KY;\>O�\ Y^U�OD��]gU�V�Y.R&IG5I�PN\KJ1O���[�\KV�V�U�O�]g\KJ�TSPXJS_^I�\;I�bSU3O�G,Y;U`]�GKV�I�PwI�PX\ Jy\KeI�b�U3TSG5IGqPNJ>I�\^I�b�UDIx��\s[(LNR�O�I�UWV�OI(v�3a#�8a ��-3G,J�TP(`\8a Fqa Ø�- h9n\KV�U�V�UW[�U�J>I�LNMKa&ÄX��ZÜ�ÇZPXJZuKU�OxI�PX_>G5I�UWT`I�bSU�R�O�Ud\Ke�UWTS_KU(f�k�G O�U�T.[(V�\ O�O�\5uKU�V�Äw��Å,Í,Ç>I�\`O�\KLNuKU�I�bSU[(LNR�O�I�UWV�PNJS_;]SV�\KkSLNU�Y�hc�iUWV�U aSG,LNL�]�G5I�I�U�V�J�O�PNJyG;[�LXR�O�I�UWViG,V�UHG O�O�RSY;UWTtI�\^e�\ V�YýG;[�\KY;]SLNU(I�U_KVG,]�b}kZM}[(\KJ�JSUW[(I�PNJS_nI�b�U�Y �oPwI�b~UWT&_ UWOWhnèB��O�]SV�PNJS_zGKV�Us_ U�JSUWV�G,I�UWT�e�V�\KY I�bSUt]�G,V�U�J>I�OO�\nI�b�G,I3I�b�U�M}PXJSb�U�V�PwIqI�bSUjU�T&_KU�O`e�V�\KY I�bSUWPXVq]�G,V�U�J>IO�hy��IqPQO3\ k�O�UWV�u UWT�I�b1G5I3I�bSPNO^[(V�\ O�O�f\5uKUWV;\K]gU�VG5I�\ V;I�GK|KUWO�Í;��Æ�ú��Ó�l�qI�PNY;Une�\KV�� ]�G,I�I�U�V�J�OjG,J1T�Æ [�LXR1OxI�U�VO;V�RSLNPNJS_�\KR&IPXI�O`G,]�]SLXPQ[�GKkSPNLXPXIxMz\KJ}]SVGK[(I�PQ[�G,LcTSG,I�G�O�U(I�OHb�GvuZPNJS_�Y;\KV�U.I�b�G,J���y[(LNR�O�I�U�VOWhq��J�G�b>MZkSV�PQTG,]�]SV�\>GK[b`]SV�\K]g\ O�UWTDPNJ�Ä Å5Ç�avI�b�U�þD��PNO$R�O�UWT3\KJSLNMDI�\Br�J�T3_ \Z\ZT3PXJSPXI�PQG,L&[�LXR�O�I�UWV$[�U�J>I�UWV�O$G,J1TI�b�U2L>f�Y^U�G,J�OoGKLX_ \KV�PwI�bSYàPQOiG,]�]SLXPNUWTyI�\;r�J�T�I�b�U`r�J�GKL�]�G,V�I�PXI�PN\KJ�h���bSPQOobZMZkSV�PQT�G,]S]�V�\>GK[b]gU�V�e�\KV�Y^U�TtkgU(I�I�UWVoI�b�GKJyI�bSU.þD�.h�æYsG5îx\ V�]�V�\ kSLXUWY»�oPwI�byþD�BO�PQO�I�bSUWPXVoO�U�J�O�PwI�PXuZPXIxM;I�\.I�bSU`O�U�LNUW[�I�PX\ Jj\,e{uvGKV�PN\KR1O!]�GKV�GKYqf

U(I�U�VOqO�R�[b~G O.]g\K]SR�LNG,I�PN\KJ�O�PXmWUKac[(V�\ O�O�\5uKU�V3GKJ�T�YqR&I�G,I�PN\KJ~]SV�\Kk1G,kSPNLXPXI�PNUWOWai¢(¥�Õ�·�þHV�U�e�U�J&fO�I�U(I�I�U~Ä ë��,Çib�GKOsO�I�R�TSPXU�T~I�bSPNOj]SV�\ kSLNU�Y GKJ�T�O�RS_ _KUWO�I�U�T�_ RSPQT&U�LNPXJ�UWO^e�\KVjO�U�LNUW[(I�PNJS_}I�bSU�O�U[(\ J>I�V�\KL�]1G,VG,Y;U(I�U�VO�hH�i\5�dU�uKUWVWa�I�bSU�O�Uq_KRSPQT&UWLXPNJSUWOHYsGvMyJS\,IDMZPXUWLNTn_ \Z\ZTzV�U�O�RSLXI�O8\KJ�O�]gU(f[(PXr1[.]SV�\ kSLNU�YsOoLNPX| U.]�G,I�I�UWV�Jz[�LXR1OxI�U�V�PXJS_1ho��I8��GKOoV�U�]g\KV�I�U�T�PXJ�Äw���>Ü�Ç�I�b�G,I8bZMZkSV�PQT�_KUWJSU(I�PN[G,LN_K\ V�PXI�b�Y;O$PNJ�[(\ V�]g\KVG5I�PXJ�_8]SV�\Kk�LXUWYqf�O�]1U�[(PXr1[dbSU�RSV�PQOxI�PN[WOcG,V�Ud_ \Z\ZT.e�\KV![�LXR1OxI�U�V�PXJS_1h{��O�PXY^fPNLNGKV0[�LNGKPXYÛPQO$YsGKT&UdPXJyÄ ÌZÜ�ÇSG,kg\KRSI{I�bSUoG,]S]SLNPQ[�G,k�PXLNPwIxM`\KegþD�BO{I�\H\KI�bSUWV{]�V�G [�I�PQ[�GKLZ]SV�\ kSLNU�YsO�h�iJ�\,I�b�U�VHPNO�O�R�U.�oPXI�b�þD�8OBPQOiI�bSU;O�UWLXU�[�I�PN\KJl\,e�G,JzGK]S]SV�\K]SV�PQG5I�U.V�UW]SV�U�O�UWJ>I�G5I�PX\ J��obSPN[blPNOLN\5�æPNJy\ V�TSU�VoG,J�TyO�bS\KV�IoPXJnT&U�r�JSPNJS_sLXUWJS_,I�b�h��I;PQO^]1\>O�O�PNkSLXU�I�\}uZPXUW�¶I�b�U�[�LXR1OxI�U�V�PXJS_}]SV�\KkSLNU�YÿG O;G,J�\ ]&I�PNY;PXm�G5I�PX\ J�]SV�\KkSLNU�YâI�b�G5I

LN\Z[WG5I�UWOcI�bSUi\ ]&I�PNYsG,L1[�U�J>I�V�\KPQTSO�\,e�I�bSU8[(LNR�OxI�U�VO�T&PNV�UW[�I�LXM^VG5I�b�U�VcI�b�G,Jsr1J�T&PNJS_.G,Js\ ]&I�PNYsG,L]�GKV�I�PwI�PX\ JHR1O�PNJS_iGiþD�3h���bSPQO�uZPXUW��]gU�V�Y;PwIO�I�bSUcR�O�U!\,e&Ø�Ò&O�G,J�TDØ�Þ�kgUW[WG,R�O�U![(UWJ>I�V�\KPQTSO�[�GKJkgUD[�\&T&UWTtUWGKO�PNLXMsPNJ�kg\,I�btI�bSUWO�UDG,]S]SV�\ G [bSUWO�GKO�I�b�U�MtO�RS]S]g\KV�I�I�bSU`T&PNV�U�[�IoV�UW]SV�UWO�U�J>I�G,I�PN\KJ\,e�G3O�\KLNR&I�PX\ JjGKO�G3V�U�G,LXf�u5G,LNRSU�Tqu UW[(I�\KV�h$��JzÄw���5Ç�a>ØdÒ&O!�dU�V�UoR�O�UWTs\ Jsk1\KI�bjb�GKV�T;GKJ�T;e�RSmWm�M[(LNR�O�I�UWV�PNJS_`]SV�\KkSLNU�YsO!GKJ�T;Ø�Þ�b�G OckgU�U�JsR1O�U�T.I�\3U�u \KLNuKUde�RSmWm�M^Y^PNJ&f�YsG5p^[�LXR1OxI�U�VOiÄ ê Ì5Ç�h{��Ib�G O0k1UWU�J;\Kk�O�U�V�uKU�T`I�b�G5IcI�bSU�Mq]1UWV�e�\ V�Y kgU(I�I�UWVcI�b�GKJ^I�bSUWPXV![�LNG O�O�PN[WG,L&[(\ RSJ>I�UWV�]�GKV�IO�avI�bSU|L>fY;UWGKJ�O{GKLX_ \KV�PwI�bSYÉG,J�TDI�bSU�e�RSm�mWMAæf�Y;U�G,J�O{G,LN_K\KV�PXI�bSY�h��B\5��UWuKU�V�avG,LNL \KeSI�bSU�O�UdG,]S]�V�\>GK[bSU�OO�R&�gUWVq��GKOBTS\�þD�BOHG,J�Tn�8úBú8O��ie�V�\ Y¾O�U�J1O�PXI�PNuZPwIxM�I�\t[�\KJ>I�V�\KL{]�G,VG,Y;U�I�U�ViO�U�LNUW[(I�PN\KJ�hi��\KVUWG [bjO�]gUW[�Pwrg[o]SV�\KkSLNU�Y�a>\KJSUib1GKO0I�\3I�R�JSUoI�b�UB]�GKV�GKY^U�I�UWV!u5G,LNRSUWO!I�\.O�RSPXI�I�b�UBG,]S]�LXPQ[�G,I�PN\KJ�h�Z# ûë7[<q),AD1B2[Oü�)*C:<;H�"� Â,A%U6)3132*<XCÒZU�G,V[bzI�U�[bSJSPQ�>RSUWOHR�O�UWTlI�\�\KkSI�G,PNJzI�bSUs\K]SI�PNY.RSY u5GKLXRSU;\Ke!I�bSUj[�V�PXI�UWV�PN\KJze�RSJ�[�I�PX\ J�G,V�UT&PNuZPNT&U�T}PXJ>I�\zTSU(I�UWV�Y;PNJSPQOxI�PN[sGKJ�T�O�I�\&[b�G OxI�PN[;O�UWGKV�[b�I�U�[bSJSPQ� R�UWOWhjFBU�I�U�V�Y;PXJ�PNO�I�PQ[sO�U�G,V[bI�U�[bSJSPQ�>RSUWOB_KR�GKV�GKJ I�U�U3GKJn\K]&I�PXYsG,L{]�G,V�I�PXI�PN\KJnkZMy]1UWV�e�\ V�Y;PNJS_sU(p&b�GKR�O�I�PNuKU3UWJ>R�Y^UWV�G,I�PN\KJ�hè8JzI�bSU^\,I�b�U�VHb�G,J�T�a�I�bSU;OxI�\&[b�GKO�I�PQ[.O�UWGKV�[b�I�UW[bSJSPQ�>RSUWOH_ U�JSUWV�G,I�U.G�JSUWGKV�f�\K]SI�PNY;GKL�]�GKV�fI�PXI�PN\KJ�V�UWG O�\ J�G,kSLNMz�>RSPQ[|>LNM�GKJ�T}_KR�GKV�GKJ>I�U�U;[(\ JZuKU�V�_KUWJ�[(U.I�\n\ ]&I�PNYsG,L!]�GKV�I�PwI�PX\ J�GKO�M>Y;]&f

Page 29: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ��fI�\KI�PQ[�GKLXLNMKhÉ�iY;\KJ�_�I�bSUzI�UW[b�JSPN�>RSU�Oj[(\ J�O�PNT&UWV�U�T�O�\�e�GKVWa�U�u \KLNR&I�PN\KJ1G,V�M�G,]S]�V�\>GK[bSU�OsG,V�UO�I�\&[b�GKO�I�PQ[DG,J�TtI�b�U`V�UWY;GKPXJ1T&U�VoG,V�UDT&U(I�U�V�Y^PNJSPQOxI�PN[Kh�èBI�bSUWViT&U(I�U�V�Y;PXJSPQO�I�PQ[`G,]S]SV�\ G [bSUWO�I�\[(LNR�O�I�UWV�PNJS_zPNJ�[(LNR�T&UtI�bSU�kSVG,J�[b~GKJ�T�k1\ RSJ�T�I�UW[bSJ�PN�>RSUyGKT&\ ]&I�U�T�PXJæÄX�K��Ì5Ç�GKJ�T¿Ä Ë,ê,Ç!e�\KV_KUWJSU�VG5I�PXJ�_l\K]SI�PNY;GKL�]�G,V�I�PXI�PN\KJ�OWh~��bSPQO;G,]S]SV�\ G [b�_KUWJSU�VG5I�UWO.I�bSUy\K]&I�PXYsGKLd]1G,V�I�PXI�PN\KJ�\KeI�b�UyTSG,I�G�G5I^I�bSU�[(\>OxI^\,eBU�p&[�UWO�O�PNuKU�[(\KY;]SRSI�G5I�PX\ J�G,LdV�UW�>RSPNV�UWY^UWJ>I�OWh���J÷Äw�vÆ5Í,Ç�acGlT&U�I�UWV�fY;PXJ�PNO�I�PQ[sG,JSJ�UWG,LNPNJS_yGK]S]SV�\ G [bl��GKOD]SV�\K]g\ O�UWTze�\KV3[(LNR�O�I�UWV�PNJS_�hs��bSPQO`G,]�]SV�\>GK[b�U�Y;]SLN\5MZOG,J�G,JSJ�UWG,LNPNJS_zI�UW[bSJSPQ�>RSU�PXJ��obSPQ[b~I�bSU�U�V�V�\ VqO�RSV�e�G [(UyPNO;O�Y;\>\KI�bSU�T�a!kSRSIs[�\KJZuKUWV�_ U�J�[�UI�\lI�bSUy_KLN\Kk1G,L�\ ]&I�PNY.R�Y PQOqJS\,I^_KR�GKV�GKJ I�U�U�T�hl��bSUyR�O�Ut\,eBTSU(I�UWV�Y;PNJSPQOxI�PN[�G,JSJSU�G,LNPXJ�_lPNJ]SV�\vp&PXY;PXIxM f�Y;\&T&Uj[(LNR�O�I�U�V�PNJS_����ob�U�V�UjI�b�Ut]�G,I�I�UWV�J1OqGKV�UjO�]1U�[(PXr�UWT�PXJ~I�U�V�YsO3\Kei]�G,PNV��oPQO�U]SV�\vp&PXY;PXI�PNUWOHV�G,I�bSUWVHI�b�GKJ�YqRSLwI�PNTSPXY;U�J1O�PN\KJ�GKLc]1\ PXJ>IO��8��GKOHU(p&]SLN\KV�UWTlPXJ�Ä ë ê5Ç�µ�LQG5I�UWVD��\ V�|G,]�]SLXPNUWT�I�bSU3T&U(I�U�V�Y;PXJSPQO�I�PQ[HGKJSJSU�G,LNPXJS_sGK]S]SV�\ GK[btI�\^I�U�pZI�RSV�U3O�UW_KY;U�J>IG5I�PN\KJ}Ä ëZÜ�Ç�h��bSUsT&U(I�U�V�Y^PNJSPQOxI�PN[;GK]S]SV�\ GK[b�UWOHG,V�U.IxMZ]SPQ[�GKLXLNMn_KV�U�U�T&MzT&UWO�[(UWJ>IDGK]S]SV�\ GK[b�UWOWag�ob�U�V�UWGKO

I�b�U~OxI�\Z[b1GKO�I�PQ[�GK]S]SV�\ GK[b�UWO�]1UWV�Y;PXIz]1UWV�I�RSV�k1G5I�PN\KJ1OtI�\�I�bSU�O�\KLNR&I�PN\KJ1O�PXJ÷JS\KJSf�LN\&[�G,LNLNM f\K]SI�PNY;GKL&T&PXV�UW[(I�PN\KJ�O0GKLNO�\B�oPXI�b^JS\KJ�m�U�V�\B]�V�\ k�G,kSPNLNPwI�PXU�O�h$��bSUdO�I�\&[b�G OxI�PN[�O�U�G,V[b`I�U�[bSJSPQ�>RSUWOG,V�UDU�PXI�bSUWVBO�UW�>RSU�J>I�PNGKL�\KVo]�GKV�GKLXLNU�L�a&�obSPNLXU.U�uK\ LXRSI�PN\KJ�GKV�MjGK]S]SV�\ GK[b�UWO�G,V�UDPXJSb�U�V�U�J>I�LNMt]�GKV�fG,LNLNU�L�h$��bSUiO�PNY.RSLQG5I�UWT;G,JSJ�UWG,LNPNJS_3G,]S]�V�\>GK[b���Ò&�8�iÄw� ��5ÇSPQO�GDO�UW�>RSUWJ I�PNGKL�O�I�\&[b�GKO�I�PQ[�O�U�G,V[bI�U�[bSJSPQ�>RSUKa>�obS\ O�UiG,]�]SLXPQ[�GKkSPNLXPXIxM.I�\3[(LNR�O�I�U�V�PNJS_3PQO�T&PQO�[�R�O�O�U�TqPNJzÄX�K�K��Ç�hcÒZPNY.RSLQG5I�UWTsGKJSJSUWGKLwfPNJS_s]SV�\Z[�UWT&R�V�U�OoG,V�U3T&UWO�PX_ JSUWT�I�\jGvuK\KPQT}��\KVBV�U�[(\5uKUWVde�V�\ Ys��O�\KLNR&I�PX\ J�Oo�obSPQ[bz[(\ V�V�UWO�]1\ J�TI�\sLN\&[�GKL�\K]&I�PXYsG^\,e$I�bSU`\ k&îxUW[(I�PNuKUHe�RSJ�[(I�PN\KJ�OWh���bSPQOoPQOiGK[W[(\ Y^]�LXPQO�b�UWT�k>M�GK[�[�U�]&I�PXJ�_^�oPXI�bO�\KY;Uo]SV�\Kk�GKkSPXLNPXIxM.GHJSU���O�\ LXRSI�PN\KJ^e�\KVcI�bSUoJSU�p>I!PXI�UWV�G,I�PN\KJ;\,e�LN\5��UWV0�>R�GKLXPXIxM���GKOcY;U�GKO�RSV�U�TkZM}I�bSU�[(V�PwI�U�V�PX\ J�e�RSJ�[(I�PN\KJ1�(h}��bSUy]SV�\Kk�GKkSPNLXPXIxM�\KeBGK[W[(U�]SI�G,J1[(UjPQO._ \5uKUWV�JSU�T�kZM}G�[(V�PwI�Pwf[�GKL�]�G,VG,Y;U(I�U�Vo[�GKLXLNUWTjI�bSUHI�U�Y;]1UWV�G,I�RSV�Us��kZMtGKJ�G,LN\K_ M^�oPXI�b�G,J�JSUWGKLXPNJS_^PXJyY;U(I�GKLNO���obSPQ[bPQODIxMZ]SPN[WG,LNLXM�O�]gUW[�Pwr�U�T�PXJ}I�U�V�Y;O3\,eoGyO�I�GKV�I�PXJ�_~��r�VOxI3PXI�UWV�G,I�PN\KJ1�HGKJ�T�r�J�G,L!I�U�Y;]gU�VG5I�RSV�Uu5G,LNRSUKhsÒZUWLXPNYéG,J1T��BLwfxÒZRSLXI�GKJ�ÄX�Wê ê5Ç!OxI�R�T&PNUWTlI�bSU;U��gU�[�I�OD\Ked[�\KJ>I�V�\KL0]�GKV�GKY^U�I�UWV�O8\KJlI�bSU]gU�V�e�\KV�Y;GKJ�[(UB\,e�I�b�U8G,LN_K\ V�PXI�b�Yya>G,J�TlÄw�WÍ,Ç1R1O�U�TtÒ&�æI�\3\ k&I�GKPXJjJ�UWG,V�f�\K]&I�PXYsG,L�]�G,V�I�PXI�PN\KJj\KeI�b�U^TSG,I�G�hDÒ&�¤PQO8O�I�G,I�PQOxI�PN[WG,LNLXM�_KR1G,VG,J>I�UWUWTyI�\tr�J�TzI�bSU^_KLN\Kk�GKL�\ ]&I�PNYsG,L0O�\ LXR&I�PX\ J�ÄX�(Ç�hD�bSPN_Kb&f�LNU�uKUWL�\KR&I�LXPNJSUD\,ecGsÒ&�Ék�G O�U�T�GKLX_ \KV�PwI�bSY¶e�\KVi[�LXR1OxI�U�V�PXJS_;PQO�_KPNuKUWJ�kgU�LN\5�`h¸2©3¹ º�¯�¬Z­`±�´»¨Àý�®bº¬�Ïzª�´<³,±�«P¹ ©3®b¯¬�Ï�§~´»´ ¬�®b©3±�´»¨�x�v�6giG,J�TS\KY;LXM�O�U�LNUW[�I;G,J~PNJSPXI�PQG,L�]�GKV�I�PwI�PX\ J�G,J�T1þ�ÿ a�G,J�T�[(\KY;]SRSI�UjI�bSU�O��>R�GKV�U�T�U�V�V�\ V

uvGKLXR�UKabß����Kh�ÒZUWLXU�[�Iiu5G,LNRSU�O�e�\KV�I�bSU3[(\ J I�V�\ L�]�G,VG,Y;U�I�U�VOWa>PNJSPXI�PQG,L�GKJ�T�r�J�GKL�I�U�Y;]gU�VG5fI�RSV�UWO��.ÿ`G,J�T����&h

��Ë ��ÒZU�LNUW[(IoGqJSUWPX_ b>kg\KV�þ��8\,ehþ ÿ G,J1T�[�\KY;]SR&I�UHPXI�OoO��>R�G,V�UWTtU�V�V�\ V�u5GKLXRSU abß � hc��e ß �� PNOLNGKV�_ U�VgI�b�GKJAß����Ka�I�bSUWJ3GKO�O�PN_KJCþ � I�\|þ»ÿ!�oPXI�b3GdI�UWY;]1UWV�G,I�RSV�U(f�T&U�]gU�J1T&U�J>I�]SV�\Kk1G,kSPNLXPXIxMKhØ!LQO�UDGKO�O�PN_KJ:þ � I�\�þ»ÿKh�goUW]1U�G5IoI�b�PNOiO�I�UW]te�\ VBGqrSp&UWT�JZRSY.kgU�Vi\Ke{PXI�UWV�G,I�PN\KJ�OWh

��Ì>�6goUWT&R1[(UHI�bSU.uvGKLXR�UH\Ke � ÿ a�§�·�¢W·�� ÿ �Òæ�� ÿ aS�obSU�V�UAæ8PNOiG^]SV�UWTSU(I�UWV�Y;PNJSUWT�[�\KJ�O�I�GKJ I�h0��e� ÿ PQOo_KV�UWG,I�UWV�I�b�G,J�� � aZI�bSU�J�_ \qI�\jOxI�U�]nË&h!Ø�LNO�U`OxI�\K]�h��bSUzÒ&�ùGKLX_ \KV�PwI�bSYÿ[�GKJ�kgUnO�LN\5�¶PXJ�V�UWGK[b�PXJS_lI�bSU�\ ]&I�PNYsG,LoO�\ LXRSI�PN\KJ�kgUW[WG,R�O�Uy\K]&I�Pwf

YsG,L0V�UWO�RSLwIOBV�UW�>RSPNV�U3I�b�U.I�U�Y;]1UWV�G,I�RSV�UqI�\yk1U;T&UW[�V�U�GKO�UWTnu U�V�MyO�LN\5�oLXMye�V�\KY PXI�U�VG5I�PX\ JnI�\PXI�U�VG5I�PX\ J�h�{GKkSR�O�UWGKV�[blĸÜ,Ë5Ç�aZLNPX| UDÒS�3a&PQOdGqY;U(I�bS\&T�T&U�O�PN_KJ�UWTsI�\^[�V�\>O�O�kg\KRSJ�T�G,V�PXU�O�\Ke�e�UWG O�PNkSPNLXPXIxM

\KVBLX\&[�GKL�\K]SI�PNY;GKLXPXIxM�GKJ�T�I�\tO�M&OxI�U�YsG5I�PN[WG,LNLXMtPXY;]g\ O�U3G,J�T�V�U�LNUWG O�U`[(\ J�O�I�VG,PNJ IOdI�\s]gU�V�Y;PwIU(p&]SLN\KVG5I�PX\ J�\,e3\KI�bSUWV��oPQO�Ule�\KV�kSPQTST&U�JæV�UW_KPN\KJ�OWh¤�$G,kSR¹O�U�G,V[b��dG OtR�O�UWT�I�\�O�\KLNuKUzI�bSU[(LNR�O�I�UWV�PNJS_;]SV�\KkSLNU�YàPNJ�Ä Ì,Ç�h

Page 30: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

³�� � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*�Z# @�� "�E�USÁ.Â*),A + C�U(-�UBWn^c<q1B25-,+ �ZN;<qC��JyI�bSPQOiO�UW[(I�PN\KJ���UDb�Gvu UDU(pSG,Y;PNJSUWT�u5G,V�PX\ R�OoT&U(I�U�V�Y;PXJSPQO�I�PQ[`G,J�T�O�I�\&[b�GKO�I�PQ[DO�U�G,V[bjI�UW[b&fJSPQ�>RSUWO�I�\.GK]S]SV�\ G [bqI�bSU8[�LXR1OxI�U�V�PXJS_.]SV�\ kSLNU�Y»GKO�GKJs\K]&I�PXY;PNmWG,I�PN\KJj]SV�\Kk�LXUWYyh0�¿YsG,îx\KV�PwIxM\,eoI�bSUWO�UtY;U�I�bS\&TSOqR�O�UsI�bSUyO��>R�GKV�U�T�U�V�V�\ V.[(V�PXI�U�V�PN\KJ�e�RSJ�[(I�PN\KJ�h}�iUWJ�[(U a{I�bSUy]�G,V�I�PXI�PN\KJ�O_KUWJSU�VG5I�UWT�kZM�I�bSU�O�UyG,]S]SV�\ G [bSUWO`GKV�UtJS\,I;GKO3u U�VO�G,I�PNLXUjG O`I�bS\ O�Uj_KUWJSU�VG5I�UWT�kZM}bSPXUWV�GKV�f[bSPQ[�GKL�G,LN_K\ V�PXI�b�Y;OWhz��bSUy[(LNR�OxI�U�VO3_ U�JSUWV�G,I�UWT�GKV�UjIxM>]�PN[WG,LNLXM}bZM>]gU�V�f�O�]Sb�U�V�PN[WG,L!PNJ�O�b�G,]gUKhØ!u \KLNR&I�PN\KJ1G,V�M�G,]�]SV�\>GK[bSU�OiG,V�U3_ LX\ k�G,LNPXmWUWTnO�UWGKV�[b�I�UW[bSJSPQ�>RSUWOWa��obSU�V�UWG OoI�bSU.V�UWO�I8\KecI�bSUG,]�]SV�\>GK[bSU�OiG,V�U3LN\&[�G,LNPNm�UWTlO�U�G,V[b�I�UW[bSJ�PN�>RSU hH�8úBúBODGKJ�TlþD�BOHG,V�U3PNJSbSUWV�UWJ I�LXM�]�GKV�GKLXLNU�LG,J1T}O�\yI�bSUWM}[WG,J�kgUsPXY;]SLNU�Y;U�J>I�UWT�R�O�PXJ�_n]�G,VG,LNLXUWLcb�G,VT&��G,V�U.I�\nPXY;]SV�\5uKU^I�bSU�PNV.O�]1UWUWT�hØ!u \KLNR&I�PN\KJ1G,V�MHGK]S]SV�\ GK[b�UWO�GKV�U�]1\ ]SRSLQG5I�PN\KJSf�k�G O�U�T�µ5I�b�G5I0PNOWavI�b�U�M3O�UWG,V[b3R�O�PNJS_8Y;\ V�U�I�b�GKJ\KJ�U.O�\ LXRSI�PN\KJnG5I8GsI�PNY^UqG,J�TyI�bSU.V�UWO�IBG,V�U`k�GKO�UWT�\ J�R�O�PNJS_tGtO�PNJS_KLNU3O�\KLNR&I�PN\KJzG,I8G^I�PNY;UKh�Bú8úBOWa1þD�BOWagÒS�3a�GKJ�T��$G,k�R�O�UWGKV�[b}���iÒS�iG,V�UDGKLXL�O�U�J1O�PXI�PNuKUHI�\;I�bSU3O�U�LNUW[�I�PX\ J�\Ke$u5GKV�PN\KR�OLNUWG,V�JSPNJS_ZÊ,[(\ J I�V�\ L�]�G,VG,Y;U(I�U�VO�h¹��J�I�b�U�\KV�MKaoGKLXLBI�bSU�O�Une�\ RSVjY;U(I�bS\&TSOyG,V�Un��U�G,|�Y;U�I�b&f\&TSOHÄw�vÆKËvÇgPXJjI�b�G,I�I�b�U�MjT&\3J�\,I�R1O�U8U(p&]SLNPN[�PwIoT&\KYsGKPXJs|ZJS\5�oLNUWT&_ UKh0�iJjPNY;]1\ V�IG,J>I�e�U�G5I�RSV�U\,egI�b�UoU�uK\ LXRSI�PN\KJ�GKV�M3GK]S]SV�\ GK[b�UWO{PNO0I�b�G5IcI�bSU�M^[�GKJqr1J�TqI�bSUo\ ]&I�PNYsG,L�O�\KLNR&I�PN\KJ^U�u U�J;�obSUWJI�b�U3[(V�PwI�U�V�PX\ Jte�RSJ1[�I�PN\KJ�PQOoT&PQO�[�\KJ>I�PNJZRS\KR�OWh�iJlUWY;]SPXV�PQ[�G,L0O�I�R�T&M�\Ke!I�bSU^]gU�V�e�\KV�Y;GKJ�[(U.\,ecI�b�U.e�\ LXLN\5�oPXJ�_tbSUWRSV�PQO�I�PQ[�OBe�\KVD[(LNR�OxI�U�V�PXJ�_

��GKO8]SV�U�O�UWJ>I�UWT�PNJ�ÄX�WÌ Ì5Ç�µ�Ò&�3a�þD�3a��iÒ�a�VG,J�TS\KY;PXmWUWTnk�V�GKJ�[bzG,J�Tlk1\ RSJ�T��3g�\��8�qÄX�WÌKÌ,Ç�aG,J1TqbZMZkSV�PNT;O�UWGKV�[by���8Ò��!O�I�VG5I�UW_KPNUWO�Ä Å,Í,Ç1��UWV�U�U�u5GKLXR�G,I�U�T�h$��b�Ui[(\KJ1[(LNR�O�PN\KJ;��GKO$I�b�G5I�þD�]gU�V�e�\KV�Y;OD�dU�LNLcPNJ�I�bSUj[�G O�U;\Ked\ JSU(f�T&PNY^UWJ�O�PX\ J�G,LcTSG,I�GSa��obSPXLNUsPXI�O`]gU�V�e�\KV�YsG,J�[�U^\ J�b�PX_ bT&PNY;U�J�O�PX\ J�G,LcTSG,I�GyO�U�I�ODPQOHJS\,I`PNY^]�V�U�O�O�PXu UKh3��bSU;]gU�V�e�\KV�YsG,J�[�U.\,eoÒ&�ðPNOHJS\KI3G5I�I�V�G [�I�PXu UkgUW[�GKR�O�U`PwIHPNOou U�V�M�O�LX\5�`hXg�\�� G,J1Tn�iÒy]1UWV�e�\ V�Y;UWTykgUWO�IWho�8ÒyPQOi_ \Z\ZT�e�\ VibSPN_KbzT&PNY;U�J&fO�PX\ J�G,LgTSG5IGShc�i\5�dU�u U�V�aKJS\ JSUB\Ke�I�bSUHY;U(I�b�\ZT�O���GKO!e�\KRSJ�TjI�\qk1UDO�R�]1UWV�PN\KV�I�\.\KI�bSUWV�O�kZM;GO�PX_ JSPwrg[�G,J>I�YsGKV�_ PXJ�hc�BJjU�Y;]SPNV�PQ[�GKLgO�I�R1T&M;\,e»L>f�Y;UWG,J1O�a&Ò&�3a&�iÒ�aZG,J1T�þD�¿��GKO�]SV�UWO�U�J>I�U�TPNJlÄ ÍKÇ�hc�iÒ�aSþD�¹G,J�TtÒS�æ�dU�V�UcîxR�T&_ UWT�[(\KY;]�GKV�GKkSLNUoPXJtI�U�V�YsO�\Ke�O�\ LXRSI�PN\KJj�>R�G,LNPXIxM;GKJ�TjGKLXL�dU�V�UqkgU(I�I�U�VDI�b�G,JGL>f�Y;UWG,J1O�h^�i\5�dU�uKUWVWagI�bSU�L>f�Y;U�G,J�OHY;U(I�bS\&TlPQOHI�bSU;Y;\ O�I`U(áj[(PNU�J>I`PNJI�UWV�YsO�\,e�U(p&U�[(R&I�PX\ JsI�PNY;UKµZ\,I�bSU�VdO�[bSUWY;UWOcI�\Z\K|^Y^\ V�UiI�PNY^U;��kZM;G`e�G [�I�\ V�\Ke�Æ����DI�\qËKÆ����>�I�\^]�GKV�I�PwI�PX\ J�G^TSG5IGqO�U(Io\,e$O�PNm�UDê��qPXJ>I�\;Æq[(LNR�O�I�U�VOWh0��RSV�I�bSUWVWaSþD�÷U�J�[�\KRSJ>I�U�V�UWTsI�bSUHk1U�OxIO�\KLNR&I�PN\KJse�G OxI�U�V�I�b�GKJ��iÒtG,J�TyÒ&�3µSÒ&�æI�\Z\K|sY;\ V�UBI�PNY^U8I�b1G,J��iÒsI�\qU�J�[�\KRSJ>I�UWV�I�bSUHk1U�OxIO�\KLNR&I�PN\KJ�h0�i\5�dU�u U�V�aKþD��I�\Z\ |`I�bSUBY;G,p&PXYqRSY I�PXY;Uoe�\ V![(\KJZu U�V�_KU�J1[(UKavI�b�G5I!PQO0I�\`\Kk&IG,PNJ;G]g\K]SRSLQG5I�PX\ Jj\,e�\ JSLNMqI�bSUBkgUWO�IoO�\ LXR&I�PX\ J�OWa,e�\KLNLN\5��U�T;k>Ms�iÒtG,J�TjÒ&�.h&�iJtPNY;]1\ V�IG,J>I�\ k�O�UWV�fu5G5I�PX\ JnPNOiI�b�G,I8PNJnk1\KI�b�ÄX�WÌ Ì5Ç{GKJ�T�Ä ÍKÇ�I�bSU.O�PXmWUWOi\Ke0I�bSU^TSG5IGjO�U�I�O8[(\KJ1O�PQT&U�V�UWT�GKV�U3O�YsG,LNL�aI�b1G5IiPQO�aZe�UW��UWV�I�b�GKJnË����q]�G5I�I�UWV�J�OWh��Ix��\Kf�LQGvMKUWV�JSU(Ix�d\KV�|B��GKO�UWY;]SLX\5M UWTHPNJjÄw�vË,Å5Ç�a��oPwI�bDI�bSUcr1V�O�I�LQGvMKU�V�PNJ�[�LXR�TSPXJS_HG�JZRSY.kgU�V

\,e0]SV�PXJ1[(PN]�G,L�[�\KY;]g\KJSUWJ IBGKJ�G,LNM&O�PQO�O�R�kSJSU(IO�agG,J�T�I�bSU3O�U�[(\ J�TyLNGvM U�V�R�O�PXJS_jGs[�\KY;]gU(I�PXI�PNuKUJSU�IWh{��b�PNO�JSU(Ix�d\KV�|B]gU�V�e�\KV�YsO�]�G,V�I�PXI�PN\KJ1G,LK[�LXR�O�I�UWV�PNJS_oR�O�PNJS_�I�bSU�V�UW_KRSLQG,V�PXmWUWTI9zG,b1G,LQG,JS\ kSPNOT&PQOxIG,J�[�UKh;��bSPQODJSU(I3��GKO8I�VG,PNJSU�TzR�O�PXJ�_�G�O�U(I`\,eH��N���jVG,J1T&\KY;LNMzO�UWLXU�[�I�U�Tl]�Pwp&U�LQOHe�V�\KYGnLQG,V�_KUsPNYsG,_KU�G,J�T}I�bSU�J~R1O�U�T}I�\�[�LNG O�O�PXe�M�UWuKU�V�Ml]�Pwp&U�L�PXJ~I�bSU�PXYsG,_ UKh�goU�e�U�V�U�J�[�U�ÄX�K�(Ç]SV�\K]g\ O�UWT^GDOxI�\Z[b1GKO�I�PQ[d[�\KJSJ�UW[�I�PX\ JSPQOxI�GK]S]SV�\ GK[by��Ò��d�H�cG,J1Tq[�\KY;]�G,V�UWTqPXI�Oc]gU�V�e�\KV�YsG,J�[�U\KJnO�I�GKJ�TSG,VT�TSG5IGsO�U�I�Oo�oPXI�bnkg\,I�b�I�bSU^Ò&� G,J1T#L>f�Y;U�G,J�OiGKLX_ \KV�PwI�bSYsO�h���IB�dG O�\Kk�O�U�V�uKU�TI�b1G5I8Ò��d�ÛPQOiO�RS]gU�V�PX\ V�I�\skg\,I�bzÒ&� G,J�T�L>f�Y;UWG,J1O�PXJyI�UWV�YsOo\Ke0O�\KLNR&I�PX\ J��>R�GKLXPXIxMKh!Ø�uK\ LXR&fI�PN\KJ1G,V�MtG,]S]�V�\>GK[bSU�OdGKV�UD_ \>\&Ty\KJ�LXMj�ob�U�J�I�b�U3TSG5IGsO�PNm�U`PQOoLNUWO�OdI�b�GKJ�����N�qGKJ�T�e�\KViLN\5�T&PNY;U�J�O�PX\ J�G,L�T�G5I�G�h��JzO�RSY;YsG,V�MKa1\KJSLNM�I�bSU2LZf�Y;UWGKJ�OiGKLX_ \KV�PwI�bSYùGKJ�T�PwIOB�8úBú U��>RSPXu5GKLXUWJ I�aSI�bSU2îD\ bS\KJSUWJ

JSU�IDÄX��ËKÅ5Ç�a>b1GvuKUBkgU�UWJ�GK]S]SLNPXU�Tj\KJ�LNGKV�_ U8TSG,I�GqO�U�I�OWµ&\,I�b�U�V�G,]S]SV�\ G [bSUWO�b�GvuKU8k1UWU�JtI�UWO�I�U�T�aIxMZ]SPQ[�G,LNLNMKa$\KJ�O�YsGKLXLdTSG5IGnO�U�I�OWhy��bSPQO`PQO3kgUW[WG,R�O�Us\Kk&IG,PNJSPNJS_zO�R�PwIG,kSLNUjLNUWG,V�JSPNJS_ZÊ,[(\ J I�V�\ L

Page 31: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ³��]�GKV�GKY^U�I�UWV�Oie�\KV`�Bú8úBOWa�þD�BOWa��iÒ�a�G,J�T}Ò&� PQODT&PXás[�RSLXI`GKJ�T�I�bSU�PNVDU(p&UW[�R&I�PN\KJlI�PNY^U�ODG,V�UuKUWV�M�bSPN_Kbze�\KVHLNGKV�_ U.TSG5IG�O�U(IO�h`�B\5��UWuKU�V�a�PXIDb�GKO8k1UWU�J}O�bS\5�oJ�Äw��ê ÆvÇ$I�b1G5IHI�bSU�L>f�Y^U�G,J�OY;U(I�bS\&T}[�\KJZuKUWV�_ UWOBI�\nG�LN\Z[WG,LNLXMn\ ]&I�PNYsG,L�O�\KLNR&I�PX\ J�hs��bSPNODkgU�b1Gvu>PN\KV`PQODLNPXJS| UWT��oPwI�b}I�bSUPNJSPwI�PNGKL1O�U�U�T^O�U�LNUW[(I�PN\KJ^PXJ;I�bSU�L>f�Y;UWGKJ�OcG,LN_K\ V�PXI�bSY�h0ÒZ\�a Pwe�GD_K\Z\&TqPXJSPXI�PQG,L1]�G,V�I�PXI�PN\KJs[WG,J^k1U\KkSI�G,PNJSU�T��>RSPQ[|ZLXMjR1O�PNJS_jG,JZMj\Ke�I�bSU`\,I�bSU�V�I�UW[bSJSPQ�>RSUWOWa&I�bSU�J#L>f�Y;UWG,J1O���\ RSLNT��d\KV�|s��UWLXLU�u U�J�\KJ�]SV�\Kk�LXUWY;Oi�oPwI�bnLNGKV�_ UDT�G5I�GsO�U(IO�h�Ø!u U�J�I�bS\ RS_Kb�u5G,V�PN\KR�OoY;U�I�bS\&TSO8T&PNO�[(R1O�O�UWTyPNJI�b�PNO�O�UW[�I�PX\ JtG,V�Ui�dUWGK|ga>PXId��GKO�V�UWuKUWGKLXU�T^I�bSV�\KR�_KbjU�pZ]gU�V�PNY^UWJ>I�G,LgOxI�R�T&PNUWO�I�b1G5Id[�\KYqkSPXJ�PXJS_T&\ Y;GKPXJ�|ZJS\5�oLNUWT&_ U��d\KRSLQT~PNY;]SV�\5uKU�I�bSUWPXVs]gU�V�e�\KV�YsG,J�[�UKh��S\KV;U�p&GKY;]SLXU a��8úBúBOj��\ V�|kgU(I�I�U�VyPXJ¹[(LQGKO�O�PXe�MZPXJS_�PXYsG,_ UWOtV�UW]SV�U�O�UWJ>I�UWT�R1O�PNJS_~U�p>I�V�G [�I�UWT�e�UWG,I�RSV�UWOtI�b1G,J¿�oPXI�b¿VGv�PNY;GK_KU�OcG,J�TqbZM>k�V�PQTq[�LNG O�O�PXr�U�VO$��\ V�|3kgU(I�I�UWVcI�b�GKJ^�8úBú8OBÄX�WÌ Æ5Ç�h0ÒZPNY^PNLQG,V�LXM a,R�O�PXJS_`T&\ YsG,PNJ|ZJS\5�oLNUWT&_ U8I�\sbZM>k�V�PQT&PNm�U`GjþD�ÉPXY;]SV�\5uKU�OdPwIOi]gU�V�e�\KV�Y;GKJ�[(UsÄX��ZÜ�Ç�hcÒ&\�aSPXIBYsGvMjkgU`R�O�U�e�RSLPNJj_KUWJSU�VG,L�I�\.R1O�UBTS\KYsG,PNJj|ZJS\5�oLNUWT&_ UBG,LN\KJS_`�oPXI�byG,]S]�V�\>GK[bSU�OcLXPN|KUHþD�3aSÒ&�3aZ�Bú8ú3a&G,J1T�iÒ�h0�i\5�dU�u U�V�a�I�bSUWO�UtG,]�]SV�\>GK[bSU�Oj��O�]gUW[(PXr1[WG,LNLXM a{I�bSU�[(V�PwI�U�V�PNGye�RSJ1[�I�PN\KJ1O.R�O�UWT~PXJ�I�bSU�Yj�b�Gvu U�G`I�U�J1T&U�J�[�M.I�\`_KUWJSU�VG5I�U�G3]�G,V�I�PXI�PN\KJ;\,e�bZMZ]1UWV�O�]SbSUWV�PQ[�GKL�[(LNR�O�I�U�VO!GKJ�TqI�bSPQO�[�\KRSLQT^k1UG8LXPNY;PwIG5I�PN\KJ�h0��\KV0U(pSGKY^]�LXU a5PXJs[(LNR�O�I�UWV�f�k�GKO�UWT.T&\&[(RSY;U�J>IcV�U(I�V�PNU�u5G,L�a5PwI!��GKO{\Kk1O�UWV�u UWT`I�b�G5II�b�UHb�PXUWV�GKV�[bSPQ[�GKLgGKLX_ \KV�PwI�bSYsO�]gU�V�e�\KV�Y;UWT�k1U�I�I�U�V�I�b1G,J�I�bSUD]�GKV�I�PwI�PX\ J�G,L�G,LN_K\ V�PXI�b�Y;OHÄX��Æ&��Ç�h�Z# @K@ Q.-31~U[A�ÂBU[A�);9S+.-;4�C}USÁ ),+.-^E�U(-*C=9TA�),+.-;9=C�+.-^En]eN*C=9=<BA +.-*4�BO.GyI�GKO�|�a{[�LXR�O�I�UWV�PNJS_�PQO3O�R�k&îxUW[(I�PNuKU;PXJ�J1G5I�R�V�U hj��bSUjO�GKY;UjTSG5IGyO�U(I3YsGvMzJ�U�UWT}I�\�k1U]�GKV�I�PwI�PX\ JSUWT�T&Pw��U�V�U�J>I�LXM�e�\ V^T&PX��U�V�U�J>I^]�RSV�]g\ O�UWOWh~�S\ VqU�pSG,Y;]SLNUKa�[�\KJ�O�PNTSU�V;G"^»_S ,�X¢�adGKJ¢��X¢�Ï>_S ,¨�¥�agGKJ�TnGn¥�Ô&¨g ��!Ð�_�Äw��Å Ë5Ç�h�½�b�G,LNUWO8G,J�TyU�LNU�]�b�G,J>I�Oie�\KV�YùGj[�LXR1OxI�U�Vi\Ke�Ùs 5Ù^Ùs 5�¸Ð�h�i\5�dU�u U�V�a�PXeDI�bSUzR1O�UWVjPNOtPXJ>I�U�V�UWO�I�UWT�PNJ�]�G,V�I�PXI�PN\KJ�PXJS_}I�bSU�Y k�GKO�UWT�\ J�I�bSUl[�\KJ�[�U�]&Ij\Ke�#§�´�§�¨>©�§�¨l^� ,¥�¢�¦�acI�b�U�J��ob1G,LNUyGKJ�T�I�R�J�GzrgO�b�GKV�Uy[(LNR�O�I�U�V�UWT�I�\K_ U(I�bSU�V�h}��MZ]SPQ[�G,LNLNMKa0I�b�PNOO�RSk&îxUW[(I�PNuZPwIxM�PNODPNJ�[(\ V�]g\KVG5I�UWTlPXJ>I�\�I�bSUj[(LNR�O�I�UWV�PNJS_n[(V�PwI�U�V�PX\ JlkZMzPNJ�[(\ V�]g\KVG5I�PXJ�_yT&\ YsG,PNJ|ZJS\5�oLNUWT&_ U8PNJ�\KJSUD\KVoY;\ V�UD]Sb�G O�U�O�\,e0[(LNR�OxI�U�V�PXJ�_�hØ!uKUWV�My[(LNR�O�I�U�V�PNJS_�GKLX_ \KV�PwI�bSYýR�O�UWOHO�\KY;U`IxMZ]1Uq\,e!|ZJS\5�oLNUWT&_ U3U�PXI�b�U�VHPXY;]SLNPN[�PwI�LXM�\ VBU(pZf

]SLNPN[�PwI�LXM h���Y^]�LXPQ[(PXIq|ZJS\5�oLNUWT&_ U;]SLNGvM&O3G�V�\KLNUsPNJ¿�x���3O�UWLXU�[�I�PNJS_lG�]1G5I�I�U�V�J�V�UW]SV�UWO�U�J>I�G,I�PN\KJO�[bSU�Y;U.��¢W·¸©>·NaSR�O�PXJ�_3\KJSU ¼ O�]SV�PX\ V�U(p&]gU�V�PXUWJ�[(UiI�\qO�U�LNUW[(IdGKJ�T;U�J�[�\&T&Uie�U�G5I�R�V�U�O��(ag��ËK�![b�\>\>OxfPNJS_nG�O�PXY;PNLNGKV�PXIxMnY;UWG O�RSV�U���¢�·¸© ·Na$R�O�PXJS_�I�b�U�9zG,b�GKLNGKJS\Kk�PNOHT&PQOxIG,J�[�U^PNJ�O�I�U�GKTz\Ke�I�bSUsØ!R&f[(LNPQT&UWGKJ�TSPNO�I�GKJ�[(U^I�\n\ k&I�GKPXJ�bZMZ]1UWV�UWLXLNPN]�O�\ PNT�G,Lc[(LNR�O�I�U�VO��a{GKJ�T���Ì>�DO�UWLXU�[�I�PNJS_zGy_KV�\KR�]SPXJ�_O�[bSU�Y;Ut��¢W·¸©>·Na�O�]gUW[�Pwe�MZPNJS_jI�bSU�L>f�Y;UWGKJ�OiG,LN_K\ V�PXI�b�Yý�obSUWJzPwIHPNOB|ZJS\5�oJyI�b�G,IH[(LNR�O�I�UWV�O8G,V�UbZMZ]1UWV�O�]SbSUWV�PQ[�GKLQ�(h�FB\ YsG,PNJy|ZJS\5�oLNUWTS_KUDPNOiR�O�U�TyPXY;]SLNPN[�PwI�LXMyPNJz�BúBú8O�a�þD�BOWa1�iÒ�a1G,J�TnÒ&�I�\qO�UWLXU�[�I!I�bSUB[(\ J>I�V�\KL�ÊvLNUWG,V�JSPNJS_H]�G,VG,Y;U(I�U�V!u5GKLXRSU�O0I�b1G5I�G,�gU�[�I�I�bSUi]gU�V�e�\KV�YsG,J�[�Uo\,e�I�bSU�O�UG,LN_K\ V�PXI�b�Y;OWh��I.PNOqG,LQO�\n]g\ O�O�PXkSLNU;I�\lR�O�UtU(p&]SLNPN[�PwI�LXM�Gvu5G,PNLNGKkSLXUsT&\ YsG,PNJ�|>J�\5�oLXU�T&_KU^I�\�[(\KJ1OxI�V�GKPXJ�\KV

_KR�PNT&UiI�bSUH[(LNR�OxI�U�V�PXJ�_3]SV�\Z[�UWO�O�h0ÒZR�[btO�]gUW[(PQG,LNPNm�UWTs[�LXR1OxI�U�V�PXJS_qG,LN_K\KV�PXI�bSYsOcb�Gvu Uok1UWU�JjR1O�U�TPNJ~O�UWuKU�VG,L�G,]S]SLNPQ[�G5I�PX\ J�OWhyF8\KYsG,PNJ~[(\ J�[(UW]&I�Oq[�GKJ�]SLNGvM}O�UWuKUWV�GKL!V�\ LXU�O`PNJ�I�bSUy[(LNR�OxI�U�V�PXJ�_]SV�\&[(UWO�OWaSG,J�T�G^u5G,V�PXU�IxMj\,ec[bS\KPQ[(U�OoG,V�UHGvu5GKPXLQG,kSLNUHI�\;I�bSU`]SVGK[�I�PwI�PX\ JSU�V�h!�dIi\KJ�UHU�pZI�V�U�Y;UKaI�b�U^Gvu5G,PNLQG,kSLNU.T&\ Y;GKPXJ�[(\KJ1[(U�]SI�O8Y^PN_Kb>IHUWGKO�PNLXMnO�U�V�uKU.G O8GKJlGKTSTSPwI�PX\ J�G,L{e�UWG,I�RSV�U���\KVDO�UWu fU�VG,L���a{G,J�TlI�bSU;V�U�YsG,PNJ�T&UWVD\,e�I�bSUs]SV�\&[(UWTSRSV�U^Y;PX_ b>IDkgUs\,I�bSU�V��oPQO�U^RSJ�G,�gU�[�I�U�T�hs�dIDI�bSU\,I�bSU�VqU(pZI�V�U�Y;U a0TS\KYsG,PNJ~[(\ J�[(UW]&I�O.Y^PN_Kb>I^k1U�R�O�U�T}I�\l[�\KJ&r1V�Y \KVquKU(I�\lGzT&U�[(PQO�PN\KJ~GKV�fV�PXu UWTzG,I8PNJ�T&U�]gU�J1T&U�J>I�LNMnkZMnGsI�VGKTSPwI�PX\ J�G,L0[(LNR�O�I�U�V�PNJS_�GKLX_ \KV�PwI�bSY�a1\ VBR�O�UWTzI�\�G,�gU�[�I8I�bSU[(\ Y;]SR&I�G,I�PN\KJ�\,e�T&PQOxIG,J�[�U8PNJ�G^[(LNR�O�I�UWV�PNJS_qGKLX_ \KV�PwI�bSY»U�Y;]SLN\5MZPXJS_q]SV�\vpZPNY;PwIxM h$��b�U8PNJ�[(\ V�f]g\KVG5I�PN\KJt\,e{T&\ YsG,PNJj|ZJS\5�oLXU�T&_KUBPXJ>I�\;[(LNR�O�I�UWV�PNJS_q[�\KJ�O�PQOxIO�YsG,PNJSLNMs\,ed  £A_SÑ�Õ�G,]S]�V�\>GK[bSU�O�oPXI�btLNPXI�I�LNUHPXJy[(\KY;Y;\KJ�µ>G [�[(\ V�TSPXJS_ LXM aK\ RSVdTSPNO�[(R�O�O�PX\ Js\,e�I�bSUBPQT&UWG.�oPXLNL�[(\ J�O�PQO�I�YsG,PNJSLNM^\KeY;\,I�PXu5G5I�PX\ J�G,L$YsG5I�U�V�PNGKL$GKJ�TlGtkSV�PNU(edO�RSV�uKUWM�\Ke�]�G OxIH��\ V�|�hC9zGK[bSPNJSUqLXU�G,V�JSPXJ�_tV�UWO�UWG,V[bG,J1Tl]�G,I�I�U�V�J�V�UW[�\K_KJ�PwI�PX\ JlV�UWO�UWG,V[blPNJ>I�UWV�O�UW[(IDPNJ�I�bSPQODI�\ ]SPQ[�G,L!GKV�U�GSa�GKJ�TzI�bSUsPNJ I�U�V�UWO�I�U�T

Page 32: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

³�� � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

V�UWGKTSU�VsPQOjV�U(e�U�V�V�UWT�I�\�I�bSUz]SV�\KY;PNJSU�J>I`îx\KR�V�J�GKLNOjPXJ�YsGK[b�PXJSUnLNUWGKV�J�PXJS_¿��¢W·¸©>·Na�òl KÕO_Z§�¨�¢�{¢� ,¦�¨�§�¨Z©,a��&·0Ñ* �Å����8¢�Ð�¢ 5¦�ÕM_&a&\KV|Å8¦�¥�§ �dÕ(§� ,����¨1¥�¢����#§w©>¢(¨�Õ�¢���e�\KVoG.e�RSLNLXUWV�I�V�U�G5I�Y^UWJ>Id\Ke�I�b�PNOI�\ ]SPQ[,h�BO�T&\&[(RSY;UWJ I�UWTsPNJ�Ä Ë ÜvÇ�a>V�RSLXU�O�PNJ�GKJjU(p&]gU�V�I�O�M&OxI�U�Y»YsGvM;k1UD[(LNR�O�I�U�V�UWTsI�\.V�UWTSR�[(UBI�bSU

O�PXmWUi\,e�I�bSUB|ZJS\5�oLNUWT&_ Uok�GKO�UKh0��bSPQO�Y;\&T&PXr1[�G,I�PN\KJs\Ke�[�LXR1OxI�U�V�PXJS_.�dG O�G,LQO�\`U(p&]SLN\KV�UWT;PNJ;I�bSUT&\ Y;GKPXJ1O�\Ke{RSJ�PXu U�VO�PXI�PNUWOWaS[(\ JS_KV�UWO�O�PN\KJ1G,L�u \,I�PXJS_^V�UW[(\ V�T�O�a&G,J1TjI�U�V�V�\ V�PQOxIdU�u U�J>I�OdkZMlÄX�K�WÅ,Ç�hÆ&hN�K�KhN��Ä1§�Ù^§��X 5¦�§�¥�Ú í Ñ5ÙBÏgÔ&¥� 5¥�§�Ñ5¨�·8��\ J�[(UW]&I�R�GKLS|ZJS\5�oLNUWT&_ U���GKO0R�O�UWT^U�pZ]�LXPQ[(PXI�LNM.PNJ^I�bSU

O�PXY;PNLNGKV�PXIxM^[�\KY;]SR&IG5I�PX\ Jj]Sb�G O�U8PXJlÄX�WÌ>ËvÇ�h{��I���GKO�G O�O�RSY;UWTsI�b�G,I�I�b�U8]�G,I�I�U�V�JjV�UW]SV�UWO�U�J>I�G,fI�PN\KJ1O8�dU�V�UqGvu5GKPXLQG,kSLNUqGKJ�T�I�bSUsT&MZJ�G,Y;PQ[q[�LXR�O�I�UWV�PNJS_yG,LN_K\KV�PXI�bSY Ä ÍN�5Ç0��GKO8R�O�U�TnI�\�_ V�\ RS]]�G,I�I�UWV�J1O�h$��bSUd[�LXR1OxI�U�VO�e�\KV�Y;UWT`�dU�V�U�TSUWO�[(V�PXkgUWT`R1O�PNJS_8[�\KJ5îxR�J�[�I�PXu UdO�I�G,I�U�Y;UWJ IO�PNJ3]SV�UWTSPwf[�G,I�U�LX\ _KPQ[,h���I0��GKO�O�I�G,I�U�T3PNJ¤ÄX�vÜ5ë�µ&�WÌ>ËvÇKI�b�G5I$I�b�U�_ V�\ RS]SPNJS_ O�\Kk&IG,PNJSUWT`kZMHI�b�Ud[�\KJ�[�U�]&I�R�G,L[(LNR�O�I�UWV�PNJS_jG,V�U3O�RS]1UWV�PN\KViI�\sI�bS\ O�U`\Kk&IG,PNJSUWT�kZM�I�bSU.J>R�Y^UWV�PQ[�GKL�Y;U(I�bS\&TSOoe�\ VB[(LNR�O�I�U�V�PNJS_�h�¿[�V�PXI�PQ[�GKLSG,J�GKLXM&O�PNO0\Ke1I�b�G5I��d\KV�|.GK]S]1U�G,VO0PXJnÄ Ì Æ5Ç1G,J�T^PXI!�dG Oc\Kk1O�UWV�u UWT`I�b�G5I�Y^\ JS\,I�bSU(I�PN[T&PNuZPNO�PXu Uq[�LXR�O�I�UWV�PNJS_yG,LN_K\KV�PXI�bSYsO8_KU�J�U�VG5I�U^[(LNR�O�I�U�VOBI�b�G,ID[WG,JzkgUsT&UWO�[(V�PXkgUWTzk>Mz[�\KJ5îxR�J�[�fI�PNuKUqOxIG5I�UWY;U�J>I�OWhB�S\ VBU�p&GKY;]SLXU a1[�\KJ�O�PNTSU�V8�$PN_KRSV�U.ë�hi�S\KR�V8[(LNR�O�I�UWV�OBPXJ�I�bSPNOBr�_ RSV�U a�I�b�G5IG,V�UD\Kk&IG,PNJSUWT�R1O�PNJS_jG;Y;\KJS\KI�bSU�I�PQ[`G,LN_K\ V�PXI�bSY�a�[WG,J�kgU.T&UWO�[(V�PNk1U�T�kZM�R�O�PNJS_j[�\KJ5îxRSJ1[�I�PNuKU[(\ J�[(UW]&I�OoG OoO�b�\5�oJ�kgU�LN\5�`È

��LNR�OxI�U�V��KÈoÄ ó��¹G5Ç��æÄ � �æk&Ç��LNR�OxI�U�V�Ë&ÈoÄ ó��¹G5Ç��æÄ � ¥æk&Ç��LNR�OxI�U�VÌSÈoÄ ó ¥¹G5Ç��æÄ � ¥¹[(Ç��LNR�OxI�U�V�Í�ÈoÄ ó ¥¹G5Ç��æÄ � �¹[(Ç�a�obSUWV�U!��PQO�I�bSU�\d\Z\KLNUWG,J�[(\KJ,îxRSJ�[�I�PX\ J}�xº GKJ�T�¼¸��\K]gU�VG5I�\ VWaZG,J1TtGSa&k�G,J1Tt[HG,V�UH[�\KJ�O�I�GKJ IO�hÆ&hN�K�Kh¸Ë�Îo 5¥�¥�¢�¦�¨"�8¢�Ï�¦�¢(Ð(¢�¨�¥� 5¥�§�Ñ5¨�·o��I^�dG O.O�bS\5�oJ�PXJæÄX�vÜ,ê5Ç!I�b�G5I^kZM�R�O�PNJS_z|ZJS\5�oLNUWT&_ U

PNJ�I�bSUj]1G5I�I�U�V�J�V�UW]SV�U�O�UWJ>I�G5I�PX\ J�]�b�GKO�UKa$GKO`PQO`PNY^]�LXPQ[(PXI�LNM�T&\KJSUsPNJ�JZRSY;U�V�PN[WG,L0IG5p&\KJS\ Y.MG,]�]SV�\>GK[bSU�O�aZPXIiPNOi]1\>O�O�PXk�LXUDI�\s\Kk&IG,PNJtI�bSU.O�G,Y;UD]�G,V�I�PXI�PN\KJ�OoG OdI�bS\>O�U`_ U�JSUWV�G,I�U�TtkZM�[�\KJ&f[(UW]&I�R1G,Lo[(LNR�O�I�U�V�PNJS_�h}��J~I�bSPNO;O�U�J�O�UKa�[(\KJ1[(U�]SI�R�GKLd[�LXR�O�I�UWV�PNJS_}G,J�T�JZRSY;UWV�PQ[�GKL�IG5p&\KJS\ Y.MG,V�U3JS\KIHT&PQG,Y;U�I�V�PN[WG,LNLXMy\K]S]g\ O�PXI�UKagkSR&IDG,V�U3UW�>RSPNu5G,LNU�J>IWh8��JnI�b�Uq[�G O�U.\,e�[(\ J�[(UW]&I�R1G,L{[�LXR1OxfI�UWV�PNJS_1aZTS\KYsG,PNJj|ZJS\5�oLNUWT&_ UBPQO�U�p&]SLXPQ[(PXI�LNMsR�O�UWTtPXJyPXJ>I�U�V�]�G5I�I�U�V�JtO�PXY;PNLNGKV�PXIxMs[(\ Y^]�R&I�G,I�PN\KJ�a�obSUWV�U�GKO�PNJ3JZRSY;U�V�PN[WG,L5IG5p&\KJ�\KY.M8PwI$PNO�PXY;]SLNPQ[(PXI�LNMDG O�O�RSY;UWTHI�b�G5I$]�G5I�I�UWV�J`V�U�]SV�UWO�U�J>IG5I�PN\KJ1OG,V�UD\Kk&IG,PNJSUWT�R�O�PXJ�_qI�bSU3T&\ Y;GKPXJy|ZJS\5�oLNUWT&_ UKhÆ&hN�K�Kh Ì í �wÔZÐ¥�¢�¦Hß^¢�Ð�Õ�¦�§ Ïg¥�§�Ñ5¨SÐ�·8��MZ]SPQ[�GKLXLNMKagPNJz|ZJS\5�oLXU�T&_KU�f�k1GKO�UWT�[(LNR�O�I�U�V�PNJS_�a�kg\,I�bzI�bSU

[(LNR�O�I�UWV�O3GKJ�T�I�bSUWPXV^T&UWO�[(V�PN]&I�PN\KJ�O3\KV3[b�GKV�G [�I�UWV�PNmWG,I�PN\KJ�O;Ä Æ,ë,Ç�G,V�U;_KU�J�U�VG5I�U�T�h���b�U�V�UjG,V�UO�\KY;UtU�p&[�U�]&I�PX\ J�O�Ä Ü,ë5Ç��obSU�V�Uy\KJSLNM�[(LNR�OxI�U�V�PXJ�_�PQO^]1UWV�e�\ V�Y;UWT�G,J�T�JS\}TSUWO�[(V�PX]&I�PX\ J�O^G,V�U_KUWJSU�VG5I�UWT^U(p&]SLNPQ[(PXI�LNMKh0��Jt[(\ J�[(UW]&I�R1G,L1[�LXR1OxI�U�V�PXJS_jÄX�WÌ>ËvÇ�a G3[�LXR1OxI�U�V�\Ke�\Kk&îxU�[�I�O�PNO�T&UWO�[(V�PNk1U�TkZMjGq[�\KJ5îxR�J�[�I�PXu U8LN\K_ PN[WG,LgU(p&]SV�UWO�O�PN\KJ�h0Ø!u U�JsI�bS\KR�_Kb�G^[(\ J5îxRSJ�[(I�PNuKU`O�I�G5I�U�Y;U�J>I�PNOd\ JSU8\KeI�b�UHY;\>OxIo[(\ Y^Y;\ JyT&U�O�[�V�PN]&I�PXu Uie�\KV�YsOdR�O�U�TtkZMsbZRSYsG,J1O�a&PXIoPNO�G^LXPNY;PwI�UWTte�\KV�Y�h$��J�ÄX�WêKÅ,Ç�ae�RSJ�[(I�PN\KJ�GKL�|>J�\5�oLXU�T&_KU�\,eB\ k&îxUW[(I�Oq�dG O.R�O�UWT~I�\}_KUWJSU�VG5I�UjY;\KV�U�PNJ>I�RSPXI�PNuKUWLXM~GK]S]1U�G,LNPXJ�_[(LNR�O�I�UWV8T&U�O�[�V�PN]&I�PN\KJ1OoI�b1G5IBUWY^]�LX\5M�I�bSU�\d\>\ LXU�G,J�§�ÙBÏg�#§�Õ 5¥�§�Ñ5¨y\K]gU�VG5I�\KV�ho� O�M&O�I�UWYùI�b�G5IV�U�]SV�UWO�U�J>I�Os[�LXR1OxI�U�VOs]SV�\Kk�GKkSPXLNPQOxI�PN[WG,LNLXM~��GKOtT&UWO�[(V�PXkgUWT�PNJ Ä ÆKÅ5Ç�µoI�b�UWO�UlT&UWO�[(V�PN]&I�PN\KJ�OtG,V�UY;\KV�Uj_KUWJSU�VG,L�I�b�GKJ�[�\KJ5îxRSJ1[�I�PNuKUy[(\ J�[(UW]&I�OWacG,J�T�G,V�Uj��UWLXLXf�O�RSPXI�U�T�I�\�bSPNU�VG,V[bSPN[WG,L�[�LNG OxfO�Pwr1[WG5I�PX\ J�TS\KYsG,PNJ�On��¢�·¸©>·÷I�bSU�G,JSPNYsG,LBO�]1U�[(PNUWOsb�PXUWV�GKV�[bZMS��h¿� [�\KJ�[�U�]&I�R�G,L8[(LNR�OxI�U�V�PXJ�_O�MZO�I�UWY»PXJ��obSPN[b�[(LNR�OxI�U�V�PXJ�_3PNOdT&\ JSUir�VO�I�PQOdTSUWO�[(V�PXkgUWTsPNJlÄ Æ,ë,Ç�hc��bSU�O�UB[�LXR1OxI�U�VO�GKV�UoI�bSU�J

Page 33: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ³�³

cooking

heating liquid holding

electric ... water ... metallic ...

ä(jel*�BÔTÔ;��ä3d;k*s�gGjewTk3tEb�ûXk*w:��beh=r*lThT�T&U�O�[�V�PNk1U�T�R�O�PNJS_�]SV�\Kk�GKkSPNLXPXI�PNUWOWh¿� O�PNY;PXLQG,V�O�[bSUWY;Uy��GKOsTSUWO�[(V�PXkgUWT�PNJÉÄX�WÌ Å5Ç�a�kSRSIsI�bSUT&U�O�[�V�PN]&I�PN\KJ1OoG,V�U8LN\K_ PN[WG,L�U(p&]SV�UWO�O�PX\ J�O�I�b�G,I�UWY;]SLX\5Mtk1\KI�bn[(\ J5îxRSJ�[(I�PN\KJnG,J�T�T&PQO�îxRSJ�[�I�PX\ J�h�iJ^PXY;]g\KV�I�G,J>Ic[b�G,VGK[(I�UWV�PQOxI�PN[�\,e1[�\KJ�[�U�]&I�R�G,L&[�LXR�O�I�UWV�PNJS_HPNO{I�b�G5IcPXI0PQO$]1\>O�O�PNkSLXUdI�\8_ V�\ RS]

\KkSîxUW[�IOBV�U�]�V�U�O�UWJ I�UWT�kZMnkg\,I�b}�>R�G,LNPwIG5I�PXu U.G,J�T��>R�G,J>I�PXI�G,I�PNuKU.e�UWG5I�RSV�UWO8Pwe!I�bSU;[(LNR�OxI�U�V�PXJ�_LNUWGKT�O^I�\~G�[(\ J5îxRSJ�[(I�PNuKUz[(\ J�[(UW]&IWh¿��\KVsU�p&GKY;]SLXU a�I�bSUz[(\ J�[(UW]&I�Õ�¦�§�ÕMc ¢(¥s¡ 5���cY;PN_Kb>Isk1UV�U�]SV�UWO�U�J>I�U�TtG O

Ä [(\KLN\KV���V�U�TZÇ�}Ä O�b�GK]1U��æO�]SbSU�V�U�Ç�}Ä YsG,|KU|�¿LXU�G5I�bSU�V�Ç��}Ä VGKTSPXR�OU�Û�Kh Í;PXJ�[b�UWO�Ç%��obSUWV�U�V�G T&PXR1O�PQOyG��>R�GKJ I�PwIG5I�PXu Uze�UWG,I�RSV�U�G,J�T¿I�bSU}V�U�OxInG,V�U�GKLXLD�>R�G,LNPXI�G5I�PXu Uze�U�G5I�R�V�U�O�h��bSPQOsT&UWO�[(V�PN]&I�PN\KJ�PNO;R�O�UWT�I�\�T&U�O�[�V�PNkgU�G}[(LNR�O�I�UWVs\,eH[�V�PQ[|KU�I^k1G,LNLNOWh���JÉÄw�5Ü5ë,Ç�a�G}_ V�GK]Sb��I�bSUl_ \ GKL8T&UW]1UWJ�T&U�J1[(M�JSU(Ix�d\KV�|S�;��GKOjR1O�U�T�I�\�_ V�\ RS]¿O�I�V�R�[�I�RSV�U�T�\Kk&îxU�[�IO�h ��J¤Äw��êKÅ5Çe�RSJ�[(I�PN\KJ�GKL�|ZJS\5�oLNUWT&_ UH��GKO�R1O�U�TtI�\s_KV�\KRS]�YsG,J&f�YsGKT&U`\ k&îxUW[(I�OWh!�SRSJ�[(I�PN\KJ�GKL�|ZJS\5�oLNUWT&_ U��GKOcV�U�]SV�UWO�U�J>I�UWTqR�O�PNJS_3GKJ�T1Êv\ V0I�V�U�U�OiÄw�vÆKË5Ç�h0�S\ V!U(pSG,Y;]SLNUKaKI�bSUie�RSJ�[�I�PX\ JlÕÑWÑ�c5§�¨Z©,a&O�bS\5�oJPNJq�$PX_ RSV�UdËKËSa,[�GKJ3k1U�T&U�[(\KY;]g\ O�UWT`PNJ>I�\8e�RSJ�[(I�PN\KJ�O$LNPX| U�_�Ñ5�X£,§�¨>©�G,J1T�_S¢ ,¥�§�¨Z©�I�bSUdYsG5I�UWV�PQG,LPNJzGn�#§3��Ô&§�£`Y;UWT&PNRSY�hiØ�G [b�YsGKJ&f�YsG T&U3\KkSîxUW[�Iib1GKOBG;]�V�PNYsG,V�Mje�RSJ�[(I�PN\KJ�e�\ VB�obSPQ[bnPwI8PNO]SV�\&T&R�[(U�T�h��SRSV�I�bSUWVWa�k�GKO�UWT�\ J~PXI�Oqe�UWG,I�RSV�UWOqPwI;YsGvM}O�U�V�uKUyGKTSTSPwI�PX\ J�G,L�e�RSJ�[(I�PN\KJ�OWh}��\KVU(pSGKY^]�LXU aSGqkg\Z\K|jPQO�Y;UWGKJ I�e�\ VH¦�¢�  £5§�¨Z©,a1kSR&IiPXe{PXIiPNO�bSU�GvuZM;I�bSUWJyPXIB[�GKJyGKLNO�\^k1UDR�O�UWT�GKOGHÏ� �Ï�¢(¦C^�¢�§w©�_&¥�hc��J�Äw�5Ü5Å5Ç1\Kk&îxU�[�I�e�R�J�[�I�PX\ J�O��dU�V�UiR�O�UWTsI�\.[�\KJ�O�I�V�R�[�I�_KU�J�U�V�PN[oV�UW[�\K_ JSPwI�PX\ JO�MZO�I�UWYsO�hÆ&hN�K�Kh Í¿Îd¦� �©KÙs 5¥�§�Õ!�ÐÐ�Ô�¢�Ð�·i�BJZM�PNY;]SLXUWY;U�J>I�G,I�PN\KJn\,e!GjO�M&OxI�U�YýI�b�G,I8U(p&]SLNPQ[(PXI�LNM�PNJ�[(\ V�f

]g\KVG5I�U�O`T&\KYsGKPXJ�[(\ J�[(UW]&I�O3PXJ>I�\nGn[�LXR�O�I�UWV�PNJS_�I�UW[bSJSPQ�>RSUsb�G OHI�\zGKT�T&V�U�O�OHI�bSUse�\ LXLN\5�oPXJ�_PNY^]g\KV�I�GKJ>I�]�V�GK_KYsG5I�PN[HPQO�O�RSUWOWÈ�x�v�6goU�]SV�UWO�U�J>IG5I�PN\KJ�aZGvu5GKPXLQG,kSPNLNPwIxMjGKJ�T�[(\KY;]SLNU(I�U�JSU�O�O�\Ke0TS\KYsG,PNJy[�\KJ�[�U�]&IO�h��Ë �n��\KJ�O�I�V�R�[�I�PX\ Jt\Ke$PNJ&e�U�V�U�J1[(UWO�R1O�PNJS_^I�bSU`|ZJS\5�oLNUWTS_KUKh��Ì>�y�B[�[�\KY;Y;\&TSG5I�PX\ J�\Ke$[b�GKJS_KPNJS_^\KViT&MZJ�GKY^PQ[D|ZJS\5�oLNUWT&_ UKh��J�O�\KY;UjT&\ YsG,PNJ�O�a$[(\ Y^]�LXU�I�Us|ZJS\5�oLNUWT&_ UqPQO3Gvu5G,PNLNGKkSLNU^U�p&]SLXPQ[(PXI�LNMKhy�S\ V`U(pSG,Y;]SLNUKa�I�bSUÅ í ò í Ñ5ÙBÏgÔ&¥�§�¨>©��B¢�´W§�¢�^0Ð3[(LQGKO�O�PXr1[�G,I�PN\KJ�I�V�U�UsR�O�UWT�PNJ Äw��ÌKÅ5Ç!PQO.[�\KY;]SLNU(I�UtG,J�T}PQO`U(pZf

]SLNPN[�PwI�LXM}Gvu5G,PNLNGKkSLXUqe�\KV`R1O�U h^��J�O�U�u U�VG,L0T&\KYsG,PNJ�OWa�|ZJS\5�oLNUWT&_ UqPQO`PNJ�[(\ Y^]�LXU�I�UsG,J�T}PQODJS\,IGvu5G,PNLNGKkSLNU^U�p&]SLXPQ[(PXI�LNMKhn��MZ]SPN[WG,LNLXM a�YsGK[b�PXJSUsLNUWGKV�J�PXJS_�I�UW[bSJ�PN�>RSU�O3G,V�UsR�O�UWT�I�\lGKR&I�\ YsG5I�fPQ[�G,LNLNMlU(pZI�V�G [�I`|ZJS\5�oLXU�T&_KU a��obSPQ[b�PNO3GnTSPwáj[(R�LwIqGKJ�T}[b�G,LNLXUWJS_KPNJS_�]SV�\KkSLNU�Y�ht��b�UsY^\>OxI]SV�\KY;PNJSU�J>I�LNMlR1O�U�T�LXU�G,V�JSPXJ�_nY^U�I�bS\&T�PQO ö LXU�G,V�JSPXJ�_�e�V�\ YéU(pSGKY^]�LXU�O�ø�ÄX��Í>ë5Ç�h���bSPQO3PQO.GKJPNJ�T&R�[(I�PNuKU`LNUWG,V�JSPNJS_;O�[bSUWY;UHR1O�U�TtI�\sGK[��>RSPNV�UH|ZJS\5�oLNUWTS_KU8e�V�\ YýU(pSGKY^]�LXU�O�\,e{U�GK[by\,e{I�bSU[(LQGKO�O�UWO!PNJ�TSPw��U�V�U�J>IoT&\KYsG,PNJ�OWhcØ!uKUWJjPXe�I�bSUH|ZJS\5�oLNUWT&_ UiPNO�Gvu5G,PNLQG,kSLNUBU�pZ]�LXPQ[(PXI�LNMKaZPXIdPQO�T&Pwá;f[(R�LwI�I�\^r�J1Tt\ R&Id�ob�U(I�b�U�VoPXI�PQO�[(\ Y^]�LXU�I�U`G,J�T�O�\ RSJ�T�h!��RSV�I�bSUWVWaZPXI�PQO�U(pZI�V�UWY^UWLXMjTSPwáj[(R�LwI

Page 34: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

³ Ö � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

I�\�u U�V�Pwe�MzO�\KRSJ1T&JSUWO�O`G,J1T�[�\KY;]SLNU(I�UWJSUWO�OH\,ed|>J�\5�oLXU�T&_KU^U(pZI�VGK[(I�U�Tze�V�\KY ]SVGK[(I�PQ[�GKL0T�G5I�GO�U(I�Ojk1U�[�G,R1O�UnO�R�[b�|>J�\5�oLXU�T&_KU�[�GKJSJS\,IjkgUnV�U�]SV�UWO�U�J>I�U�T�PNJ�]SV�\K]g\ O�PwI�PX\ J�G,LoLN\K_ PN[Kh���IjPNO]g\ O�O�PNkSLNUBI�b�G5Iokg\,I�b�I�b�UDT�G5I�G^G,J1Tt|ZJS\5�oLNUWT&_ UB| U�U�]y[b�G,J�_KPNJS_.�oPXI�b�I�PNY;UKh!�S\ V�U(pSG,Y;]SLNUKaPNJtG`LNPXkSVG,V�MKa JSU���kg\Z\K|&O!Y;PN_Kb>I�_ U(I�G TST&U�TjG,J�TsO�\KY;Ui\ LNT;kg\Z\K|&O�Y^PN_Kb>I�kgU8TSU�LNU(I�U�T;e�V�\KYI�b�U^[�\KLNLXU�[�I�PN\KJn�oPXI�blI�PNY;UKhD�iLQO�\1a1I�bSU;[(LQGKO�O�PXr1[�G,I�PN\KJnO�MZO�I�UWY ��|ZJS\5�oLNUWT&_ U��oUWY;]SLX\5M UWT�kZMI�b�U`LXPNkSVG,V�MsPNOoR�]gTSG,I�U�T�]gU�V�PN\ZTSPN[WG,LNLXM h��YsG5îx\KVc]�V�\ kSLXUWY �oPXI�bs|ZJS\5�oLNUWT&_ U(f�k�GKO�UWTq[(LNR�O�I�U�V�PNJS_DPNO!I�b�G,I!PwI�b1GKOcJS\KI!k1UWU�JjGK]S]SLNPXU�T

I�\.LNGKV�_ UiTSG5IG3O�U�I�O�\KV!PNJtT&\ YsG,PNJ�O!�oPXI�bjLQG,V�_KUo|ZJS\5�oLNUWTS_KUok�G O�U�O�h0��MZ]SPQ[�GKLXLNMKaKI�bSU8JZRSY.kgU�V\,e�\KkSîxUW[�IOD_KV�\KRS]gUWT���GKOHLXU�O�O`I�b�GKJ��������yG,J1T�JZRSYqk1UWV`\,e�V�R�LXU�ODR�O�U�T�G O`G�]�G,V�I`\,e�I�bSU|ZJS\5�oLNUWT&_ Ut��GKOqLXU�O�OqI�b1G,J÷�����h���bSU�Y^\>OxIsT&PXáj[(RSLXIs]SV�\ kSLNU�Y PQO.I�\�R1O�U�Glu U�V�M�LNGKV�_ U|ZJS\5�oLNUWT&_ U3k�GKO�U`e�\ VH[�LXR�O�I�UWV�PNJS_j\ k&îxUW[(I�OBPXJ}O�UWuKU�VG,L�]SV�G [�I�PN[WG,L�]�V�\ kSLXUWYsOiPNJ�[(LNR�T&PNJS_�T�G5I�GY;PXJ�PXJS_1aSPNY;GK_KU`O�U�_KY;UWJ IG5I�PX\ J�a&G,J�T�T&\&[(R�Y^UWJ>I�V�U(I�V�PNU�u5GKL�h�Z# @ À�E}]eN*C=9=<,A +.-*4:WB)BAD4,<sCn);9:)§7[<~9=C��bSUWV�UnG,V�U�O�UWuKU�VG,LoGK]S]SLNPN[WG5I�PN\KJ1Oq�ob�U�V�UyPXIjPQOsJSUW[�UWO�O�GKV�M}I�\�[�LXR1OxI�U�VjG}LNGKV�_ Uy[�\KLNLXU�[�I�PX\ J\,e�]�G5I�I�U�V�J�OWh.��bSU;T&U(r1JSPwI�PX\ J�\KeBº LNGKV�_ UK¼gb�GKO8u5G,V�PXU�T���G,J�T��oPXLNLc[(\ J I�PXJZRSUqI�\�T&\�O�\Z�i�oPXI�b[b�GKJS_KU�O3PNJ~I�U�[bSJS\ LX\ _KM���¢�·¸© ·Na�Y^UWY;\KV�M}GKJ�T�]SV�\&[(UWO�O�PXJS_zI�PNY^Uv��h���J�I�bSU}�WÅKêN�KOWa�º LQG,V�_KUK¼Y;UWGKJ IDO�UWuKUWV�GKL�I�bS\ R�O�G,J�T�]�G,I�I�U�V�J�OqÄX��Æ>Ü�Ç�µ�JS\5�`a1I�b�U�V�UqG,V�U.GK]S]SLNPN[WG5I�PN\KJ1Oi�obSUWV�U3Y;PNLXLNPN\KJ�O\,e�]�G5I�I�U�V�J�OH\,e�bSPX_ b�T&PNY;U�J�O�PN\KJ�GKLXPXIxMnb�GvuKU.I�\yk1Us[�LXR�O�I�UWV�U�T�h3�S\ VDU(pSG,Y;]SLNUKagI�\�O�U�_KY;UWJ IG,JnPNYsG,_ U3\,e!O�PXmWU^Æa�N��7zÆa���;]�Pwp&U�LQOWa�I�bSU.JZRSYqk1UWVB\,e!]�Pwp&U�LQOoI�\jkgUq[(LNR�O�I�UWV�U�T�PNODËKÆ��Sa ������h��J�T&\&[(RSY;U�J>IoV�U(I�V�PNU�u5G,L�G,J1TtPNJ&e�\KV�YsG5I�PX\ Jtr�LXI�UWV�PNJS_1a>Y;PNLXLNPN\KJ�O�\Ke{]�G,I�I�UWV�J1O��oPwI�byG;T&PNY;U�J&fO�PX\ J�G,LNPwIxM�\Ke8Y;\KV�UyI�b�GKJ¹������b�GvuKU�I�\�kgUn[(LNR�OxI�U�V�UWT�I�\�GK[b�PXUWuKU�TSG5IG�GKk�OxI�V�G [�I�PX\ J�h��YsG5îx\ V�PXIxMt\Ke$I�bSUqGK]S]SV�\ G [bSUWOoGKJ�TzG,LN_K\ V�PXI�b�Y;Oi]SV�\ ]1\>O�U�TyPXJnI�bSU.LNPXI�U�VG5I�RSV�U3[�G,J�JS\,IBb1G,J&fT&LNU`O�R�[b�LNGKV�_ UHT�G5I�G^O�U(I�OWh!�i]�]SV�\>GK[bSU�O�k1GKO�UWTj\ J�_ U�JSU�I�PQ[8GKLX_ \KV�PwI�bSYsO�a>IG,kSR�O�U�G,V[btG,J1TO�PXYqRSLNG,I�U�T}GKJSJSU�G,LNPXJS_zGKV�U;\ ]&I�PNY;PXm�G5I�PN\KJ}I�UW[bSJSPQ�>RSUWO.G,J�T�GKV�U;V�UWO�I�V�PN[(I�UWT�I�\nV�U�GKO�\KJ�GKkSLXMO�Y;GKLXL$TSG5IGsO�U�I�OWho��Y;]SLXUWY;U�J>I�G,I�PN\KJ�OB\,e![(\ J�[(UW]&I�R�GKL{[�LXR�O�I�UWV�PNJS_s\ ]&I�PNY;PXmWU.O�\ Y;U.[(V�PwI�U�V�PX\ Je�RSJ�[(I�PN\KJ�OBG,J�TyG,V�UHIxM>]�PN[WG,LNLXMt[�\KY;]SR&IG5I�PX\ J�G,LNLXMtU(p&]1UWJ�O�PXu UKh��bSU�[�\KJZuKUWV�_ U�J>I L>f�Y;U�G,J�OqG,LN_K\KV�PXI�bSY G,J�T�PXI�O^�Bú8úàU�� R�PXu5G,LNU�J>I�a0I�bSU6îD\KbS\ JSU�J�JSU�IWa

b�Gvu U8kgU�UWJnR�O�U�TjI�\j[(LNR�O�I�U�VoLQG,V�_KUDTSG,I�G;O�U�I�O3ÄX��ËKÅ5Ç�hc��bSUDV�U�GKO�\KJ�OdkgU�bSPNJ�TyI�b�U`]1\ ]SRSLQG,V�PwIxM\,e$I�b�U L>f�Y;U�G,J�O�G,LN_K\ V�PXI�b�YýG,V�UKÈ�x�v����I�O;I�PXY;Ul[�\KY;]SLNU(p&PwIxM�PNO~Í;��5�L°=���ao�obSUWV�U:5ÉPNOsI�bSUzJZRSYqk1UWVj\,eD]�G,I�I�UWV�J1O�a�L�PNOsI�bSU

J>R�Y.kgU�V3\Ke�[�LXR�O�I�UWV�OWa{GKJ�TG=dPNO3I�bSUsJZRSYqk1UWV.\KedPXI�UWV�G,I�PN\KJ�OHIG,|KUWJ�k>MlI�bSU�G,LN_K\KV�PXI�bSYI�\t[�\KJZuKUWV�_ UKhi��M>]�PN[WG,LNLXM a.LnGKJ�T#=!GKV�U3rSp&UWTnPNJ�G T&u5G,J�[�U.G,J�TlO�\sI�bSU;G,LN_K\KV�PXI�bSYùb�GKOLXPNJSUWGKVdI�PNY^Uq[(\KY;]SLNU(p&PXIxMjPNJtI�bSU3O�PNm�U`\Ke�I�bSU3TSG5IG;O�U�I.Ä Ì ë5Ç�h

��Ë ����I�O�O�]1GK[(UH[(\ Y^]�LXU�pZPXIxMsPQO@Í;�%L��À5��(h0��I�V�UW�>RSPNV�UWO�G TST&PXI�PN\KJ�GKL�O�]�G [(U8I�\;OxI�\KV�UiI�bSUHT�G5I�GY;G,I�V�Pwp�h���I$PNO{]g\ O�O�PNkSLNUcI�\HOxI�\KV�U0I�bSUdTSG5IGiYsG5I�V�PXpHPNJ.GiO�UW[�\KJ�T�G,V�MBY;U�Y;\KV�MDG,J�T`G [�[(U�O�OUWGK[b�]�G5I�I�UWV�J�k�G O�U�Tt\ J�JSUWUWT�h!�B\5��UWuKUWVWa I�bSPQOiO�[bSU�Y;UDV�UW�>RSPNV�U�OdG^bZRS_ UDG [�[�UWO�O�I�PXY;Uk1U�[�G,R1O�U�\,e&I�b�U�PXI�UWV�G,I�PNuKU�J1G5I�R�V�U�\,eSI�bSUdGKLX_ \KV�PwI�bSYÉG,J�TqGKO$GB[(\ J�O�UW�>RSU�J1[(U!]SV�\&[(U�O�O�PXJ�_I�PNY^U`PNJ�[�V�U�GKO�UWOdU�JS\ V�Y;\ R�O�LNMKh

��Ì>����I{PQO�\ V�T&UWV�f�PNJ�T&U�]gU�J1T&U�J>IWµve�\ V$GB_KPNuKUWJ`PXJSPXI�PQG,L&O�U�U�T3O�U�I{\Ke�[(LNR�OxI�U�V0[(UWJ I�U�VO�avPXI{_ U�JSUWV�G,I�UWOI�bSU;O�GKY;U.]�GKV�I�PwI�PX\ Jl\,e�I�bSU;TSG5IGjPNV�V�UWO�]gUW[�I�PXu U.\Ke!I�bSU^\KVT&UWV8PNJl�obSPQ[bzI�bSU^]�G5I�I�U�V�J�OG,V�U8]SV�UWO�U�J>I�UWTtI�\;I�b�U3G,LN_K\KV�PXI�bSY�h

�i\5�dU�u U�V�avI�bSUIL>f�Y;U�G,J�OcGKLX_ \KV�PwI�bSY PQO!O�UWJ�O�PwI�PXu U�I�\`PNJSPwI�PNGKL�O�U�UWT;O�U�LNUW[(I�PN\KJsG,J�T^UWuKU�J;PNJ^I�bSUkgUWO�IB[�GKO�UKa&PXIB[�GKJ�]�V�\&T&R�[�UD\KJSLNMjbZMZ]1UWV�O�]SbSUWV�PQ[�GKL�[(LNR�OxI�U�VO�h�iPNU�VG,V[bSPN[WG,L!GKLX_ \KV�PwI�bSYsO`G,V�UsY^\ V�U;u U�VO�G,I�PNLXU h~\dR&I3I�bSU�M}b�GvuKU^I�bSUse�\KLNLN\5�oPXJS_zTSPNO�GKTZf

u5G,J>I�GK_KU�O�È

Page 35: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ³�ì

�(tEz;behLÞT�þaMwT|_o;beh=�qj g���wEx�acbed*fPgPh=iGjek*lLÅ�belTwTiGj gPm*|_facbed*fPgPh=iGjek*l ��je|_hnacwT|_o*beh��qj g�� �qo*tEs:h&acwT|_o*beh��qj g��Å�belTwTiPj gGm*|beh:tEr*h=i #�y Ô%$�� #�y Ô3�Ôq��|_h:tEk*f #�y&$�Ô('K� #�y Ô3�  �*ù}��Å���Å #�y&$�Ô('K� #�y Ô3�fGm*wTi gGh=f g�fPo3tEk*k*jek;l_o3tSgGm #�y&$*)T� #�y&$��fGjek*lTbeh���bejek;û #�y&$ ) bewTl+$[� #�y&$ ) �s=wT|_o*beh�gGh���bejek*û #�y&$*)[bewTl+$[� #�y&$*)T�

�x�v�y��bSU0I�PNY;U�[(\ Y^]�LXU�pZPXIxMB\Ke>b�PXUWV�GKV�[bSPQ[�GKL5G,_K_ LX\ Y;U�VG5I�PNuKU0G,LN_K\ V�PXI�b�Y;O�PQO�Í;�35 k LN\K_�5��0ÄX�K�5Ü�Ç�h��I�PNO!]1\>O�O�PXk�LXU�I�\3\Kk&IG,PNJsO�PNJS_KLNU(f�LNPXJS|^[(LNR�O�I�U�VOcR�O�PNJS_.G,J�9lÒS��\Ke�I�bSUBT�G5I�G�aK�obSPQ[bs[�GKJk1U3[�\KJ�O�I�V�R�[�I�UWT�PXJ#Í;�35HLN\K_ k 5���I�PNY;UDe�\KV�Ix�d\,f�T&PNY^UWJ�O�PX\ J�G,L�TSG,I�G�Ä ÌN�5Ç�h

��Ë �y��bSUtO�]�GK[�Uj[(\KY;]SLNU(p&PXIxMl\KeoGK_K_ LX\ Y^UWV�G,I�PNuKU;G,LN_K\ V�PXI�bSYsO`PQO2Í;�35 k �(hn��bSPNO.PNO.k1U�[�GKR�O�UGtO�PXY;PNLNGKV�PXIxM�Y;G,I�V�Pwpn\Ke�O�PNm�U25"7�5�b�G OBI�\tkgUsOxI�\KV�UWT�hD��\�[(LNR�O�I�UWV8UWuKU�V�My]SPwp&UWL$PNJ�G����07������yPXYsGK_KUKa$G,]S]�V�\vp&PNY;G,I�UWLXM�Ë����yY;U�_>G,kZM>I�UWOD\Ke�O�I�\ V�GK_KU^��\ RSLQT�kgUjV�UW�>RSPNV�U�T��GKO�O�RSJSPNJS_qO�PXJ�_KLNU(f�]SV�U�[(PQO�PN\KJ�OxI�\KVG,_KUB\,e{O�PXY;PNLNGKV�PXI�PNUWO��h0��IoPQO�]g\ O�O�PXkSLNU8I�\;[(\KY;]SRSI�U8I�bSUU�J>I�V�PXU�OD\,e�I�b�PNO.Y;G,I�V�Pwp}k�GKO�UWT}\ J}J�U�UWT�PNJ�O�I�U�GKT}\,eiO�I�\KV�PNJS_yI�bSUWY ��kSR&I3I�bSPNO.��\ RSLQTPXJ�[�V�U�GKO�UBI�bSU3G,LN_K\ V�PXI�b�Yy¼ O�I�PNY;U3[(\KY;]SLNU(p&PXIxMlĸÜ�Ç���h

�{GKkSLXUy�^LXPQOxIOHI�bSU^I�PXY;UsG,J�T�O�]1GK[(U;[(\ Y;]SLXU�p&PwI�PXU�O8\Ke�O�U�uKUWV�GKL{�dU�LNLXf�|ZJS\5�oJlGKLX_ \KV�PwI�bSYsO�h�iUWV�U a°5lPQO�I�b�U`J>R�Y.kgU�Vo\,e$]�G5I�I�UWV�J�OdI�\;k1U3[�LXR�O�I�UWV�U�T�a>L�PNOdI�bSU`JZRSY.kgU�Vo\Ke$[�LXR�O�I�UWV�OWaSG,J1T=$PNOoI�bSU`JZRSYqk1UWVo\,e{PXI�UWV�G,I�PN\KJ�OWh��]1\>O�O�PNkSLXU!O�\KLNR&I�PX\ J8I�\�I�bSU�]SV�\ kSLNU�Yæ\KeZ[�LXR1OxI�U�V�PXJS_oLQG,V�_KU0TSG,I�GoO�U(I�O��obSPXLNU!\ JSLXM8YsG,V�_KPNJ�G,LNLXM

O�GK[(V�PXr1[(PNJS_3I�bSU`uKUWV�O�G5I�PXLNPXIxM^\Ke$[�LXR�O�I�UWV�OdPQOdI�\^PXY;]SLNU�Y;UWJ IiY;\ V�UHU(áj[(PNU�J>Iou5G,V�PNGKJ>I�O�\,e$[�LXR1OxfI�UWV�PNJS_nG,LN_K\ V�PXI�b�Y;OWh;�¤bZMZkSV�PNT}G,]�]SV�\>GK[b��dG O8R1O�U�TlPNJ�Äw�vÆ Ü�Ç�a��obSUWV�UsG�O�U�I`\,e�V�U�e�U�V�U�J�[�U]g\KPNJ IO�PQO�[b�\ O�U�JjGKO�PXJ;I�bSUILZf�Y;UWGKJ�O�GKLX_ \KV�PwI�bSY¤GKJ�TsU�GK[bs\,e�I�bSUBV�U�YsG,PNJSPNJS_.TSG,I�G`]g\KPNJ>I�OPQOsGKO�O�PN_KJSU�T�I�\�\ JSU�\ V;Y^\ V�UyV�U(e�U�V�U�J1[(Uy]1\ PXJ>I�O;\ Vs[(LNR�OxI�U�VO�h�9nPXJ�PXYsG,LiO�]�GKJSJSPNJS_lI�V�UWUWO�39�Ò&�i�BGKV�U.\Kk&IG,PNJSUWT�e�\ V8U�GK[bn_ V�\ RS]n\,e!]g\KPNJ>I�OHO�UW]�G,VG5I�U�LNMKhB��bSU�O�U�9lÒ&�oOHG,V�U.Y;U�V�_KU�TI�\qe�\KV�YàG,JyG,]S]�V�\vp&PNY;G,I�U8_KLN\Kk�GKL�9lÒS�DhS��bSPNO�GK]S]SV�\ GK[b�[(\KY;]SRSI�UWO�O�PXY;PNLNGKV�PXI�PNUWOdkgU(Ix�dU�UWJ\KJ�LXM�Gne�VGK[(I�PN\KJ~\Ke8G,LNLd]1\>O�O�PXk�LXU�]�G,PNV�Oq\,ei]g\KPNJ>I�OWh���I^��GKOqO�bS\5�oJ~I�b�G,IqI�bSU�JZRSYqk1UWVq\KeO�PXY;PNLNGKV�PXI�PNUWOq[(\KY;]SRSI�UWT�e�\KVt���Sa ���N��]1G5I�I�U�V�J�O3R1O�PNJS_nI�bSPNO^G,]�]SV�\>GK[b}PNO.I�b�U�O�G,Y;UtGKO`I�bSUI�\KI�GKL�JZRSY.kgU�VH\,ec]�GKPXVOi\Kec]1\ PXJ>I�O8PNJlGj[(\ LXLNUW[(I�PN\KJn\Ke!ËSa �N���;]g\KPNJ>I�OWh|goU(e�UWV�UWJ�[(U�Äw�5Ü�Ç$[�\KJ&fI�GKPXJ1OHGKJlG,LN_K\ V�PXI�b�YùI�b�G5I`[�GKJl[(\ Y;]SR&I�U;G,J}G,]S]�V�\vp&PNY;G,I�U 9�Ò&�ÛPNJÀÍ;��5DLN\K_�5��oI�PXY;UKh3�O�[bSU�Y;U^I�\n_ U�JSUWV�G,I�U;G,J�G,]S]�V�\vp&PNY;G,I�U;T&U�J1T&V�\ _KVG,Y PNJ�[(V�U�Y;UWJ IG,LNLXMlPXJ"Í;��5DLN\K_�5��8I�PXY;U��GKO$]SV�UWO�U�J>I�U�T3PNJyÄ Ëa� Ì5Ç�a��ob�PXLNU`Äw��ëKë5Ç&]SV�\K]g\ O�UWO$G,J^G,LN_K\ V�PXI�bSYÉI�\HO�]gU�UWTqRS]qI�bSU���Ò�èHFB�c�{�[(LNR�O�I�UWV�PNJS_sG,LN_K\ V�PXI�bSY�h!� O�I�R1T&Mt\Ke{I�bSU.G,]�]SV�\vp&PNYsG5I�UDO�PXJS_ LXU�f�LNPNJS|5G,_KU`[�LXR�O�I�UWViG,J�GKLXM&O�PNO�\KeLQG,V�_KU`TSG5IGsO�U�I�OB�dG O�V�UW]1\ V�I�UWTyPXJ~Ä ÆKË5Ç�hd��JyI�b�G,IB�d\KV�|ga1G,JnG,]S]�V�\vp&PNY;G,I�U�9lÒ&�÷��GKOoR1O�U�TI�\^e�\ V�Y¾O�PNJS_KLNU(f�LNPXJS|�[(LNR�OxI�U�VOd\,ecG^T�G5I�G;O�U(Ii\Ke0O�PXmWUDÍN�Sa ���N�Sh��bSU�U�Y;U�V�_KPNJS_�T&PQO�[�PX]�LXPNJSU�\,esTSG,I�G�Y;PXJ�PXJS_ ��T&PQO�[�R�O�O�UWTÉG OzG,JÉG,]S]�LXPQ[�G,I�PN\KJÉPXJ ÒZU�[�f

I�PN\KJ�êSh Í>�ob1GKOHO�]SR�V�V�UWTyI�bSU^TSU�uKUWLX\ ]SY;U�J>IB\Ke!JSU�� GKLX_ \KV�PwI�bSYsO�e�\KVD[(LNR�O�I�UWV�PNJS_tLQG,V�_KU3T�G5I�GO�U(I�OWhq���d\�G,LN_K\KV�PXI�bSYsO8\,e�J�\,I�UsGKV�U.I�bSUt�X}���gi�BúHÒ}G,LN_K\KV�PXI�bSY T&UWuKUWLX\ ]1U�TzkZMzúi_nG,J1T�BGKJ�ÄX��Í1�(Ç!G,J1TzI�bSU�\��*gi�d�»G,LN_K\ V�PXI�b�Y ]SV�\ ]1\>O�U�TzkZM-,gb�GKJS_�¢(¥D 5�X·�Ä Ë�� Ë5Ç�hs�X}��|gB�Bú8Ò����LNR�O�I�UWV�PNJS_�}{G,V�_KU!�B]S]SLNPN[WG5I�PN\KJ1O�k�G O�U�T`\KJ2gi�Bú8T&\KY ÒZU�G,V[b1��PQT&U�J>I�PXr�U�O$[WG,J�TSPNTSG,I�U�[�LXR1OxfI�UWVB[(UWJ>I�V�\KPQTSOdI�bSV�\KR�_KbnG,J�GKLXM&O�PNO�\Ke$V�U�]gUWG,I�U�T�VG,J1T&\KYýO�G,Y;]SLNUWOoe�V�\ YàI�b�U3\KV�PX_ PXJ1G,L�TSG5IGSh\dUW[WG,R�O�U�\KeiI�b�UyR1O�Uy\,eHV�GKJ�T&\KYÿO�G,Y;]SLNPNJS_�acI�bSUyI�PNY;U�[�\KY;]SLNU(p&PXIxM�PNO�Í;��5��qe�\ VsGl]�G,I�fI�UWV�J�O�U(I3\Ke�5�U�LNU�Y;U�J>I�OWht��bSU�\d�*gi�d�»G,LN_K\ V�PXI�bSY �3\�G,LQG,J�[�UWT���I�UWV�G,I�PNuKU�goUWTSR�[(PNJS_zG,J1T��LNR�OxI�U�V�PXJ�_>�$OxI�\KV�UWOcO�RSY;YsG,V�M`PXJ&e�\ V�YsG,I�PN\KJ;G,kg\KR&I�[WG,J�T&PQTSG,I�Uo[(LNR�O�I�U�VO0PNJ;GDT&MZJ�GKY;PN[�I�V�U�U

Page 36: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

³�ü � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

�(tEz*beh�Ô;�ñ�d;|�zBh=i�wEx���jef g�tEk;s:h acwT|_o*d;gGtSgPjewTk*f�y&$��}xKwTi?gPm*h�fGjek;lTbeh=�Dbejek*û�s=bed*fPgPh=iGjek*l�tEbelTwTiPj gGm*| tEk*r0tg��MwE��beh�p~h=b[r*j pqjer*h?tEk*r s=wTk*�qd;h:i�tEbelTwTiGj gPm*|V�$ fGjek*lTbeh���bejek;û o g��MwE��beh�p~h=b

Þ:øTø Ä*{ óT¡Tø ¡ Þ:ÔTøTø¡TøTø Þ:ÔEÄ*{ öE¡Tø ÔTø Þ:ø;{ öE¡TøÞ:øTøTø Ä~óTó;{ ¡TøTø Ä~ø ¾;ÞT{ ¡TøTøÞ:ø;{ øTøTø Ä~ó;{ óTóT¡;{ øTøTø Þ:øTø ÞT{ ø;Þ:¾;{ öE¡Tø

TSG,I�G3O�I�V�R�[�I�RSV�UKh0��bSPNO!I�V�U�U8bSPXUWV�GKV�[b�PN[WG,LNLXM3\ V�_>G,JSPNm�U�O$I�bSUH[(LNR�O�I�U�V�PNJS_ OcV�U�]�V�U�O�UWJ I�UWT;G5I�I�bSULNUWG5e!J�\ZTSUWOWhi��bSU3I�V�UWUq[�GKJnk1UqV�UWkSRSPNLwIH�obSU�J�G;I�bSV�UWO�bS\ LNTnO�]1U�[(PXe�MZPXJS_y[(LNR�O�I�U�VHO�PNm�U.PNO8RS]&fTSG,I�UWT;YsGKJ>R1G,LNLXM aK\KVc�ob�U�JsY;U�Y;\KV�Mq[�\KJ�O�I�VG,PNJ>I�O0e�\ V�[�UiG`[b�G,J�_KUoPNJ;I�bSPQOcI�bSV�U�O�b�\KLQT�h$��b�PNOG,LN_K\ V�PXI�b�Yya LXPN|KU8�X}{�|gi�8ú8Ò�aZb�G O!GDI�PXY;U8[�\KY;]SLNU(p&PXIxM.LNPXJSU�G,V!PNJsI�bSUiJZRSY.kgU�V�\,e�]�G,I�I�UWV�J1O�h��bSUlG,LN_K\ V�PXI�b�Y;OtT&PNO�[(R1O�O�UWT�G,kg\5uKUn�d\KV�|�\ J�LNGKV�_ UzTSG5IG~O�U�I�OWa��obSU�V�UzPXItPNOt]1\>O�O�PNkSLXU

I�\�GK[�[�\KY;Y;\&TSG5I�UqI�bSUtUWJ>I�PNV�Us]�G,I�I�U�V�J�O�U(IqPXJ�I�bSUjYsG,PNJ�Y;U�Y;\KV�MKh��i\5�dU�u U�V�a�I�bSUWV�U�G,V�UG,]�]SLXPQ[�G,I�PN\KJ�O{�obSUWV�U�I�bSUdU�J>I�PNV�U�TSG,I�GBO�U(Ic[�GKJSJS\KI{kgUdO�I�\ V�U�T`PXJ.I�bSUdYsG,PNJ3Y;U�Y;\KV�MDk1U�[�GKR�O�U\,e{PwIOdO�PNm�UKhc��\KVdU(pSG,Y;]SLNUKa>I�\;O�I�\KV�U8GqY;PXLNLNPX\ Jt]�G,I�I�UWV�J1O�aZUWG [bj�oPXI�bl�����3e�UWG5I�RSV�UWOWa>GqYsG,PNJY;U�Y;\KV�M�O�PNm�U�\,e3�����nY;U�_>G,kZM>I�U�O3PQOqV�UW�>RSPNV�UWT��obSPQ[b�PQO.J�\,I^Gvu5GKPXLQG,kSLNUt\ J~Y;\ O�Iq\KeoI�bSUU(p&PQOxI�PXJ�_�[�\KY;]SR&I�U�VO�h¿��b�U�V�U�GKV�Un[�RSV�V�U�J>I�LXM�I�bSV�U�U�]1\>O�O�PNkSLXUzGK]S]SV�\ G [bSUWO.I�\~O�\KLNuKUyI�b�PNO]SV�\KkSLNU�Y�h

�x�v�y��bSUD]�G5I�I�U�V�J�O�U(Ii[WG,Jyk1U`O�I�\KV�UWTtPXJnG^O�U�[(\ J�TSG,V�M;Y;U�Y;\KV�MtG,J1TtO�RSk�O�U(I�O�\Ke�I�bSPNOoT�G5I�G[(LNR�OxI�U�V�UWTsPNJ�T&UW]1UWJ�T&UWJ I�LXM aZe�\KLNLX\5�dUWT;kZMjG.Y^UWV�_ PXJ�_qO�I�U�]jI�\^M>PNU�LQTtGq[(LNR�O�I�U�V�PNJS_.\Ke�I�bSUU�J>I�PNV�UD]�G,I�I�U�V�JyO�U(I�hc½�U3[WG,LNL�I�bSPQOiG,]�]SV�\>GK[btI�bSUt£,§�´W§�£ ¢s 5¨g£�ÕÑ5¨���Ô�¢�¦dGK]S]SV�\ GK[b�h

��Ë �y�iJ�PNJ�[(V�U�Y;U�J>IG,L�[�LXR�O�I�UWV�PNJS_zGKLX_ \KV�PwI�bSY [WG,J�k1U�U�Y;]SLN\5MKU�T�hy�BU�V�UKa{I�bSUtU�J>I�PNV�UjT�G5I�GY;G,I�V�PwpyPNOBOxI�\KV�UWTyPXJzGsO�UW[�\KJ�T�G,V�MjY;U�Y;\KV�M�GKJ�TnTSG5IG;PwI�U�YsOBGKV�UDI�V�GKJ�O�e�U�V�V�U�TjI�\;I�bSUY;GKPXJsY;UWY^\ V�Mq\KJSUiG,I�GDI�PXY;Uie�\ V�[(LNR�O�I�UWV�PNJS_�h!è8JSLNM.I�bSUB[�LXR�O�I�UWV�V�U�]SV�UWO�U�J>IG5I�PN\KJ1OcG,V�UOxI�\KV�UWTjPNJyI�bSU`YsGKPXJ�Y;U�Y;\KV�MsI�\;GKLXLNU�uZPQG5I�U8I�bSU3O�]�GK[�UHLNPNY^PXI�G,I�PN\KJ�OWh

��Ì>�y� ]�GKV�GKLXLNU�L{PXY;]SLNU�Y;U�J>IG5I�PN\KJl\,e�Gj[�LXR1OxI�U�V�PXJS_yG,LN_K\ V�PXI�bSY¾YsGvM�kgU^R�O�U�T�hH½�U^T&PNO�[(R1O�OI�bSU�O�U`G,]�]SV�\>GK[bSU�OdPXJ�I�bSU`J�U(pZIoI�bSV�U�U3O�RSk�O�UW[(I�PN\KJ�OWh

Æ&hN��Ë&hN��ß3§�´�§�£K¢� 5¨g£ í Ñ,¨���Ô�¢(¦AÅ�Ï Ïg¦�Ñ� KÕO_S·H�iUWV�U a���U^OxI�\KV�U3I�b�UqUWJ I�PXV�U^]�G5I�I�U�V�JzYsG5I�V�PXp\,e�O�PNm�U�517��nPNJ�G�O�UW[�\KJ�TSGKV�MnO�I�\ V�GK_KU;O�]�G [(Un��¢�·¸©>·Na$G�T&PQO�|zr�LXUv��hs½}UjT&PNu>PQT&U;I�bSPNO`T�G5I�GPNJ I�\AwnkSLN\&[|ZOWa��ob�U�V�U3G,J�\K]&I�PXYqRSY¾uvGKLXR�U3\,e�wz[�GKJnk1Uq[bS\ O�U�J�k�G O�U�T�\ JyI�bSU^[(LNR�OxI�U�V�PXJ�_G,LN_K\ V�PXI�b�Y¹R�O�UWT�Äw��ÌKë,Ç�h�}�U(I$R�O0GKO�O�RSY;U�I�b�G,I{�dU�b�Gvu U�5/.Owq]�G5I�I�U�V�J�O{PXJqUWG [b`\,eSI�bSU�k�LX\&[|&O�h½}U8I�V�GKJ�O�e�U�VoUWG [bt\Ke�I�b�UWO�UHk�LX\&[|&O�I�\^I�bSUDYsG,PNJ�Y;U�Y;\KV�MjG,J�Ty[(LNR�O�I�UWVdPXIiPNJ I�\�Lt[�LXR�O�I�UWV�OR�O�PXJ�_3G`OxIG,J�TSGKV�T;GKLX_ \KV�PwI�bSY�h0è8JSUo\ V!Y;\KV�UoV�UW]SV�U�O�UWJ>I�G5I�PXu UdO�G,Y;]SLNUWOce�V�\ Y¤U�GK[b^\,e�I�bSU�O�U[(LNR�O�I�UWV�O;G,V�U�OxI�\KV�UWT~O�U�]�GKV�G,I�UWLXM�µd��Uyb�GvuKU�w�L~\,e8I�bSU�O�UyV�UW]SV�UWO�U�J>I�G,I�PNuKUt]1G5I�I�U�V�J�O^PweH��U[bS\Z\ O�U�\KJSUBV�UW]SV�U�O�UWJ>I�G5I�PXu U�]gU�Vd[(LNR�O�I�U�V�h0��bSUWO�U�w�LqV�U�]SV�UWO�U�J>I�G,I�PNuKUoG,V�U�e�RSV�I�bSUWV�[(LNR�O�I�UWV�U�TPNJ I�\�Ll[�LXR1OxI�U�VO3G,J�TlI�b�Ut[(LNR�O�I�U�V`LQG,kgU�LQO`\Ke�I�bSUWO�UsV�UW]SV�UWO�U�J>I�G,I�PNuKU^]�G5I�I�U�V�J�O`GKV�U;R�O�UWT�I�\V�U�LQG,kgU�L>I�bSUo\ V�PN_KPNJ�GKL ]�G,I�I�U�V�J.YsG5I�V�PXp�h{½}UoT&U�]SPQ[�I0I�bSPNOcIx��\Kf�LNU�u U�LZG,LN_K\KV�PXI�bSYÉPNJ^�$PN_KRSV�UiË,ÌSh��IjPQOs]1\>O�O�PNkSLXU�I�\�U(pZI�UWJ�T�I�bSPQOjGKLX_ \KV�PwI�bSY I�\~GKJZM~JZRSY.kgU�Vj\KeHLNU�u U�LQO�µoY;\ V�UnLNU�u U�LQOsG,V�UV�UW�>RSPNV�U�TjPXe�I�b�U3TSG5IGqO�U(IoPQO�uKU�V�MsLQG,V�_KU8GKJ�TtI�bSUDYsG,PNJ�Y;UWY^\ V�MjO�PNm�UDPNO�u U�V�MsO�YsG,LNL!ÄX�WÌKë,Ç�h��eZI�bSU�O�PNJS_KLNU(f�LNPXJS|HG,LN_K\ V�PXI�bSY¹PNO�R�O�U�THe�\KV�\ k&I�GKPXJ�PXJS_HÆ�[(LNR�OxI�U�VO�aWI�b�U�JDI�b�U�V�U!PNO�GiO�R�k�OxIG,J>I�PQG,LO�Gvu>PNJS_>O�PNJyI�bSUDJZRSY.kgU�Vo\Ke0[�\KY;]SR&IG5I�PX\ J�O�GKOoO�bS\5�oJtPNJn�{GKkSLXU`Ë.e�\KVo\ ]&I�PNYsG,LNLXMt[b�\ O�U�J w�obSUWJtI�bSUDJ>R�Y.kgU�V�\,e0[(LNR�OxI�U�VOdPNO�rSp&UWTyG5IiÆ&h!�B\5��UWuKUWVWa I�bSPQO�G,LN_K\ V�PXI�bSY¶�d\KV�|&O��dU�LNL�\KJSLNM�obSUWJtI�bSU`]1\ PXJ>IO�PXJyUWG [b�kSLN\&[|jG,V�U8V�UWG O�\ J�G,k�LXM;bS\ Y^\ _KUWJSU�\ R�Od�obSPN[byPQO�\,e�I�UWJyO�G5I�PNO�r�U�TkZMjPNY;GK_KU`TSG,I�GSh

Page 37: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ³��

xxxxx x xx

xx

x xxx

x

xxx

x x xxxxx

x

xxx xx

xxxx

x xxx

xx x

x

xx

x

xx

x

x

xx

. . .

1 2 p

n-- p

pk

ä(jel*�3ÔT¾;�þ��j pqjer*hntEk*r s=wTk*�qd;h:i�tEo*o*iPw~tEs�m�gPwLs=bed*fPgPh=iGjek*l*�� Ix�d\,f�LXUWuKUWL{O�I�VG5I�UW_KM�e�\KVD[(LNR�O�I�U�V�PNJS_�G�TSG5IGtO�U(I`[(\KJ>IG,PNJSPXJ�_yË&a ���N�;]�G5I�I�UWV�J�OH��GKO8T&U(f

O�[(V�PXkgUWT�PXJÉÄX�vÜKÜvÇ�h���J�I�bSUyr�VOxIsLNU�u U�L�a!I�b�UzTSG5IG}O�U(IsPQO;LX\Z\>O�UWLXM~[�LXR�O�I�UWV�U�T�PNJ>I�\�G�LNGKV�_ UJZRSY.kgU�Vd\,e�[�LXR1OxI�U�VO!R�O�PXJ�_`I�bSUHLNUWGKTSU�V�GKLX_ \KV�PwI�bSY�h giU�]SV�UWO�U�J>I�G,I�PNuKU�O0e�V�\ Y I�bSUWO�U8[�LXR1OxI�U�VO�a\KJ�Uo]1UWV�[(LNR�O�I�U�V�a GKV�UdI�bSUiPNJS]SR&I!I�\DI�bSU8O�U�[(\KJ1T.LNU�u U�L�[�LXR�O�I�UWV�PNJS_1aK�obSPQ[b;PNOc\ k&I�GKPXJ�UWT^R�O�PXJS_½�G,VT�¼ O�b�PXUWV�GKV�[bSPQ[�GKL�Y^U�I�bS\&T�hÆ&hN��Ë&h¸Ë0��¨gÕ�¦�¢�Ù;¢�¨�¥� 5� í �#ÔZÐ�¥�¢�¦�§�¨>©>·o��J�[�V�UWY;U�J>I�GKL�[(LNR�O�I�UWV�PNJS_zPQO.k1GKO�UWT�\KJ~I�bSUyGKO�O�RSY;]&f

I�PN\KJæI�b�G,IyPXInPNOy]g\ O�O�PNkSLNUzI�\�[�\KJ�O�PNTSU�Vy]�G5I�I�U�V�J�Oy\KJ�U}G,I�G~I�PNY^U�GKJ�TæG O�O�PX_ J�I�bSUWY I�\U(p&PQOxI�PXJ�_�[(LNR�O�I�UWV�OWhH�BU�V�UKa�GjJ�U�� TSG,I�GtPwI�U�Y PQO8G O�O�PX_ JSUWTnI�\�G�[(LNR�O�I�U�VH�oPXI�bS\ R&IDG,�gU�[�I�PXJS_I�b�U`U(p&PNO�I�PNJS_j[�LXR�O�I�UWV�OoO�PN_KJSPXr1[�GKJ>I�LNMKh!�ÉbSPN_Kb�LNU�uKUWL�T&UWO�[(V�PN]&I�PN\KJ�\,ecGqIxMZ]SPN[WG,L�PNJ�[�V�UWY^UWJ>I�G,L[(LNR�O�I�UWV�PNJS_sG,LN_K\ V�PXI�bSY¶PQOo_ PXu U�Jyk1UWLX\5�`h§0´21K´ Âa­�¬�«"¬�´.¯®b©�¸2©3¹ º�¯�¬Z­`±�´»¨8§~©3¨�ª>­�±�¯�¼»«�x�v�y�BO�O�PN_KJ�I�bSUDr1V�O�IiTSG5IGqPXI�UWYàI�\jG^[�LXR1OxI�U�V�h��Ë �n��\KJ�O�PNTSU�VqI�bSU�JSU�p>IsTSG,I�G�PwI�U�Y�h�Ø�PwI�bSU�VsGKO�O�PX_ J�I�bSPQO;PXI�U�YÿI�\}\KJSUy\,eiI�bSU�U(p&PQOxI�PXJS_

[(LNR�OxI�U�VOi\ VHG O�O�PX_ JnPwI8I�\yGjJSUW� [(LNR�O�I�U�V�h8��b�PNOHGKO�O�PN_KJ�Y^UWJ>I8PQO8T&\ JSU.k1GKO�UWT�\KJ�O�\ Y^U[(V�PwI�U�V�PX\ J�aq¢�·¸© ·ýI�b�U�TSPNO�I�GKJ�[(U�k1U�Ix��UWU�J¹I�bSU}JSU��éPwI�U�Y GKJ�T�I�bSU�U(p&PNO�I�PNJS_�[(LNR�OxI�U�V[(U�J>I�V�\ PNTSOWh

��Ì>�6goU�]gUWG,IoO�I�UW]zË3I�PXLNL�GKLXL�I�bSU3TSG,I�G^PwI�U�YsOiGKV�UD[(LNR�O�I�U�V�UWT�h��bSUzYsG5îx\ VtGKT&u5GKJ IG,_ Un�oPwI�b�I�bSU�PXJ�[�V�UWY;U�J>I�GKLB[(LNR�O�I�U�V�PNJS_~G,LN_K\ V�PXI�bSYsOsPQOsI�b�G5I�PwIyPNO

JS\KIjJSUW[�UWO�O�GKV�M�I�\~OxI�\KV�U�I�bSUlU�J>I�PNV�Un]1G5I�I�U�V�J�Y;G,I�V�Pwp�PXJ�I�bSUzY;U�Y;\KV�MKhÉÒZ\�adI�bSUlO�]�GK[�UV�UW�>RSPNV�UWY^UWJ>I�O3\KeBPNJ�[(V�U�Y;U�J>IG,L�G,LN_K\KV�PXI�bSYsO.GKV�U�uKUWV�M�O�YsGKLXL�h���MZ]SPQ[�GKLXLNMKa0I�bSU�M~GKV�UjJ�\KJ&fPXI�U�VG5I�PXu UKhcÒZ\�a>I�bSU�PNV�I�PXY;UHV�U��>RSPXV�U�Y;UWJ IO�GKV�U8G,LQO�\^O�YsG,LNL�h$��bSUWV�UHG,V�U8O�U�u U�VG,L�PNJ�[�V�UWY^UWJ>I�G,L[(LNR�O�I�UWV�PNJS_sG,LN_K\ V�PXI�bSYsOWÈ�x�v�y��bSUiLNUWGKTSU�V![(LNR�O�I�UWV�PNJS_.GKLX_ \KV�PwI�bSYýÄ ë ËvÇ1PNO!I�bSUBO�PNY^]�LXU�OxIdPXJ;I�U�V�Y;O!\,e�I�PNY;UB[(\ Y^]�LXU�pZPXIxM

�obSPN[b�PQO�Í;�35�LS��h���IBb�G Oo_ GKPXJ�UWT�]g\K]SRSLQG,V�PXIxMjk1U�[�GKR�O�U.\,e0PwIOiJSUWRSV�GKL�JSU�Ix��\ V�|�PXY;]SLNU(fY^UWJ>I�G5I�PX\ J�agI�bSUs��g$� JSU(Ix�d\KV�|�Ä Ë,Í,Ç�h`��IHPQOHuKU�V�M�UWG O�MyI�\yPNY^]�LXUWY^UWJ>I`G OHPwIDV�U��>RSPXV�UWO\KJSLNM~Í;��L���O�]�G [(U h

��Ë �y��bSU~O�b�\KV�I�UWO�IzO�]1G,JSJSPNJS_�]�G,I�b¶��Ò�Ò&Þ��nGKLX_ \KV�PwI�bSY ÄX�vÜKËvÇ3��GKO�\KV�PN_KPNJ�G,LNLXMæ]SV�\ ]1\>O�U�Te�\KVnTSG5IG�V�U�\ V�_>G,JSPNmWG,I�PN\KJ¿GKJ�Tæ��GKO�O�R�[�[�UWO�Oxe�R�LXLNM�R�O�UWT¹PXJÉG,R&I�\KYsG5I�PN[}G,R1T&PwI�PXJ�_�\KeV�U�[(\KVTSO�Äw�vË&�(Ç�h��BU�V�UKadÒ�Ò&Þ¤GKLX_ \KV�PwI�bSY ��GKOqR�O�U�T~I�\}[�LXR1OxI�U�VjËa�N���z]1G5I�I�U�V�J�O^R�O�PXJS_�Wë.e�UWG5I�RSV�UWOWh!��bSUWO�U3[(LNR�O�I�U�VOoG,V�UHR�O�U�T�I�\sUWO�I�PNYsG5I�UHY;PQO�O�PNJS_;e�UWG,I�RSV�UDuvGKLXR�UWO�PNJ�T�G5I�GPwI�U�YsOoG,J�T�I�\^PQT&UWJ I�Pwe�M�U�V�V�\ JSU�\ R�O�e�UWG,I�RSV�UDuvGKLXR�UWOWh

��Ì>�y��bSU�ÕÑ ¡K^�¢�¡`O�MZO�I�UWY Ä Æ,Å5Ç0PQO`G,JlPNJ�[�V�UWY^UWJ>I�G,Lc[�\KJ�[�U�]&I�R�G,L![�LXR�O�I�UWV�PNJS_�G,LN_K\ V�PXI�bSY�h3��Ib�GKO�kgU�UWJ�O�R�[W[(UWO�O�e�RSLXLNMjR�O�UWT�PNJyUWJS_KPNJSUWU�V�PXJS_sGK]S]SLNPN[WG5I�PN\KJ1OHÄ ê��,Ç�h

Page 38: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

³�] � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

Y

X

1

3 4

6

2 5

ä(jel*�3ÔEÄ*����m*hnbeh:tEr*h=i�tEbelTwTiGj gPm*| jef�wTiPr*h=i�r;h:oBh=k*r*h=k~g��

��ÍZ�y�iJ�PNJ�[(V�U�Y;U�J>IG,L�[�LXR1OxI�U�V�PXJS_�G,LN_K\KV�PXI�bSYée�\KVqTSM>J1G,Y;PN[jPXJ&e�\ V�YsG,I�PN\KJ�]SV�\&[(UWO�O�PXJS_n��GKO]SV�U�O�UWJ>I�UWT8PNJjÄ ËKÌ5Ç�h���bSUcY;\,I�PXu5G5I�PX\ J`k1UWbSPNJ�THI�bSPQO��d\KV�|oPQO�I�b1G5IWa�PNJ3T&MZJ�G,Y;PQ[cTSG5IG,k�G O�U�O�aPwI�U�YsO$Y^PN_Kb>I0_KU�I$GKT�T&UWTqG,J�TqT&U�LNU(I�UWT3\5u U�V�I�PNY^U h$��b�UWO�Ud[b�GKJS_KU�O�O�bS\KR�LNT.k1UdV�U�Ý�UW[(I�U�TPXJ�I�bSUs]1G,V�I�PXI�PN\KJ}_KU�J�U�VG5I�U�Tz�oPXI�bS\ R&I.O�PX_ JSPwrg[�G,J>I�LXMlG,�gU�[�I�PXJS_yI�bSUj[(RSV�V�U�J>ID[�LXR1OxI�U�VO�h��bSPNO{G,LN_K\ V�PXI�bSY÷��GKO�R�O�UWT`I�\B[�LXR�O�I�UWV�PNJ�[(V�U�Y;UWJ IG,LNLXMDG,J`�xúHÒ&Þ�Ø���TSG5IG,k�G O�U!\Ke���Ë&a êKëKÍT&\&[(RSY;U�J>IOo[(\KV�V�UWO�]1\ J�T&PNJS_.I�\s[(\KY;]SRSI�U�V8O�[�PXUWJ�[(U`G,J1TtUWLXU�[�I�V�PQ[�G,L�UWJS_KPNJSUWU�V�PXJS_1h

è8V�T&UWV�f�PNJ�T&U�]gU�J1T&U�J�[�U8PQO�G,JyPXY;]g\KV�I�GKJ I�]SV�\K]gU�V�IxMs\,e{[�LXR1OxI�U�V�PXJS_;G,LN_K\ V�PXI�b�Y;OWh0�iJnG,LN_K\KfV�PwI�bSY»PNODÑ5¦�£ ¢(¦q$�§�¨�£K¢�ÏS¢�¨g£ ¢(¨1¥�Pwe{PwId_KU�J�U�VG5I�U�OcI�bSU8O�G,Y;UB]1G,V�I�PXI�PN\KJse�\ V�G,JZM;\KVT&UWV�PNJj�obSPQ[bI�b�UBTSG5IGDPNO�]SV�UWO�U�J>I�U�T�hcèBI�bSU�V��oPQO�U aKPXI�PNO8Ñ5¦�£ ¢(¦q$�£ ¢�Ï�¢(¨�£K¢�¨�¥�h�9n\ O�I�\Ke1I�bSUiPNJ�[(V�U�Y;U�J>IG,L1GKLwf_K\ V�PXI�b�Y;Od]SV�UWO�U�J>I�UWTyG,kg\5uKUDG,V�UH\ V�TSU�V�f�T&UW]1UWJ�T&UWJ I�h{½}U`PNLXLNR�O�I�VG5I�UHI�bSPNOi\KVT&U�V�f�TSU�]gU�J�T&UWJ>I]SV�\K]gU�V�IxMjPNJz�{PN_KR�V�U3Ë5Ís�ob�U�V�U8I�bSU�V�U3G,V�U3êqIx��\Kf�TSPXY;U�J1O�PN\KJ�GKL�\Kk&îxU�[�IOoLNGKk1UWLXU�T}�DI�\jêSh���e�dU`]SV�U�O�UWJ>IiI�bSU�O�U`]1G5I�I�U�V�J�OoI�\;I�bSUqLXU�GKT&UWVBG,LN_K\ V�PXI�b�YàPXJ�I�bSU3\ V�T&UWV8Ë&aN�Ka ÌSa¸Æ&a Í�a ê.I�bSUWJ�I�bSUIx�d\;[�LXR1OxI�U�VO�\Kk&IG,PNJSUWT�G,V�U`O�b�\5�oJ�kZMtUWLXLNPN]�O�U�O�hc��e0I�bSU`\KVT&U�VoPQO`� a ËSa ê�a Í1a ÆSa Ì�aKI�bSU�Jn�dUD_KU(IGnIx�d\,f�]�GKV�I�PwI�PX\ J~GKO.O�bS\5�oJ~kZM}I�b�UtI�V�PQG,JS_ LXU�O�h}��bSUyÒ�Ò&Þ GKLX_ \KV�PwI�bSY�aBÕ�Ñ ¡K^�¢�¡�a�G,J�T�I�bSUG,LN_K\ V�PXI�b�Y¶PXJ�Ä Ë,Ì5Ç�GKV�U`GKLXL�\ V�T&UWV�f�T&UW]1UWJ�T&U�J>I�h

Æ&hN��Ë&h Ì�Îo 5¦� ,���X¢�� ��ÙBÏg�N¢(Ùs¢(¨1¥� ,¥�§�Ñ,¨g·|goUW[�U�J>I3��\ V�|~ÄX�� ë5Ç!T&UWY^\ J�O�I�VG5I�U�O8I�b�G,I.Gy[�\KYqkSPwfJ�G,I�PN\KJ�\,eoG,LN_K\ V�PXI�bSY;PQ[^U�JSb�GKJ�[(UWY;U�J>I�ODI�\zG�[(LNR�OxI�U�V�PXJ�_zG,LN_K\KV�PXI�bSYéGKJ�T�T&PQOxI�V�PNkSR&I�PX\ J}\KeI�b�Uz[(\KY;]SRSI�G5I�PX\ J�O^\5uKUWV;G}JSU�Ix��\ V�|�\Ke8�d\KV�|&OxIG5I�PN\KJ1Oq[WG,J�G,LNLX\5�ýGKJ�UWJ>I�PNV�UzÆ&�vË:7~Æ&�vËPNY;GK_KUDI�\jk1U^[(LNR�O�I�U�V�UWTyPNJlG^e�U��ÛY;PNJZR&I�U�O�hoF8U�]gU�J�T&PNJS_�\KJ�I�b�U.[(LNR�O�I�U�V�PNJS_tG,LN_K\ V�PXI�b�YýPNJR�O�UKa>]�G,VG,LNLNU�LNPXm�G5I�PN\KJ^\,e�I�bSUB[�\ZTSUBG,J�T;V�U�]�LXPQ[�G,I�PN\KJs\,e�TSG,I�GDe�\ V!U(áj[�PXUWJ�[(M^YsGvMqMZPNU�LQT;LNGKV�_ UkgU�JSU�rSI�OWh��B\5��UWuKU�V�aSG;_KLN\Kk1G,L�O�b�G,V�UWTyTSG5IGsOxI�V�R1[�I�R�V�U aSJ�G,Y;UWLXMsI�bSU.[�LXR�O�I�UWViY;U�Yqk1UWV�O�bSPN]I�GKkSLNUKa>V�UWY;GKPXJ1O�G,J1T;Y.R�O�I�kgUBYsG,J1G,_KU�T;[(U�J>I�V�GKLXLNMq\ V�V�U�]SLNPQ[�G5I�UWTsGKJ�TsO�MZJ�[b�V�\ JSPXmWUWT^]gU�V�Pwf\&T&PQ[�G,LNLNMKh���bSU.]SV�U�O�UWJ�[(UD\ ViG,k�O�U�J�[�U`\,e0V�\ kSR�O�IWaSU�áj[(PNU�J>Ii]�G,VG,LNLNU�L�[�LXR�O�I�UWV�PNJS_^I�U�[bSJSPQ�>RSUWO�oPNLXL!T&U�I�UWV�Y;PNJSU^I�bSUsO�R�[�[�UWO�OB\ V8e�GKPXLNRSV�Uq\Ked[�LXR�O�I�UWV`G,J�GKLXM&O�PNOHPNJ�LQG,V�_KU�f�O�[�GKLXU.T�G5I�G�Y;PXJ�PXJS_G,]�]SLXPQ[�G,I�PN\KJ�O�PNJyI�bSUDe�RSI�RSV�UKh

èZ#�"_Y�Y»W�Q#E�"�^�Qe`VJn7��LNR�OxI�U�V�PXJ�_lG,LN_K\ V�PXI�bSYsO.b�GvuKUjkgU�UWJ�R�O�UWT~PXJ�GlLNGKV�_ Uju5G,V�PXU�IxM�\KeBG,]S]�LXPQ[�G,I�PN\KJ�O�Ä Å>Æ&µi�vÆ&�Kµ��Í>ÌSµ>ê��5Ç�h$��JsI�bSPQOdO�U�[�I�PN\KJ�a �dUBT&U�O�[�V�PNk1UHO�UWuKUWV�GKL�G,]S]�LXPQ[�G,I�PN\KJ�Oc�ob�U�V�UB[(LNR�O�I�U�V�PNJS_3b�G O!kgU�U�JU�Y;]SLN\5MKU�TjGKOdG,J�UWO�O�UWJ>I�PQG,L�OxI�U�]�hc��bSU�O�UDG,V�UWG O�G,V�UKÈ��x�v��PXYsG,_ U8O�U�_ Y^UWJ>I�G5I�PX\ J�a���ËK��\KkSîxUW[�IG,J1T�[b�GKV�G [�I�U�V�V�U�[(\ _KJSPXI�PN\KJ�a���Ì ��T&\&[(R�Y^UWJ>IiV�U�I�V�PXUWuvGKL�a&GKJ�T���Í>��T�G5I�G^Y;PNJSPXJ�_�h

Page 39: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ³�f

x

x

x

1

2

3

ä(jel*�cÔT¡;�ä3h:tSgPd*iGh�iPh:o;iGh=fGh=k~g�tSgPjewTkúxKwTi_s=bed*fPgPh=iGjek*l*�� �|�tElTh�|_h�tEfPd*iGh=|_h=k~gGf�tEk*rOoBwTfGj gPjewTk*f�tEiGh�gPi�tEk;fP�xKwTiG|_h=r_gGwLxKh:tSgGd*iPh=f���acbed*fPgPh=iGf�jek xKh:tSgGd*iPhnfGo3tEs=hns=wTiGiPh=fGoBwTk*r�gPwLje|�tElTh}fPh:lT|_h=k~gGf:�èZ# @ QwÁ )*45<�7[<X4�Á�<B-;9:);9S+ U(-0>�CT+.-;4jEn]eN;C:9=<BA +.-;4��Ùs �©>¢HÐ�¢�©,Ùs¢�¨�¥� 5¥�§�Ñ5¨3PQO�G3e�RSJ�TSGKY^UWJ>I�G,Lg[(\ Y^]g\KJ�U�J>I�PNJjYsG,JZM^[�\KY;]SR&I�U�V�u>PQO�PX\ JjG,]S]SLNPQ[�G5fI�PN\KJ1O�aZG,J�Tt[�G,JskgUDGKTST&V�UWO�O�UWT;GKO�G.[(LNR�O�I�UWV�PNJS_3]SV�\Kk�LXUWY¾ÄX��Æ ÆvÇ�h$��bSUHO�UW_KY;U�J>IG5I�PN\KJs\Ke�I�bSUPNY;GK_KU>��O�0]SV�UWO�U�J>I�U�T.I�\.G,JsPNYsG,_ UBG,J�GKLXM&O�PNOcO�M&OxI�U�YðPNO�[(V�PwI�PN[WG,LNLXM;T&UW]1UWJ�T&U�J>Id\KJ;I�b�UBO�[�U�JSUI�\DkgUoO�UWJ�O�U�T�a5I�bSU�PXYsG,_ PXJ�_8_ U�\KY;U�I�V�MKa5[(\ J&r�_KR�V�G,I�PN\KJ�a,GKJ�T.O�U�J�O�\KV0R�O�UWT.I�\8I�VG,J1O�T&R1[(U�I�bSUO�[(U�J�UHPNJ>I�\jG;T&PN_KPXI�GKL�PXYsG,_ UKaSGKJ�TtR�LwI�PXYsG5I�U�LNMjI�bSU3T&UWO�PNV�U�Tt\ R&I�]SRSIq��_ \ G,L���\,e$I�bSU3O�M&OxI�U�Y�h��bSU.G,]�]SLXPQ[�GKkSPNLXPXIxMj\,e![�LXR�O�I�UWV�PNJS_sY;U(I�bS\&T&\KLN\K_ MsI�\;I�bSU3PNYsG,_KU3O�U�_ Y;U�J>I�G,I�PN\KJy]SV�\ kSLNU�Y

��GKO3V�UW[�\K_ JSPXmWUWT}\5uKUWVDI�bSV�U�UyT&UW[WGKT&U�O.GK_K\�a$G,J�T�I�bSU�]�G,VGKT&PN_KYsO`R�J�T&U�V�LNM>PNJS_nI�bSUtPNJSPXI�PQG,L]SPN\KJSUWU�V�PXJ�_oU(��\KV�I�O�GKV�U!O�I�PNLXL PXJ`R1O�UcI�\&TSGvMKh��~V�U�[(RSV�V�PNJS_dI�b�U�Y;U!PQO�I�\8T&U(r�J�Uce�UWG,I�RSV�UcuKU�[�I�\ V�OG5IiUWuKUWV�MjPNYsG,_ U`LX\&[�G,I�PN\KJ���]�Pwp&U�L��o[�\KY;]1\>O�U�Ty\,e0k1\KI�b�e�RSJ�[(I�PN\KJ�OB\,e0PXYsGK_KU`PNJ I�U�J�O�PXIxM�G,J1Te�RSJ�[(I�PN\KJ�Oq\,e�I�bSUj]SPXp&U�LdLX\&[�G,I�PN\KJ�PXI�O�U�LXexhz��bSPNO.k�GKO�PQ[sPNTSUWGSacT&UW]SPQ[�I�U�T�PXJ��{PN_KR�V�UtË Æ&a$b�GKOkgU�U�JsO�R�[�[�UWO�Oxe�R�LXLNM3R�O�UWTqe�\KVcPNJ>I�UWJ�O�PXIxM3PNYsG,_KU�Oo���oPXI�b;\KVc�oPXI�b�\KR&IcI�U(pZI�RSV�U��(a,VG,JS_ UD��T&U�]SI�b1�PNY;GK_KU�OoG,J�T�Y.RSLXI�PQO�]1U�[�I�VG,L�PNYsG,_ UWOWhêShN�KhN�1Ä�¢�©KÙs¢(¨1¥� ,¥�§�Ñ,¨g·i�BJ�§�Ù; W© ¢BÐ�¢�©,Ùs¢(¨1¥� ,¥�§�Ñ,¨DPNO$IxMZ]SPQ[�GKLXLNM.T&U�r�JSUWT;G OcG,J^U(p&b�G,R1OxI�PXu U

]�GKV�I�PwI�PX\ JSPXJ�_t\,edG,JlPNJS]SRSIDPNYsG,_ U.PNJ I�\�V�U�_ PX\ J�OWa1U�GK[bz\Ke��obSPQ[blPQOH[�\KJ�O�PQT&U�V�UWT�I�\�kgU^bS\,fY;\K_ U�JSUW\KR�O8�oPwI�b�V�U�O�]gUW[(I8I�\�O�\KY;U^PXYsGK_KU;]SV�\K]gU�V�IxMy\Ke�PNJ>I�U�V�UWO�Ij��¢�·¸© ·Na{PXJ>I�U�J�O�PwIxM a�[(\ LX\ VWa\KV�I�U(pZI�R�V�Uv�8ÄX��KÍ,Ç�h0��e

3"��(���!SR��F/��É������F�54a�%T��É������F�76�-PQO`I�b�UjPXJ�]SR&I.PNYsG,_KUs�oPXI�b��84;V�\5�iO`G,J�TG�763[(\ LXR�Y^J1O.G,J1T�Y^U�GKO�RSV�U�Y;U�J>I3u5G,LNRSU���!SR�G5I]SPXp&U�Li��/O�ËT>�(a�I�bSUWJlI�bSUsO�UW_KY;U�J>IG5I�PN\KJ}[�GKJlkgU^U�p&]SV�U�O�O�UWTlGKO:9�� (`ô���������Mô o - a��oPXI�b�I�bSU=�I�byO�U�_ Y;U�J>I ô Õ � (>��/ Õ; �%T Õ; �K������W�3/ Õ;<*= �%T Õ&<*= �O-[(\ J�O�PNO�I�PNJS_y\,e�Gy[(\ JSJSUW[(I�U�T�O�RSk�O�U(ID\,e�I�bSU;]SPXp&U�L![(\Z\ V�T&PNJ�G,I�UWOWh3úi\�Ix�d\yO�U�_ Y^UWJ>I�ODO�b1G,V�UG,JZM�]SPXp&U�LdLX\&[�G,I�PN\KJ�Oy��ô !?> ô R �A@CB�/�D� TZ��a�G,J�T�I�bSUyRSJSPN\KJ�\KeBG,LNLdO�U�_ Y;U�J>I�O^[(\5u U�VOI�b�UqUWJ I�PXV�U.PNYsG,_ Ut�FE o! p � ô ! � (>������F� 4 -278( �U������� 6 -v��hHG>G,PNJlG,J�T�FBR�k1U�O^Ä Å Æ5Ç$G,e�I�U�VD�SRG,J1TP9nR�PBÄ Üa�5Ç�a�PQT&U�J>I�PXr�U�TzI�bSV�UWU;I�U�[bSJSPQ� R�UWOHe�\KVD]SV�\&T&R�[�PXJS_nO�U�_ Y^UWJ>I�G5I�PX\ J�O8e�V�\ Y PNJS]SR&IPNY;GK_KUWV�M�Èd¦�¢�©,§�Ñ,¨>$�¡ vÐ�¢£5a0¢�£W© ¢�$�¡ vÐ�¢£5a1\KV.Õ��#ÔZÐ�¥�¢�¦q$�¡ vÐ�¢£5h��\KJ�O�PNTSU�V^I�bSU�R�O�Uy\,eHO�PNY^]�LXU�_KVGvM�LXUWuKUWL�I�bSV�UWO�bS\KLQT&PNJS_lI�\}O�U�_ Y;U�J>I;G}bSPN_KbSf�[�\KJ>I�VGKO�I

PNJ I�U�J�O�PXIxM�PXYsG,_ UKh��$PX_ RSV�U�Ë,ê1��G �.O�b�\5�iOqGl_KVGvMZO�[�GKLXUsPNYsG,_ Ut\,eBGlI�U�pZI�kg\>\ |�¼ Oqk�G,V;[(\&T&U

Page 40: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

Ö � � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

0 50 100 150 200 250 300

’x.dat’

(c)

(a) (b)

ä(jel*�XÔTÕ;�þðcjek3tEiGjÞç:tSgPjewTk�p;jut}gPm*iGh=fPm*wTber*jek*l*��y%t~����ù�iPjelTjek3tEb*lTi�t=�;fPs:tEbeh�je|�tElThT�cyKzB���1?�iGt:�X��beh�p~h=b,m;jefPgPwTlTi�tE|V�yKsS����¶�h=fGd;b gGf�wEx�gGm;iGh=fGm*wTber;jek*l*�

O�[�G,J�JSUWT�\ JlGsÝ1G,I�kgUWTzO�[�GKJSJSUWVWhBÞcGKV�I^��k1�BO�bS\5�iOiI�bSU^V�UWO�RSLwIOi\Ke�GtO�PXY;]SLNU3I�bSV�U�O�b�\KLQT&PXJ�_\K]gU�VG5I�PX\ J�T&U�O�PN_KJ�UWT�I�\�O�UW]�G,VG5I�UtI�bSUzTSGKV�|~GKJ�T�LNPN_Kb>IjV�UW_KPN\KJ�OqPNJ�I�bSUnk�GKV;[�\&T&UnG,V�UWGSh\dPXJ1G,V�PXm�G5I�PN\KJ�O�I�U�]1O`LXPN|KU^I�bSPNO.G,V�Us\,e�I�UWJ�]1UWV�e�\ V�Y;UWT�PNJ~[b�G,VGK[(I�U�VDV�UW[�\K_KJ�PwI�PX\ J�O�MZO�I�UWYsO�h��bSV�UWO�bS\KLQT&PNJS_3PNJtU��gU�[�IHº [�LXR�O�I�UWV�OW¼ I�bSU8PXYsG,_ UB]SPXp&U�LQO�PNJ>I�\.Ix��\q_KV�\KRS]�O�k�GKO�UWTj\KJsI�bSU8\ JSU(fT&PNY;U�J�O�PX\ J�G,L{PXJ>I�U�J�O�PwIxM�Y;UWG O�R�V�UWY^UWJ>IqÄw�vÆ,ê�µgÆa�,Ç�h8� ]g\ O�I�]SV�\&[(UWO�O�PXJS_jO�I�UW]lO�U�]�GKV�G,I�UWOoI�bSU[(LQGKO�O�UWOdPXJ>I�\;[�\KJSJ�UW[�I�UWTyV�U�_KPN\KJ1O�h$½�bSPNLXU3O�PXY;]SLNUD_KVGvMsLXUWuKUWL�I�bSV�UWO�bS\KLQT&PNJS_;PNOoG T&UW�>R�G,I�UDPNJO�\KY;Ut[�GKV�U�e�RSLNLXM�[(\ J>I�V�\KLNLXU�T�PNYsG,_ UtGK[W� R�PNO�PwI�PX\ J~U�JZuZPNV�\ JSY;U�J>I�O3GKJ�T�YqR�[b~V�UWO�UWG,V[b}b�GKOkgU�U�J}T&U�u \,I�UWT�I�\�G,]�]SV�\ ]SV�PNG,I�U3Y;U(I�bS\&TSOBe�\KV8I�bSV�UWO�bS\KLQT&PNJS_�ÄX�WÅ ÌSµ$�Wë>ÆvÇ�ag[�\KY;]SLNU(pnPXYsGK_KUWOV�UW�>RSPNV�UDY;\KV�U8UWLNGKk1\ V�G,I�U`O�U�_KY;UWJ IG5I�PX\ JjI�U�[bSJSPQ�>RSUWOWh9zG,JZM;O�UW_KY;U�J>I�UWV�O�R�O�UBY;UWG O�RSV�U�Y;UWJ IO!�obSPQ[bjG,V�Uikg\,I�bzÐ�ÏS¢Õ�¥�¦� 5����¢W·¸©>·NaZI�bSUHY.R�LwI�PNO�]1U�[�fI�VG,L!O�[�GKJSJSUWV`R�O�U�TlPNJ�V�UWY;\,I�UsO�U�J�O�PNJS_>�HG,J1T�Ð�Ï� 5¥�§� 5�!��k�GKO�UWT�\KJ�I�bSUs]�Pwp&U�L�¼ O`LX\&[WG5I�PN\KJ}PNJI�b�UtPNY;GK_KUj]�LNGKJSU��(hl��bSUtY;U�GKO�RSV�UWY;U�J>IqG5IqUWGK[b�]�Pwp&U�LdbSUWJ�[(Uy[(\KV�V�UWO�]1\ J�TSO3T&PNV�UW[�I�LXM�I�\\KR�Vi[(\KJ1[(U�]SI�\Ke0G^]�G,I�I�U�V�J�hêShN�Kh¸ËI�(Ù; W© ¢AÄ�¢�©KÙ;¢�¨�¥� 5¥�§�Ñ5¨KJ�§�  í �#ÔZÐ�¥�¢(¦�§�¨Z© ·B��bSU`G,]S]�LXPQ[�G,I�PN\KJy\,e{LN\&[�GKL�e�UWG5I�RSV�UD[�LXR1Oxf

I�UWV�PNJS_sI�\�O�U�_ Y^UWJ>IB_KVGvM>f�O�[�GKLXUHPXYsGK_KUWOB�dG OBT&\&[�RSY;U�J>I�U�TnPXJ�Äw��êKÌ5Ç�ho��bSPQOB]�GK]1UWVBUWY^]�b�G5fO�PXmWUWTyI�b�UqG,]�]SV�\ ]SV�PNG,I�U3O�U�LNUW[�I�PX\ Jz\,e0e�U�G5I�R�V�U�OBG5IHUWG [bn]SPwp&UWL�VG5I�b�U�ViI�b�G,JzI�bSU^[(LNR�OxI�U�V�PXJ�_Y;U(I�bS\&T&\KLN\K_ MKacG,J�T�]�V�\ ]1\>O�U�T}I�bSU�R�O�U�\,eoPNY;GK_KUj]�LNGKJSU�[�\>\ V�TSPXJ�G,I�U�Oj��O�]�G5I�PNGKL�PNJ&e�\ V�YsG5f

Page 41: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � Ö �I�PN\KJg�oGKOiG TST&PXI�PN\KJ�GKL�e�UWG,I�RSV�UWOoI�\skgU3U�Y;]SLN\5MKU�T�PNJn[(LNR�O�I�U�V�PNJS_,f�k�GKO�UWTyO�U�_KY;UWJ IG5I�PX\ J�h���bSU_K\>G,L&\Ke�[�LXR�O�I�UWV�PNJS_`��GKO$I�\`\Kk&IG,PNJ;G`O�UW�>RSUWJ�[(U�\KegbZMZ]1UWV�UWLXLNPN]�O�\ PNT�G,LS[(LNR�O�I�UWV�O!O�I�GKV�I�PXJ�_H�oPXI�b[(LNR�O�I�UWVB[(UWJ I�U�VO�]1\>O�PXI�PN\KJ�UWTyG5IiYsG5p&PNY.RSY¾T&U�J�O�PXIxMtLN\Z[WG5I�PX\ J�O�PXJyI�bSU`]�G5I�I�UWV�JnO�]�GK[�UKaSG,J1T_KV�\5�oPNJS_�[�LXR�O�I�UWV�O;GKk1\ R&IqI�bSUWO�Un[(UWJ I�U�VO^RSJ>I�PNLiGML k I�UWO�I;e�\KVs_K\Z\&T&JSU�O�Oq\,e8rSIs�dG O^u>PN\,fLQG5I�U�T�hc�÷uvGKV�PNU(IxM;\Ke�e�UWG,I�RSV�UWOd�dU�V�U8T&PQO�[�R�O�O�U�TtG,J1TtG,]�]SLXPNUWTjI�\^k1\KI�by_KVGvM&O�[WG,LNUiG,J�T�[(\KLN\KVPNY;GK_KUWV�M h�iJ�G,_K_ LX\ Y;U�VG5I�PNuKU�[(LNR�OxI�U�V�PXJ�_}GKLX_ \KV�PwI�bSY �dG O;G,]S]SLNPNUWT�PXJÉÄw�5Ü��,ÇdI�\lI�bSUn]SV�\KkSLNU�Y \Ke

RSJ�O�RS]gU�V�uZPNO�UWT}LNUWG,V�JSPNJS_�\,eo[(LNR�O�I�U�VOD\,e3ÕÑW¢FN�Õ(§�¢�¨�¥H´v¢Õ�¥�Ñ,¦Ð8e�\ VDIx��\�PNYsG,_KUsY;\&T&UWLNODI�b�G5I[(\ V�V�UWO�]g\KJ�T8I�\8PXYsGK_KU�O�U�_ Y^UWJ>I�OWh{��bSU�r�V�O�I�PNYsG,_KU�Y;\ZTSU�L>PNO�]1\ LXMZJS\ Y^PQG,L e�\KV�I�bSU�\Kk�O�U�V�uKU�TPNY;GK_KU�Y^U�GKO�RSV�U�Y;U�J>I�OWµ5I�bSUdG O�O�RSY;]&I�PX\ J.bSUWV�U�PNO{I�b1G5I0I�bSUdPNY;GK_KU�PNO0GH[(\KLNLNUW[�I�PX\ J.\Ke1O�UWuKUWV�GKLGKT5îx\KPNJSPXJ�_i_KVG,]Sb`O�RSV�e�GK[(U�O�a�UWG [b`Go]1\ LXMZJS\ Y;PNGKL,e�RSJ�[(I�PN\KJ3\KeZI�bSU�PXYsG,_ Uc]SLQG,JSU�[�\Z\KVT&PXJ1G5I�U�O�a�obSPQ[b^GKV�UdO�GKY;]SLXU�T.\ J3I�bSU�V�G OxI�U�V0_KV�PNT3I�\H]SV�\ZTSR�[(UdI�b�Ud\ k�O�U�V�uKUWT3PXYsG,_ UKh$��bSUoG,LN_K\KV�PXI�bSY]SV�\&[(U�U�TSOikZMy\Kk&IG,PNJSPNJS_juKU�[�I�\KVOo\,e�[�\>U�áj[(PNU�J>I�OB\,e!LNUWGKO�I�f�O�� R1G,V�UWOdrSIOiI�\sI�bSU^TSG5IGsPNJP�T&PQO�îx\ PXJ>I;PXYsGK_KUt�oPNJ�T&\5�iOWh��iJ�G,_ _KLN\KY;U�VG5I�PXu Uj[(LNR�OxI�U�V�PXJ�_�G,LN_K\ V�PXI�b�Y Y;UWV�_ UWOy��G5I;UWG [bO�I�U�]g�dI�bSU3Ix��\s[(LNR�O�I�UWV�Oo�ob�PN[bnMZPNU�LQTyG;Y;PNJSPNY.RSY¾_KLN\Kk�GKL�kgU(Ix�dU�U�JSf�[�LXR�O�I�UWV�9zG,b1G,LQG,JS\ kSPNOT&PQOxIG,J�[�UKh}��bSUyO�G,Y;Use�VG,Y;UW��\ V�|}�dG O.GK]S]SLNPXU�T�I�\}O�UW_KY;U�J>I�G,I�PN\KJ�\KeiI�U�p>I�RSV�UWT�PNYsG,_KU�O�akSR&IBe�\KVBO�R�[bnPNY;GK_KU�OdI�bSU3]g\KLNMZJS\KY;PQG,L�Y;\&T&UWL���GKOoPNJ�G,]�]SV�\ ]SV�PNG,I�U`G,J�T�G;]�GKV�GKY;U(I�UWV�PNm�U�T9zGKV�| \5u�gBG,J�T&\ Yù�$PNU�LQT�Y;\&T&UWL��dG OoGKO�O�RSY;U�TtPNJ�O�I�UWG T�hgoU(e�UWV�UWJ�[(U�Äw��ÅKê5ÇHT&UWO�[(V�PXkgUWOjI�bSU�G,]�]SLXPQ[�G,I�PN\KJ�\Ke`I�bSU�]SV�PNJ�[�PX]SLNUWO�\,e`JSU�Ix��\ V�|�Ý�\5�¾I�\RSJ�O�RS]gU�V�uZPNO�UWT~[�LNG O�O�PXr1[�G,I�PN\KJ�a$MZPXUWLNT&PNJS_}GnJS\5uKUWL�bSPNU�VG,V[bSPQ[�GKL�G,LN_K\ V�PXI�bSY e�\KV;[(LNR�O�I�UWV�PNJS_�h��JnUWO�O�U�J�[�UKa&I�bSU`I�U�[bSJSPQ�>RSU3uZPXUW�iO�I�b�U3RSJSLQG,kgU�LNUWT�]�G,I�I�U�V�J�OBG OoJS\&T&UWOiPXJzG;_ V�GK]Sb�aS�obSUWV�UI�b�Uy�dU�PN_Kb>Is\,eDG,J�UWT&_ U���§�·�¢W·Na�PXI�Oj[WG,]�G [(PXIxMS�3PQOsGlY;U�GKO�RSV�Uy\,eDO�PNY;PXLQG,V�PXIxM�k1U�Ix��UWU�J�I�bSU[(\ V�V�UWO�]g\KJ�T&PNJS_}JS\&T&UWOWh¹��LNR�OxI�U�VOsG,V�U�PQT&UWJ I�Pwr1UWT�kZM�V�U�Y;\5uZPXJS_}UWTS_KUWO^e�V�\KYÿI�bSUn_ V�GK]SbI�\�]SV�\&T&R�[(U}[(\ JSJSUW[(I�U�T¿T&PQO�îx\ PXJ>InO�RSk�_KVG,]Sb�OWhð��JæPNY;GK_KU}O�UW_KY;U�J>I�G,I�PN\KJ�ao]�Pwp&U�LQOy�obSPQ[bG,V�U;Í,f�JSU�PN_KbZkg\KVOB\ V3ë5f�JSU�PN_KbZkg\KVOHPXJ�I�bSUtPXYsG,_ Uq]�LNGKJSUjO�b1G,V�UqU�T&_KU�ODPXJ}I�b�Uj[(\KJ1OxI�V�R�[(I�U�TGKT5î�GK[(UWJ�[(M�_KVG,]Sb�adG,J�T�I�bSUn��UWPX_ b>I;\KeDG}_ V�GK]Sb�U�T&_KU�PQO;k�GKO�UWT�\ J�I�bSUzOxI�V�UWJS_,I�b�\,eHGbZMZ]1\KI�bSU�O�PNm�U�T�PXYsG,_ UjUWTS_KUtkgU(Ix�dU�UWJ�I�bSU�]SPXpZUWLNOqPNJ>u \KLNuKU�T���I�bSPQO;OxI�V�UWJS_,I�b�PNOq[�GKLN[�RSLNG,I�U�TR�O�PXJ�_�O�PXY;]SLNU�T&UWV�PNu5G5I�PXu UzYsGKO�|ZO��hð�iUWJ�[(U aoI�bSPQOyO�UW_KY;U�J>I�UWVt�d\KV�|&OjkZM�r1J�T&PNJS_�[�LX\>O�U�T[(\ J>I�\KR�V�OdPNJ�I�bSU`PNY;GK_KU`G,J1TtPQOokgUWO�IiLNGKk1UWLXU�TtU�T&_KU�f�k�G O�U�TtVG5I�bSU�VdI�b�G,J�V�U�_KPN\KJSf�k�G O�U�T�h��J¿Äw��ëKÅ5Ç�a�Ix�d\nJSU�R�V�GKL!JSU(Ix�d\KV�|&O`G,V�UsT&UWO�PX_ JSUWT�I�\z]1UWV�e�\ V�Y ]�G5I�I�UWV�J�[(LNR�O�I�UWV�PNJS_n�obSUWJ

[(\ Y.kSPNJSU�T�hj�ðIx��\Kf�LQGvMKUWVBJSU�Ix��\ V�|n\ ]1UWV�G,I�U�OD\KJ�G�YqRSLXI�PQT&PXY;UWJ�O�PN\KJ1G,L!bSPQO�I�\K_ V�GKY \,e�I�bSUTSG,I�G�I�\~PQT&U�J>I�PXe�Mɺ ]SV�\KI�\KIxM>]gUWOW¼��ob�PN[bæGKV�UlR�O�U�T�I�\�[(LQGKO�O�PXe�M�I�bSU}PXJ�]SR&I�]�G5I�I�U�V�J�OtPXJ>I�\[(LNR�O�I�UWV�OWhi��bSUWO�U3]SV�\,I�\,IxMZ]gUWOBGKV�UDe�U�T�I�\tI�bSUq[(LQGKO�O�PXr1[�G,I�PN\KJnJSU�Ix��\ V�|�a�GKJS\,I�bSU�VBIx��\Kf�LQGvMKUWVJSU�Ix��\ V�|q\K]gU�VG5I�PNJS_`\ JqI�bSUBb�PNO�I�\ _KVG,Y \KegI�bSUBPNJS]SRSIdTSG,I�GSa kSR&I�I�VG,PNJSUWTqI�\.b�GvuKUiT&PX��U�V�PXJS_�dU�PN_Kb>I�Oqe�V�\KYâI�b�Uy]�V�\KI�\,IxMZ]gUyO�U�LNUW[(I�PN\KJ�JSU(Ix�d\KV�|�h~��J�k1\KI�b�JSU(Ix�d\KV�|&O�a0I�bSU�bSPNO�I�\ _KVG,Y\,e�I�bSUjPNY;GK_KUsPQO3R�O�UWT}I�\z�dU�PN_Kb>I`I�bSUy[(\ J I�V�PNkSR&I�PX\ J�O`\Ke�]1G5I�I�U�V�J�O`JSUWPX_ bZk1\ V�PNJS_�I�b�Uj\KJSURSJ�TSU�V8[�\KJ�O�PQT&U�VG5I�PX\ J�I�\sI�b�U3LX\&[WG5I�PN\KJn\Kec]SV�\KI�\KIxM>]gUWOi\KVoI�bSU3RSLXI�PNYsG5I�U^[(LQGKO�O�PXr1[WG5I�PN\KJ�µ1GKOO�R�[b�a&PXIiPNO�LNPX| U�LNMsI�\;kgU`Y;\KV�U8V�\KkSR1OxIo�obSUWJ�[�\KY;]�GKV�U�TsI�\^I�UW[bSJSPQ�>RSUWO��ob�PN[bnGKO�O�RSY;UHGKJRSJ�TSU�V�LXMZPNJS_n]�G,VG,Y;U�I�V�PN[^T&U�J1O�PXIxMze�RSJ1[�I�PN\KJ�e�\ VDI�bSUt]�G5I�I�U�V�J�[(LQGKO�O�U�O�hj��b�PNO3GKV�[b�PwI�UW[�I�RSV�U��GKOdI�U�OxI�UWTy\KJy_KVGvM>f�O�[�GKLXU8G,J�T�[(\ LX\ VoO�UW_KY;U�J>I�G,I�PN\KJ�]SV�\ kSLNU�YsO�hgoU(e�UWV�UWJ�[(UyÄw���Kê5Ç0T&UWO�[(V�PNk1U�O8Gt]SV�\&[�UWO�Oie�\ VBU(pZI�V�G [�I�PNJS_y[(LNR�OxI�U�VO8O�UW�>RSUWJ>I�PQG,LNLXM�e�V�\ Y¾I�bSUPNJS]SR&I3]�G,I�I�U�V�J}O�U(I`kZMzPQT&U�J>I�PXe�MZPXJ�_nb>MZ]gU�V�U�LNLXPN]�O�\KPQTSG,L0V�U�_ PX\ J�Oq��k1\ RSJ�T&U�T}k>MlLX\&[(Pc\Ke�[�\KJ&fO�I�G,J>IA9zGKb�G,LQG,JS\ kSPQO8T&PQO�I�G,J1[(U��H�ob�PN[b�[(\ J IG,PNJ�G�O�]1U�[(PXr�UWTle�V�G [�I�PX\ J�\Ke�I�b�U^R�J�[(LQGKO�O�PXr�U�T]g\KPNJ IOdPXJtI�bSUDO�U�IWh!��bSUHU(pZI�V�G [�I�U�TsV�U�_KPN\KJ1O�G,V�U8[�\KY;]�GKV�U�TjG,_>G,PNJ�OxI�I�bSUDkgUWO�I�f�rSI�I�PXJS_^Y.R�LwfI�PNu5G,V�PNG,I�U`þDG,R�O�O�PNGKJ�T&UWJ�O�PXIxMsI�bSV�\ RS_KbyG2îD\ LXY;\ _K\KV�\5u>f�Ò&Y^PNV�JS\5u`I�U�OxI�aSG,J�TtI�b�U8r�Io�>R�GKLXPXIxMPQO3R�O�UWT~G O.G�r1_KRSV�Us\,eiY;U�V�PXI3e�\KV^O�UWLXU�[�I�PNJS_nI�bSUzº kgUWO�IW¼$V�UW_KPN\KJ�G5I.U�GK[b�PXI�UWV�G,I�PN\KJ�hz��bSU]SV�\&[(UWO�O![�\KJ>I�PNJZRSUWO�RSJ>I�PNLgG3O�I�\ ]S]SPNJS_.[�V�PXI�UWV�PN\KJ;PQO�O�G5I�PQO�r�UWT�hc��bSPQO!]�V�\&[(U�T&RSV�Uo�dG O�GK]S]SLNPXU�T

Page 42: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

Ö � � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

I�\^I�bSU`]SV�\KkSLNU�YsOd\,e{I�bSV�UWO�bS\KLQTyO�UWLXU�[�I�PN\KJ�e�\KVoYqRSLXI�PXI�bSV�UWO�bS\KLQTyO�UW_KY;U�J>I�G,I�PN\KJ�\,e{PNJ>I�UWJ�O�PXIxMPNY;GK_KUWV�MjGKJ�T�O�UW_KY;U�J>I�G,I�PN\KJ�\,e0V�GKJS_KUHPXYsGK_KU�V�MKh��LXR�O�I�UWV�PNJS_nI�UW[bSJ�PN�>RSU�O3b�Gvu UjG,LQO�\nkgU�UWJ�O�R1[�[(U�O�O�e�RSLNLXM}R�O�UWT}e�\ V3I�b�U�O�U�_KY;UWJ IG5I�PX\ J}\Ke

VG,JS_ U.PNY;GK_KU�O�a��obSPQ[b�GKV�U^Gt]g\K]SR�LNGKVHO�\KRSV[(Uq\,e�PNJS]SRSI`T�G5I�Gte�\KV8I�b�V�UWU(f�T&PXY;UWJ�O�PN\KJ1G,L$\Kk&fîxUW[(I�V�UW[(\ _KJSPXI�PN\KJ;O�MZO�I�UWYsOBÄ ÅKë5Ç�h»gBG,JS_ UiO�UWJ�O�\ V�O$IxMZ]SPQ[�GKLXLNM.V�U(I�RSV�J^VGKO�I�UWV!PNY;GK_KU�O0�oPwI�b;I�bSUY;UWG O�RSV�UWTyu5G,LNRSU3G,IBUWG [by]�Pwp&U�L�k1UWPXJS_jI�bSU.[�\Z\KVT&PXJ1G5I�U�O�\,e!GsÌKF LX\&[WG5I�PN\KJ�PNJzO�]1GK[(U h�F8U(f]gU�J�T&PNJS_^\KJ;I�bSUHO�U�J1O�\ VW¼ O�[�\KJ&r�_ RSVG5I�PN\KJ�a,I�b�UWO�U8ÌKF¹]g\ O�PwI�PX\ J�O�[WG,JjkgUBR�J�T&U�VO�I�\Z\&TjGKO!I�bSULN\Z[WG5I�PX\ J�OH�obSU�V�UqVGvM&OBUWY;U�V�_KPNJS_te�V�\KYäI�bSU;PXYsGK_KU;]SLQG,JSU^LX\&[WG5I�PN\KJ1O8PNJ}U�PXI�bSUWV3Gt]�GKV�GKLXLNU�LkSRSJ1T&LXU`\ ViG^]1UWV�O�]1U�[�I�PXu UD[�\KJSUDPNJ>I�U�VO�UW[�I�I�bSU`\Kk&îxU�[�IOoPXJ�e�V�\KJ>Ii\,e{I�bSU3O�U�J�O�\KV�h��bSU�LX\&[�GKLKe�U�G5I�RSV�Uo[�LXR�O�I�UWV�PNJS_H[(\KJ1[(U�]SI0PQO$]�G,V�I�PQ[(R�LNGKV�LNM`G5I�I�V�G [�I�PXu U!e�\KV0VG,JS_ U�PNYsG,_KU�O�U�_,f

Y;U�J>I�G,I�PN\KJ~O�PXJ1[(Ul��RSJSLNPX| UtPNJ I�U�J�O�PXIxM�Y;UWG O�R�V�UWY^UWJ>I�O�HI�bSU�Y;UWGKO�RSV�U�Y;U�J>IO3G5I.U�GK[b�]SPXp&U�Lb�Gvu U`I�bSU;O�G,Y;U3RSJSPXI�O;��LXUWJS_,I�b1��µ�I�bSPNOH�d\KRSLQTnYsG,| U� K£�_�ÑWÕBI�V�GKJ�Oxe�\ V�YsG,I�PN\KJ�OB\KVBJ�\KV�Y;GKLwfPNmWG5I�PX\ J�OH\,e�I�bSU;PNY;GK_KUqe�UWG,I�RSV�UWODRSJ�JSUW[�UWO�O�GKV�M�PXe�I�bSU�PNV`_K\>G,L$PNOHI�\yPNY;]1\>O�U^UW�>R�GKL!O�[WG,LNPXJ�_\KJjI�bS\>O�UBe�UWG5I�RSV�UWOWh$�B\5��UWuKU�V�aKVG,J�_KUiPNYsG,_KU8O�UW_KY;U�J>I�UWV�O�\,e�I�U�J�G TSTjG TST&PXI�PN\KJ�GKL�Y;UWG O�RSV�U(fY;U�J>I�OoI�\^I�bSUDe�U�G5I�RSV�U`O�]�GK[�UKa&V�U�Y;\5uZPXJ�_.I�bSPNOBGKT&u5G,J>IG,_KU h��V�GKJS_KUdPNY;GK_KUiO�U�_ Y^UWJ>I�G5I�PX\ J^O�M&OxI�U�YðT&UWO�[(V�PXkgUWT^PNJnÄ ë>ÆvÇ�UWY^]�LX\5M&OcO�� R1G,V�UWTqU�V�V�\ V0[�LXR1Oxf

I�UWV�PNJS_�PNJ�G�O�PwpZf�T&PNY^UWJ�O�PX\ J�G,L0e�U�G5I�R�V�UsO�]�GK[�U;G O`G�O�\ RSV�[�U;\,eoG,J ö PNJSPwI�PNGKLNø�O�U�_ Y^UWJ>I�G5I�PX\ J�obSPQ[b¿PQOjV�U(r�JSU�TÛ��IxMZ]SPQ[�GKLXLNM�k>M�Y;U�V�_KPNJS_~O�U�_KY;UWJ IO��sPXJ>I�\�I�bSU�\KR&I�]SR&I�O�UW_KY;U�J>I�G,I�PN\KJ�h��bSUHI�U�[bSJSPQ�>RSU8��GKOdUWJSb�G,J1[(UWT�PNJ�Ä ê ËvÇ�GKJ�TtR1O�U�TtPNJ�G^V�UW[(UWJ>I�O�M&OxI�U�YsG5I�PN[H[(\ Y^]1G,V�PNO�\KJj\KeVG,JS_ U`PXYsG,_ U.O�U�_KY;UWJ I�U�VO`Ä ë Å5Ç�µgG OBO�R�[b�a1PwIHPNOB]SV�\ k�G,k�LXM�\KJSU3\KecI�bSU.LX\ JS_KU�OxI�f�LNPXu UWTyVG,JS_ UO�U�_KY;UWJ I�U�VOd�obSPN[b�b�G O�]1UWV�e�\ V�Y;U�Tt�dU�LNL�\KJnG^LNGKV�_ U8u5GKV�PNU(IxMj\Ke{VG,JS_ U8PNYsG,_ UWOWh��bSPNODO�U�_ Y^UWJ>I�U�VD�d\KV�|&OBGKO8e�\ LXLN\5�iO�h3�dI`U�GK[bz]SPXp&U�Li�3/M�ËTZ�iPNJlI�bSU^PXJS]�R&I3V�GKJS_KUqPXYsGK_KUKa

I�b�Uq[(\ V�V�UWO�]g\KJ�T&PNJS_sÌKF Y;UWGKO�RSV�U�Y;U�J>IBPQOBTSU�JS\KI�UWT��3� !SR �PO !ÞR �RQ !SR ��ag�obSUWV�U`IxMZ]SPQ[�GKLXLNM6� !SR PNOG`LNPXJ�UWG,V�e�RSJ�[(I�PN\KJj\KebTy��I�bSUH[(\KLNRSY;JsJZRSY.kgU�V��!GKJ�TSO�!SRBPNO�G3LNPXJ�UWG,V!e�RSJ�[�I�PX\ Jj\,e,/���I�bSUBV�\5�JZRSY.kgU�V���h!��L�76LjJSUWPX_ bZk1\ V�bS\Z\&Ts\Ked��/O�ËT>��PQO�R�O�U�TsI�\qU�OxI�PXYsG5I�UHI�bSU`ÌKFÉO�RSV�e�GK[(UHJS\ V�YsG,L´ !ÞRC�¤��5�T!SR �F5�U!SR �F5�V!SR ��G,Iq��/O�%TZ�(a&IxMZ]SPN[WG,LNLXM�kZMjr�J�TSPXJS_jI�bSU`LNUWG OxI�f�O��>R�G,V�UWOd]SLQG,J�GKV�rSIiI�\;I�bSUÌKFÉ]g\KPNJ>I�O�PNJtI�bSU`JSUWPX_ b>kg\KV�bS\Z\&T�h0��bSUHe�UWG5I�RSV�UHu UW[(I�\KV�e�\KV�I�bSUD]SPXpZUWL�G5I3��/O�ËT>��PQOdI�bSU`O�PwpZfT&PNY;U�J�O�PX\ J�G,L{Y;UWGKO�RSV�U�Y;U�J>Iq�3��!SRN�PON!ÞR��RQ�!SR��F5�T !SR �F5 U!SR �F5�V!SR �(agGKJ�TzGj[WG,J�T&PQTSG,I�U.O�U�_ Y^UWJ>I�G5I�PX\ JPQO!e�\ RSJ�TskZMs[(LNR�O�I�U�V�PNJS_`I�b�UWO�Uie�UWG,I�RSV�UBu UW[(I�\KVOWh{�S\ V�]�V�G [�I�PQ[�GKL�V�UWG O�\ J�O�aKJS\,IdU�uKUWV�M^]SPXp&U�L�¼ Oe�UWG,I�RSV�UouKU�[�I�\KV!PQOcR�O�UWT;PNJ;I�bSU8[(LNR�OxI�U�V�PXJ�_`]SV�\&[�UWT&RSV�UKµKIxMZ]SPN[WG,LNLXM���N���8e�UWG,I�RSV�UiuKU�[�I�\KVOcG,V�U[bS\>O�UWJ�kZMtO�RSk�O�G,Y;]SLNPXJ�_�h��bSUq�X}�ÃHÒ&�oØUg÷G,LN_K\ V�PXI�bSY Ä Å>ÆvÇ���GKOdR�O�UWT�I�\s\ k&I�GKPXJ�O�UW_KY;U�J>IoLQG,kgU�LQO�e�\KVoU�GK[by]SPwp&UWL�h

�X}�ÃHÒ&�oØUg�PQO�GKJ`U�JSb�GKJ�[(UWY;U�J>I�\,eZI�bSU�L>f�Y;UWG,J1O�G,LN_K\ V�PXI�bSY�µ�PwI$b�GKO�I�bSU�GKkSPNLXPXIxMBI�\oPNTSU�J>I�PXe�MO�U�uKUWV�GKLg[�LXR1OxI�U�V�PXJS_>O�\Ke$G^TSG5IGqO�U(I�a&UWG [bj�oPwI�byG;T&PX��U�V�U�J>IdJZRSYqk1UWV�\,e$[�LXR1OxI�U�VO�hc�i\K�gYsGKJG,J1T"G>G,PNJ�G,LQO�\�U�pZ]gU�V�PNY^UWJ>I�UWT��oPXI�b�\KI�bSUWV.[(LNR�O�I�UWV�PNJS_yI�U�[bSJSPQ� R�UWOt��¢W·¸©>·Nac[(\ Y^]�LXU�I�U(f�LNPXJS|�aO�PXJS_ LXU�f�LNPNJS|�a>_ V�GK]Sb&f�I�bSUW\KV�U(I�PN[Ka>GKJ�Tj\KI�bSUWV�O��>R�G,V�UWTtU�V�V�\ V�GKLX_ \KV�PwI�bSYsO���G,J�Tje�\KRSJ1T��X}»Ã8Ò>f�oØUg¿I�\;]SV�\5uZPNT&U8I�b�UHkgUWO�Ii[(\ Y.kSPNJ�G5I�PX\ Jt\Ke{]gU�V�e�\KV�Y;GKJ�[(UDG,J1TtGK[W[(RSVGK[�MKh0�iJ�GKTSTSPwI�PX\ J�G,LGKTSuvGKJ>I�G,_ U`\,e��X}�ÃHÒ&�oØUgÉPQOoI�b�G5IHPwI8]SV�\&T&R1[(UWO8GjO�UW�>RSU�J1[(U3\Ke0\ R&I�]�R&IH[�LXR�O�I�UWV�PNJS_>O3�x§�·�¢�·NaG.Ë5f�[�LXR�O�I�UWV�O�\KLNR&I�PN\KJsR�]jI�b�V�\ RS_KbjGAÆXW�Y T f�[�LXR1OxI�U�V�O�\ LXR&I�PX\ Js�obSU�V�U|ÆZW�Y T PNOdO�]gUW[�Pwr1UWTskZMI�b�U8R�O�U�VoGKJ�TjPQO�IxM>]�PN[WG,LNLXMjËa�.\KV�O�\Z��µZUWG [b�[�LXR�O�I�UWV�PNJS_qPXJtI�bSPQOoO�U��>RSU�J�[�UBMZPNU�LQTSO�Gq[�LXR�O�I�UWV�fPNJS_sOxIG5I�PQO�I�PQ[B�obSPQ[b�[(\KYqkSPNJSUWOdkgU(Ix�dU�U�JSf�[�LXR�O�I�UWVoO�UW]�G,VG5I�PX\ JtG,J�T��oPXI�bSPNJ&f�[(LNR�OxI�U�ViO�[�G,I�I�UWVWh��bSUD[(LNR�O�I�U�V�PNJS_.I�b�G5I�\K]SI�PNY^PNm�U�O�I�bSPQOoOxIG5I�PNO�I�PQ[BPQO�[bS\ O�U�J�GKO�I�bSUDkgUWO�Id\ JSUKhcØ�G [bj]SPXp&U�L�PNJI�b�UsV�GKJS_KU^PXYsGK_KU^PNO`G O�O�PX_ JSUWTzI�bSUjO�U�_ Y;U�J>IHLQG,kgU�L�\,e�I�bSUsJSU�G,V�UWO�ID[�LXR�O�I�UWV3[(UWJ I�U�V�h^��b�PNOY;PXJ�PXYqRSYùT&PQO�I�G,J1[(UD[(LQGKO�O�PXr1[�G,I�PN\KJyOxI�U�]yPNO�JS\KIo_KR�GKV�GKJ I�U�U�T;I�\;]SV�\&T&R�[(U`O�U�_ Y^UWJ>I�Od�obSPQ[bG,V�Ui[(\ JSJSU�[�I�U�TsPNJ;I�bSU8PXYsG,_ Ui]SLQG,JSU µKI�bSU�V�U(e�\ V�U a G3[�\KJSJ�UW[�I�UWTs[�\KY;]1\ JSU�J>IO!LQG,kgU�LNPXJS_^G,LN_K\KfV�PwI�bSY¶G,LNLX\&[�G,I�U�O!JSUW�¿LNGKk1UWLNO�e�\KVdT&PQO�îx\ PXJ>I�V�U�_ PX\ J�OcI�b�G5I��dU�V�Ui]SLQGK[(U�TsPNJsI�bSUDO�G,Y;UB[(LNR�O�I�UWVWhÒZRSk1O�U�� R�U�J>I8\ ]1UWV�G,I�PN\KJ�OBPXJ�[�LXR1T&UqO�RSV�e�GK[(U.IxMZ]1U.I�UWO�I�OWa�Y;U�V�_KPNJS_j\,e�G Tvî�GK[�U�J>I8]1G5I�[b�UWOiR1Oxf

Page 43: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � Ö ³

(a) (b)

(c) (d)

ä(jel*�MÔ~öq�þ¶�tEk*lTh�je|�tElThVfGh=lT|_h=k~g�tSgPjewTk�d*fPjek*l�s=bed*fPgPh=iGjek*l*� y%t~���� �k*o*dqgVi�tEk;lTh�je|�tElTh~� yKzB���0�Xd*iPx%tEs=hk*wTiP|�tEbef�x%wTi�fPh:beh=s�gPh:rúje|�tElTh�o*j �qh=bef��ýyKs����8 �k*j gPjutEb�fPh=lT|_h:k~gGtSgGjewTk¯yPÞ:ó§s=bed*f gGh=i�fGwTbedqgGjewTkB�LiPh=gPd*iPk*h=rúz~�acØ�à}�X��ô�¶d;fGjek*l�Þ:øTøTø0fGj �X��r*je|_h=k*fPjewTk3tEb�fGtE|_o*beh=f�xKiGwT| gPm*h8je|�tElTh8tEfVt�o3tSg gGh=iPk¯fPh�g��y%r3���Rä(jek3tEbfGh=lT|_h=k~g�tSgPjewTk§y%÷�fGh=lT|_h=kXgPf��co*iPwqr;d*s=h:r�zX��oBwTfPgPo*iGwXs=h=fGfGjek;l*�

PNJS_^G3I�U�OxIde�\KV�I�bSUD]SV�UWO�U�J1[(UB\Ke�[(V�UWG O�U8\KV{îxRSY;]tUWTS_KUWOdkgU(Ix�dU�UWJtGKTvî�G [(UWJ IoO�U�_KY;UWJ IO�aZG,J1TO�RSV�e�G [(UD]�GKV�GKY^U�I�UWVdU�OxI�PXYsG,I�PN\KJ�h�{PN_KR�V�U.Ë>Ü.O�bS\5�iOdI�bSPNOB]SV�\Z[�UWO�O�PNJS_;G,]S]�LXPNUWTyI�\jG;V�GKJS_KUHPXYsGK_KUKhdÞcG,V�ID��G ��\Ke{I�bSU`r�_ RSV�U

O�bS\5�iO$I�bSUBPXJS]�R&I�VG,JS_ U�PNYsG,_KU µK]�GKV�IB��k1�cO�bS\5�iO$I�b�UBT&PQOxI�V�PNkSR&I�PX\ J^\Ke�O�RSV�e�GK[�UoJS\KV�YsG,LQO�h{��J]�GKV�Io��[���a,I�bSU�PXJ�PwI�PNGKLZO�U�_ Y;U�J>I�G,I�PN\KJ.V�U(I�RSV�JSUWT.k>Mq�X}»Ã8Ò&�oØ�g�GKJ�T3Y;\&T&PXr�UWT.I�\D_ R�G,VG,J>I�UWU[(\ JSJSU�[�I�U�TzO�U�_KY;UWJ IOiPQO8O�bS\5�oJ�hHÞcG,V�I.��T��8O�bS\5�iOoI�bSU3r�J1G,L0O�UW_KY;U�J>I�G,I�PN\KJn]SV�\&T&R�[�UWTnkZMY;U�V�_KPNJS_8G Tvî�GK[�U�J>I0]�G5I[bSUWO{�obSPQ[bqT&\HJS\,I0b�Gvu U�GHO�PN_KJSPXr1[WG,J>I$[�V�U�GKO�U�UWTS_KU�kgU(Ix�dU�UWJ3I�bSU�Y�h��bSU�r�J1G,LB[�LXR�O�I�UWV�O;V�UWG O�\ J�G,k�LXM�V�U�]SV�UWO�U�J>IsT&PQOxI�PXJ�[(I�O�RSV�e�G [(U�O;]SV�U�O�UWJ>I;PNJ�I�bSPQOj[�\KY;]SLNU(p\KkSîxUW[�I�h��bSU�GKJ�G,LNM&O�PQO`\,eoI�U(pZI�R�V�U�T�PXYsGK_KUWO.b�GKO.k1UWU�J~\KeiPXJ>I�U�V�UWO�I.I�\lV�U�O�U�G,V[bSU�VOHe�\KV;O�UWuKUWV�GKL

MKU�G,VO�h��{U(pZI�R�V�UnO�U�_KY;UWJ IG5I�PX\ J�I�UW[bSJSPQ�>RSUWO;b1GvuKU�k1UWU�J�T&UWuKU�LN\K]gUWT�R�O�PXJ�_~G�u5GKV�PNU(IxM~\KeI�U�pZI�RSV�UtY;\&T&U�LQO^G,J�T�PNYsG,_ Uj\K]gU�VG5I�PX\ J�O�hl��J¹ÄX��Í>Ë5Ç�a{I�U�pZI�RSV�U�PNYsG,_ UtO�UW_KY;U�J>IG5I�PN\KJ���GKO

Page 44: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

Ö�Ö � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

(a) (b)

ä(jel*�5ÔT÷;�þ��h��XgGd;iGh�je|�tElTh�fGh=lT|_h=k~g�tSgPjewTk�iGh=fGd*b gPf���yDt~���}ä3wTd*i ��s=butEfGf�gPh��qgPd*iPhL|_wTf�tEjesT��yKzB���}ä3wTd*i ��s=bed*fPgPh=ifGwTbedqgGjewTk o*iGwXr*d*s=h=rVz~�VacØ�à��q��ôc¶I��j gPm�o*j �qh=b[s=wqwTiPr*jek3tSgPh:f�jek*s=bed*r*h=rVjek�gPm*hnx%h:tSgPd*iGhnfPh=g:�

GKT�T&V�U�O�O�UWT�kZM�Y;\&T&U�LNPXJ�_lI�bSUtPNYsG,_KUyGKO^GzbSPNU�VG,V[bZMl\KeiIx��\P9zG,V�|K\5u8giG,J1T&\KY �$PXUWLNT�O�a\KkSI�G,PNJSPNJS_8O�\KY;UdO�PNY;]SLXU�O�I�G5I�PNO�I�PQ[�O�e�V�\KYÛUWG [b3PNY;GK_KU�kSLX\&[|HI�\Be�\KV�Y Goe�U�G5I�R�V�U�uKUW[(I�\ VWa5G,J1T[(LNR�O�I�UWV�PNJS_�I�bSU�O�U;kSLN\&[|ZOHR�O�PNJS_yGte�RSmWm�M�Æzf�Y;UWGKJ�OH[(LNR�OxI�U�V�PXJ�_�Y;U(I�bS\&T�h;��bSUs[(LNR�OxI�U�V�PXJ�_]SV�\&[(UWTSRSV�U8bSU�V�UHPNO�Y;\ZTSPwr�U�TjI�\Bîx\ PXJ>I�LXMsU�OxI�PXYsG5I�UBI�bSUHJ>R�Y.kgU�V�\,e{[�LXR1OxI�U�VO�G O��dU�LNL�GKO�I�bSUe�RSmWm�MtY;UWY.kgU�VO�bSPN]y\,e0UWGK[b�e�UWG,I�RSV�UDuKU�[�I�\ VdI�\;I�b�U`uvGKV�PN\KR1Od[�LXR1OxI�U�VO�h��O�M&OxI�U�YÉe�\KV0O�U�_KY;UWJ I�PXJ�_iI�U�pZI�RSV�U�PNYsG,_KU�O���GKO$T&U�O�[�V�PNk1U�T`PNJ�Ä ÅKê5Ç�µvI�b�U�V�UKaKþDG,kg\KV{r�LXI�UWV�O

�dU�V�UoR�O�U�T^I�\3\ k&I�GKPXJsG3O�U(I�\,e�Ë,ëD\ V�PNU�J>I�G,I�PN\KJ&f�GKJ�TsO�[�G,LNU(f�O�U�LNUW[�I�PXu Ude�UWG5I�RSV�UWOcI�b�G5Id[b�G,VGK[(fI�UWV�PNm�UBI�bSU8I�U�pZI�RSV�UBPNJjI�bSUBJSUWPX_ bZk1\ V�bS\Z\&Ts\Ke�UWGK[bs]�Pwp&U�L�h!��bSU�O�UDË,ëDe�U�G5I�R�V�U�O�GKV�UiV�UWTSR�[(U�TI�\�GyO�YsG,LNLNU�VHJ>R�Y.kgU�VHI�bSV�\KR�_KblGte�UWG,I�RSV�U^O�U�LNUW[(I�PN\KJz]�V�\&[(U�T&RSV�UKa�G,J1TnI�b�U^V�UWO�RSLXI�PNJS_je�U�G5fI�R�V�U�O�G,V�Ui]SV�U�]�V�\&[(U�O�O�UWT;GKJ�T^I�bSUWJ�[�LXR�O�I�UWV�U�T;R�O�PXJS_3I�bSU`�X}�Ã8ÒS�oØUg�]SV�\K_ V�GKY�h{�iJtPXJ�TSU(pO�I�G5I�PNO�I�PQ[DÄ Í>ê5ÇSPQO0R�O�UWTqI�\`O�U�LNUW[�I0I�bSUok1U�OxI�[�LXR1OxI�U�V�PXJS_1h 9zPXJSPNY.R�Y¤T&PQOxIG,J�[�Uo[(LQGKO�O�PXr1[�G,I�PN\KJqPNOR�O�UWTqI�\`LQG,kgU�L�UWGK[b^\,egI�b�Ui\KV�PX_ PXJ1G,LZPXYsGK_KU�]SPXpZUWLNOWhc��bSPQO0I�U�[bSJSPQ� R�Uo�dG O$I�UWO�I�U�T^\KJsO�UWuKUWV�GKLI�U�pZI�RSV�UDY^\>O�GKPN[WO�PNJ�[�LXR�TSPXJS_^I�bSUDJ�G5I�RSV�GKL�\�V�\&TSG5I�mBI�U(pZI�R�V�U�OdGKJ�TyO�MZJ>I�bSU�I�PQ[HPXYsG,_ UWOWh$�$PN_,fRSV�U.Ë,ë1��G �dO�bS\5�iOoG,JyPNJS]SR&IiI�U(pZI�R�V�U`Y;\ O�G,PQ[D[(\ J�O�PQO�I�PNJS_;\,e$e�\KRSVo\Ke{I�bSU3]g\K]SRSLQG,V�\dV�\&TSG5I�mI�U�pZI�RSV�UWO�Ä ËKËvÇ�h�ÞcGKV�I���k1�^O�bS\5�iO3I�bSUnO�UW_KY;U�J>IG5I�PN\KJ�]SV�\ZTSR�[(U�T~�obSUWJ~I�b�UnþDGKk1\ V^r�LwI�U�Ve�UWG,I�RSV�UWO;GKV�U�G,RS_ Y;U�J>I�U�T~I�\�[�\KJ>I�GKPXJ�O�]1G5I�PQG,L�PNJ&e�\KV�YsG5I�PX\ J÷��]SPwp&UWLi[(\Z\KVT&PNJ�G5I�UWO��h���b�PNOþDG,kg\KVDr1LwI�U�V`k�G O�U�TzI�UW[bSJSPQ�>RSUsb�G OD]SV�\5u U�J�uKU�V�Mn]g\5��UWV�e�RSL!GKJ�T�b�GKODkgU�UWJ}U�pZI�U�J1T&UWT�I�\I�b�UDGKR&I�\ YsG5I�PQ[DO�UW_KY;U�J>IG5I�PN\KJ�\,e{I�U(pZIoPNJyT&\&[�RSY;U�J>I�O`Ä Å>ÜvÇ�G,J�T�O�UW_KY;U�J>I�G,I�PN\KJ�\,e{\ k&îxUW[(I�OPNJ�[�\KY;]SLNU(ptk1GK[|Z_KV�\KRSJ1TSO8ÄX��>ËvÇ�h��LXR�O�I�UWV�PNJS_l[WG,J~kgUtR1O�U�T~GKOqGn]SV�U�]SV�\&[(UWO�O�PXJS_zO�I�GK_KUsI�\lPQT&U�J>I�Pwe�M�]�G,I�I�UWV�J�[(LQGKO�O�U�ODe�\KV

O�RSk�O�UW�>RSU�J>I;O�RS]gU�V�uZPNO�UWT�[(LQGKO�O�PXr1[�G,I�PN\KJ�hÀgoU(e�UWV�UWJ�[(U�O�ÄX�Wë>Ë&µi�vË5ÍKÇdT&U�O�[�V�PNk1UyGz]�GKV�I�PwI�PX\ J�G,L[(LNR�O�I�UWV�PNJS_nG,LN_K\ V�PXI�bSY G,J�T�G�YsG,JZR�GKLcLNGKk1UWLXPNJS_�I�U�[bSJSPQ�>RSU;I�\nPQT&U�J>I�Pwe�M}YsG5I�UWV�PQG,L![�LNG O�O�UWO��¢�·¸©>·Na [(UWV�UWkSV�\ O�]SPXJ1G,L,Ý1RSPNT�a,�obSPXI�U�YsG5I�I�U�V�a,OxI�V�PQG5I�UWT.Y.R�O�[(LNUKavI�RSY;\KV���PNJ.V�U�_ PNO�I�UWV�U�T`PXYsGK_KUWO\,eiGnbZRSYsGKJ~bSUWG T�\Kk&IG,PNJSUWT�G,I3r�u UtT&PX�gUWV�UWJ I^YsG,_KJ�U(I�PQ[;V�UWO�\KJ�GKJ�[(UsPNYsG,_KPNJS_l[b1G,JSJSUWLNO��MZPNU�LQT&PNJS_tG^r�u U(f�T&PXY;UWJ�O�PN\KJ1G,L�e�UWG,I�RSV�U3u UW[�I�\KViG,IBUWG [b�]SPXp&U�L���ho�ÛJZRSYqk1UWVi\,e![(LNR�O�I�UWV�PNJS_ O�dU�V�Ui\Kk&IG,PNJSUWTsGKJ�Tj[�\KY.k�PXJSU�T;�oPwI�btT&\ Y;GKPXJt|>J�\5�oLXU�T&_KU3��b>R�Y;GKJjU(p&]gU�V�I�PQO�Uv�0I�\3PNTSU�J>I�PXe�MI�b�UiT&Pw��U�V�U�J>I�[�LNG O�O�UWOWh{F8UW[�PNO�PX\ JqV�RSLNUWO$e�\ V!O�RS]gU�V�uZPNO�UWT^[(LQGKO�O�Pwr1[WG5I�PX\ Jq�dU�V�U�k1GKO�UWTq\KJ^I�bSU�O�U

Page 45: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � Ö ì

(a) (b)

ä(jel*�5ÔTó;� õVd;b gGjefPo,h=s�gPi�tEbZõVh=r*jes:tEb� �|�tElThL�qh=lT|_h:k~gGtSgGjewTk6��y%t~����Å fGjek*lTbeh�s�m3tEk;k*h=b�wEx�gPm*hLjek;o*d;gnje|�tElThT�yKzB����óS��s=bed*f gGh=i�fGh=lT|_h=kXgGtSgGjewTk5�

(a)[

(b)

ä(jel*��¾Tø;�þØ6Å}ñ��}�qÅ�� je|�tElTh fPh=lT|_h:k~gGtSgGjewTk6�¯y%t~����ù�iGjelTjek3tEb�je|�tElTh�y sò ôM�XÅnÿSôcà�¶�  õVÅ{?�ôcÿT�;tSgPgPh=bej gP�z*jeberB����y%z3���cacbed*fPgPh=iGh=r�fPs:h=k*hT�\KkSI�G,PNJSU�Ty[�LNG O�O�UWOWh��$PN_KRSV�U.Ë,Å1��G �dO�bS\5�iO�\KJ�U3[b�G,JSJ�U�L�\Ke0GKJyPNJS]SRSIBY.RSLXI�PQO�]1U�[�I�VG,L{PXYsGK_KUKµ]�GKV�I3��kg��O�bS\5�iOdI�bSU3Å5f�[(LNR�O�I�UWVdV�UWO�RSLXIWh��bSU2L>f�Y;UWG,J1OBG,LN_K\ V�PXI�b�Yý��GKOiGK]S]SLNPXU�TyI�\jI�bSU.O�U�_ Y^UWJ>I�G5I�PX\ J�\,eU}��8úBFDÒ&�c�ÉPNY;GK_KUWV�M

PNJÉÄX�vÜKÆvÇ�h���JSPwI�PNGKLB[(LNR�O�I�UWVt[(UWJ I�U�VO;��UWV�Un[bS\>O�UWJ�PNJ>I�UWV�G [�I�PNuKUWLXM�kZM�GlI�V�GKPXJ�UWT�\K]gU�VG5I�\KV�aG,J1T�[(\KV�V�UWO�]1\ J�TzI�\zLQG,J�TZf�R�O�Uj[(LQGKO�O�U�O`O�R1[b~GKO`RSV�k�GKJ~G,V�UWGKOWa�O�\KPNL8��uKU�_ U(IG5I�PN\KJSf�e�V�U�Uv�8GKV�fUWG O�a�e�\KV�UWO�IWa1_KVGKO�O�LQG,J�T�a�G,J�Tz�dG,I�U�V�ho�$PX_ RSV�UqÌ�����G ��O�bS\5�iO�I�bSU.PNJS]SR&IHPXYsGK_KU3V�U�J�TSU�V�UWTnGKO_KVGvM&O�[WG,LNUKµ>]�G,V�I3��k1��O�bS\5�iOdI�bSU`V�U�O�R�LwIo\,e$I�b�U3[(LNR�OxI�U�V�PXJ�_^]�V�\&[(U�T&RSV�UKhêShN�Kh Ì�ÄgÔ&ÙqÙs 5¦�ÚK·i��J.I�bSPNO�O�U�[�I�PN\KJ�a5I�bSUiGK]S]SLNPN[WG5I�PX\ Jq\Keg[(LNR�O�I�UWV�PNJS_DY;U(I�b�\ZTS\KLN\K_KM3I�\DPXY^f

G,_ UoO�UW_KY;U�J>I�G,I�PN\KJq]SV�\ kSLNU�YsO0b�GKO0kgU�UWJ;Y^\KI�PNu5G5I�U�TqGKJ�T;O�R�V�u U�MKU�T�h���bSUob�PNO�I�\ V�PQ[�GKL>V�UW[�\KVTO�bS\5�iO0I�b1G5I�[�LXR�O�I�UWV�PNJS_`PQO�G`]g\5�dU�V�e�RSL&I�\Z\ LSe�\KV�\Kk&IG,PNJSPXJ�_.[(LQGKO�O�PXr1[WG5I�PN\KJ1O0\,e�PXYsGK_KUo]SPXp&U�LQO�h

Page 46: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

Ö ü � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*îDU�M�PQO�O�RSU�OBPNJlI�bSU;T&UWO�PX_ Jz\,edG,JZMn[(LNR�OxI�U�V�PXJ�_,f�k�GKO�UWTnO�U�_ Y^UWJ>I�U�VDG,V�U3I�bSU;[bS\KPQ[(Uq\,e�]SPXp&U�LY;UWG O�RSV�U�Y;UWJ IO3��e�U�G5I�RSV�U�O��iG,J�TnT&PNY;U�J�O�PN\KJ�GKLXPXIxM�\Ke0I�bSU`e�U�G5I�RSV�U.uKUW[(I�\ V.�x§�·�¢�·Na�O�b�\KRSLQT�I�bSUe�UWG,I�RSV�UBu UW[(I�\KVd[(\ J IG,PNJjPNJ I�U�J�O�PXI�PNUWOWa>]�Pwp&U�L�]g\ O�PwI�PX\ J�OWa Y;\&T&U�L�]�GKV�GKY;U(I�UWV�OWa,r1LwI�U�V�\KR&I�]SR&IO�a¢�¥�Õ�ãv��a&G3Y;UWG O�R�V�Ui\Ke�O�PNY;PXLQG,V�PXIxMq�obSPQ[bjPQO�GK]S]SV�\K]SV�PQG5I�Uie�\KV!I�bSUDO�UWLXU�[�I�U�T;e�UWG,I�RSV�UWOdG,J1T^I�bSUG,]�]SLXPQ[�G,I�PN\KJ�T&\ Y;GKPXJ�a�I�bSUjPQT&U�J>I�PXr1[WG5I�PN\KJ�\KeoGn[�LXR1OxI�U�V�PXJS_zGKLX_ \KV�PwI�bSY�a�I�bSUjT&U�u U�LN\K]SY;UWJ I\,eHOxI�V�G,I�U�_ PXU�O`e�\ V.e�U�G5I�R�V�UyG,J�T�TSG5IGzV�UWT&R�[(I�PN\KJæ��I�\�GvuK\ PNT}I�bSU ö [(RSVO�Uj\,e8TSPXY;U�J1O�PN\KJ�GKLwfPXIxMZø^G,J1TsI�b�UH[�\KY;]SR&IG5I�PN\KJ1G,L�kSRSVT&U�J�\,e0[(LQGKO�O�PXe�MZPXJS_qLNGKV�_ UBJZRSYqk1UWV�O�\,e$]�G5I�I�U�V�J�OdG,J�TgÊv\KVe�UWG,I�RSV�UWO��acGKJ�T}I�bSUtPNT&UWJ>I�PXr1[�G,I�PN\KJ�\,eoJSU�[(U�O�O�G,V�Mz]SV�U(fDG,J�T�]g\ O�I�f�]SV�\Z[�UWO�O�PNJS_yI�U�[bSJSPQ�>RSUWO��¢�·¸©>·Na&PXYsG,_ UiO�Y;\Z\,I�bSPNJS_.G,J1T;Y^PNJSPNY.RSY¶T&PQO�I�G,J1[(Ui[(LQGKO�O�Pwr1[WG5I�PX\ J1��h0��bSUiR�O�Ui\Ke�[(LNR�OxI�U�V�PXJ�_e�\KV�O�U�_KY;UWJ IG5I�PX\ JtTSG5I�UWO�k�GK[|^I�\.I�bSUq��ÅKêN�KO�GKJ�TjJ�U���u5G,V�PNG,I�PN\KJ�Od[(\ J>I�PNJ>R�UiI�\^U�Y;UWV�_ UBPNJI�b�U`LXPXI�UWV�G,I�RSV�UKh���b�GKLXLNU�JS_ UWOdI�\;I�bSU`Y;\KV�UDO�R�[W[(U�O�O�e�RSL�R�O�UD\,ec[(LNR�O�I�U�V�PNJS_;PXJ�[�LXR1T&UDI�bSU`b�PX_ b[(\ Y;]SR&I�G,I�PN\KJ�GKL�[(\ Y;]SLXU�p&PwIxMq\,e�YsG,JZMq[�LXR�O�I�UWV�PNJS_3GKLX_ \KV�PwI�bSYsO!G,J�TqI�bSU�PNV�PNJ�[(\ V�]g\KVG5I�PX\ Jq\KeO�I�V�\KJS_iG O�O�RSY;]&I�PN\KJ1O!��\Ke�I�U�J`YqRSLXI�PNuvGKV�PQG5I�U�þDG,R1O�O�PNGKJ1��G,kg\KRSI�I�bSU�Y.RSLXI�PQT&PNY^UWJ�O�PX\ J�G,L>O�b�GK]1U\,e0[(LNR�O�I�U�VO�I�\;kgU`\Kk&IG,PNJSUWT�hc��bSU`GKkSPXLNPXIxMj\,e$JSU��÷[(LNR�OxI�U�V�PXJ�_q]SV�\&[(U�T&RSV�UWO�I�\;b�GKJ�T&LNUD[�\KJ&f[(UW]&I�O8G,J�TnO�U�YsGKJ I�PN[WOiPNJl[(LQGKO�O�Pwr1[WG5I�PX\ J}��PXJlG TST&PXI�PN\KJnI�\jJZRSY;U�V�PN[WG,L�Y;U�GKO�RSV�UWY;U�J>I�O���oPNLXLkgU`PXY;]g\KV�I�G,J>I�e�\KVi[�U�V�I�GKPXJ�G,]S]�LXPQ[�G,I�PN\KJ�O`ÄX�WÌ>Ë&µ��WÌ Å5Ç�h

èZ# À `�ØP\�<q1~9�)6-3H�E}23),AD)31~9=<BA�A�<q1XU,4(-,+ 9S+ U(-êSh¸Ë&hN�K]i¡3e�¢�Õ�¥ �8¢Õ�Ñ�©K¨�§�¥�§�Ñ5¨g·B��bSUDR�O�UH\Ke$[�LXR�O�I�UWV�PNJS_^I�\;_ V�\ RS]tuZPNU��iO�\,e0ÌKFÉ\ k&îxUW[(I�O�e�\KV

I�b�U^]�RSV�]g\ O�UWOH\Ke�\Kk&îxU�[�IDV�U�[(\ _KJSPXI�PN\KJ�PXJ�V�GKJS_KU;TSG5IGt��GKOHT&U�O�[�V�PNk1U�TlPNJ�Ä Í Ì,Ç�hq��bSU^I�U�V�Y´�§�¢K^~V�U(e�UWV�OoI�\�GjV�GKJS_KU`PNYsG,_KU.\,e!G,JzR�JS\&[�[(LNR�T&U�T�\Kk&îxU�[�IH\Kk&IG,PNJSUWTye�V�\KYäG,JZM�G,V�kSPwI�V�GKV�MuZPXUW�o]1\ PXJ>I�h~��bSUyO�M&OxI�U�YâRSJ�TSU�Vs[(\ J�O�PQT&UWV�G,I�PN\KJ~UWY^]�LX\5M UWT~G�´W§�¢�^gÏSÑ,§�¨�¥;£K¢�ÏS¢�¨g£ ¢(¨1¥D��\KVuZPXUW��f�[�U�J>I�UWV�U�T���G,]�]SV�\>GK[byI�\jI�bSUq\Kk&îxU�[�IBV�UW[�\K_KJ�PwI�PX\ Jy]�V�\ kSLXUWY�µ�UWG [bn\Kk&îxU�[�IiI�\jkgU.V�UW[�f\K_ JSPNm�UWT���GKOdV�UW]SV�UWO�U�J>I�U�TtPNJyI�U�V�YsO�\,ecG^LXPNkSVG,V�Ms\,e0V�GKJS_KUHPXYsGK_KUWOd\Ke{I�b�G5Ii\ k&îxUW[(IWh��bSU�V�U3G,V�U`YsG,JZMt]g\ O�O�PNkSLNU`uZPXUW�iOo\,e!GsÌKF \Kk&îxU�[�IBGKJ�T�\KJSU`_ \ GKL�\,e$I�b�G,IB�d\KV�|j�dG O�I�\

GvuK\ PNTjY;G,I�[bSPNJS_^G,JtR�JS|ZJS\5�oJjPNJS]SR&IouZPXUW�æG,_>G,PNJ�O�I�UWG [bjPNY;GK_KUH\,e�U�GK[bj\ k&îxUW[(IWhc�É[(\ YqfY;\KJ�I�bSUWY;UsPXJ}I�b�Us\Kk&îxU�[�I`V�U�[(\ _KJSPXI�PN\KJ�LXPXI�UWV�G,I�RSV�U;PNO;§�¨�£K¢�×K§�¨Z©,a{�obSU�V�U�PNJ�I�bSUsRSJ�|>J�\5�oJuZPXUW��PQO!R1O�U�T^I�\3O�U�LNUW[�I�G.O�RSk1O�U�I!\,e�uZPXUW�iOc\,e�G`O�RSk�O�U(I!\,e�I�bSUi\KkSîxUW[�IOcPNJ;I�bSUBT�G5I�GKk�GKO�Ude�\KVe�RSV�I�bSUWV`[(\KY;]�GKV�PQO�\KJ�agG,J�TlV�U�îxUW[�IO8GKLXL0\KI�bSUWV8uZPNU��iO8\,e�\ k&îxUW[(I�OWh3è8J�U.\,e�I�bSU;G,]S]�V�\>GK[bSU�OI�\�PNJ�T&U�pZPNJS_�U�Y;]SLN\5M&OHI�bSUsJ�\,I�PN\KJ}\,eH´W§�¢�^ Õ��X vÐÐ�¢�Ð�µcGyuZPXUW�¤[(LQGKO�ODPQOHI�bSUjO�U(I`\,eo�>R�G,LNPXI�G5fI�PNuKUWLXM�O�PXY;PNLNGKViuZPXUW�iOo\,e!G,J�\ k&îxUW[(IWh���J�I�b�G,IB�d\KV�|gaSI�bSU3uZPNU��É[(LQGKO�O�U�Oo�dU�V�U`PNT&UWJ>I�PXr�UWT�kZM[(LNR�O�I�UWV�PNJS_sG,J�TtI�b�U`V�U�OxIo\,e$I�b�PNOiO�RSk�O�UW[(I�PN\KJy\KR&I�LXPNJSU�O�I�bSUDI�UW[bSJ�PN�>RSU hè8k&îxUW[(I�uZPNU��iOd�dU�V�U8_ V�\ RS]1U�TjPNJ>I�\s[(LQGKO�O�U�O�k1GKO�UWTj\ JtI�bSU`O�PNY;PXLQG,V�PXIxMs\,e$O�b�GK]1UDO�]gUW[(I�VG,L

e�UWG,I�RSV�UWOWh�Ø�GK[b�PXJ�]SR&IBPNYsG,_KUD\Ke0GKJy\ k&îxUW[(IBuZPXUW��U�TtPNJnPQO�\ LNG,I�PN\KJyM>PNU�LQTSOiG^e�U�G5I�RSV�U`u UW[(I�\KV�obSPQ[b�[b1G,VGK[�I�U�V�PXmWUWO.I�b�G,IjuZPXUW�`h���b�U�e�U�G5I�RSV�U�u UW[�I�\KVs[(\ J>I�G,PNJ�OqI�b�U�r�V�O�I;I�UWJ�[�U�J>I�VG,LY;\KY;U�J>IO!\,e�G`JS\ V�YsGKLXPNm�U�T^O�b�GK]1UiO�]1U�[�I�V�GKL1T&PQOxI�V�PNkSR&I�PX\ J�a7^¤��F_g��a>\,e�G,Js\ k&îxUW[(I!u>PNU��`hc��bSUO�b�G,]gU.O�]1U�[�I�V�RSYä\,e!GKJz\Kk&îxU�[�IBuZPNU��ÉPQOi\KkSI�G,PNJSU�T�e�V�\ YùPXI�OBV�GKJS_KUqTSG5IGskZMy[�\KJ�O�I�V�R�[�I�PXJ�_GybSPQOxI�\K_KVG,Y \KeBÐ�_S ÏS¢t§�¨g£ ¢�×ju5G,LNRSUWOs���obSPN[b�G,V�U^V�UWLNG,I�UWTlI�\nO�RSV�e�GK[(Us[�RSV�u5G,I�RSV�Uqu5GKLXRSU�O��G,J1TnGK[�[�RSY.R�LNG,I�PNJS_tG,LNL�I�bSU3\ k&îxUW[(IB]SPXpZUWLNOiI�b�G,IBe�GKLXL{PXJ>I�\�UWG [byk�PXJ�h�\�MyJS\ V�YsG,LNPNm�PNJS_^I�bSUO�]1U�[�I�V�RSYð�oPwI�bjV�UWO�]1U�[�I!I�\`I�bSUiI�\,IG,L1\Kk&îxU�[�I�GKV�U�GSa5I�bSU8O�[�GKLXU3��O�PNm�Uv�cT&PX�gUWV�UWJ�[(U�OcI�b1G5I�YsGvMU(p&PQOxI8k1U�Ix��UWU�JzT&PX�gUWV�UWJ>IB\Kk&îxU�[�IOiG,V�U`V�UWY;\5uKUWT�h���bSU`r1V�O�IBY;\KY;U�J>Ia`#�HPQOi[(\ Y;]SR&I�U�TzGKOI�b�U`��UWPX_ b I�UWT�Y;UWG,Jy\,eb^¤~�c_1�(È

`#��� n Ì �c_1�Z^¤��F_g�q� �x���

Page 47: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � Ö ���bSU`\KI�bSUWVi[(U�J>I�V�GKLgY;\ Y^UWJ>I�OWad` y a1Ë5�Àwe�æ��;GKV�U`T&U�r�JSUWT�G O�È

` y � n Ì �c_ r `���� y ^¤~�F_g�q� ��ËK�

��bSUWJ�a�I�bSUse�UWG,I�RSV�U;uKU�[�I�\ V`PNO.T&U�JS\KI�U�T}G O!f � �g`����P` k ��JJ�J�P`#� ÿ ��a$�oPwI�b�I�bSUsVG,JS_ U^\KeUWG [b�\Ke�I�bSUWO�U`Y;\KY;U�J>I�O�kgU�PNJS_zÄ r ���W�(Ç�h}�U(IihD��(`Í � �MÍ k ��J�JJ��OÍ + -�kgUoGB[(\ LXLNUW[(I�PN\KJq\,eb5tÌ F�\ k&îxUW[(I�O$�obS\>O�U�u>PNU��iO0GKV�U�]SV�U�O�UWJ>IPNJtI�bSU`Y;\ZTSU�L�TSG,I�G,k1GKO�UKa*jAkDhc��bSU�/�I�byu>PNU��æ\,e�I�bSU|TKI�by\Kk&îxU�[�I�a>Í !R PXJ�I�b�UDT�G5I�GKk�GKO�UHPNOV�U�]SV�UWO�U�J>I�U�TtkZMmlgn !R �of !R%p a��ob�U�V�Uqn !R PNOiI�bSU3\ k&îxUW[(IiLNGKk1UWL{GKJ�T�f !R PQOoI�b�U`e�UWG,I�RSV�U`uKU�[�I�\ VWhþHPNuKU�JjG.O�U�I�\,e�\ k&îxUW[(I�V�U�]SV�UWO�U�J>I�G,I�PN\KJ�O r ! ��(�lgn ! � �of ! � p ��J�JJ��%lgn !W �of !W p -BI�b�G5I�TSUWO�[(V�PXkgUWO`åuZPNU��iOs\Ke8I�bSU�/�I�b�\Kk&îxU�[�I�a�I�bSUn_K\>G,LoPQO;I�\~TSU�V�PXu U�G}]�GKV�I�PwI�PX\ J�\,eHI�bSUnuZPNU��iOWa�s ! �(`� !� �M� !k �J�JJK�M� !out ->hjØ�GK[b�[(LNR�O�I�UWV`PXJ"s ! [(\ J>I�G,PNJ�OHI�bS\ O�U;u>PNU��iOD\Ke�I�bSU�/�I�b�\KkSîxUW[�I`I�b�G5Ib�Gvu U.kgU�U�J�G TvîxR�T&_ UWTlO�PNY^PNLQG,VDk�GKO�UWTl\KJlI�bSUsT&PQO�O�PNY^PNLQG,V�PwIxMnkgU(Ix�dU�UWJlI�bSUs[(\KV�V�UWO�]1\ J�T&PNJS_Y;\KY;U�J>IHe�UWG,I�RSV�UWOH\,e�I�bSU;O�b�G,]gUsO�]gUW[(I�VGj\,e�I�bSU;uZPNU��iOWh3��bSU;Y^U�GKO�RSV�U.\,e�T&PQO�O�PXY;PNLNGKV�PXIxMKakgU(Ix�dU�U�Jef !R GKJ�T�f !o a&PQOiT&U�r�JSU�TyG O

v��gf !R �Rf !o ��� � ÿn Õ p �:w f !R Õ r f !o ÕFx k � ��Ì �

êSh¸Ë&h¸Ë í �#ÔZÐ�¥�¢(¦�§�¨Z©yJ{§�¢K^0Ð�·i��T�G5I�GKk�GKO�U�[(\KJ>IG,PNJSPXJ�_HÌ�a Ë����iVG,J�_KUdPXYsG,_ UWO$\,e$��HT&PX�gUWV�UWJ IO�[(RSLN]&I�U�T~\ k&îxUW[(I�O3�oPXI�b�Ì Ë��nuZPXUW�iO.]gU�V^\Kk&îxU�[�I^PNOqR�O�UWT¿Ä Í Ì,Ç�h}��bSUtVG,JS_ UjPNY;GK_KU�O`e�V�\KYÌ Ë��n]g\ O�O�PNkSLNUtuZPXUW�o]1\ PXJ>IOy��T&U(I�U�V�Y;PXJSU�T~kZM}I�bSU�I�U�O�O�U�LNLQG5I�PN\KJ�\KeiI�b�U�uZPNU���f�O�]Sb�U�V�UjR�O�PXJS_I�b�UlPQ[(\ O�G,b�UWT&V�\KJ1�s\,e`I�b�Ul\KkSîxUW[�IOt�dU�V�UlO�MZJ I�bSUWO�PNm�UWT�h¤�$PX_ RSV�UlÌS�lO�bS\5�iO�G�O�RSk�O�U(I�\KeI�b�U}[�\KLNLXU�[�I�PN\KJæ\,e.uZPNU��iO�\,e^��\Kk�V�G�R�O�U�T�PNJ¿I�b�U�U�pZ]gU�V�PNY^UWJ>IWh¶��bSU�O�b�GK]1U�O�]gUW[(I�V�RSY\,eHUWG [b�uZPXUW�àPQOs[(\KY;]SRSI�UWT�G,J1T~I�bSU�J�PwIO^e�UWG,I�RSV�U�uKUW[(I�\ VqPQOsT&U(I�U�V�Y;PXJSU�T�h���b�UyuZPNU��iO\,e8UWGK[b�\ k&îxUW[(I;GKV�U�[(LNR�OxI�U�V�UWT�k�GKO�UWT�\ J�I�b�UyT&PQO�O�PNY;PXLQG,V�PwIxM�Y;UWG O�R�V�Uzv k1U�Ix��UWU�J�I�bSUWPXVY;\KY;U�J>I.u UW[(I�\KVO`R�O�PNJS_�I�bSUy[(\ Y^]�LXU�I�U(f�LNPXJS|�bSPNU�VG,V[bSPN[WG,L![�LXR�O�I�UWV�PNJS_lO�[bSUWY^UzÄ Å Æ5Ç�hn��bSUbSPNU�VG,V[bSPQ[�G,LB_KV�\KRS]SPNJS_�\ k&I�GKPXJSU�T��oPXI�bæÌ>Ëa��uZPNU��iOj\Ke`I�bSU���\KkSVG�\ k&îxUW[(I�PQOtO�bS\5�oJ¿PNJ�$PX_ RSV�U^Ì>Ë&h3��bSU;uZPXUW� _KV�\KR�]SPXJ�_tbSPNU�VG,V[bSPNUWO8\,e!I�bSU;\,I�b�U�VDJSPNJSU;\Kk&îxU�[�I�ODGKV�U^O�PNY;PXLQG,VHI�\I�b�U�T&U�J1T&V�\ _KVG,Y¿PNJ3�$PX_ RSV�U0Ì>Ë&h���b�PNO{T&U�J�TSV�\ _KVG,Y¿PQO�[(RSI{G5I{GoTSPNO�O�PNY;PXLQG,V�PXIxMiLXUWuKUWL,\,eb�ShN�c\KVLNUWO�O$I�\`\KkSI�G,PNJs[(\ Y^]1GK[�I!GKJ�T^��UWLXLXf�O�U�]1G,VG5I�U�T.[�LXR�O�I�UWV�OWh0��bSUi[(LNR�O�I�U�V�PNJS_ O0\ k&I�GKPXJSU�T.PNJ;I�b�PNOYsG,JSJ�U�VBT&UWY;\KJ�O�I�VG5I�UDI�b�G,IiI�bSU.u>PNU��iOi\,e0UWGK[b�\ k&îxUW[(Ioe�G,LNL�PNJ I�\jO�UWuKUWV�GKL�T&PNO�I�PNJS_ RSPNO�b�GKkSLXU[(LNR�O�I�UWV�OWhH��b�Uq[(UWJ>I�V�\KPQTn\,e!U�GK[bz\Ke!I�bSU�O�U^[(LNR�O�I�U�VO8�dG OBT&U�I�U�V�Y;PXJ�UWTzkZMn[(\ Y;]SR&I�PNJS_tI�bSUY;UWGKJl\,e�I�bSU;Y;\KY;U�J>IDuKU�[�I�\ V�O8\,e�I�bSU^uZPXUW�iOBe�GKLXLNPNJS_�PNJ>I�\�I�bSUs[�LXR�O�I�UWVWh3F8\KVG,P0G,J1TMG>G,PNJT&UWY^\ J�O�I�VG5I�U�TsI�b�G5I�I�b�PNOo[�LXR�O�I�UWV�PNJS_Kf�k�G O�U�TsuZPXUW�¿_KV�\KR�]SPXJ�_.]SV�\&[(UWTSRSV�U8e�GK[�PXLNPXI�G5I�UWOd\KkSîxUW[�IYsG5I[bSPXJ�_sPXJ�I�U�V�Y;OB\,ec[(LQGKO�O�PXr1[WG5I�PN\KJnG [�[(R�V�G [(MtGKJ�T�I�bSU3JZRSYqk1UWVB\Ke$YsG5I[bSUWOBJSUW[�UWO�O�GKV�Me�\KVy[(\ V�V�UW[(It[(LQGKO�O�PXr1[�G,I�PN\KJ�\,e`I�UWO�I�uZPNU��iOWh¤è8k&îxUW[(I�uZPXUW�iOtGKV�Un_ V�\ RS]1U�T�PXJ>I�\�[(\ Y^]1GK[�IG,J1TsbS\KY;\ _KU�J�U�\KR1O!uZPXUW�¿[(LNR�O�I�U�VOWaKI�b>R1O�T&UWY;\KJ�O�I�VG5I�PXJS_.I�bSU8]1\5�dU�V�\,e�I�bSU8[�LXR1OxI�U�V�f�k�G O�U�TO�[bSU�Y;UHe�\KVouZPNU��÷\KV�_ G,J�PXm�G5I�PN\KJ�G,J�T�U(áj[(PNU�J>Ii\ k&îxUW[(I�YsG,I�[bSPNJS_�hêSh¸Ë&h Ì í _S ,¦� KÕ�¥�¢(¦��B¢ÕÑ�©K¨�§�¥�§�Ñ5¨�·8��LNR�OxI�U�V�PXJ�_H��GKO0UWY;]SLX\5M UWTqPXJnÄ ÌKÌ,Ç&I�\`PQT&U�J>I�PXe�My�X¢�×Z¢�Ù;¢(Ð

PNJ�b�GKJ�T&�oV�PwI�I�U�J~I�U(pZI^e�\KVqI�bSUy]SRSV�]g\ O�UWOq\,ei�oV�PwI�U�V�f�PNJ�T&UW]1UWJ�T&U�J>I;b�G,J1T&�oV�PXI�PNJS_�V�U�[(\K_ JSPXfI�PN\KJ�h.��bSU;O�R�[W[(U�O�OH\,edGtb�GKJ�T&�oV�PwI�PXJ�_�V�UW[�\K_KJ�PwI�PX\ JlO�M&O�I�UWY PNOHuZPwIG,LNLXMzTSU�]gU�J�T&UWJ>ID\ JlPXI�OGK[W[(UW]&I�GKJ�[(U`kZMy]1\KI�U�J>I�PNGKL�R�O�U�VO�hd½�V�PXI�U�V�f�T&U�]gU�J�TSU�J>I8O�MZO�I�UWYsOo]SV�\5u>PQT&U3G;bSPN_Kb�U�VBLNU�u U�L�\KeV�UW[(\ _KJSPXI�PN\KJyGK[W[(RSVGK[�MqI�b�G,J��oV�PwI�U�V�f�PNJ�T&UW]1UWJ�T&UWJ IiO�M&OxI�U�YsO�a&k�R&IiV�U��>RSPXV�UDGqLQG,V�_KUHG,Y;\KR�J I\,edI�VG,PNJSPNJS_zTSG,I�GSh��¶�oV�PXI�UWV�f�PNJ�T&U�]gU�J1T&U�J>I.O�MZO�I�UWY�a{\ J�I�bSUj\KI�bSUWV`b�G,J�T�a{YqR�OxI3kgUtGKkSLXUI�\�V�U�[(\ _KJSPNm�U3Gs�oPQT&UquvGKV�PNU(IxMy\,e!�oV�PXI�PNJS_tO�IxM>LNUWOBPXJl\KVT&U�VBI�\�O�G5I�PNO�e�M�G,JnPNJ�T&PNu>PQT&R�GKL{R1O�UWVWh�BO�I�b�UBu5G,V�PNGKkSPNLXPXIxMq\Ke�I�bSUH�oV�PwI�PXJS_qOxIxMZLNUWO�I�b�G,I�Y.R1OxIdk1UH[�G,]SI�RSV�UWTskZMsG3O�M&OxI�U�Y»PXJ1[(V�UWGKO�UKa

Page 48: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

Ö ] � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

ä(jel*�3¾;ÞT�Å�fGd*z;fGh�g�wEx�pqjeh���f�wEx�acwTz*iGt�s�m*wTfPh:k x%iPwT| t&fGh�g�wEx�¾TÔTø�p;jeh���f��

Page 49: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � Ö f0.

00.

050.

100.

150.

200.

25

ä(jel*�3¾TÔ;���jeh:iGtEiGs�m;jes�tEb6lTiGwTd*o*jek;lLwExZ¾TÔTø&pqjeh=��f�wEx�acwTz*i�t;�

Page 50: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

� � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

PXIqkgUW[(\ Y;UWOqY^\ V�U�G,J�T�Y;\KV�U�TSPwáj[(R�LwIqI�\�TSPNO�[(V�PXY;PNJ�G5I�UjkgU(Ix�dU�U�J�T&Pw��U�V�U�J>I;[(LQGKO�O�U�O.T&RSUI�\�I�b�U^GKY^\ RSJ>I8\Ke�\5uKUWV�LQG,]�PNJzI�b�U.e�U�G5I�R�V�U;O�]1GK[(U h`è8J�UqO�\KLNR&I�PN\KJlI�\jI�bSPQO8]�V�\ kSLXUWYäPNO8I�\O�U�]�GKV�G,I�U^I�bSU�TSG5IGye�V�\ Y I�b�UWO�UjT&PNO�]�GKV�G,I�U;�oV�PXI�PNJS_zO�IxMZLXU�ODe�\KV3U�GK[b�[(LQGKO�O`PNJ I�\zT&PX�gUWV�UWJ IO�RSkg[�LNG O�O�UWOWa&|ZJS\5�oJ�GKO`�X¢�×Z¢(Ùs¢(Ðh���bSUWO�U`LXU�p&U�Y;UWO�V�U�]SV�UWO�U�J>Io]g\KV�I�PN\KJ�O�\Ke{I�bSU3TSG5IG;�obSPQ[bG,V�UjY;\KV�UtU�GKO�PXLNM�O�UW]�G,VG5I�UWT}e�V�\KY I�bSU�TSG,I�Gn\Ke8[(LQGKO�O�U�O3\KI�bSUWV3I�b1G,J~I�b�G5IqI�\��obSPN[b~I�bSULNU(p&U�Y;UDk1UWLX\ JS_ OWh��J�I�bSPQO.O�M&OxI�U�Y�a{b1G,J�T&�oV�PXI�PNJS_zPQO.[�GK]&I�R�V�U�T�kZM�T&PN_KPXI�PNm�PNJS_�I�bSU������oOS�`]g\ O�PwI�PX\ J�\,edI�bSU

]gU�JæGKJ�T�I�b�U�O�I�G5I�Uz\,e`I�bSUl]gU�Jæ]1\ PXJ>I}��RS]¿\ V�T&\5�oJ1�jG5I�G�[(\KJ1OxIG,J>ItO�GKY;]SLXPNJS_�V�G,I�UKh�S\ LXLN\5�oPNJS_HO�\KY;UdV�U�O�GKY;]SLXPNJS_1a,JS\KV�YsG,LNPXm�G5I�PX\ J�a5G,J�T^O�Y;\Z\,I�bSPNJS_�a,U�GK[b^OxI�V�\ |KUd\,e�I�bSU�]1UWJ;PNOV�U�]SV�UWO�U�J>I�U�T3GKO0G8u5G,V�PNGKkSLXU�f�LNU�J�_,I�b^OxI�V�PNJS_8\,e1]g\KPNJ>I�OWh$��Y;U(I�V�PQ[�k�GKO�UWT.\KJ.UWLNG OxI�PN[�I�U�Y;]SLQG5I�UYsG5I[bSPXJ�_tG,J�TnTSM>J1G,Y;PN[3]SV�\ _KVG,Y;Y;PXJ�_^PQOBTSU(r�JSU�TyI�\tGKLXLN\5�¹I�bSU^T&PNO�I�GKJ�[(U.k1U�Ix��UWU�J�Ix�d\O�I�V�\K|KU�O�I�\;k1U3[WG,LQ[(RSLQG5I�UWT�hÃBO�PXJS_.I�bSUDT&PQOxIG,J�[�UWOd[�GKLN[�RSLNG,I�U�TsPXJtI�bSPQOdYsG,JSJSUWVWaZGq]SV�\vp&PNY;PwIxM^YsG5I�V�PXp;PQOd[(\KJ1OxI�V�R�[(I�U�Te�\KVqUWG [b�[�LNG O�O3\,eBT&PN_KPXI�O��x§�·�¢�·NaU�yI�bSV�\KR�_Kb~Å �(hzØ�G [b}YsG,I�V�Pwp}Y^U�GKO�RSV�UWODI�bSUtPNJ>I�VG5f�[(LQGKO�OT&PQOxIG,J�[�UWODe�\ V.Gy]�G,V�I�PQ[(R�LNGKV3T&PX_ PwI^[(LQGKO�O�htF8PN_KPXI�O`PNJ~G�]�G,V�I�PQ[(R�LNGKV3[(LQGKO�O`G,V�Uj[(LNR�OxI�U�V�UWT}PNJG,J�G5I�I�UWY^]SIsI�\�r�J�T�G�O�YsG,LNL�JZRSY.kgU�Vs\Ke8]SV�\,I�\,IxMZ]1U�O�h¿��LNR�OxI�U�V�PXJ�_�PQOsT&\KJ�UyR1O�PNJS_�I�bSU�X}�ÃHÒ&�oØUg¹]SV�\K_ V�GKY»TSUWO�[(V�PXkgUWT�G,kg\5uKU;Ä Å ÆvÇ�aZPXJ��obSPQ[b�I�bSUDe�U�G5I�R�V�UDuKU�[�I�\KVde�\KViG;T&PN_KPXIoPNOPXI�OI�â]SV�\vp&PNY;PwI�PXU�OoI�\jI�bSU^T&PX_ PwIOB\Ke0I�bSU^O�GKY^Uq[(LQGKO�O�h8�X}»Ã8Ò&�oØ�g G5I�I�U�Y;]&IOiI�\j]SV�\&T&R�[(UI�b�UHkgUWO�Ii[(LNR�O�I�U�V�PNJS_.e�\ VoUWG [btu5G,LNRSUH\,e Æ \5uKUWVdO�\KY;UHV�GKJS_KU aZ�obSU�V�UIÆ PQO�I�bSUDJZRSY.kgU�Vo\Ke[(LNR�O�I�UWV�OHPNJ I�\t�obSPQ[b�I�bSU;TSG5IGtPQO8I�\yk1U;]�GKV�I�PwI�PX\ JSUWT�h3�BOHU(p&]gUW[�I�UWT�a�I�bSU^Y;UWG,J}O��>R�GKV�U�TU�V�V�\KVq��9lÒ&Ød�8TSUW[(V�UWG O�U�OiY;\KJ�\,I�\ JSPQ[�G,LNLNM�G O8Gte�RSJ�[(I�PN\KJ}\,e�Æ�h3��bSU ö \K]SI�PNY;GKLNøtu5G,LNRSUq\Keî PQOi[bS\>O�UWJtkZMtPQT&UWJ I�Pwe�MZPNJS_jG ö |ZJSUWUWøqPXJyI�b�U`]SLX\KIi\,eh9lÒ&ØÉ´5¢(¦Ð�ÔZÐ�Æ�h½�bSU�J¹V�UW]SV�U�O�UWJ>I�PNJS_~G~[(LNR�O�I�UWV�\Ke.T&PX_ PwIOtkZM�G�O�PXJ�_KLNUz]SV�\,I�\KIxMZ]1U aoI�bSU�k1U�OxIy\KJ&f�LNPXJSUV�UW[(\ _KJSPXI�PN\KJtV�U�O�RSLXI�Od�dU�V�U8\ k&I�GKPXJ�UWT�k>MsR1O�PNJS_qI�bSU3T&PN_KPXIdI�b�G,I�PQOo[(LN\ O�UWO�IdI�\qI�b�G,Io[�LXR1OxI�U�V�¼ O[(UWJ>I�U�V�h�ÃBO�PXJ�_;I�bSPQOiO�[bSU�Y;UKaSG;[�\KV�V�U�[�I�V�U�[(\K_ JSPXI�PN\KJtVG5I�UD\,ecÅKÅSh ÌKÌ�{¤�dG Od\Kk&IG,PNJSUWT�hèZ# ñþQ.-;W U[A�Á�);9S+ U(-jA�<~9TA + <~@3)6]��J&e�\ V�YsG5I�PX\ JqV�U(I�V�PNU�u5GKL����*gB�0PQOc[(\ J�[(UWV�J�UWTq�oPwI�bjG,R&I�\KYsG5I�PN[�O�I�\KVG,_ UdGKJ�T^V�U�I�V�PXUWu5G,LZ\,e�T&\&[�fRSY;U�J>IO`Äw�vÆ&�(Ç�hh9zG,JZM;RSJSPNuKUWV�O�PwIxMsLNPNkSV�GKV�PNUWO�R�O�U8�*g÷O�MZO�I�UWYsO!I�\^]�V�\5uZPQT&U8G [�[(U�O�O�I�\^kg\>\ |&O�aîx\KR�V�J�GKLNOWaKGKJ�T;\,I�bSU�V�TS\Z[�RSY;U�J>I�OWhh}�PNkSV�GKV�PNUWO0R1O�U�I�bSU|}�PNkSVG,V�M3\,e{��\ JS_KV�UWO�O!��LNG O�O�Pwrg[�G5I�PX\ J�3}0�o���$O�[bSUWY;U�e�\ V0U(áj[(PNU�J>I!OxI�\KVG,_ U�G,J1T.V�U(I�V�PNU�u5G,LZ\Ke1kg\>\ |&O�h$��bSU�}$�o��O�[bSUWY^Uo[�\KJ�O�PNO�I�O\,e�[(LQGKO�O�U�OHLNGKk1UWLXU�T��ðI�\y,æÄX�K�Wë,Çc�obSPN[b�G,V�U^R�O�U�TzI�\n[b�G,VGK[(I�U�V�PNm�U.kg\Z\K|&ODkgU�LN\KJS_ PXJS_�I�\T&PX�gUWV�UWJ>I�O�R�k&îxUW[(I�OWh0��\KV!U�pSG,Y;]SLNUKa>LNGKk1UWL.d¹[(\ V�V�UWO�]1\ J�TSO$I�\3k1\Z\ |ZO�PXJ;I�bSU8GKV�U�GH\,e�O�[�PXUWJ�[(UG,J1T;I�bSUHO�R�kg[�LNG O�O�dH�¿PQO�G O�O�PN_KJSU�T^I�\.YsG,I�bSUWY;G,I�PQ[�OWh }{G,kgU�LQO@dH�DÜ5êDI�\�dH�DÜ5êSh ë3GKV�UiR1O�U�Te�\KVi[�LNG O�O�PXe�M>PNJS_;kg\>\ |&O�V�UWLNG,I�UWTtI�\s[�\KY;]SR&I�U�VOoG,J�T�\,I�bSU�VBGKV�U�GKO�\,ec[(\ Y^]�R&I�UWViO�[�PXUWJ�[(U h��bSU�V�U.G,V�U3O�U�uKUWV�GKL�]SV�\KkSLNU�YsO8GKO�O�\&[(PQG5I�UWTy�oPXI�bnI�bSUq[�LNG O�O�Pwrg[�G5I�PX\ J�\,eck1\Z\ |ZOBR�O�PXJS_jI�bSU}$�o�¿O�[b�U�Y;UKh�ÒZ\ Y;UH\Ke{I�bSUWO�U`G,V�UDLXPQOxI�UWTykgU�LN\5�`È

�x�v�;½�bSUWJ¿G�R�O�UWVjPQOjO�U�G,V[bSPNJS_}e�\KVjkg\Z\K|&OsPNJ�G~LXPNkSVG,V�M~�obSPQ[b�TSUWG,LB�oPwI�b¿G}I�\K]�PN[n\KePNJ I�U�V�UWO�I�I�\.bSPNY�aZI�bSU�}0�o��JZRSY.kgU�V�G,LN\KJSUHYsGvM;JS\,I�k1UDG,k�LXU8I�\^V�U�I�V�PXUWuKUBGKLXLgI�bSUDV�UWLXUWuvGKJ>Ikg\>\ |&O�h»��bSPQOtPQOyk1U�[�G,R1O�UlI�bSU}[(LQGKO�O�PXr1[�G,I�PN\KJ¿JZRSYqk1UWVyG O�O�PN_KJSU�T�I�\~I�bSU}k1\Z\K|&O�\KVtI�bSUO�RSk&îxUW[(I$[WG5I�UW_K\ V�PNUWOgI�b�G5I0G,V�U0IxM>]�PN[WG,LNLXMHU�J>I�UWV�U�TDPXJ3I�bSUdTSG5IG,k�G O�U!T&\BJS\,I0[(\KJ>IG,PNJ3O�R&áj[�PXUWJ IPNJ&e�\KV�YsG5I�PN\KJyV�U�_ GKV�TSPXJS_;G,LNL�I�b�UDI�\K]�PN[WOi[(\5u U�V�UWTjPNJnG^k1\Z\K|�h!�{\;PXLNLXR1OxI�V�G,I�UDI�b�PNOo]g\KPNJ>IWaSLNU(IR�O�[(\KJ1O�PQT&U�V;I�bSUzkg\Z\K|¿º¸�iLN_K\ V�PXI�b�Y;Ose�\KVy��LNR�O�I�U�V�PNJS_~F8G,I�G�¼�kZMIG>G,PNJ�G,J�T�F8RSk1U�O�Ä Å Æ5Ç�h��I�O�}0�o�¤J>R�Y.kgU�V^PNO�ºxdH�ùË Ü,ëSh G Ì>Æ&¼Nhz��J~I�bSPQO2}0�o�ðJZRSY.kgU�V�a�dH�ùË>Ü5ëz[�\KV�V�U�O�]g\KJ�T�O`I�\I�b�U3I�\ ]SPQ[sº¸[(LNR�OxI�U�VHG,J�GKLXM&O�PNOW¼Xa+G�[�\KV�V�U�O�]g\KJ1TSO�I�\jI�bSUqr�VOxI8GKR&I�b�\KV�¼ OBJ�G,Y;U.GKJ�TzÌ ÆsPNOiI�bSUO�U�V�PNGKLBJZRSY.kgU�V�GKO�O�PX_ JSUWT�kZM�I�bSU8}�PNkSVG,V�M�\Ke^��\KJS_ V�U�O�OWh ��bSU�O�RSk&îxU�[�I�[�G5I�U�_ \KV�PXU�O;e�\KVI�b�PNOHkg\>\ |�]�V�\5uZPQT&UWTnkZMyI�b�U.]SRSk�LXPQO�b�U�V;���obSPQ[b�GKV�U`IxMZ]SPQ[�GKLXLNM�U�J>I�UWV�U�TnPNJlGtTSG,I�GKk�GKO�U`I�\

Page 51: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ì��e�GK[�PXLNPXI�G5I�UsO�U�G,V[b1�BGKV�U;[(LNR�O�I�UWV3G,J�GKLXM&O�PNOWa�TSG5IGt]�V�\&[(U�O�O�PNJS_yGKJ�T}G,LN_K\KV�PXI�bSYsOWhq��bSUWV�U^PNO`G[b�GK]&I�UWV`PXJ}I�b�PNO`kg\Z\K|�Ä Å>ÆvÇcI�b1G5I.T&U�G,LQO`�oPwI�b�[(\KY;]SRSI�U�V`uZPQO�PN\KJ�a�PNY;GK_KU;]SV�\&[(UWO�O�PXJS_1a�G,J1TPNY;GK_KUsO�U�_KY;UWJ IG5I�PX\ J�h;Ò&\�a�GyR�O�U�V`LN\Z\K|ZPXJ�_te�\ V`LXPXI�UWV�G,I�RSV�Uq\ J}[�\KY;]SR&I�U�V`uZPQO�PN\KJ�G,J�T�a�PNJ]�GKV�I�PN[�RSLNGKVWa5PNYsG,_ U�O�U�_ Y;U�J>I�G,I�PN\KJ^�oPXLNLSJS\KI!k1UiGKkSLXUdI�\DG [�[�UWO�O$I�bSPQOckg\>\ |3kZMqO�UWGKV�[bSPNJS_BI�bSUTSG,I�G,k1GKO�U��oPXI�bqI�bSU�bSUWLX]^\,egU�PXI�bSUWV0I�bSU�}0�o��JZRSY.kgU�V0\ V{I�bSUoO�R�k&îxUW[(Ic[WG5I�U�_K\ V�PNUWO{]SV�\5uZPNT&U�TPNJ`I�bSUdTSG5IG,k�G O�U h{��bSU�}$�o��JZRSY.kgU�V{e�\KV$[(\ Y^]�R&I�UWV{uZPQO�PN\KJ`kg\Z\K|&O�PQO{�$�¿��êKÌ>ËDÄw� �Wë5Ç>�obSPQ[bPQO�uKU�V�MtT&PX��U�V�U�J>Ioe�V�\ Y¶I�b�U`J>R�Y.kgU�V�dH� Ë Ü,ëSh G Ì>Æ3G O�O�PX_ JSUWTjI�\;I�bSPNO�kg\Z\K|�h��ËK�0��b�U�V�UoPNOcGKJ^PNJSbSUWV�UWJ>I!]SV�\ kSLNU�Y PNJjGKO�O�PN_KJ�PXJS_C}$�o�~JZRSY.kgU�VO0I�\Hkg\Z\K|&OcPNJsGDV�GK]SPNTSLXM

T&UWuKU�LN\K]�PXJS_3GKV�U�GSh$�S\KV�U(pSG,Y;]SLNUKa LXU�I�R�O�[(\ J�O�PQT&UWVcI�bSU8G,V�UWGD\,e�JSUWRSVG,L�J�U(Ix�d\KV�|ZOWh���J�PwI�PNGKLXLNMKa[�G,I�UW_K\KV�M�ºxdHÞi¼&PNJ:}0�o��O�[bSU�Y;U`��GKOdR�O�UWT�I�\sLQG,kgU�L�kg\Z\K|&OiGKJ�T�[�\KJ&e�UWV�UWJ�[(UD]SV�\&[(UWUWT&PNJS_ OPNJ�I�bSPQO;G,V�UWG�hz�S\KV^U(pSGKY^]�LXU a0Þ�V�\&[�U�UWTSPXJS_>O`\,eoI�bSUy��J I�U�V�J�G5I�PX\ J�G,L�GK\ PXJ>Is��\ J&e�U�V�U�J1[(Uj\ JúiUWRSVG,L�úiU�Ix��\ V�|&ODÄ �|G&�dúBúð¼ ÅS��ÇcÄ Å Ë5Ç��dG O�G O�O�PX_ JSUWTjI�bSUDJZRSYqk1UWVDºSdHÞ�ÌKê ÌSh ÌS¼Nh \dR&I�a&Y^\>OxI\,eDI�bSUlV�UW[�U�J>Itkg\>\ |&Oj\KJ�J�U�RSVG,L8JSU(Ix�d\KV�|&OjG,V�Un_KPNuKUWJ¿G�JZRSY.kgU�V�R�O�PNJS_�I�bSU�[WG5I�U�_K\ V�MLQG,kgU�L!ºxdH�3¼Nµ�Þ!V�\Z[�U�U�T&PXJ�_ O�\,e0I�bSU.�|G&�dúBú¶¼ Å Ë�Ä ÅKÌ,Ç{PQOBG O�O�PX_ JSUWT�I�bSU3JZRSY.kgU�V.ºSdH�»Ü5ê�h ëZÜZ¼Nh9nRSLXI�PN]SLNU3LQG,kgU�LQO�e�\KVokg\Z\K|&OiT&U�G,LNPXJS_;�oPXI�b�I�bSU.O�G,Y;UHI�\K]�PN[D�oPNLXL�e�\KV[(UHI�b�U�YùI�\skgU`]SLNG [(U�T\KJzTSPw��U�V�U�J>IHO�I�G [|&OoPXJzGjLXPNkSVG,V�MKho�iUWJ�[(U a�I�bSU�V�U.PQOBGsJ�U�UWTyI�\tRS]�TSG,I�U`I�bSUq[�LNG O�O�Pwrg[�G5I�PX\ JLQG,kgU�LQOde�V�\ YàI�PNY;UDI�\^I�PNY;U`PXJnGKJ�UWY^UWV�_ PXJ�_;TSPNO�[(PN]SLNPXJSU h��Ì �B�BO�O�PN_KJ�PXJS_yGsJZRSY.kgU�V8I�\yGjJSUW�Ûk1\Z\ |�PQO8G�T&PXás[�RSLXIH]SV�\Kk�LXUWYyhH� kg\Z\K|�YsGvMyT&U�G,L

�oPXI�bzI�\K]SPQ[�OD[�\KV�V�U�O�]g\KJ�TSPXJS_jI�\�Ix��\�\KVHY^\ V�U�}$�o�÷JZRSYqk1UWV�ODGKJ�T�agI�bSUWV�U�e�\KV�UKa�GKO�O�PX_ JSPXJ�_G^RSJSPQ�>RSU`JZRSY.kgU�V�I�\jO�R�[b�G^k1\Z\ |tPQOoT&Pwáj[�RSLwI�hgoU(e�UWV�UWJ�[(UDÄw��ÌKÅ,Ç&TSUWO�[(V�PXkgUWO0G8|>J�\5�oLXU�T&_KU�f�k�G O�U�T`[(LNR�O�I�U�V�PNJS_HO�[bSUWY^U�I�\D_ V�\ RS]3V�U�]SV�UWO�U�J&fI�G,I�PN\KJ�O$\KeSk1\Z\K|&O$�obSPQ[bqGKV�U�\Kk&IG,PNJSUWT`R1O�PNJS_8I�bSU��B�X9¾�Xg¹���BO�O�\Z[�PNG,I�PN\KJ.e�\KV!��\KY;]SR&I�PXJS_9zG [bSPXJ�U�V�M í Ñ5ÙBÏgÔ&¥�§�¨>©S�B¢�´W§�¢�^0Ð��o[(LQGKO�O�Pwr1[WG5I�PX\ JtI�V�UWUjÄ Ë5Ç�h���b�PNOiI�V�U�U`PQOoR�O�UWTykZMjI�b�U3G,R&fI�b�\KVO�[(\ J>I�V�PXkSRSI�PNJS_`I�\qu5G,V�PX\ R�O��B�X9 ]�RSkSLNPN[WG5I�PN\KJ1OcI�\q]SV�\5u>PQT&Uo| U�MZ��\ V�T�OcPXJjI�bSUBe�\KV�Yð\Ke�B�X9 �Xgð[�G,I�UW_K\KV�MyLNGKk1UWLNOWh.��bSPQO8I�V�U�U;[(\KJ1O�PQOxIOB\Ke8� �.JS\&T&U�OHG,I8I�bSU^r�VOxIDLXUWuKUWL�h3��bSU�O�UJS\&T&U�OoG,V�U8LQG,kgU�LNUWTy�¹I�\�î;hSØ�G [btJS\&T&UDPNJtI�bSPNOdI�V�UWUDb�GKO�G^LNGKk1UWL�I�b�G,IoPNOoG;O�I�V�PXJS_^\,e$\KJSU\KVHY;\KV�U.O�M>Yqk1\ LNOWhD��bSUWO�UqO�MZY.kg\KLQO8GKV�U.GKLX]�b�G,JZRSY;U�V�PQ[.[b�GKV�G [�I�UWV�OWhB��\KVBU�pSG,Y;]SLNUKa���Æ&�vÆPQOdI�bSU`LQG,kgU�L�\Ke0Gqe�\ RSV�I�b&f�LXUWuKU�L�J�\ZTSUHPNJyI�bSUDI�V�UWUKhêSh ÌShN��Îo ,¥�¥�¢�¦�¨8�B¢�Ïg¦�¢(Ð�¢(¨1¥� ,¥�§�Ñ,¨g·iØ�GK[b3kg\Z\K|DPQO{V�U�]�V�U�O�UWJ I�UWT`G O{G8_KUWJSU�VG,LNPXmWUWTDLNPNO�IoÄw��ê ËvÇ

\,e�I�bSUWO�U8O�I�V�PNJS_ O�R�O�PNJS_.�B�X9â�Xg¿[(LQGKO�O�Pwr1[WG5I�PX\ JqI�V�UWUqÄ ËvÇ�h$��b�Uie�\KR�V�I�b&f�LNU�u U�LgJS\&T&UWO�PXJjI�bSU�B�X9 �XgÉ[(LQGKO�O�PXr1[WG5I�PN\KJ�I�V�U�U3GKV�U`LQG,kgU�LNUWTyR�O�PNJS_sJZRSY;U�VG,LQO`�DI�\jÅsGKJ�T�[b�G,VGK[(I�U�VO��ÉI�\,$a5e�\ VcI�b�UBO�GK|KU�\,e�kSV�U�uZPXIxM3PXJsV�U�]�V�U�O�UWJ IG5I�PX\ J�h{��\KVcU(pSGKY^]�LXU a,I�b�UB[bSPNLNT&V�U�J^JS\&T&U�Oc\,e���h¸Æ&hN��xÙsÑ�£K¢��¸Ð���GKV�UiLQG,kgU�LNUWTj��h ÆShX� hX��I�\.��h¸Æ&hN�Kh êSh0�iU�V�UKa>��h¸Æ&hN�KhN�i[(\KV�V�UWO�]1\ J�TSO0I�\3I�b�UBJS\&T&U8LNGKk1UWLXU�T£K¢�¥�¢(¦�Ù^§�¨�§QÐ�¥�§�ÕcG,J�T.��h ÆShX� h ê8OxIG,J�T�O$e�\KV$I�bSU�JS\&T&UdLQG,kgU�LNUWTtÐ¥�¦�Ô�Õ�¥�Ô&¦� ,�#h���J^G8O�PNY^PNLQG,V$e�GKO�bSPN\KJ�aG,LNL1I�bSUBe�\KRSV�I�b&f�LNU�uKUWL�JS\&T&U�O!PNJjI�bSUiI�V�UWUB[�GKJjk1U8LNGKk1UWLXU�TjGKO�JSUW[�UWO�O�GKV�M h$��V�\ Y¤J�\5��\ J�a I�bSUT&\KI�OiPNJnkgU(Ix�dU�U�JzO�R�[W[(UWO�O�PXu UDO�MZY.kg\KLQOo�oPNLXL{k1Uq\KY;PwI�I�U�TyI�\tO�PXY;]SLNPXe�MtI�bSU.V�U�]SV�UWO�U�J>IG5I�PN\KJ�h�S\ VoU(pSG,Y;]SLNUKa&��h¸Æ&hN�KhN�D�oPXLNL�kgU3T&U�JS\KI�U�TyG O���Æ&� �Kh½�UyPXLNLNR�OxI�V�G,I�UtI�bSPQO.]�V�\&[(U�O�O.\,eiV�U�]SV�UWO�U�J>IG5I�PN\KJ��oPXI�b�I�bSU�bSU�LN]�\KeoI�bSUykg\>\ |�kZMbG>G,PNJ

G,J1TyF8RSkgUWOqÄ Å>ÆvÇ�h!��bSU�V�U3G,V�UHr�uKU`[b�GK]&I�UWV�O�PNJ�I�bSPQOokg\Z\K|�h��S\ ViO�PNY;]SLNPN[�PwIxM�\,e0]SV�\&[�UWO�O�PNJS_�a�dU^[�\KJ�O�PNTSU�VH\KJSLNM�I�bSU;PNJ&e�\KV�YsG5I�PX\ JlPNJlI�bSU^[b1G,]&I�U�V`[(\ J I�U�J>I�OWh3��bSUWV�U^PNO`GyO�PXJS_ LXUqU�J>I�V�MPNJtI�bSUHI�G,k�LXUD\,e0[(\ J I�U�J>I�O�e�\ V�[b1G,]&I�U�VD�Ka�º ��J>I�V�\ZTSR�[�I�PX\ J�¼XaSGKJ�TtO�\;��UDT&\;JS\KI�U�pZI�VGK[�IoG,JZM|KUWMZ��\ V�TSOHe�V�\KY I�bSPNOWh���b�GK]&I�UWV^Ë&a0LQG,kgU�LNUWT�º¸FHG5I�G�goU�]SV�UWO�U�J>IG5I�PN\KJ�¼Xa$b�GKOqO�U�[�I�PX\ J�I�PXI�LNUWOI�b1G5Iq[�\KV�V�U�O�]g\KJ�TlI�\zI�bSUjLQG,kgU�LQO`\KedI�bSUjJS\&T&U�O3PNJ�I�bSU��B�X9 �Xgð[�LNG O�O�PXr1[�G,I�PN\KJ}I�V�U�UzÄ ËvÇ�obSPQ[bnG,V�U8_ PXu U�Jyk1UWLX\5�`È�x�v�}��G ����Æ ËKËy�x (¢ 5¥�Ô&¦�¢q¢(´5 5�#Ô� ,¥�§�Ñ,¨� ,¨g£jÐ�¢(�X¢Õ�¥�§�Ñ,¨>�(a��Ë �}��k1�d��ÆKÌ Ë���Ð�§�Ùq§��N 5¦�§�¥�ÚtÙs¢� 5Ð�Ô&¦�¢�Ð��(a�G,J�T

Page 52: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

� � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

��Ì>�}��[W�d��ÆS��Æ���Ð�¥� 5¥�§QÐ¥�§�Õ 5� �(h\�GKO�UWTH\KJDI�bSU�GKk1\5u UcG,J�GKLXM&O�PNOWa5��b1G,]&I�U�V$Ëd\KedG GKPXJ3GKJ�T`FBR�k1U�O�kg\Z\K|D[�G,JDkgU�[b�GKV�G [�I�U�V�PXmWUWTkZM;I�bSUH�dU�PN_Kb>I�U�TtT&PQO�îxR�J�[�I�PX\ J����$��Æ ËKËq}~��Æ,Ì Ë8}���Æ&�vÆK���x�Ka Í>����h0��bSUH��UWPX_ b IO8���Ka Í>��T&U�J�\,I�UI�b1G5I3PXIDPQO`\ JSUq\Ke�I�bSU^e�\KRSV3[b1G,]&I�U�VOD�obSPN[b}]SLQGvM&OHGyV�\KLNUqPNJ}I�bSUsV�U�]�V�U�O�UWJ IG5I�PX\ Jz\,e�I�bSUkg\>\ |�h�\dG O�U�Ty\KJnI�bSU`I�GKkSLNU.\,e![�\KJ>I�UWJ IO�a1��Uq[�G,JnR1O�Uq\KJSU3\ ViY;\KV�U3\,e0I�bSUqO�I�V�PXJ�_ Oo��Æ ËKË&a��Æ,Ì>Ë&a&G,J1Tj��Æ&�vÆ`I�\qV�U�]�V�U�O�UWJ Io[b�GK]&I�UWVoËSh0��JyG^O�PNY;PXLQG,VoYsGKJSJSU�V�aZ��UD[�GKJ�V�U�]�V�U�O�UWJ Id\,I�bSU�V[b�GK]&I�UWV�O�PXJ`I�bSPQO�kg\Z\K|DGKO��dU�PN_Kb>I�UWT`T&PQO�îxR�J�[�I�PX\ J�O�k1GKO�UWT`\ JDI�bSU�I�G,k�LXU�\,e�[(\ J>I�U�J>IO�G,J1THI�bSU�B�X9 �Xg�[(LQGKO�O�PXr1[WG5I�PN\KJ.I�V�U�U h$��bSUBV�UW]SV�U�O�UWJ>I�G5I�PX\ J.\Ke1I�bSUiU�J>I�PXV�U�k1\Z\K|�aKI�bSUB[�\KJ5îxR�J�[�I�PX\ J\,ecG,LNL�I�b�UWO�UD[b1G,]&I�U�VoV�U�]SV�UWO�U�J>I�G,I�PN\KJ�OWaZPNO�_ PXu U�JykZM��������ÆKËKËS}���Æ,Ì>Ë7}���Æ&�vÆK���x�Ka Í>�����¹���0��ÆS��Æ7}~��ÆKÌS�v�(��ËSa ÍZ�����¹������Æ,Í��q}���Í êS}~��Í>Ì,Í>���x� a ÍZ�����(h��RSV�V�U�J>I�LXM aKI�bSUWO�UiV�U�]SV�UWO�U�J>I�G,I�PN\KJ�O�G,V�Ui_KUWJSU�VG5I�UWT^YsG,JZR�G,LNLNMqkZM;O�[WG,JSJSPNJS_`I�bSUiIG,kSLNUB\Ke

[(\ J>I�U�J>IO�\Ke�k1\Z\ |ZO�PNJ�[(\ Y;]SR&I�UWVoO�[�PXUWJ�[(UHG,V�UWG3G Od�B�X9 �Xgæ[(LQGKO�O�Pwr1[WG5I�PX\ JsI�V�U�U8]SV�\5uZPQT&UWO|ZJS\5�oLNUWT&_ U.\,e�[(\ Y^]�R&I�UWVDO�[(PNU�J1[(U^k1\Z\K|&OH\KJ�LXM hq��bSU;T&U(IG,PNLNOD\Ke!I�b�U;[�\KLNLXU�[�I�PX\ Jl\,e�k1\Z\K|&OR�O�UWTyPNJtI�bSPNOBOxI�R�T&M�GKV�U`Gvu5G,PNLQG,kSLNU8PNJ�Äw��ÌKÅ,Ç�hêSh ÌSh¸ËzÄg§�Ùq§��X ,¦�§�¥�ÚCòl¢ vÐ�Ô&¦�¢�·8��bSUdO�PNY^PNLQG,V�PwIxMDkgU(Ix�dU�U�J.Ix��\Hkg\>\ |&O�PQO$k�GKO�UWT.\KJ3I�bSU�O�PNY;Pwf

LQG,V�PwIxM3kgU(Ix�dU�UWJ;I�bSUi[�\KV�V�U�O�]g\KJ1T&PXJ�_DO�I�V�PNJS_ OWh{���d\`\,egI�bSUB��UWLXLXf�|ZJS\5�oJ;T&PQOxIG,J�[�U�e�RSJ�[(I�PN\KJ�OkgU(Ix�dU�U�J�G}]�GKPXVs\KeDO�I�V�PXJ�_ OsG,V�U�Äw�WÍ,ÇoI�bSUz�BGKY^Y;PNJS_~T&PQOxIG,J�[�UzG,J�T�I�bSUnUWT&PXItT&PQOxIG,J�[�UKhúiUWPwI�bSU�V`\Ke�I�bSUWO�U^Ix��\�T&PQOxIG,J�[�Uqe�R�J�[�I�PX\ J�O`[�GKJ�kgU;Y^U�G,JSPNJS_Ke�RSLXLNMzR�O�UWT�PNJ�I�bSPQO`G,]S]SLNPQ[�G5fI�PN\KJ�h$��bSU�e�\ LXLN\5�oPNJS_DU(pSG,Y;]SLNU�PXLNLXR1OxI�V�G,I�UWO$I�bSUo]g\KPNJ I�hc��\ J�O�PNT&UWV0I�bSV�U�UoO�I�V�PXJ�_ O0��Ë5ÍZË&a5��ËKÌKÌSaG,J1T}�HË5ÍZË&h���b�UWO�UjOxI�V�PNJS_ O.G,V�UsLNGKk1UWLNOj��Ïg¦�¢£,§�Õ� ,¥�¢y�NÑ�©K§�ÕI (Ñ5¦�c,¨gÑa^d�N¢�£W© ¢y¦�¢�Ï�¦�¢�Ð�¢�¨�¥� 5¥�§�Ñ5¨�û�XÑ�©,§�ÕsÏg¦�Ñ�©K¦� 5Ù^Ù^§�¨>©Ka�GKJ�TÉ£5§QÐ�¥�¦�§�¡�Ô&¥�¢�£�£K 5¥� K¡ 5Ð(¢zÐ�ÚvÐ�¥�¢�Ù.Ð��^\KeBI�b�V�UWU�e�\KRSV�I�b&f�LNU�uKUWL�JS\&T&UWOPNJzI�b�U^�B�X9 �Xg [(LQGKO�O�PXr1[WG5I�PN\KJ�I�V�UWUKh`úi\&T&U�OH��Ë5Í>ËjG,J�Tn��ËKÌKÌjGKV�U.I�bSU^_KVG,J1TS[bSPNLNT&V�U�Jn\KeI�b�UjJS\&T&UjLQG,kgU�LNUWT���Ë��� 5¦�¥�§ ��Õ�§� 5��§�¨�¥�¢����#§w© ¢�¨gÕ¢��3GKJ�T��8Ë,Í>ËyPQO.Gn_ V�GKJ�TS[bSPNLNT�\,e�I�bSUtJS\&T&ULQG,kgU�LNUWTj�HËj��£  5¥� K¡ vÐ�¢3Ù; ,¨g �©>¢�Ù;¢�¨�¥���h!ÒZ\1aKI�bSUHTSPNO�I�GKJ�[(UikgU(Ix�dU�UWJj��Ë5ÍZË`G,J1Ts��Ë,Ì Ì`O�bS\ RSLQTkgUyO�YsG,LNLXUWV.I�b�G,J�I�b�G,I^kgU(Ix�dU�UWJ���Ë5ÍZËzGKJ�T~�8Ë,Í>ËSh��B\5��UWuKUWVWac�BGKY;Y^PNJS_}T&PNO�I�GKJ�[(U�G,J1TUWTSPwIDT&PNO�I�GKJ�[(U�Äw�WÍ,Ç{kg\,I�bzb�Gvu U.Gsu5G,LNRSUqËjk1U�Ix��UWU�Jn��Ë5ÍZË;G,J�Tz��Ë,ÌKÌsGKJ�TnGju5GKLXRSU.\,ei�3kgU(fIx�dU�U�Jn��Ë,Í>Ë;GKJ�Tn�8Ë,Í>Ë&hi��b�PNOBLXPNY;PwIG5I�PN\KJlY^\KI�PNu5G5I�U�OoI�bSUqT&U�r�JSPXI�PN\KJz\Ke!GsJSU�� O�PNY^PNLQG,V�PwIxMY;UWG O�RSV�UdI�b�G,I�[(\ V�V�UW[(I�LNM3[�G,]SI�RSV�UWO$I�bSUiO�PNY;PXLQG,V�PXIxM3k1U�Ix��UWU�JqI�bSU8G,kg\5uKU�OxI�V�PNJS_ OWh{��b�UiO�PNY;PwfLQG,V�PwIxMDkgU(Ix�dU�U�JqIx�d\8O�I�V�PXJS_>O$PNO0T&U�r�JSUWT^GKO{I�bSU�VG5I�PX\H\,e�I�bSU�LNU�JS_KI�b.\Ke�I�bSU�LQG,V�_KU�OxI0[(\ Y^Y;\ J]SV�U(rSp�ÄX�WÌKÅ,Ç�k1U�Ix��UWU�J�I�bSU3Ix�d\jOxI�V�PNJS_>O�I�\sI�bSU.LNU�J�_,I�bn\Ke0I�bSU`r1V�O�I8O�I�V�PXJS_1ho�S\KVBU(pSG,Y;]SLNUKaI�b�U8O�PXY;PNLNGKV�PXIxM.kgU(Ix�dU�UWJtOxI�V�PNJS_>Oc��ÆKË ËDG,J�T;��ÆS�iPNO��Sh¸Æ&h0��bSUi]SV�\K]g\ O�UWT;O�PXY;PNLNGKV�PXIxM^Y^U�GKO�RSV�UPQO`JS\,I3O�MZY^Y;U�I�V�PN[;kgUW[WG,R�O�U^I�bSUjO�PXY;PNLNGKV�PXIxMzkgU(Ix�dU�UWJ}��ÆS�sG,J�T}��ÆKË ËjPQOA��h êZÜZhs��bSUsY;PXJ�PwfY.R�YùG,J1T�YsG,pZPNY.R�Yàu5G,LNRSUWO�\Ke{I�bSPNOBO�PNY;PXLQG,V�PwIxMtY^U�GKO�RSV�UDGKV�UC�Sh �;G,J�T}� h ��a&V�U�O�]gUW[(I�PNuKU�LNMKh��bSU�|ZJS\5�oLNUWT&_ U�\KeBI�b�UyV�U�LQG5I�PX\ J�O�bSPX]�k1U�Ix��UWU�J�JS\&T&UWO;PNJ�I�bSUn�B�X9 �Xgù[�LNG O�O�Pwrg[�G5I�PX\ JI�V�U�UsPQO.[WG,]&I�RSV�UWT}kZMzI�b�UjV�UW]SV�UWO�U�J>I�G,I�PN\KJlPNJ�I�b�Use�\KV�Yé\KeoO�I�V�PNJS_ OWht�S\ V3U(pSGKY^]�LXU a{JS\&T&ULQG,kgU�LNUWTzÏS ,¥�¥�¢(¦�¨�¦�¢Õ�Ñ�©K¨�§�¥�§�Ñ5¨�PNODV�U�]�V�U�O�UWJ I�UWTlk>MzI�bSUjO�I�V�PXJ�_���ÆSa��obSU�V�UWG O8I�bSUsO�I�V�PXJS_���ÆKÌ[(\ V�V�UWO�]g\KJ�TSO$I�\DI�bSUBJS\&T&UiLQG,kgU�LNUWTzÕ��#ÔZÐ�¥�¢�¦�§�¨>©Kh$��b�UBO�PNY;PXLQG,V�PXIxM.kgU(Ix�dU�U�J;I�bSUWO�U�Ix�d\`JS\&T&UWO����Æ;GKJ�Ty��Æ,Ì>�dPNO`� h ��h�� O�MZY^Y;U�I�V�PN[DY;UWG O�R�V�UD\,ecO�PXY;PNLNGKV�PXIxM�ÄX�WÌ Å5Ç�PQOoR�O�UWT�I�\t[�\KJ�O�I�V�R�[(IoGO�PXY;PNLNGKV�PXIxMjYsG5I�V�PXpt\,e0O�PNm�Us�����,p������3[�\KV�V�U�O�]g\KJ1T&PXJ�_.I�\y�����qk1\Z\ |ZO�R1O�U�T�PNJ�U(p&]gU�V�PXY;U�J>IO�hêSh ÌSh ÌlÅ8¨6Å8� © Ñ,¦�§�¥?_&ÙÓ (Ñ,¦ í �wÔZÐ¥�¢�¦�§�¨>©S~BÑ�Ñc5Ð�·B��bSU`[�LXR�O�I�UWV�PNJS_;]SV�\KkSLNU�Yà[WG,Jyk1U3O�I�G,I�U�T

GKOoe�\KLNLX\5�iOWhiþHPXu U�JzGj[�\KLNLXU�[�I�PN\KJ�ad�8a1\,eckg\>\ |&O�a1��U3J�U�UWTyI�\j\KkSI�G,PNJzGjO�U(I�ab¡ca�\Kec[�LXR1OxI�U�VO�h�¤]SV�\vp&PNY;PwIxM�T&U�J1T&V�\ _KVG,YâÄ Å>ÆvÇ$R�O�PNJS_tI�bSU;[(\ Y^]�LXU�I�U(f�LNPXJS|nGK_K_KLN\KY;UWV�G,I�PNuKU3[(LNR�O�I�UWV�PNJS_�GKLwf_K\ V�PXI�b�Yäe�\KVHI�bSUs[�\KLNLXU�[�I�PN\KJ}\,e8�����kg\>\ |&O8PQO`O�bS\5�oJlPNJ}�$PN_KRSV�U;ÌKÌSh^ÒZU�u U�J�[(LNR�OxI�U�VODG,V�U\KkSI�G,PNJSU�T�k>M�[bS\Z\ O�PNJS_sG;I�bSV�UWO�bS\ LNT������Bu5G,LNRSU3\Ke���hX�vË&h���I8PQOi�dU�LNLwf�|ZJS\5�oJtI�b�G5IDT&PX�gUWV�UWJ Iu5G,LNRSUWO.e�\KVS�~Y;PN_Kb>I;_KPNuKU�TSPw��U�V�U�J>I^[�LXR1OxI�U�V�PXJS_>O�Ä Å Æ5Ç�h���bSPQO.I�bSV�UWO�bS\KLQT~u5GKLXRSU�PNO;[bS\>O�UWJ

Page 53: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ì�³

1

2

3

4 5

6 7

8

9

10

11

12

13 14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

3233

34 35

36

37 3839 40

4142

43

44 45

46

47

48

49

5051

52

53

54

55

56

57

58

59 60

6162

63

64

65

66

67 68 69 70

71

72

73

74

75

76

7778

79 80

81

82 83

8485

86 87

88

89

90

91

92

93

94

95

96

97

98

99

100

0.0

0.2

0.4

0.6

0.8

1.0

ä(jel*�3¾T¾;�Å�r*h=k*r*iPwTlTi�tE| s:wTiPiGh=fGoBwTk*r;jek*lLgGw Þ:øTø�zBwqwTûXf��

Page 54: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ì Ö � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

kgUW[�GKR�O�UsI�bSUyø,_>G,]�ø�PNJ�I�b�UtT&U�J1T&V�\ _KVG,Y k1U�Ix��UWU�J�I�bSUjLNU�uKUWLNOqG5I^�obSPN[b~O�PXp�GKJ�T~O�U�uKUWJ[(LNR�O�I�UWV�O�G,V�Une�\KV�Y;UWT�PQOjI�bSUlLQG,V�_KU�OxI�h �iJæU(pSG,Y;PNJ�G5I�PX\ J�\,e`I�b�U�O�RSk&îxUW[(IyGKV�U�GKOj\KeDI�bSUkg\>\ |&OqÄX�WÌ Å5Ç�PNJzI�bSUWO�Uq[�LXR�O�I�UWV�O8V�U�uKU�G,LNUWT�I�b1G5IHI�bSU^[(LNR�OxI�U�VOB\ k&I�GKPXJ�UWTzGKV�U3PNJ�T&UWUWTnY;U�G,J&fPNJS_,e�RSL�h!Ø�G [bt\Ke�I�b�UWO�U3[(LNR�OxI�U�VOdPNOoV�U�]�V�U�O�UWJ I�UWTtR�O�PNJS_sGqLXPQOxIi\Ke$O�I�V�PXJ�_�aSOWaSG,J�Tte�V�U��>RSU�J�[�MKa�� a&]1G,PNV�OWaZ�obSU�V�U

�� PQOdI�b�UHJZRSYqk1UWVo\,e�kg\Z\K|&O�PNJtI�bSU`[(LNR�OxI�U�VoPNJ��ob�PN[b�O�PNOd]SV�UWO�U�J>I�h0��\KV

U(pSGKY^]�LXU aS[(LNR�OxI�U�V  �H[�\KJ>I�GKPXJ1O�Í>Ì.kg\Z\K|&Odk1UWLX\ JS_KPNJS_qI�\qÏ� 5¥�¥�¢�¦�¨n¦�¢ÕÑ�©K¨�§�¥�§�Ñ5¨1a�¨g¢�Ô&¦� 5��¨�¢(¥%$^�Ñ5¦�c5Ð�a� 5¦�¥�§ ��Õ�§� 5��§�¨�¥�¢(���#§w©>¢�¨gÕ¢(a$G,J�T�ÕÑ5ÙBÏgÔ&¥�¢(¦^´W§QÐ�§�Ñ,¨zG,J�T�G�]1G,V�IH\Ke�PwIODV�UW]SV�UWO�U�J>I�G,I�PN\KJrl�����W�dPNOi_KPNuKU�J�k1UWLX\5�`hrl�%� � ���q����\iÜZ�Wë�a�����a{���8��ËSa�����a���F���a1ËK�(a���FHÌS� �Ka����(a���FHÌS��ËSa�ËK�(a���FHÌ Ë&aSÌ>��a���F8Ì>Ë&�Ka��v��a���FHÌ Ë Ë&a

����ac��F8Ì>Ë,ÅSac�v��a�JJ�Jc����Í>êSa�Ì �(a!����Í ê��Ka�ËK�(a!����Í>ê Ë&a0�v��a!����Í>êKÌ�agÌ>��a�J�JJc�gGZË,êSa0�v��a!�gG>êSac�v��a�gG>êS�Ka�ÜK��a��FGZÜ&�KaN�����

��bSUWO�Uo[(LNR�OxI�U�VO0\,e�k1\Z\ |ZO0GKJ�TqI�bSUi[�\KV�V�U�O�]g\KJ�TSPXJS_H[(LNR�O�I�U�V!TSUWO�[(V�PX]&I�PX\ J�Oc[�GKJqkgUoR�O�UWT;GKOe�\KLNLN\5�iO�h0��e$G^R�O�U�V�PQOoO�U�G,V[bSPNJS_.e�\ V�k1\Z\K|&OWaSO�GvM aZ\KJ}§�Ù; W© ¢3Ð�¢�©KÙs¢(¨1¥� ,¥�§�Ñ,¨z����Í ê>��aZI�bSU�Jy��UO�U�LNUW[�Id[(LNR�OxI�U�V����ok1U�[�G,R1O�UoPXI�O�V�UW]SV�U�O�UWJ>I�G5I�PX\ J^GKLX\ JSUi[(\ J>I�G,PNJ�O0I�bSUBO�I�V�PXJ�_`��Í êSh0úi\KI�UoI�b�G5Ikg\>\ |&O � k �F�q¢(Ô&¦�Ñ�ÕÑ5ÙBÏgÔ&¥�§�¨>©��$G,J�T2�C�P�D� Ä�¢�¨SÐ�Ñ,¦�Úa�.¢�Ô&¦� 5���q¢(¥%^�Ñ5¦�c5Ð��i�� ,¥�¢�¦� ,����¨°_Z§�¡�§�¥�§�Ñ,¨>�G,V�Uikg\,I�bjY;U�Y.kgU�VO�\,e�[(LNR�O�I�U�V�����UWuKU�JjI�bS\ RS_Kb;I�bSU�PNVX}0�o��JZRSY.kgU�VO�GKV�UB�>RSPXI�UHT&PX�gUWV�UWJ I�3� k PQO�dH�HÜ,êSh¸Æ&h �iÍKÍ Í>ËSaN���|�DPQOa��þ`Ì êKÌb� Ìb� �zÌ Ì ��h�S\KR�VlGKTSTSPwI�PX\ J�G,Lqk1\Z\K|&OnLQG,kgU�LNUWT ��� ÿ ������� ÿOk �M�C� ÿO÷ a.GKJ�T �C� ÿMø b�GvuKU�kgU�UWJÛR�O�UWT÷I�\

O�I�R�T&M�I�bSUl]SV�\ kSLNU�Y \KeDG O�O�PN_KJSPNJS_�[(LQGKO�O�PXr1[WG5I�PN\KJ�JZRSY.kgU�VO;I�\�J�U��äk1\Z\ |ZOWhæ��bSU#}0�o�JZRSY.kgU�VO3\Ke�I�bSU�O�Ujkg\Z\K|&O.GKV�U È����C� ÿ �W� dHÌ Ì Æ&h �oÌKÅ�a��3��� ÿMk �2dH�DÜ5êSh#Ü5Ì�h Þ�Ì ÆKê>��Æ Ü&ac�3��� ÿO÷ �dH�HÜ,êSh¸Æ&h \iÜ5ê>�8h¸Ë&aZG,J1T}���C� ÿMø �|dH�DÜ5êSh ÅSh FDÆ5½�ÍKÍ1h$��b�UWO�U`k1\Z\K|&OoGKV�U`GKO�O�PX_ JSUWTtI�\j[�LXR�O�I�UWV�Ok�G O�U�T�\KJnJSU�G,V�UWO�IiJSU�PN_KbZkg\KVB[�LNG O�O�Pwrg[�G5I�PX\ J�ho��bSU3JSU�G,V�UWO�IBJSUWPX_ b>kg\KVB\,e��C� ÿ �va�Gsk1\Z\ |�\ J 5¦�¥�§ ��Õ�§� 5�&§�¨1¥�¢����#§w©>¢(¨�Õ¢(a,PQO � kM÷ GKJ�T`O�\I�C� ÿ �0PQO{G O�O�PX_ JSUWT8I�\8[(LNR�O�I�UWV ���5h{��I$PQO�\ k�O�U�V�uKUWTHI�b�G5II�b�U8GKO�O�PX_ JSY;U�J>I�\,e�I�bSUWO�Uie�\ RSV�kg\Z\K|&O�I�\`I�bSU8V�UWO�]gUW[�I�PXu UB[(LNR�O�I�UWV�O�PNO�Y;UWG,J�PXJS_Ke�RSL�a>T&UWY;\KJ&fO�I�VG5I�PNJS_nI�b�G5I^|ZJS\5�oLXU�T&_KU�f�k1GKO�UWT�[(LNR�O�I�U�V�PNJS_zPQO.R�O�U(e�R�LdPNJ�O�\KLNuZPXJS_l]SV�\ kSLNU�YsO.G O�O�\&[(PQG5I�U�T�oPXI�bnT&\&[(RSY;UWJ IiV�U(I�V�PNU�u5GKL�hèZ# �ÉCn);9:)O/0+.-B+.-*4goU�[(U�J>I�M UWGKV�O�b1GvuKU!O�U�U�J`UWuKUWV�PNJ�[(V�UWG O�PNJS_ouK\ LXR�Y^U�O�\,e�[�\KLNLXU�[�I�UWT`TSG,I�Go\Ke&GKLXL>O�\ V�IO�h�½�PwI�bqO�\Y.R1[btTSG5IG.Gvu5G,PNLQG,kSLNUKa PwI�PNO�JSU�[(UWO�O�G,V�M.I�\qT&UWuKU�LN\K]�G,LN_K\KV�PXI�bSYsOc�obSPQ[b�[WG,JjU�pZI�VGK[�I8Ù;¢ 5¨�$§�¨>©� Ô&�,PNJ&e�\KV�YsG5I�PX\ J;e�V�\ Y I�bSUBu5GKO�I�O�I�\ V�U�O�hcÒZUWGKV�[b�PXJS_De�\ V�R�O�U(e�R�L1JZRS_ _KU(IOc\,e�PNJ&e�\ V�YsG5I�PX\ JG,Y;\ JS_;b>R�_KU`G,Y;\KR�J IOd\,ecTSG5IGqb1GKO�kgUW[(\ Y;UDI�bSUDr�UWLNT�\,ei£K ,¥� tÙ^§�¨�§�¨>©KhF8G,I�G;Y;PXJ�PXJS_�[�G,J�kgU.G,]�]SLXPNUWT�I�\sV�UWLNG,I�PN\KJ�GKL�a&I�V�GKJ�O�GK[�I�PX\ J�aSG,J1TyO�]�G,I�PQG,L�TSG,I�GKk�GKO�UWOWa�GKO

�dU�LNL{GKOBLNGKV�_ U3OxI�\KV�UWOo\KecRSJ�O�I�V�R�[�I�RSV�U�TnTSG5IGjO�R�[bzGKOiI�bSUq½�\ V�LQT�½�PNTSU3½�UWk�hB��bSUWV�UqG,V�UYsG,JZM�T�G5I�G�Y;PNJSPNJS_lO�MZO�I�UWYsO`PXJ�R1O�U;I�\ZT�GvMKa0G,J�T�G,]�]SLXPQ[�G,I�PN\KJ�O3PXJ�[�LXR1T&UsI�b�U0Ã3h¸Ò�h{�{V�UWG5fO�RSV�MyT&U(I�UW[(I�PNJS_tY;\KJ�U�MtLQG,R�J�T&U�V�PNJS_�agúBG5I�PX\ J�G,L»\dG O�| U(I�k�G,LNL��BO�O�\Z[�PNG,I�PN\KJn[(\>GK[bSU�OiT&U�I�UW[(I�fPNJS_sI�V�U�J1TSOiG,J1T�]�G5I�I�U�V�J�Oo\Kec]SLNGvMte�\KV8PXJ�TSPXuZPQT&R�G,L{]SLQGvMKU�VOoG,J1TtI�UWGKY;OWa1GKJ�Tn[�G,I�UW_K\KV�PNm�PNJS_]�G,I�I�UWV�J1O!\,e�[b�PXLQT&V�U�JjPNJsI�b�Uie�\ O�I�UWV�[WG,V�UBO�M&O�I�UWYäÄ ëKÌ,Ç�hcÒZUWuKU�VG,L,îx\KRSV�J�G,LQO!b1GvuKUib�G T;V�U�[(UWJ IO�]1U�[(PQG,L�PQO�O�RSUWO�\ JnTSG5IGqY;PNJSPNJS_nÄ Ì��(Ç�a�Ä ÌKÍ,Ç�a�Äw��Å��5Ç�hêSh Í�hN��ß^ 5¥� :òn§�¨�§�¨Z©�Å�ÏKÏ�¦�Ñ� KÕO_S¢(Ð(·HFHG5IG�Y^PNJSPNJS_�a$LNPX| Uj[(LNR�OxI�U�V�PXJ�_�a$PNO3GKJ�U(p&]SLN\KVG5I�\ V�M

GK[(I�PNuZPwIxM a�O�\j[�LXR1OxI�U�V�PXJS_;Y;U(I�bS\&TSOBGKV�UD�dU�LNL�O�RSPwI�UWTye�\ VBTSG5IG;Y;PXJSPNJS_1h���LNR�OxI�U�V�PXJ�_^PQOi\Ke�I�UWJG,J}PNY^]g\KV�I�GKJ>I3PXJSPXI�PQG,L�OxI�U�]�\,eoO�UWuKUWV�GKL$PNJ}I�bSUjT�G5I�GyY;PNJSPXJ�_n]SV�\&[�UWO�OsÄ Æ>Ü�Ç�hsÒ&\KY;Us\,e�I�bSUTSG,I�G^Y;PXJSPNJS_jGK]S]SV�\ GK[b�UWO��obSPN[b�R�O�U`[(LNR�O�I�U�V�PNJS_sG,V�U;£  5¥� K¡ vÐ�¢.Ð�¢�©KÙs¢(¨1¥� ,¥�§�Ñ,¨�aZÏ�¦�¢£5§�Õ�¥�§�´5¢ÙsÑW£ ¢(�#§�¨Z©,agG,J�T�´�§QÐÔ� ,�#§�� 5¥�§�Ñ5¨�\,e{LQG,V�_KU`TSG,I�GKk�GKO�UWOWh

Page 55: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ì�ìÄ�¢�©,Ùs¢�¨�¥� 5¥�§�Ñ5¨g·H��LXR1OxI�U�V�PXJS_DY;U(I�bS\&TSOcG,V�U�R�O�UWTqPXJsTSG,I�GHY;PXJSPNJS_HI�\`O�U�_ Y^UWJ>IcT�G5I�GKk�GKO�UWOPNJ I�\�b�\KY;\K_ U�JSUW\KR�O8_KV�\KRS]1O�h.��b�PNOD[�GKJ}O�U�V�uKUq]SRSV�]1\>O�U�OH\,e�TSG,I�Gy[(\ Y^]�V�U�O�O�PX\ J����d\KV�|ZPXJ�_�oPXI�b�I�bSUl[(LNR�O�I�UWV�OtV�G,I�bSUWVsI�b�GKJ�PXJ1T&PXuZPQT&R�GKLBPXI�U�YsO��ai\ VsI�\�PNT&UWJ>I�PXe�M�[b1G,VGK[�I�U�V�PNO�I�PQ[�O;\KeO�RSkS]g\K]SRSLQG5I�PX\ J�OD�obSPQ[b�[�G,J}kgU;I�G,V�_KU�I�U�Tze�\ V3O�]gUW[�Pwr1[;]�RSV�]g\ O�UWOs��U�_1a�YsG,V�|KU�I�PNJS_yGKPXY;U�TG5IiO�U�JSPN\KVi[�PwI�PXmWU�J�O��h�äÕÑ,¨�¥�§�¨�Ô�Ñ5ÔZÐ�c�� Ù;¢ 5¨�Ð8[(LNR�O�I�UWV�PNJS_�G,LN_K\KV�PXI�bSY Ä ÆKÆvÇcb�G OHk1UWU�JlR1O�U�TzI�\y[�LXR�O�I�UWVD]SPwp&UWLNO

PNJ8}{G,J�T�O�G,IHPNYsG,_KU�O;Ä ÆKê5Ç�h;Ø�GK[b�]SPwp&UWLc\KV�PX_ PXJ�GKLXLNMnb�G O.Üju5GKLXRSU�OHe�V�\ YéT&PX�gUWV�UWJ>I`O�G5I�U�LNLXPXI�Uk�GKJ�TSOWa$PNJ�[�LXR�TSPXJS_lPXJ&e�VGvçZV�U�T�hn��bSUWO�UyÜyu5GKLXRSU�O.GKV�UjT&PXáj[(RSLXI.e�\ V.bZRSYsG,J1O`I�\�GKO�O�PNY;PXLQG5I�UG,J1TyGKJ�G,LNMZm�UH�oPwI�bS\KRSIBGKO�O�PQOxIG,J�[�UKhcÞ!PXp&U�LQO��oPwI�b�I�bSUqÜ3e�U�G5I�R�V�U`u5G,LNRSU�OoG,V�UD[�LXR1OxI�U�V�UWT�PXJ>I�\ËKÆKêD_KV�\KRS]1O�aKI�bSUWJjUWG [b^]�Pwp&U�LgPQO�GKO�O�PX_ JSUWTqI�b�UBu5G,LNRSUi\KegI�bSU8[�LXR1OxI�U�V�[�U�J>I�V�\KPQT�h0��bSUBPNYsG,_ U[�GKJ;I�bSUWJjkgU8T&PQO�]�LNGvM UWT^�oPwI�bsI�b�U8O�]�G5I�PNGKLSPXJSe�\KV�Y;G,I�PN\KJsPNJ>I�GK[(IWhc�iR�Y;GKJjuZPXUW��UWV�O�[�G,JsLN\Z\K|G5I.G�O�PXJ�_KLNUs]SPN[(I�RSV�UjG,J1T�PQT&UWJ I�Pwe�M}G�V�UW_KPN\KJ�\,e�PXJ>I�UWV�U�OxI�a���¢W·¸©>·Na0bSPX_ bZ�dGvMn\ VDe�\KV�UWO�I�DG,J1TLQG,kgU�L�PwIoGKOdG.[�\KJ�[�U�]&I�hc��bSUHO�M&OxI�U�YðI�b�U�JyPNT&UWJ>I�PXr�UWO�\,I�bSU�V�]SPXp&U�LQO�PNJjI�bSUHO�G,Y;UH[(LNR�OxI�U�VoGKOG,JyPNJ�OxIG,J�[�U`\,e{I�b�G,IB[(\KJ1[(U�]SIWhÎd¦�¢£5§�Õ�¥�§�´5¢|òlÑW£ ¢(�#§�¨Z© ·DÒ>IG5I�PNO�I�PQ[�GKL&Y^U�I�bS\&TSO!\,egT�G5I�GDGKJ�G,LNM&O�PQO$R�O�R1G,LNLXM`PNJZuK\KLNuKUdbZMZ]1\KI�b&f

UWO�PQOiI�UWO�I�PNJS_�\Ke�GjY;\&T&U�L$I�bSU^GKJ�G,LNM&OxIHG,LNV�U�GKT&Myb�GKO8PNJlY;PXJ1T�h`F8G,I�GjY;PNJSPNJS_y[WG,JlGKPNTnI�bSUR�O�U�V8PXJlTSPNO�[(\5u U�V�PXJS_;]g\,I�U�J>I�PQG,L$bZM>]g\,I�bSUWO�UWOB]SV�PX\ VoI�\�R�O�PNJS_tO�I�G,I�PQOxI�PN[WG,L�I�\Z\KLQO�h8Î�¦�¢£5§�Õ�¥�§�´5¢ÙsÑW£ ¢(�#§�¨Z©HR�O�UWO�[(LNR�O�I�U�V�PNJS_3I�\q_ V�\ RS]jPXI�U�YsOWaZI�bSUWJtPNJ&e�U�VoV�RSLNUWO�I�\;[b�G,VGK[(I�UWV�PNm�UoI�bSUH_KV�\KRS]�OG,J1T.O�RS_K_ UWO�I{Y;\&T&U�LQO�h0�S\ V0U(pSG,Y;]SLNUKa5YsG,_>G,mWPXJSUdO�R�k�O�[�V�PNkgU�VO{[WG,J.kgUo[(LNR�O�I�U�V�UWT.k�GKO�UWT3\KJqGJZRSY.kgU�V8\,e0e�GK[(I�\ V�O3��G,_ UKa�O�U(p�a�PNJ�[�\KY;UKac¢(¥�Õ�·¸��a1I�bSUWJ�I�bSUqV�U�O�RSLXI�PNJS_s_ V�\ RS]�Oi[b�GKV�G [�I�U�V�PXmWUWTPNJ�G,J�G5I�I�U�Y;]&I;I�\lr�J�T�GlY;\&T&U�L��obSPQ[b~�oPNLXLoT&PQO�I�PNJS_KRSPQO�b~I�b�\ O�U�O�RSk�O�[(V�PXkgU�VO3I�b�G5I;�oPNLXLV�U�JSUW�¿I�b�U�PNVBO�R�k�O�[�V�PN]&I�PX\ J�O�e�V�\ YàI�b�\ O�U8I�b�G5Ii�oPNLNL�JS\,I3ÄX�vÜ&�(Ç�hJ�§QÐ�Ô� 5�#§�� ,¥�§�Ñ,¨g·D��LXR�O�I�UWV�OqPNJ~LNGKV�_ UtTSG,I�G,k1GKO�UWO3[WG,J~kgUtR�O�UWT�e�\KV^u>PQO�R�G,LNPXm�G5I�PX\ J�a0PXJ~\ V�f

T&UWVDI�\zG,PQT�b>R�Y;GKJ�G,J�GKLXM&O�I�OHPXJ�PQT&U�J>I�Pwe�MZPNJS_n_KV�\KRS]1OHGKJ�T�O�R�kS_KV�\KRS]1OBI�b�G5I3b1GvuKUsO�PNY;PXLQG,V[b�GKV�G [�I�UWV�PQO�I�PQ[�OWh8½�PNJSïBPNm�Äw�vËa�5Ç0PQOHGyTSG,I�GjY;PNJSPNJS_�uZPQO�R1G,LNPXm�G5I�PN\KJzI�\Z\KL0PNJl�obSPQ[b�T&UWV�PNuKU�T[(LNR�O�I�UWV�O�[�GKJ�kgUDU(p&]g\KV�I�UWTyGKOdJSUW�¹G,I�I�V�PNkSR&I�U�O��obSPQ[by[WG,J�I�bSUWJ�kgU3[b�G,VGK[(I�UWV�PNm�U�TskZM;I�bSUO�MZO�I�UWY�h0��\KV�U(pSGKY^]�LXU a>k�V�U�G,|>e�GKO�I�[�U�V�UWGKLNOdG,V�U8[�LXR�O�I�UWV�U�TtG [�[(\ V�TSPXJS_.I�\;[�GKLX\ V�PNUWOWa ]�V�\KI�U�PNJ�ae�G5I�a�O�\&T&PNRSY�a�r�kgU�V�a�[�GKV�kg\KbZM&T&VG5I�U a1O�RS_ GKVWa�]g\,IGKO�O�PNRSY�a�G,J�Tlu>PXI�GKY;PXJ}[(\KJ>I�U�J>I8]gU�V`O�U�V�u fPNJS_�h�Ãi]g\KJ�O�U�U�PNJS_.I�bSUDV�UWO�RSLwI�PXJ�_q[(LNR�O�I�UWV�OWa>I�bSUHR�O�U�Vo[�GKJtU(p&]g\KV�I�I�bSU`[(LNR�OxI�U�VO!I�\q½�PNJSï8PXmGKODG,I�I�V�PNkSR&I�U�O�h3��b�U;O�M&OxI�U�Y O�bS\5�iOBI�b�G,IH\ JSUq\Ke!I�b�U;[�LXR1OxI�U�VO8PQOD[b�G,VGK[(I�UWV�PNm�U�T�k>Mnb�PX_ b]g\,I�G O�O�PNRSYð[�\KJ>I�UWJ>IWaZG,J�T;I�bSUBbZRSYsGKJtG,J�GKLXM&O�I�V�UW[(\ _KJSPNm�U�O$I�bSUHPNJ�T&PNu>PQT&R�GKLNO�PXJjI�bSUH[(LNR�OxI�U�VGKO^kgU�LN\KJS_ PXJ�_lI�\lI�bSU ö kSVG,J�ø�[(UWV�U�G,L�e�G,Y;PXLNMKa�LXU�GKT&PNJS_�I�\�G�_KU�J�U�VG,LNPXm�G5I�PN\KJ�I�b�G5I ö kSV�GKJ[(UWV�U�G,LQO�G,V�UHb�PX_ b�PNJ�]1\KI�GKO�O�PXRSYsø�hêSh Í�h¸Ëzòn§�¨�§�¨Z©H�X 5¦�© ¢dÔ&¨�Ð¥�¦�Ô�Õ�¥�Ô&¦�¢£i£  5¥� K¡ vÐ�¢(Ð�·8FHG5IG�Y;PXJSPNJS_ob�G O�\,e�I�U�J`kgU�UWJ`]1UWV�e�\ V�Y;UWT

\KJqI�VG,J1O�G [�I�PN\KJ^G,J�T^V�U�LQG5I�PX\ J�G,L&TSG,I�G,k1GKO�UWO$�obSPQ[b^b1GvuKUd��UWLXLwçZT&U�r�JSU�T3r�UWLNT�Oc�obSPQ[b^[WG,J^k1UR�O�UWTqGKO�e�UWG5I�RSV�UWOWa5kSR&I$I�bSUWV�Udb�GKO{kgU�U�J^V�UW[(UWJ>I{V�UWO�UWG,V[b`\KJ.LNGKV�_ U�RSJ�O�I�V�R�[(I�RSV�UWT3T�G5I�GKk�GKO�UWOO�R�[byG OdI�bSU`½}\KV�LQTt½�PQT&U3½}U�k�Ä Æ,Ì5Ç�hØcpSG,Y;]SLNUWO0\Ke�V�UW[�U�J>I�G5I�I�UWY^]SI�OcI�\3[(LQGKO�O�PXe�M.½}U�kjTS\Z[�RSY;U�J>I�O�R�O�PXJS_`�d\KVTSO0\ Vce�RSJ�[(I�PN\KJ�O

\,ei�d\KVTSO^GKO3e�UWG5I�RSV�UWOqPXJ�[�LXR1T&U}ÄX��Ë ÆvÇoG,J�TæÄ Ë ÆvÇ�h}�B\5��UWuKU�V�a$V�UWLNG,I�PNuKU�LNM�O�YsGKLXL�O�U�I�Oq\,eBLQG5fkgU�LNUWT�I�V�GKPXJSPNJS_tO�G,Y;]SLNUWO8G,J�T�u U�V�M�LQG,V�_KU3TSPXY;U�J1O�PN\KJ�GKLXPXIxMyLXPNY;PwI8I�bSUqRSLwI�PXYsG,I�UqO�R�[W[(UWO�Oi\KeG,RSI�\KYsG,I�PQ[8½}U�knT&\&[�RSY;U�J>IB[�G,I�U�_ \KV�PXm�G5I�PX\ Jjk�GKO�UWT�\KJ��d\KVTSO�GKOde�U�G5I�R�V�U�O�hgiG5I�bSU�V$I�b1G,J._ V�\ RS]SPNJS_8TS\Z[�RSY;U�J>I�O$PNJqG8��\ V�T`e�UWG5I�RSV�UdO�]�GK[�UKa&ÄX�WÅ>ÜvÇZ[�LXR1OxI�U�VO�I�bSUd��\ V�TSOe�V�\KY G�O�YsG,LNLB[(\ LXLNUW[(I�PN\KJ�\,eD½}\KV�LNT�½�PQT&Uz½}U�k¿T&\&[(R�Y^UWJ>I�OsPNJ�I�bSU�T&\&[(RSY;U�J>I�O�]�G [(UKh��bSUyO�GKY^]�LXUyTSG5IGlO�U(I^[�\KJ�O�PQOxI�UWT�\KeBë ÆzTS\Z[�RSY;U�J>I�O.e�V�\KY I�bSUyYsG,JZR&e�G [�I�R�V�PNJS_lT&\ YsG,PNJPNJ�Í�T&PX�gUWV�UWJ IDR�O�U�V�çZT&U�r�JSU�Tz[�G,I�U�_ \KV�PXU�Oq���X K¡Ñ,¦ûi�X¢�©  ,�¸ûd©>Ñ5´5¢(¦�¨1Ù;¢�¨�¥�ûB£K¢(Чw©K¨>�(h^��b�UWO�U^ë>Æ

Page 56: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ì�ü � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

T&\&[(R�Y^UWJ>I�OB[�\KJ>I�GKPXJ�UWT�Æ&�WÅN�;T&PNO�I�PNJ�[(IB��\ V�T�O�I�UWY;OBG5e�I�UWV8[�\KY;Y;\KJ���\ V�T�O`��I�b�UKa1GKJ�T�a1\,e���dU�V�UiV�UWY;\5uKUWT�h0ÒZPNJ�[�UiI�b�UB�d\KVTSO�GKV�UB[�U�V�I�GKPXJSLNM;JS\,IdRSJ�[�\KV�V�UWLNG,I�UWT�a,I�b�U�MsO�b�\KRSLQT;e�G,LNLgPXJ>I�\[(LNR�O�I�UWV�O��obSU�V�Ui�d\KVTSOcR�O�UWTsPNJtG3[�\KJ�O�PQOxI�U�J>I���GvM^G [(V�\ O�O0I�bSUHT&\&[(RSY;UWJ IdO�U�I�b�Gvu UBO�PNY;PXLQG,Vu5G,LNRSUWO�\Ke{e�V�UW�>RSUWJ�[(MtPXJ�UWG [byTS\Z[�RSY;U�J>IWhÆnf�Y^U�G,J�O�[(LNR�O�I�U�V�PNJS_���GKOtR�O�U�T�I�\�_KV�\KR�]�I�bSU�Æ&��Å����d\KVTSOjPNJ>I�\¹��~_ V�\ RS]�OWh»è8JSUO�RSV�]�V�PQO�PNJS_^V�U�O�R�LwIi��GKOdI�b�G5IBGKJyGvu U�VG,_KU8\,ecÅ Ë{ð\,e{I�bSU3�d\KVTSO�e�U�LNL�PNJ>I�\jG;O�PNJS_ LXU`[(LNR�O�I�UWVWa�obSPQ[b�[�\KRSLQT�I�bSUWJ�kgUnT&PQO�[WG,VT&UWT�e�\KVsTSG,I�G}Y;PXJSPNJS_�]SR�V�]g\ O�UWOWh���bSUzO�YsG,LNLXU�OxIj[�LXR�O�I�UWV�O[(\ J>I�G,PNJSU�T�I�UWV�YsOy�obSPQ[b¿I�\�G�bZRSYsG,JÉO�UWU�YåO�U�YsG,J>I�PQ[�GKLXLNM�V�UWLNG,I�U�T�hý��bSU~Ü~O�YsG,LNLXU�OxI[(LNR�O�I�UWV�Ode�V�\KYýGqIxMZ]SPQ[�GKL�V�R�JyGKV�U`O�bS\5�oJtPNJn�{PN_KR�V�UðÌ,Í�h

acbed*fPgPh=i�Þ acbed*f gGh=i�Ô acbed*fPgPh=i�¾ acbed*fPgPh=i�Ä acbed*f gGh=i�¡ acbed*fPgPh=i�Õ acbed*fPgPh=i�öh=|_o*bew��~h tEo;o*bejes tEs�gGjewTk s:tEr*|�tOç s�xKi tE|_h=k*r tEk*je|x%|_but s=butEje| tS�_iG| s=wTk*fGd;b g s=wTk~g�tEjek z3tEk*ûXiGd;o;gGs=j s=wT|_|_wqrbeh:t:p v*beh tE|_h=iGjes:tEk s=wToX�qiGjelTm~g s=wTfP|_h=g s=wqr;h s=o*l

jek~p~h=kXg r*jefGs=iPje|_jek s=d*fPgPwT| h�� s=wTd*iPg h��;s=h=o;go*tSgGh=k~g �PwTz r*h=fGjelTk m*tEjei s=iGh=r*j gPwTi x%tSgo;iGw�pqjefGjewTk |_jek*wTi |�tEk3tEl jek;lTiGh=r*j r*h=z;gPwTi xKh

wTo*oBwTiPgPd*k o*iPwE�Ph=s�g butEzBh=b oBh�gGj gPjewTk xKwqwXroBh:wTo;b fGh=s�g |�tEkXd;x%tEs�gGd*i o*iPwTo,h=i gGj xKiGd*j g�MwT|_h=k fGh=i p;jes o;iGwXr*d*s�g fGh=s�gPjewTk beh�p~h=b

iPh=lTd*b fGh=s=d*i o*o*|gPiGd*f gGh iGh�xKh=i

gPwTop~h=lTh�g

ä(jel*�3¾EÄ*���m*hnfGh�p~h=k�fP|�tEbebeh=fPg�s=bed*fPgPh=iGfMxKwTd*k*r�jek�gGm;hnr*wqs=d*|_h=k~g�fPh�g��Z��m*h=fGh?tEiPhnfPgPh:|_|_h=r_�MwTiPr*f��

��UWV�YsOo�obSPQ[b�G,V�U`R�O�U�TyPXJ�\KVT&PNJ�G,V�Mj[(\ J>I�U(pZIO�aS\ VoRSJSPQ�>RSUDI�UWV�YsOo�obSPQ[bnT&\sJS\KIi\Z[W[(RSV\,e�I�U�JsGK[�V�\>O�O$I�bSU�I�VG,PNJSPNJS_`T&\&[(RSY;UWJ IdO�U�I!�oPXLNL&I�UWJ�T^I�\3[�LXR1OxI�U�V!PNJ>I�\HI�bSUBLNGKV�_ UdÍZ���N�BY;U�Y^fkgU�VD_KV�\KRS]�h.��bSPQOBIG,| UWOD[�GKV�Uq\,edO�]gU�LNLXPNJS_yU�V�V�\ V�OWa1]�V�\ ]1UWVHJ1G,Y;UWOH�obSPQ[b�GKV�U^PXJSe�V�U�� R�U�J>IWaG,J1T;I�UWV�YsO!�ob�PN[btGKV�UBR�O�U�TsPNJsI�bSUHO�GKY;UBYsG,JSJ�U�V!I�bSV�\KRS_ bS\KR&I�I�bSU8U�J>I�PNV�UHT&\&[(RSY;UWJ I�O�U�IWh�{U�V�Y;O�R�O�UWTsPNJ�O�]gUW[(PXr1[8[(\KJ>I�U(pZI�OH��O�R�[btG O/���X¢!PNJjI�bSUD[(\KJ>I�U(pZI�\Ke�r�LXPNJS_^G3]�G,I�U�J>I�a>VG5I�bSU�VI�b1G,J�Gy[(\ Y;]SR&I�UWVBr1LXUv�B�oPNLNL0GK]S]gUWG,VHPNJzI�b�U;TS\Z[�RSY;U�J>I�OD[�\KJ�O�PNO�I�UWJ>I�LNMy�oPXI�b}\,I�bSU�V8I�UWV�YsOG,]�]SV�\ ]SV�PNG,I�UiI�\^I�b�G,Io[�\KJ>I�U�pZID��ÏS ,¥�¢�¨�¥�û!§�¨�´5¢(¨1¥Q�dGKJ�TsI�b>R1O��oPXLNL�I�UWJ�T�I�\;[(LNR�OxI�U�V�I�\K_KU�I�bSUWVWh�iY;\ JS_^I�bSU`_ V�\ RS]�Od\,e0��\ V�T�O�aZRSJSPQ�>RSU3[(\ J>I�U(pZIOoOxIG,J�Ty\KRSIde�V�\KYàI�bSU3[�V�\5�iT�h�oe�I�UWV!T&PQO�[WG,VT&PXJ�_iI�b�UdLQG,V�_KU�OxI0[(LNR�O�I�U�V�avI�b�U�O�YsG,LNLXUWV$O�U(Ic\KeSe�UWG,I�RSV�UWO0[�GKJ.kgU�R�O�U�T`I�\D[�\KJ&f

O�I�V�R�[�I�� R�U�V�PXU�O!e�\ VdO�U�UW|>PNJS_q\KR&Id\,I�b�U�VdV�UWLXUWuvGKJ>IdT&\&[(R�Y^UWJ>I�Od\KJsI�bSUH½�UWktR�O�PXJ�_qO�I�G,J1TSG,VT½}U�knO�U�G,V[bSPNJS_.I�\Z\KLQO`��¢�·¸© ·Na�}�M&[(\>O`Ä Ë��,Í,Ç�a&�iLXI�GKïBPQOxIGnÄ Ë�� ÆvÇ�a�è8]1UWJ��{U(pZI.Ä Ë��Kê,Ç��(hÒZUWGKV�[bSPNJS_sI�bSU.½}U�k��oPwI�bzI�U�V�Y;OBI�GK|KUWJ�e�V�\ YùI�bSU^��\ V�Tn[�LXR�O�I�UWV�O8G,LNLX\5�iO8T&PQO�[�\5uKU�V�Mt\Ke

r�JSUWV�_ V�GKPXJSU�THI�\ ]SPN[WO���¢W·¸©>·Na5e�G,Y;PNLXMHY;UWT&PQ[�GKLKLNUWGvu U����oPXI�bSPNJ`I�bSU�kSV�\ G T&LNM8T&U�r�JSUWT.[�G5I�U�_ \KV�PXU�O��¢�·¸©>·Na�LQG,kg\KV���hêSh Í�h Ì�ß^ 5¥� 1ò�§�¨1§�¨>©�§�¨ Öi¢Ñ5�NÑ�©K§�Õ 5�Bß^ 5¥� K¡ vÐ�¢(Ð(·BF8G,I�GKk�GKO�U�Y;PNJSPNJS_�PQO�G�[�V�PXI�PQ[�GKLHV�U(f

O�\KRSV[(U!PNJ3\ PXL>U(p&]SLN\KVG5I�PX\ JDGKJ�T`]SV�\&T&R�[(I�PN\KJ�h{��I{PQO{[�\KY;Y;\KJ`|ZJS\5�oLNUWT&_ U!PXJ3I�bSU�\KPNL PNJ�T&R�O�I�V�MI�b1G5I�I�bSUoIxMZ]SPQ[�GKL1[(\>OxI�\,e�T&V�PXLNLXPNJS_.G3JSU���\,��O�bS\KV�Uo��UWLXL1PNO�PNJ;I�bSU8V�GKJS_KUo\Ke?�,Ì��,f�ÍZ�8Y;PNLXLNPN\KJ�akSR&I`I�bSUj[b�GKJ�[(U;\,edI�b1G5I.O�PwI�Usk1UWPXJS_zGKJ�U�[(\ JS\KY;PQ[^O�R�[W[(UWO�ODPQOs�;PXJ����h�9n\KV�U;PXJ&e�\ V�Y;U�TG,J1T�O�M&OxI�U�YsG5I�PN[`T&V�PNLXLNPXJ�_;TSUW[(PQO�PX\ J�Oo[�GKJyO�PX_ JSPXr1[�GKJ I�LXMsV�UWTSR�[(U`\5u U�VG,LNL1]SV�\&T&R�[(I�PN\KJ�[(\ O�I�OWh�BT&u5G,J1[(UWO�PNJtT&V�PXLNLXPNJS_`I�UW[bSJ�\KLN\K_KM^G,J�TtTSG5IG3[(\ LXLNUW[(I�PN\KJjY;U(I�bS\&TSO�b�GvuKUoLNUWT;I�\.\ PXL�[(\ Yqf

]�GKJSPXU�O�G,J�TtI�bSUWPXViGKJ�[(PNLNLNGKV�PNUWOd[(\ LXLNUW[(I�PNJS_qLQG,V�_KUDG,Y;\ RSJ>I�Od\,e�_ U�\ ]SbZMZO�PQ[�G,L�Êv_ U�\ LX\ _KPQ[�G,LST�G5I�G

Page 57: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ì��e�V�\KY ]SV�\&T&R�[(I�PN\KJ}��UWLXLQO`G,J�T}U�pZ]�LX\ V�G,I�PN\KJ�O�PXI�UWOWa�GKJ�T�I�bSUWJ}\ V�_>G,JSPNm�PNJS_tI�bSUWYéPNJ I�\�LNGKV�_ UTSG,I�G,k1GKO�UWOWh�F8G,I�G8Y;PXJSPNJS_8I�U�[bSJSPQ� R�UWO$b�GKO$V�UW[�U�J>I�LNMDk1UWU�J^R�O�U�T`I�\HT&UWV�PNuKU�]SV�UW[(PQO�UdGKJ�G,LNM>I�PQ[V�U�LQG5I�PN\KJ1O0k1U�Ix��UWU�J;\Kk�O�U�V�uKU�T3]Sb�U�JS\ Y^UWJ�G`G,J1Tq]1G,VG,Y;U(I�U�VO$��b�UWO�UoV�UWLNG,I�PN\KJ�Oc[WG,J^I�bSUWJ;k1UR�O�UWT�I�\s�>R�GKJ I�Pwe�M�\KPNL�G,J�T�_ G O�V�U�O�UWV�u UWOWh��J;�>R�GKLXPXI�G,I�PNuKUdI�UWV�YsOWaK_ \>\&TqV�U�[(\5u U�VG,kSLNU�V�UWO�U�V�uKU�O{b1GvuKU�bSPN_Kb;bZMZTSV�\&[�GKV�kg\KJ^O�G,I�RSVG5I�PX\ J

I�b1G5I.G,V�UqI�VG,]S]gUWT}kZMzbSPN_KbSLNMz]g\KV�\KR�ODO�UWT&PNY;U�J>I�Os��V�U�O�UWV�u \KPNV8]g\KV�\ O�PXIxM&�HGKJ�T�O�RSV�V�\ RSJ�T&U�TkZM�b�G,VT¿k�RSLX|æV�\&[|&OjI�b�G5I�]SV�U�u U�J>I�I�bSU�bZMZTSV�\&[�GKV�kg\KJ�e�V�\KY LXU�G,|ZPXJ�_�Gv��GvMKhà� LNGKV�_ UuK\ LXR�Y^U�\,eS]g\KV�\KR�O�O�UWTSPXY;U�J>IO�PQO�[�V�R�[�PNGKL,I�\ir�J�TSPXJS_8_K\Z\&TDV�U�[(\5u U�VG,kSLNU0V�U�O�UWV�u UWOWa(I�b�U�V�U(e�\KV�UKaT&UWuKU�LN\K]�PXJS_HV�U�LNPNGKkSLXU�G,J1T.GK[W[(RSVG5I�U�Y;U�I�bS\&TSO$e�\ V$U�OxI�PXYsG,I�PN\KJ.\KegO�UWT&PNY;U�J>Ic]1\ V�\>O�PXI�PNUWO�e�V�\KYI�b�U3[(\KLNLNUW[�I�UWTyTSG5IG^PNOo| U�MsI�\;UWO�I�PNY;G,I�PNJS_sbZM&T&V�\&[WG,V�k1\ Jj]1\KI�UWJ I�PNGKL�h��bSUj_KUWJSU�VG,LcV�RSLNUj\,edI�bZRSYqk�U(p&]gU�V�I�O3R1O�Use�\ V3]g\KV�\ O�PwIxMl[�\KY;]SR&IG5I�PX\ J�PNODI�b�G5IqPwI^PNO3G

�>R�GKO�PXf�U�pZ]g\KJ�U�J>I�PQG,Lge�RSJ�[(I�PN\KJ�\,ecT&UW]&I�b�Èþ!�(��� � /���O���Æ)J Ç ��� � T 4 T%� 4������Þ4 T%� ��� k���y Ê3Ì � ��Í>��ùJ>R�Y.kgU�V^\,eoe�GK[(I�\ V�OWa!O�R1[b�GKOqV�\&[|�IxMZ]1U�O�a!O�I�V�R�[�I�RSV�UKa!G,J1T~[(UWY^UWJ>I�G5I�PX\ J�a!GKOq]�GKV�GKYqfU(I�U�VOH\,e�e�R�J�[�I�PX\ J8äù[(\ J&e�\KRSJ1TnI�b�PNODV�U�LQG5I�PX\ J�O�b�PX]�h^��bSPQODJSUW[�UWO�O�PXI�G,I�UWO8I�bSUjT&U(r1JSPwI�PX\ J�\Ke]SV�\K]gU�VBÕÑ5¨1¥�¢�× ¥�Ð�PNJ;�obSPQ[bqI�\`G5I�I�U�Y;]&I�T&PQO�[(\5uKUWV�M`\Ke1]g\KV�\ O�PwIxM3e�\KV�Y.RSLQG,U h$þHU�\ LX\ _KPQ[�GKLZ[�\KJ&fI�U�pZI�OBGKV�UDU�pZ]�V�U�O�O�UWT�PXJ�I�U�V�YsOo\,ec_KUW\KLN\K_ PN[WG,L�]SbSUWJS\KY;U�J1GSa�O�R�[bnGKOo_ U�\ Y^U�I�V�MKaSLNPXI�bS\ LX\ _KMKa[(\ Y;]�GK[(I�PN\KJ�a0G,J�T�O�RSk�O�PQT&U�J�[�UKa0GKO�O�\&[�PNG,I�UWT}�oPXI�b~GnV�U�_ PX\ J�ht��IqPNO.��UWLXL�|>J�\5�oJ�I�b�G5I.I�bSU_KUW\KLN\K_ PN[WG,L�[(\ J I�U(pZIB[b�GKJS_KU�O�e�V�\ Yýk�G O�PNJyI�\jk1GKO�PXJ���TSPw��U�V�U�J>IB_ U�\K_ V�GK]SbSPQ[�GKL�GKV�U�GKO�PNJyI�bSU�d\KV�LNT��iG,J�TzGKLNO�\se�V�\KYäV�U�_KPN\KJyI�\tV�U�_KPN\KJn�oPXI�b�PXJ}Gsk�GKO�PNJ�Ä ÆSµ�Ëa�5Ç�hB��RSV�I�bSU�V�Y;\KV�UKa�I�bSU^RSJ&fT&UWV�LNMZPXJS_.e�UWG,I�RSV�UWO�\,e�[�\KJ>I�U�p>IO�YsGvM;u5G,V�M;_KV�UWG5I�LXM h0Ò&PXY;]SLNU8Y;\&T&UWLgYsG,I�[bSPNJS_3I�UW[bSJ�PN�>RSU�O�a�obSPQ[b��d\KV�|�PXJ�U�JS_ PXJSUWU�V�PXJ�_�T&\ Y;GKPXJ1O.�obSUWV�UykgU�b�GvuZPN\KV^PNO;[(\ J�O�I�VG,PNJSUWT�kZM�YsG,JSf�YsGKTSUO�MZO�I�UWYsOqGKJ�T��dU�LNLwf�UWO�I�GKkSLXPQO�bSUWT�LQGv�iO3\Kei]SbZMZO�PQ[�OWacY;GvM}JS\KI;GK]S]SLNM}PNJ�I�bSU�bZM&T&V�\&[�G,V�kg\KJU(p&]SLN\KVG5I�PX\ JzT&\KYsGKPXJ�hH��\yGKTSTSV�U�O�OiI�bSPQO�a�TSG,I�G�[(LNR�OxI�U�V�PXJ�_t��GKOiR1O�U�T�I�\�PNT&UWJ>I�PXe�M�I�bSU^V�UWLwfU�u5GKJ I3[�\KJ>I�U�p>IO�a�GKJ�TnI�bSU�J}UW�>R�G,I�PN\KJ�T&PQO�[�\5uKU�V�My�dG OH[WG,V�V�PNUWTz\KR&I`�oPXI�bSPNJ�U�GK[b}[(\KJ>I�U(pZIWh��bSU3_ \ GKL��dG O�I�\tTSU�V�PXu UDI�bSU.O�RSk�O�U(I�� � �F��k���� �� �F� W e�V�\KYäG;LNGKV�_ U�ViO�U(IB\Kec_KU�\ LX\ _KPQ[�GKL1e�U�G5fI�R�V�U�O�agG,J�TyI�bSU`e�RSJ�[(I�PN\KJ�GKL�V�U�LQG5I�PX\ J�O�b�PX]�ä¤I�b�G,IBkgUWO�I8T&U(r1JSUWTyI�bSU.]g\KV�\ O�PwIxMje�RSJ�[�I�PX\ JzPNJG^V�UW_KPN\KJ�h��bSU�\5uKU�VG,LNL�Y;U�I�bS\&T&\ LX\ _KM�PNLXLNR�O�I�VG5I�U�T~PNJ��$PN_�hcÌ ÆSa�[(\ J�O�PNO�I�O^\,e8Ix��\}]SV�PXYsGKV�M�O�I�U�]1O�È

��P��`��\KJ>I�U�pZIHT&U�r�JSPXI�PN\KJlR1O�PNJS_yRSJ�O�RS]1UWV�uZPQO�U�Tl[�LXR�O�I�UWV�PNJS_tI�UW[b�JSPN�>RSU�O�a�GKJ�T���PXP��HØ��>R�G5I�PX\ JT&PQO�[�\5uKUWV�M;kZMjV�U�_KV�UWO�O�PX\ JtG,J�GKLXM&O�PNODÄX�WÅ Å Æ3Ç�h�goU�G,L�U�pZ]�LX\ V�G,I�PN\KJ�T�G5I�G;[�\KLNLXU�[�I�U�Tje�V�\KYùGqV�U(f_KPN\KJtPXJtI�bSUD�iLQGKO�|5G3k�G O�PNJj��GKOdG,J�GKLXMZm�U�T;R�O�PXJS_.I�bSUHY;U(I�bS\&T&\KLN\K_ M;TSU�uKUWLX\ ]1U�T�hc��bSU8T�G5I�G\KkSîxUW[�IOB��]�G5I�I�U�V�J�O�cG,V�UiT&U�O�[�V�PNk1U�T;PXJjI�U�V�YsO!\Ke�ÌZÜ8_KUW\KLN\K_KPQ[�GKLZe�UWG,I�RSV�UWOWa>O�R�[bjG Oc]1\ V�\>O�PXIxMKa]gU�V�Y^U�G,kSPNLNPwIxM a,_KVG,PNJ^O�PNm�UKa T&U�J�O�PXIxMKaKGKJ�T;O�\ V�I�PXJS_1a,G,Y;\KR�J Ic\KegT&PX�gUWV�UWJ>I!Y^PNJSUWV�GKLZe�V�GK_KY;U�J>I�O��¢�·¸©>·NaS� R1G,V�I�mKa>[bSU�V�IWaKe�U�LQTSO�]�G,V��0]SV�UWO�U�J>IWa J�G5I�RSV�Ui\,e�I�b�UBV�\Z[|.e�V�GK_KY;U�J>IO�a ]1\ V�Ui[b�GKV�G [�I�U�V�fPQOxI�PN[WO�a�G,J1Tl[(UWY;U�J>I�G,I�PN\KJ�hD�iLNL$I�bSU�O�Uqe�UWG,I�RSV�U(f�u5G,LNRSUWO8G,V�U.JZRSY;U�V�PN[.Y;UWGKO�RSV�U�Y;U�J>IOiYsGKT&U\KJ�O�G,Y;]SLNUWO�\KkSI�G,PNJSU�Tte�V�\KYý��UWLXLXf�LN\K_>O�T&RSV�PXJS_;U�pZ]�LX\ V�G,I�\KV�MsT&V�PXLNLXPNJS_;]SV�\&[(UWO�O�UWOWh��bSUPL>f�Y;UWG,J1Oj[(LNR�O�I�U�V�PNJS_~G,LN_K\ V�PXI�bSY �dG OsR�O�UWT�I�\�PNT&UWJ>I�PXe�M�G�O�U(I�\,e`bS\KY;\ _KU�J�U�\KR1O

]SV�PXY;PXI�PNuKU`_ U�\KLN\K_ PN[WG,L�O�I�V�R�[�I�RSV�U�O3���Z���|� k ��� �� �|��WH��h���bSUWO�U`]SV�PXY;PXI�PNuKUWOi��UWV�UDI�bSU�JnYsG,]�]1U�T\KJ>I�\.I�bSU8R�JSPwIi[�\ZTSU8u U�VO�R�OdO�I�VG5I�PN_KVG,]�bSPN[BRSJSPXIoY;GK]�hc�$PX_ RSV�UDÌKêqT&U�]�PN[(I�OoGq]�G,V�I�PQG,LgYsG,]&f]SPNJS_3e�\ VdGqO�U�I�\Ke���UWLXLQO�GKJ�T;e�\ RSV�]�V�PNY;PwI�PXu U8O�I�V�R�[�I�RSV�U�O�h0��bSU8JSU(pZIoOxI�U�]jPNJsI�b�UHT&PQO�[(\5uKUWV�M]SV�\&[(UWO�O!PQT&UWJ I�Pwr1UWTyO�U�[�I�PN\KJ1O�\Ke���UWLXLQO�V�U�_ PX\ J�O�I�b�G,I��dU�V�UBYsGKT&UHRS]�\,e�I�b�UHO�G,Y;U8O�UW�>RSUWJ�[(U\,ec_ U�\KLN\K_ PN[WG,L�]SV�PXY;PXI�PNuKU�O�h�Ø!u U�V�MtO�R1[bzO�U�� R�U�J�[�U3T&U(r�J�UWTnGj[�\KJ>I�U�p>I�� ! hd��V�\ YýI�bSU3]�GKV�fI�PQG,L8YsG,]S]SPNJS_~\Ke3�{PN_KR�V�UlÌ êSadI�b�Ul[(\ J I�U(pZI6� � ����k!��� � �!��kH�!��÷n��GKOsPQT&U�J>I�Pwr�U�T�PNJIx�d\z��UWLXL�V�UW_KPN\KJ�Ot��I�b�U�Ì��N�nG,J�T�êN���nO�U�V�PXU�O��(hn�oe�I�UWV.I�bSU�[�\KJ>I�U�pZI�O`�dU�V�UtT&U�r�JSUWT�a0T�G5I�G]g\KPNJ IO^k1UWLX\ JS_KPNJS_�I�\}UWGK[b�[(\ J I�U(pZI;��UWV�Uy_KV�\KRS]gUWT�I�\K_ U(I�bSU�V^e�\KV;U�� R1G5I�PN\KJ�T&U�V�PXu5G,I�PN\KJ�h

Page 58: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ì�] � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

yPÞ��0£�¤6«3©S®��5©���®~×�«�ªu©Eª.¤5«ÞT�eÞ r*jefPs:w:p~h=i ÈBË�Í.Ç�Í.ÊDÍKåS»&½�Ê%Ë�É*Ü�Ê%É;Ë »�½ y;�%�R c� )  P¡�¡�¡� ��u¢_�czX��s=bed*fPgPh=iGjek*l*{ÞT� Ô r*h�v3k*h Ü�¹TÎ3Ê�»�£~Ê jekúgGh=iG|_f�wEx�gGm;h�iPh:beh�pEtEkXg�fGh=�qd;h:k;s:h=fVwEx&o*iPje|_j gGj p~hVf gGiPd*s�gGd;iGh=f�{�jD� h~�e{ ¤�¥q¦�§¥ �©¨ �§¥ ) ¨  o¡�¡�¡�  ¨ � ¥&ª {ÞT� ¾ lTiGwTd;o�r3tSgGt_tEs=s:wTiPr*jek*l�gPw�gPm*h?s=wTkXgPh��qg�r*h�v3k*j gPjewTk�gGw&x%wTiP| ì;¹TÇL¹GÓX»:ÎB»�¹TÉ;½�ºXæTÊ�æ�Ó~Ë ¹TÉSÈB½ {ÞT� Ä xKwTi�h:tEs�m�iGh=beh�pTtEk~gnr3tSgGt�lTiPwTd*o6{5r*h�gGh=iP|_jek*h�gPm*h&fGh�g}wEx ËP»:¼ »:åEæTÎ3Ê�åSæTË�Í%æ�«:¼ »�½ y&¬��§ g¬ )  P¡�¡�¡� �¬ ª ��xKwTi

oBwTiGwTfPj g��X�yDÔ~�S­/®[¨6À*©Eª.¤5«z��®qÁTªuÒ;À*©Eª.¤5«Ô;�eÞ fGh=beh=s�g�o,wTfPfGjez*beh «Pæ~½�»�ÇL¹:º~»�¼ ½ y%h=�Xd3tSgGjewTk;f���d;fGjek*lLr;wT|�tEjek�gPm*h=wTiP�~{Ô;� Ô d*fPh}gGm*h ¼ »�æT½�ÊM½�Ý:É*æTË »�½ |_h�gPm*wqr�gGw�lTh:k;h:iGtSgGh?s=wXh=�Ls:jeh=k~g�pEtEbed*h=f�xKwTi�h�tEsGm�z3tEfPh�|_wXr*h=bD{Ô;� ¾ d*fPh�gGm;h Ü�¹TÇ�Èq¹~ÎB»:Î3ÊBÈ,¼ É;½MË »�½GÍ%ºTÉ*æT¼TÈB¼ ¹TÊ y Ü È,Ë�È �[m*h=d*iPjefPgPjes�gGw�r;�;k*tE|_jes�tEbeb �}|_wqr*j x.��gPm*hMh=�Xd3tSgGjewTk

|_wXr*h=b5gPwLzBh=g gPh:i�v*g�gGm;hnr3tSg�t;{

ä(jel*�3¾T¡;�K��®q³:ÃXÁEªK¦6©Eª.¤5«R¤BÐM©E°6®!¯�«6¤(°�²u®;±[¬B®�±�²[ÀB³=®q±IÑ[ÃXª.®;«B©Eªu×ZÃ:��ª.³�ÃT¤*ÒB®qÁR³0¿nÁS¤6ÃT®;³:³�´

Area Code

Stra

tigra

phic

Uni

t

100 200 300 400 500 600 700

3190

3180

3170

2000

3160

3150

3140

3130

3120

3110

3100

3000

ä(jel*�3¾TÕ;�þÖ�ÁS®qÀ�£&¤6±[®�ÒB®;ÁE³�¨[³_Ñ5©SÁSÀ*©Eª.¬,ÁSÀB¦(°�ªKÃ�µ «�ªu©_­¯ÀB¦RÐ�¤,Á_¿�ÀBÁ�©�¤,Ð�©E°6®�Ñ5©T¨[±(ªu®;±úÂ_®q¬5ª.¤5«

��bSU3T&UWV�PNu5G5I�PX\ J�]SV�\&[(U�T&RSV�U8UWY^]�LX\5M UWT�Y.RSLXI�PN]SLNU`V�UW_KV�UWO�O�PN\KJtGKJ�G,LNM&O�PQO`ÄX�Wê>ÜvÇ�h��bSPNOyY;U(I�bS\&T¿��GKOyG,]S]�LXPNUWT¿I�\�G�TSG,I�G�O�U(I�\,e^G,kg\KR&IzË,êN����\KkSîxUW[�IO�[(\KV�V�UWO�]1\ J�T&PNJS_

I�\nO�G,Y;]SLNU;Y^U�GKO�RSV�U�Y;U�J>I�OD[�\KLNLXU�[�I�U�Tze�V�\KYé��UWLXLQOHPNOHI�bSUj�iLQGKO�|5G,J8\dG O�PNJ�h;��bSU�L>f�Y^U�G,J�O[(LNR�O�I�UWV�U�T3I�bSPNO�TSG5IGHO�U(I!PNJ>I�\3O�U�u U�J^_KV�\KRS]�OWh��8O!G,J;PNLXLNR�O�I�VG5I�PN\KJ�a,��UoO�U�LNUW[(I�UWT;GDO�U(I!\,e$�WÌ ë\KkSîxUW[�IOiV�U�]SV�UWO�U�J>I�PXJS_sGj[�\KJ>I�U�pZIie�\KVBe�RSV�I�bSU�VHG,J�GKLXM&O�PNOWh���bSU3e�U�G5I�R�V�U�O�I�b�G,I8kgUWO�IHT&U�r�JSU�TI�b�PNOo[�LXR�O�I�UWV��dU�V�UDO�UWLXU�[�I�U�T�a&G,J�TtU(p&]gU�V�I�O�O�R�V�Y;PQO�U�TsI�b1G5IdI�bSU`[(\ J>I�U(pZI�V�UW]SV�UWO�U�J>I�U�TjG.LN\5�]g\KV�\ O�PwIxMsV�U�_ PX\ J�a&�obSPQ[b���GKO�Y;\&T&U�LNUWTyR�O�PNJS_^I�bSU`V�U�_ V�U�O�O�PX\ Jj]SV�\&[(UWTSRSV�U h

Page 59: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ì�fëZ#_7c>�/ú/�"iA�i��bSUWV�UoG,V�U�O�UWuKU�VG,L&GK]S]SLNPN[WG5I�PN\KJ1O0�obSU�V�UoT&UW[�PNO�PX\ JqYsGK|>PNJS_DG,J�T^U�pZ]�LX\ V�G,I�\KV�MD]�G5I�I�UWV�J;G,J�GKLwfM&O�PQOib1GvuKUDI�\tk1Uq]1UWV�e�\ V�Y;UWTy\ JnLNGKV�_ U3TSG5IGjO�U�I�OWhi�S\ ViU(pSG,Y;]SLNUKagPNJzT&\&[(RSY;U�J>IHV�U�I�V�PXUWuvGKL�aGtO�U(ID\,e!V�U�LNU�u5GKJ IDT&\&[(RSY;UWJ IOHb�GKOBI�\�k1Uqe�\KRSJ1TlG,Y;\ JS_tO�U�uKUWV�GKL�Y;PNLXLNPX\ J�O8\,e�T&\&[�RSY;U�J>I�O\,e�TSPXY;U�J1O�PN\KJ�GKLXPXIxMyY^\ V�U3I�b�GKJ~��N���Sh���IDPNOB]1\>O�O�PNkSLXU.I�\�b�G,J�TSLXU`I�bSUWO�U.]�V�\ kSLXUWYsOiPXe�O�\ Y^UR�O�U(e�RSLoGKk�OxI�V�G [�I�PX\ J�\,eiI�bSUyT�G5I�GlPNO^\ k&I�GKPXJSU�T~G,J1T~PQO.R�O�UWT�PXJ�T&UW[�PNO�PN\KJ~YsG,|ZPNJS_lVG5I�bSU�VI�b1G,J�TSPXV�UW[(I�LNMsR�O�PNJS_qI�bSUDUWJ I�PXV�U8T�G5I�G^O�U(IWh�\dMz£K ,¥� � K¡(Ð�¥�¦�  Õ(¥�§�Ñ5¨1a&��UHY;UWGKJ�G^O�PNY;]SLXUDG,J1T[(\ Y;]�GK[(IBV�UW]SV�UWO�U�J>I�G,I�PN\KJn\,e0I�bSU^T�G5I�G�hB��bSPQO8O�PNY^]�LXPQ[(PXIxM�bSU�LN]�OBI�bSUqY;G [bSPNJSU.PNJzU(áj[�PXUWJ I]SV�\&[(UWO�O�PXJS_�\KV`GybZRSYsG,J}PXJ�[(\ Y^]�V�UWbSU�J�TSPXJS_�I�b�U;O�I�V�R�[(I�RSV�U;PXJ�TSG5IGtU�GKO�PXLNMKhj��LNR�OxI�U�V�PXJ�_G,LN_K\ V�PXI�b�Y;O�GKV�UDPQT&UWGKLXLNMtO�RSPwI�UWT�e�\KViG [bSPNU�uZPXJ�_^TSG,I�G;G,k1OxI�V�G [�I�PN\KJ�h��JlI�bSPNOD]1G,]gU�V�a���U^b�Gvu UqU�p&GKY;PXJSU�Tzu5G,V�PN\KR�ODO�I�U�]1ODPXJ�[(LNR�O�I�U�V�PNJS_�È^�x���8]�G,I�I�U�V�J�V�U�]SV�U(f

O�U�J>I�G,I�PN\KJ�aB��ËK�^O�PXY;PNLNGKV�PXIxM~[(\ Y^]�R&I�G,I�PN\KJ�aH��Ì �q_ V�\ RS]SPNJS_l]SV�\&[(U�O�OWa�G,J1Tæ��ÍZ�^[(LNR�OxI�U�VsV�U�]&fV�UWO�U�J>I�G,I�PN\KJ�hæ�BLNO�\���Unb1GvuKUnT&PQO�[�R�O�O�UWT�O�I�G,I�PQOxI�PN[WG,L�a�e�R�m�m�M a�JSU�RSVG,L�adU�uK\ LXRSI�PN\KJ�GKV�M a�G,J1T|ZJS\5�oLNUWT&_ U(f�k�GKO�UWTyG,]S]�V�\>GK[bSU�O�I�\t[(LNR�O�I�UWV�PNJS_�h�½�Uqb�GvuKU`T&U�O�[�V�PNkgUWTye�\KR�VBG,]S]�LXPQ[�G,I�PN\KJ�Oo\Ke[(LNR�O�I�UWV�PNJS_�Èo�����dPNY;GK_KU`O�U�_KY;UWJ IG5I�PX\ J�a���Ë ��\ k&îxUW[(IiV�U�[(\ _KJSPXI�PN\KJ�a���Ì ��T&\&[(R�Y^UWJ>IiV�U�I�V�PXUWuvGKL�aG,J1T���Í>��TSG,I�G^Y;PXJSPNJS_1h��LXR�O�I�UWV�PNJS_sPQOBGs]�V�\&[(U�O�Oi\,ec_KV�\KRS]�PXJS_sTSG,I�GsPXI�UWYsOik�G O�U�T�\ JzGsY;UWG O�RSV�U`\,e!O�PXY;PNLNGKV�PXIxMKh

��LNR�OxI�U�V�PXJ�_`PNO�G3O�R�k&îxUW[(I�PNuKUo]SV�\&[(UWO�OWµ,I�b�U8O�G,Y;UiO�U�I�\,e�TSG,I�GDPXI�UWY;O�\,e�I�U�JsJSUWUWTSO!I�\3kgUi]�GKV�fI�PXI�PN\KJ�UWT^T&Pw��U�V�U�J>I�LXM`e�\ VcT&Pw��U�V�U�J>I!G,]�]SLXPQ[�G,I�PN\KJ�OWh{��b�PNOcO�RSk&îxU�[�I�PNuZPwIxM`YsGK|KUWO{I�bSU�]SV�\&[�UWO�O{\Ke[(LNR�O�I�UWV�PNJS_;b�G,VT�h���b�PNOoPQOokgUW[WG,R�O�U3GsO�PNJS_ LXU`G,LN_K\ V�PXI�b�Yà\KViGK]S]SV�\ GK[byPQOoJS\,IBG T&UW�>R�G,I�UHI�\O�\KLNuKUHU�uKUWV�Mj[�LXR1OxI�U�V�PXJS_;]SV�\Kk�LXUWYyhc�É]g\ O�O�PNkSLNU`O�\ LXR&I�PX\ J�LNPNUWO�PNJyV�U(Ý1UW[�I�PXJ�_qI�bSPQOoO�RSkSîxUW[�I�PXu>fPXIxMjPXJyI�bSUHe�\KV�Yà\,e$|>J�\5�oLXU�T&_KU h0��b�PNO�|ZJS\5�oLNUWT&_ U8PQO�R�O�UWT�U�PXI�bSUWVoPXY;]SLNPQ[(PXI�LNMt\KVoU�p&]SLXPQ[(PXI�LNMPNJ�\KJ�U�\ VqY;\KV�Ut]�b�GKO�UWO^\,eH[(LNR�OxI�U�V�PXJ�_�hGîDJS\5�oLNUWT&_ U(f�k�GKO�UWT�[�LXR�O�I�UWV�PNJS_}G,LN_K\KV�PXI�bSYsOqR�O�UT&\ Y;GKPXJy|ZJS\5�oLNUWT&_ U8U�pZ]�LXPQ[(PXI�LNMKh��bSUBY;\ O�I�[b�GKLXLNU�J�_KPNJS_3OxI�U�]jPNJt[�LXR�O�I�UWV�PNJS_`PQO!e�U�G5I�RSV�UBU(pZI�VGK[(I�PN\KJ;\KV�]�G5I�I�U�V�JsV�U�]SV�UWO�U�J&f

I�G,I�PN\KJ�hzÞcG,I�I�U�V�J}V�UW[�\K_ JSPwI�PX\ J�V�U�O�U�G,V[bSU�VOD[(\KJZu U�JSPNU�J>I�LNM�Gvu \KPQT�I�bSPQO.O�I�UW]~kZM}G O�O�RSY;PXJ�_I�b1G5I�I�bSU`]1G5I�I�U�V�J�V�U�]�V�U�O�UWJ IG5I�PX\ J�O�GKV�UDGvu5G,PNLNGKkSLNUHG O�PNJS]SRSIoI�\^I�bSU3[�LXR1OxI�U�V�PXJS_;G,LN_K\ V�PXI�b�Yyh��JzO�Y;GKLXL{O�PNm�U3TSG,I�G;O�U(I�OWa�]1G5I�I�U�V�J�V�UW]SV�U�O�UWJ>I�G5I�PX\ J�O�[�GKJykgU3\ k&I�GKPXJSU�Tyk�GKO�UWTy\KJ�]SV�U�uZPN\KR�OU(p&]gU�V�PXUWJ�[(UH\,e�I�bSUDR�O�U�Vd�oPwI�btI�bSUH]SV�\ kSLNU�Y�hc�i\5�dU�uKUWVWa>PNJjI�b�UD[WGKO�UB\Ke{LQG,V�_KUBTSG,I�G^O�U�I�OWaZPwIPQO�T&PXáj[(RSLXI�e�\ VcI�bSU8R�O�U�VcI�\3|KUWU�];I�VGK[|.\,e�I�bSU8PXY;]g\KV�I�GKJ�[(Uo\Ke�U�GK[b^e�UWG,I�RSV�UiPNJt[(LNR�O�I�UWV�PNJS_�h�ðO�\ LXR&I�PX\ JzPQOiI�\tYsG,| UqGKOBYsG,JZM�Y^U�GKO�RSV�U�Y;U�J>I�OB\KJnI�bSU^]�G5I�I�U�V�J�OHGKO8]1\>O�O�PNkSLXU^G,J�TzR�O�UI�b�U�Y PNJ�]1G5I�I�U�V�J�V�U�]�V�U�O�UWJ IG5I�PX\ J�hA\dR&I`PwI`PQO8J�\,I`]1\>O�O�PNkSLXUqI�\�R�O�U;G�LQG,V�_KU^[(\ LXLNUW[(I�PN\KJl\KeY;UWG O�RSV�U�Y;UWJ IO;T&PXV�UW[(I�LNM�PXJ�[(LNR�O�I�UWV�PNJS_}k1U�[�G,R1O�Uy\,eD[(\KY;]SRSI�G5I�PX\ J�G,Lo[�\ O�I�OWh�ÒZ\�adO�UWuKUWV�GKLe�UWG,I�RSV�UiO�U�LNUW[�I�PX\ JgÊvU�pZI�VGK[�I�PX\ J^GK]S]SV�\ G [bSUWO$b�Gvu UdkgU�UWJjT&UWO�PN_KJSU�T.I�\`\Kk&IG,PNJ;LXPNJSUWGKV!\KVcJ�\KJ&fLNPXJSU�G,Vc[(\ Y.kSPNJ�G,I�PN\KJ�O{\,eSI�bSUWO�UdY^U�GKO�RSV�U�Y;U�J>I�O$�obSPQ[bq[WG,Jqk1U�R�O�UWT3I�\HV�UW]SV�U�O�UWJ>I{]�G,I�I�UWV�J1O�h9n\>OxI0\,e1I�bSUoO�[bSU�Y;UWO$]SV�\K]g\ O�UWT3e�\KV$e�UWG,I�RSV�UdU(pZI�VGK[(I�PN\KJgÊ,O�UWLXU�[�I�PN\KJqG,V�U�IxMZ]SPQ[�GKLXLNM`PwI�U�VG5I�PXu UPNJzJ�G5I�RSV�U.G,J�Tn[WG,JSJ�\,IBkgU.R�O�UWT�\ JnLNGKV�_ U3TSG5IGjO�U(I�O8T&RSU.I�\j]SV�\Kb�PXkSPXI�PNuKUq[(\KY;]SRSI�G5I�PX\ J�G,L[(\>OxIO�h��bSU�O�UW[�\KJ�T~O�I�UW]~PNJ�[(LNR�O�I�U�V�PNJS_lPQOqO�PNY^PNLQG,V�PwIxM�[(\ Y^]�R&I�G,I�PN\KJ�h}�àu5G,V�PXU�IxM�\,eBO�[bSU�Y;UWO

b�Gvu U3k1UWU�J�R�O�U�T�I�\y[(\ Y^]�R&I�U^O�PNY;PXLQG,V�PwIxM�kgU(Ix�dU�UWJnIx��\�]�G5I�I�UWV�J�OWh8��b�U�M�R�O�U.|ZJS\5�oLNUWT&_ UU�PXI�b�U�V`PNY^]�LXPQ[(PXI�LNMl\ V`U(p&]SLNPN[�PwI�LXM h�9z\ O�ID\Ke�I�bSU;|ZJS\5�oLXU�T&_KU�f�k1GKO�UWTl[�LXR1OxI�U�V�PXJS_�G,LN_K\ V�PXI�b�Y;OR�O�UBU�pZ]�LXPQ[(PXId|ZJS\5�oLNUWTS_KUiPNJtO�PXY;PNLNGKV�PXIxMs[(\KY;]SRSI�G5I�PX\ J�h0�i\5�dU�uKUWVWa Pwe{]�G5I�I�U�V�J�OdG,V�UiJS\KIdV�U�]&fV�UWO�U�J>I�U�TsR�O�PXJS_q]SV�\K]gU�V�e�UWG5I�RSV�UWOWa I�bSU�J�PwI�PQO�JS\KId]g\ O�O�PXkSLNUiI�\q_ U(I�G.Y;UWGKJSPNJS_,e�RSLg]�GKV�I�PwI�PX\ JPNV�V�UWO�]1U�[�I�PXu U.\,e�I�bSUs�>R�GKLXPXIxMzG,J�T��>R�G,J>I�PXIxMz\Ke�|ZJS\5�oLXU�T&_KUqR�O�UWT�PXJ�O�PNY;PXLQG,V�PXIxM�[�\KY;]SR&IG5fI�PN\KJ�h3��bSU�V�U.PQOHJS\tRSJ�PXu U�VO�GKLXLNMnGK[�[�U�]&IG,kSLNUqO�[bSUWY^U.e�\KVD[(\ Y^]�R&I�PNJS_�O�PNY;PXLQG,V�PwIxM�kgU(Ix�dU�UWJ]�G,I�I�UWV�J1O�V�U�]SV�UWO�U�J>I�UWTsR�O�PNJS_^G.Y;PwpZI�R�V�UH\,e�kg\,I�b��>R�GKLXPXI�G,I�PNuKU8GKJ�Tt�>R�GKJ>I�PXI�G5I�PXu Uie�U�G5I�R�V�U�O�h

Page 60: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ü�� � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

F8PNO�O�PNY;PXLQG,V�PXIxM}kgU(Ix�dU�UWJ�Gz]1G,PNVq\Kei]�G5I�I�U�V�J�OqPNOqV�U�]SV�UWO�U�J>I�U�T�R�O�PXJ�_�GlTSPNO�I�GKJ�[(U�Y^U�GKO�RSV�UI�b1G5IiYsGvMj\KV�YsGvMjJS\KIik1U3G^Y;U(I�V�PQ[,h��bSUiJSU�p>I�OxI�U�]sPNJt[(LNR�O�I�UWV�PNJS_3PQOcI�bSUB_ V�\ RS]SPNJS_3OxI�U�]�h0��bSUWV�UBGKV�UBkSV�\>GKT&LNM3Ix�d\`_KV�\KR�]SPXJ�_

O�[bSU�Y;UWOWÈdbSPXUWV�GKV�[b�PN[WG,L�G,J1T�]�G,V�I�PXI�PN\KJ�GKL{O�[bSU�Y;U�O�ho��bSU3b�PXUWV�GKV�[bSPQ[�GKL�O�[bSU�Y;UWOBG,V�U3Y;\KV�UuKUWV�O�G5I�PXLNUoG,J�T^I�bSUB]1G,V�I�PXI�PN\KJ�GKL�O�[b�U�Y;UWO!GKV�UoLNUWO�OcU�pZ]gU�J1O�PNuKU h$��bSUB]�G,V�I�PXI�PN\KJ�GKL�G,LN_K\ V�PXI�b�Y;OG,PNY»G5I�YsG5p&PNY;PXmWPXJS_DI�bSUBO��>R�G,V�UWT^U�V�V�\KV![(V�PXI�U�V�PN\KJ^e�RSJ�[(I�PN\KJ�h�9n\KI�PNuvG,I�U�T;k>MqI�b�Uoe�G,PNLXR�V�Ui\KeI�b�U^O��>R�G,V�UWT�UWV�V�\KVi]1G,V�I�PXI�PN\KJ�GKL{[(LNR�O�I�UWV�PNJS_�GKLX_ \KV�PwI�bSYsOiPNJnr�J�TSPXJS_�I�b�U.\K]SI�PNY;GKL$O�\KLNR&I�PX\ JI�\�I�b�PNOD]SV�\Kk�LXUWYya�G�LQG,V�_KUq[�\KLNLXU�[�I�PX\ Jl\,edG,]S]SV�\ G [bSUWOBb�GvuKUqk1UWU�J}]SV�\K]g\ O�UWTzGKJ�TlR1O�U�TnI�\\KkSI�G,PNJ�I�bSU�_KLN\Kk�GKL�\K]SI�PNY;GKLoO�\ LXR&I�PX\ J�I�\lI�bSPQO;]SV�\KkSLNU�Y�h��i\5�dU�u U�V�a{I�bSUWO�U�O�[bSUWY;UWO^G,V�U[(\ Y;]SR&I�G,I�PN\KJ�GKLXLNMj]SV�\Kb�PXkSPXI�PNuKUH\KJ�LQG,V�_KUDTSG5IG;O�U�I�OWh0�8úBúÉk�G O�U�T�[�LXR1OxI�U�V�PXJS_sO�[bSU�Y;U�OoG,V�UJSUWRSV�GKL{PNY;]SLNU�Y;U�J>I�G,I�PN\KJ�O8\,ecI�bSUq[�LXR1OxI�U�V�PXJS_yG,LN_K\ V�PXI�bSYsO8G,J�T�I�bSU�MnO�b�G,V�U3I�bSU.R�J�T&UWO�PNV�U�T]SV�\K]gU�V�I�PNUWO�\,eZI�bSU�O�UdG,LN_K\ V�PXI�bSYsOWh��i\5�dU�u U�V�aW�8úBúBO$b�Gvu U0I�bSUd[�GK]�G,kSPNLNPwIxM8I�\HG,R&I�\KYsG5I�PN[WG,LNLXMJS\ V�YsG,LNPNm�UdI�bSU8TSG5IG`G,J�T^U(pZI�V�G [�Ice�UWG,I�RSV�UWOWh0�iJsPNY^]g\KV�I�GKJ>I!\Kk�O�U�V�u5G5I�PN\KJ^PQOcI�b1G5I!U�u U�J;PXe�GO�[bSU�Y;U3[�GKJyr�J�TyI�b�U3\K]&I�PXYsGKL�O�\ LXRSI�PN\KJyI�\sI�bSU.O��>R�G,V�UWT�U�V�V�\ V�]�G,V�I�PXI�PN\KJSPNJS_s]SV�\Kk�LXUWYya�PwIYsGvM^O�I�PNLNL1e�GKLXL�O�bS\KV�I�\,e�I�bSUHV�U�� R�PXV�U�Y;U�J>IO!kgUW[�GKR�O�UB\,e�I�bSUB]g\ O�O�PXkSLNUBJ�\KJ&f�PNO�\,I�V�\ ]SPQ[�J�G5I�RSV�U\,e$I�b�U3[(LNR�OxI�U�VO�h��JjO�\ Y^UiGK]S]SLNPN[WG5I�PX\ J�O�a,e�\KV!U�p&GKY;]SLXUBPXJsT&\&[(R�Y^UWJ>I�V�U�I�V�PXUWu5G,L�aKPXI�YsGvM.kgUiR�O�U(e�RSL�I�\`b�Gvu U

Gz[�LXR�O�I�UWV�PNJS_nI�b�G5I^PNO.JS\,I^Gz]�GKV�I�PwI�PX\ J�hz��bSPQO3Y;UWGKJ�O.[�LXR�O�I�UWV�OqG,V�Uj\5uKUWV�LQG,]�]SPXJ�_�h��SRSmWm�M[(LNR�O�I�UWV�PNJS_tGKJ�Tye�RSJ�[(I�PN\KJ�GKL{[(LNR�O�I�UWV�PNJS_tGKV�U`PQT&UWGKLXLNM�O�RSPXI�U�Tye�\KVBI�bSPQOB]�RSV�]g\ O�UKho�BLNO�\se�RSmWm�M[(LNR�O�I�UWV�PNJS_�G,LN_K\ V�PXI�bSYsOs[WG,J�b�G,J�TSLXUnY;PXpZU�T�TSG5IG}IxM>]gUWOWhæ�B\5��UWuKU�V�a�G�YsG5îx\ V;]SV�\ kSLNU�Y�oPXI�b�e�RSmWm�M�[�LXR1OxI�U�V�PXJS_�PQO;I�b�G5IjPXItPQOjT&PXás[�RSLXIjI�\�\ k&I�GKPXJ�I�b�UnY^UWY.kgU�VO�b�PX]�u5G,LNRSUWOWh¹�_KUWJSU�VG,L0G,]�]SV�\>GK[bnYsGvM�JS\,ID�d\KV�|ykgUW[WG,R�O�U.\Ke!I�b�U;O�RSk&îxU�[�I�PXu U.J�G,I�RSV�Uq\Ke�[(LNR�O�I�UWV�PNJS_�h`��IPQO.V�UW�>RSPNV�U�T}I�\�V�UW]SV�U�O�UWJ>I.[(LNR�OxI�U�VO3\ k&I�GKPXJSU�T�PNJ�GlO�RSPXI�G,k�LXUte�\KV�YéI�\lbSUWLX]�I�bSU�TSUW[(PQO�PX\ JYsG,| U�V�h»îDJS\5�oLNUWT&_ U(f�k�GKO�UWTq[(LNR�O�I�U�V�PNJS_`O�[bSUWY;UWO0_KUWJSU�VG5I�U�PXJ>I�R�PwI�PXu U�LNMqG,]�]1U�G,LNPXJS_3TSUWO�[(V�PX]&fI�PN\KJ1OB\Ke�[(LNR�O�I�U�VOWh8��bSUWM�[WG,JzkgU^R�O�U�TnU�u U�Jz�ob�U�JzI�bSU^]�G5I�I�U�V�J�OHG,V�U3V�U�]SV�UWO�U�J>I�U�T�R�O�PXJS_G^[(\KYqkSPNJ�G5I�PX\ Jj\,e{�>R�GKLXPXI�G,I�PNuKUDG,J�T��>R�G,J>I�PXI�G,I�PNuKUBe�UWG5I�RSV�UWOWa>]�V�\5uZPQT&UWTs|ZJS\5�oLNUWTS_KUBLNPNJS|ZPXJS_Gl[�\KJ�[�U�]&I;G,J�T�I�bSUyY;Pwp&UWT�e�UWG5I�RSV�UWOqPNO^Gvu5G,PNLNGKkSLXU h��B\5��UWuKU�V�a$PXY;]SLNU�Y;U�J>IG5I�PN\KJ1O.\KeoI�bSU[(\ J�[(UW]&I�R1G,L{[�LXR1OxI�U�V�PXJS_�O�[bSUWY;UWOHG,V�U3[(\KY;]SRSI�G5I�PX\ J�G,LNLNM�U�pZ]gU�J1O�PNuKU^G,J�TnGKV�U3J�\,IHO�RSPXI�GKkSLXUe�\KVo_ V�\ RS]SPNJS_^LNGKV�_ UHTSG,I�GsO�U(IO�h��bSU�L>f�Y;UWG,J1O�G,LN_K\ V�PXI�bSY÷G,J�TDPXI�O�JSU�R�V�GKL,PXY;]SLNU�Y;UWJ IG5I�PX\ J�a�I�bSUUîD\ bS\KJ�U�JDJSU(I�a5G,V�UcY^\>OxI

O�R�[�[�UWO�Oxe�RSLNLNMnR�O�U�Tz\ JlLQG,V�_KUqT�G5I�GyO�U(I�OWh.��bSPQOHPNOHkgUW[WG,R�O�U�LZf�Y;UWGKJ�OHG,LN_K\KV�PXI�bSY PQODO�PNY;]SLXUI�\qPXY;]SLNU�Y;UWJ IoG,J1Tj[(\ Y^]�R&I�G,I�PN\KJ�GKLXLNM^G,I�I�V�G [�I�PNuKUBk1U�[�G,R1O�U8\,e�PXI�O�LXPNJSUWGKV�I�PXY;UH[(\KY;]SLNU(p&PXIxMKh�i\5�dU�u U�V�aKPXI�PQO�J�\,Ide�UWGKO�PNkSLXUiI�\^R�O�U8U�u U�J;I�b�PNOdLNPXJSU�G,V�I�PNY^UDG,LN_K\ V�PXI�b�Y¤\ JjLNGKV�_ UiTSG5IG.O�U(IO�h��J�[�V�UWY^UWJ>I�G,L>G,LN_K\ V�PXI�bSYsO�LNPX| U!LNUWGKTSU�V{GKJ�TDPXI�O�J�U�RSVG,L PXY;]SLNU�Y;U�J>IG5I�PN\KJ�aWI�bSU���g$��J�U(Ix�d\KV�|ga[�GKJqkgUiR�O�UWT.I�\3[�LXR1OxI�U�VcLQG,V�_KUoTSG5IGDO�U�I�OWh \dR&IcI�bSU�M.I�U�J1T.I�\`k1Uo\ V�TSU�V�f�T&UW]1UWJ�T&UWJ I�h$ß.§�´W§�£ ¢ 5¨�£zÕÑ5¨.�(Ô�¢�¦iPQO`GtbSUWRSV�PNO�I�PQ[3I�b�G5I`b�G OHk1UWU�J}V�PN_Kb>I�LNM�U(p&]SLN\KPXI�U�TlkZMz[(\ Y;]SR&I�UWV`G,LN_K\KV�PXI�bSYT&U�O�PN_KJSUWV�O�I�\;V�UWT&R1[(UD[(\KY;]SRSI�G5I�PX\ J�G,L�[�\ O�I�OWh0�B\5��UWuKUWVWa>PwIiO�bS\KR�LNT�k1UdîxR�TSPN[�PX\ R�O�LNMjR�O�UWT�PNJ[(LNR�O�I�UWV�PNJS_^I�\sGK[b�PXUWuKUDY;UWG,J�PXJS_Ke�RSL�V�UWO�RSLwIO�h��JzO�RSY;YsG,V�MKag[(LNR�O�I�U�V�PNJS_sPNOBG,JnPNJ I�U�V�UWO�I�PNJS_�a1R�O�U(e�RSL$G,J�Tn[b�GKLXLNU�J�_KPNJS_;]SV�\ kSLNU�Y�h���I8b�GKO

_KV�UWG,Ij]1\KI�UWJ I�PNGKLBPNJ¿G,]S]�LXPQ[�G,I�PN\KJ�OtLXPN|KUn\ k&îxUW[(ItV�U�[(\ _KJSPXI�PN\KJ�a�PNYsG,_KUzO�U�_ Y;U�J>I�G,I�PN\KJ�aoG,J1TPNJ&e�\KV�YsG5I�PN\KJyr�LXI�UWV�PNJS_jGKJ�T�V�U�I�V�PXUWu5G,L�h��i\5�dU�u U�V�a&PwIBPQOi]g\ O�O�PXkSLNUDI�\tU(p&]SLN\KPXIoI�bSPQOi]g\,I�U�J>I�PQG,L\KJ�LXMtG,e�I�UWVoY;GK|ZPXJS_sO�U�u U�VG,L�T&UWO�PN_KJ�[bS\KPQ[(U�Oo[�G,V�U(e�R�LXLNMKh

"?15Ã,-;U`í ] <qH54,<,Á <B-;9=C��bSUlGKR&I�b�\KVOs�oPNO�b�I�\�GK[|ZJS\5�oLNUWT&_ U�I�bSUz_ U�JSUWV�\>O�PXIxM~\,e3O�U�u U�VG,LB[�\KLNLXU�G,_KR�UWO;�obS\~V�UWG TYsG,JZR�O�[(V�PX]SI�T&V�G,e�I�OWaKYsGKTSUiO�RS_ _KU�OxI�PX\ J�O�a G,J�T;]SV�\5uZPNTSUWT^O�RSY;YsG,V�PNUWOc\KegUWY^UWV�_ PXJ�_3G,]S]SLNPQ[�G5fI�PN\KJ�G,V�UWGKO!�obSPN[bt��Uib1GvuKUiPNJ�[(\ V�]g\KVG5I�UWT;PNJ>I�\`I�bSPNO�]�GK]1UWVWh!þDG,RSI�G,Y \dPQO���GKO!GKJ�T���UWJ0}�P

Page 61: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ª '(6�'8«�= 2(¬�6�­W4Q)#*(®>¯���°S­�±�) ­�² � ü��\,egï!G,J�TSU�V�kSPXLXIUÃiJ�PXu U�VO�PXIxM`]SV�\5u>PQT&U�T`I�b�UoY;G,I�UWV�PQG,LZ\KJ;|ZJS\5�oLNUWT&_ UdTSPNO�[(\5u U�V�MHPNJ^_KU�\ LX\ _KPQ[�GKLTSG,I�G,k1GKO�UWOWhy�BJ�Gl��V�U�T�\,eo��J�O�I�PXI�R&I�\}ÒZRS]gU�V�PN\KV.�·¶U�[(JSPQ[(\nPNJ"}�PQO�k1\ J�acÞ0\KV�I�RS_>G,Lc]SV�\5uZPNT&U�TYsG5I�U�V�PNGKL�\KJz[�LXR1OxI�U�V8GKJ�G,LNM&O�PQOiPNJ�I�b�UqO�M>J>IGK[�I�PN[.T&\KYsG,PNJ�hi½�PNLNLXPQG,Y Þ!R�J�[bzG,J�T�9zG,V�PXLNMZJ½}RSLwe�UW|ZRSbSLNU�V�]�V�\5uZPQT&UWTqYsG5I�UWV�PQG,L&\ J^I�bSUBGK]S]SLNPN[WG5I�PX\ Jq\Ke�[�LXR�O�I�UWV�G,J1G,LNMZO�PQO$I�\3TSG,I�GDY;PXJ�PXJS_]SV�\KkSLNU�YsOWh8Ò&[�\,I�I3��\KJSJ�U�LNL�]SV�\5uZPNT&U�T�YsG5I�UWV�PQG,L$T&UWO�V�PXkSPNJS_jb�PNO8��\ V�|�\KJl[b1G,VGK[�I�U�ViV�UW[�\K_KfJSPXI�PN\KJ�hl��bSPXI�VGzF8\KVG,P!\Keo�*\X9 �Dh G1h�½�G5I�O�\KJGgoU�O�U�G,V[b���U�J>I�UWV3]SV�\5u>PQT&U�T�YsG,I�U�V�PQG,L!\ JI�b�UtR�O�Uj\,eB[�LXR1OxI�U�V�PXJS_nPNJ�Ì Fý\ k&îxUW[(I.V�U�[(\ _KJSPXI�PN\KJ�heG PNGKJ�[b�GKJS_#9zG,\l\,eo�*\@9å�iLNYsGKT&UWJgoU�O�U�G,V[b���U�J>I�U�V�a�Þ0U(I�U�V�\�G5î�[�O�Mn\,e�I�bSU�ÃBJSPNuKU�VO�PwIxMn\Ke���LNLXPNJS\KPQOWa�G,J�Tb,g\ V�GKJ�è8kSVGKT&\5uZP�¶[\,e�½�GKO�bSPXJ�_,I�\ J�ÒZI�G5I�U0ÃiJ�PXu U�VO�PXIxMlG,LQO�\�]SV�\5uZPNTSUWT�Y;GKJZMlbSUWLX]&e�R�L�[(\ Y^Y;UWJ IO�h~9zG,V�PX\nT&U�$PX_ RSU�PNV�PNT&\8]SV�\5u>PQT&U�TD]1UWV�e�\ V�Y;UWT.GiY;U(I�PN[�RSLX\ R�O$V�U�GKT&PNJS_i\KeSI�b�U�YsG,JZR�O�[(V�PN]&I$GKJ�T`]SV�\5uZPNT&U�TYsG,JZMjbSUWLX]Se�RSL�O�RS_K_ UWO�I�PN\KJ�OWh��bSPNOi��\ V�|s��GKOoO�RS]S]g\KV�I�U�TtkZMjI�bSU3úBG,I�PN\KJ�GKL�Ò&[(PNU�J1[(U`�S\ RSJ�TSG,I�PN\KJ�RSJ�T&UWVo_KVG,J>Io�xúB�df

ÅKÌ>Ë&�vÆ,ë,Í1h

Page 62: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

ü�� � �! #"$ >%�'�)#*,+�-3 w/$ �-`254w6�7B'5*�9;:> %5 1< = 75*5*

¸d¹�º�¹�¸d¹»�¼©¹%½¢ Þ�´�ô��SÅ}tEiPgPf(tEk*r�ã3�Sâ}wTiGf g���¾ ÍKÇ&É;¼ æ~ÊD»�º}Û�Î3ÎB»�æT¼ ÍKÎqÓ&æTÎBº�¿�¹T¼ Ê.î:Ç�æTÎ3Î�¸8æ~Ü�ì;Í.ÎB»Eé�Û ¾ ÊD¹�Ü�ì*æT½�Ê%Í%Ü�ÛMÈ~È,Ë ¹:æ~Ü=ì

Ê�¹ Æ ¹TÇ�«=ÍKÎBæTÊ�¹TË�ÍKæT¼+À�ÈBÊDÍ.Ç�Í î�æTÊDÍ%¹TÎ�æ~ÎBºÂÁ?»�ÉqË æ~¼ Æ ¹TÇ�ÈBÉ;ÊDÍ.ÎqÓ {qãTwTm*kL�újebeh���Ã��qwTk*f:{qñ�� � �e{3Þ:óT÷Tó;�¢ ÔS´�Å�a�õ aM¶üacbutEfPfGj v3s:tSgPjewTk*f�{ Û Æ ¸ Æ ¹TÇ�ÈBÉ;Ê%ÍKÎqÓ_ïM»�å�Í%»:Ú�½ �*¾T¡;� ¡oÄBÞ:Õ;{�Þ:óTóEÄ*�¢ ¾S´ â��n�B��Å�b � �qd*b gGtEk6��Å �(tEz*d��qh:tEiGs�m¯Å�o;o*iGw~tEs�m�gPw�acbed*f gGh=iGjek;lúµ�iGwTz*beh=|V�/Å æTÊDÊD»�Ë�ίïM»�Ü�¹GÓ~Î3Í.ÊDÍK¹~Î {

ÔT÷;�eÞ=ÄTÄ~¾S��Þ=Ä~¡;ÞT{�Þ:óTóT¡;�¢ ÄE´ â����,�(Å�b � �qd*b gGtEkRtEk*rRõ§�(õ§�Zâ}m3tEk6��acwT|_o*dqg�tSgPjewTk3tEb�ô��qoBh:iPjeh=k*s=h�wTk0ä3wTd*i&Å�belTwTiGj gPm*|_f?x%wTi�gGm;h

��tEiPrVacbed*f gGh=iGjek;lLµ�iPwTz*beh=|V��Å æ~Ê%Ê�»�Ë�Î�ïM»�Ü�¹GÓ~Î3Í.ÊDÍ%¹TÎ!Æ6»�ÊDÊ�»:Ë�½ {,Þ�öq� ÔTóT¡S� ¾TøT÷;{eÞ:óTóTÕ;�¢ ¡S´�µZ� Å��;Å�bebeh=k tEk;r ã*� ¶n�;Å�bebeh=k6� ¿�æT½�Í.Î Û�ÎBæT¼ ÇT½�Í.½=é Å Ë�ÍKÎBÜ:Í ÈB¼ »:½næTÎBº&Û�È~ÈB¼ ÍKÜ�æTÊDÍ%¹TÎ3½|È ðcbutEs�û~�Mh=beb6�qs=jeh:k~gPj v3s

µ�d*z;bejes�tSgPjewTk*f:{[Þ:óTóTø;�¢ ÕS´ õ§�ZÅ�|�tEr3tEfPd*kRtEk*rO¶?� Å��Zâ}jek*l*{?ßGØ6w�����Ø[h�p~h=b}�Xh:lT|_h=k~g�tSgPjewTkOwExnõVd*b gPjefGoBh=s�gGiGtEb� �|�tElTh=fLpqjut�Å�lE�

lTbewT|_h=i�tSgPj p~h�aMbed;fPgPh:iPjek*lLwEx�à�k;j x%wTiP|ëñ�h=jelTmXzBwTiGm*wXwqr;f�{ áaÅ æTÊDÊD»�Ë�ÎVï�»�ÜG¹�ÓTÎ3ÍKÊDÍK¹TÎ Ô;ÞTyD¾~��� ÔTÕ;Þ�ÄqÔTÕT÷;{Þ:óT÷T÷;�

¢ ö�´ õ§�3¶n�;Å�k*r*h=iGzBh=iGl*��Æ ¼ É;½GÊ�»�Ë�Û�ÎBæT¼ ÇT½�Í.½�í�¹~Ë�ÛMÈ~È,¼ Í%ÜGæ~Ê%Í%¹TÎ3½ �BÅ�s�tEr;h:|_jes�µ�iGh=fPf�{q �k*sT�e{3ñ�h�� � wTiGûB{6Þ:ó~öE¾;�¢ ÷S´ ã*��?&�[Å�d*lTd*fPgPfGwTk�tEk*r�ã*��õVjek;ûTh:i:�[Å�k§Å�k*tEb �;fPjef�wEx��XwT|_hi?�i�tEo*m���m*h=wTiGh�gGjes:tEb�acbed*f gGh=iGjek;l���h=s�m;�

k*je�Xd*h=f��É ¹TÉ;Ë�ÎBæT¼Z¹Pí?ÊKì;»nÛ Æ ¸ {5Þ�öq� ¡~öqÞ�� ¡T÷T÷;{�Þ:ó~öEø;�¢ óS´H?&�Mµ(��ðMtEz*d�tEk*r�õ§�Mñ��cõVd*iPg��~�MÅþñ�h:tEi � ù�o;gPje|�tEb� �k*j gPjutEb?�qh=h=r�Ê�tEbed*h��qh=beh:s�gPjewTk�jek�â��D|_h�tEk;f

Å�belTwTiPj gGm*|�d*fPjek*l_t�?�h=k*h�gPjes&Å�belTwTiGj gPm*|V�%Å æTÊDÊ�»:Ë�ÎVï�»�Ü�¹GÓ~Î3Í.ÊDÍK¹TÎqÆ6»�Ê%Ê�»�Ë�½ {,Þ=Ä*� öEÕT¾S� öEÕTó;{[Þ:óTóT¾;�¢ Þ:øS´H?&��µ(�(ðMtEz*d0tEk*r�õ§��ñ��[õVd*iPg��~�Zacbed*f gGh=iPjek*l��új gGm�ôZp~wTbed;gPjewTkR�XgPi�tSgPh:lTjeh=f:�©Å æTÊDÊ�»:Ë�Î0ïM»�Ü�¹GÓ~Î3Í.ÊDÍK¹~Î {

Ô~öq� ¾TÔ;Þ�� ¾TÔTó;{[Þ:óTóEÄ*�¢ ÞTÞ�´H?&�*µ(�*ðMtEz;d6{3õ§�;ñ��;õVd*iPg��~{*tEk*rV�B�3�,�*â}h=h:i gGm;jD�3�XgPwXs�m3tEfPgPjes&acwTk*k*h=s�gGjewTk*jef g�Å�o*o*iPw~tEs�m xKwTiMµZtSgPgPh=iGk

acbed*fPgPh=iGjek*l*�qgGw_tEo;o,h:tEi�jek çgË+Ë©Ë0ÌBË æTÎ3½|È ¾ ÇT½�Ê�»�Ç&½FÍZ¸8æTÎ�æTÎBº Æ Ç�«G»�Ë�ÎB»:ÊDÍ%Ü:½ {,Þ:óTó~öq�¢ Þ:ÔS´�äM�Sð��:ðMtEsGûTh:i(tEk;rnØ���ã3�:��d*zBh=iPg:��Ås?�i�tEo*m;�D��m;h:wTiPh�gGjes�Å�o*o*iPw~tEs�m}gPw0?�wXwqr;k*h=fGfP� ù�xK��ä(j g6jek?acwT|_o*beh�gGh��

Ø[jek*û���jeh=i�tEiPs�m*jes:tEb�acbed*f gGh=iGjek;l*�ÎÉ ¹TÉ;Ë�ÎBæT¼�¹Pí�ÊKì;»�Û�ÇL»:Ë�Í%ÜGæ~Î ¾ Ê�æTÊDÍ.½�ÊDÍKÜ�æT¼�Û?½�½�¹�Ü:Í%æTÊDÍK¹TÎ {MöqÞT� ÷~öEøS�÷~öE÷;{[Þ:ó~öEÕ;�

¢ Þ:¾S´�ô��*ðMtEs�ûTh=i��cÆ ¹TÇ�ÈBÉ;ÊD»�Ë�Ï%Û?½�½GÍK½�ÊD»�º�ïM»�æT½�¹TÎ3ÍKÎqÓ Í.Î Æ ¼ É;½GÊ�»�Ë�Û�ÎBæT¼ ÇT½�Í.½ {*µ�iGh=k~gGjes=h���tEbebD{qØ[wTk*r*wTk5{�Þ:óTóT¡;�¢ Þ=ÄE´ ¶?�;Å&�*ðMtEhFç:tS� � tSgPh:f:�B �kXgPiGwXr*d*s�gPjewTkVgGwL�}tSg�tL�XgGiPd*s�gGd;iGh=f}tEk*r Å�belTwTiPj gGm*|_f�¶�h=butSgGh=r�gPwL �k;xKwTiG|�tSgPjewTk

¶�h�gPiGjeh�pTtEbD�; �k �¯�3ð��;ä3i�tEûTh=f�tEk*rV¶n�*Å��3ðMtEh*ç:tS� � tSgPh=f�{3h=r*j gPwTiGf:{ ç�Î�í=¹TË�Ç�æ~Ê%Í%¹TÎ�ï�»�Ê%Ë�Í%»:åEæT¼eé�Ð?æ~ÊDæ¾ ÊDË�É*Ü:ÊDÉ;Ë »:½?æ~ÎBº�Û�¼ Ó~¹~Ë�Í.ÊKìqÇ�½ {3o*o6�[Þ:¾S��Ô~öq{*µ�iPh=kXgPjes=h&��tEbebD{*ñ�h��¯ã~h=iPfGh��~{[Þ:óTóTÔ;�¢ Þ:¡S´�µZ�3ðMtS�Ps=f �X{;µ�m6� ���3��jefPfGh=iPgGtSgGjewTk5{3à�k;j p~h:iPfGj g���wEx( �bebejek*wTjef:{5Þ:óTó~öq�¢ Þ:ÕS´H?&�,���*ðMtEbeb�tEk*r��&�3ã3�3��tEbebD�3  �*ù}��ÅZ��Å&{3Åüñ�w:p~h:b(õVh�gPm*wXrVwExc��tSg�tLÅ�k3tEb �;fPjef�tEk;r�acbutEfGfGj v*s�tSgPjewTk6�

gGh=s�m;k*jes:tEb(¶�h=oBwTiPg:{�¾ Ê�æTÎ�í�¹~Ë º_ï�»�½�»�æTËPÜ�ì ç�Î3½�ÊDÍ.ÊDÉ;ÊD» {*a�tEbej xKwTiGk;jut;{5Þ:óTÕT¡;�¢ Þ�ö�´ ã*�qØ��Xðch:k~gPbeh=�LtEk*r�ã*�X���~ä3iGjeh=r*|�tEk5�TäBtEfPg�Å�belTwTiGj gPm*|_f(x%wTicacwTk*fPgPiGd*s�gPjek*l&õVjek*je|�tEb3�qo*tEk*k*jek*l���iGh=h=f

jekVacwXwTiGr*jek*tSgGh&�qo3tEs=h=f�� çFË©Ë+Ë0Ì3Ë æ~Î3½�È Æ ¹TÇ�ÈBÉ;Ê�»:Ë�½ {BÔ~öq� ó~ö���Þ:øT¡;{�Þ:ó~öE÷;�¢ Þ:÷S´ ã*�Xa��~ðch*ç:r;h:ûB��Å æTÊDÊD»�Ë�ÎLï�»�ÜG¹�ÓTÎ3ÍKÊDÍK¹TÎZÑ�ÒÔÓ&ÕiÖקØ�ØPÇaÀ?«;Ù|Ú�ÛoÓÜÒÔÝuÚ+Ö×%ÞßÛPÓÜÒ;à§Þ�á â ã�à§ä�ÒÔÓ&Õ�åçæ�è�é©ê�ë|ì�í(î"é+ïcë|ðFðoèñ/ë�òeó©ô§ïcõßèöP÷§ø%ö§ùú öP÷Rû:ü(ù�ñiù�ý�þ�í%ÿ��uì�è Ê ù Ê ù������§þ����uìè��uì ���çù��/ù Ê ë|ì(õ����Fë|ðcþù�� ë|ì(ë��������/ê��§ô§ï�� �Fþ(î��&ô§ï ��ê�í(ð��Fë|ï���ì �

!"� �Fþ#�uì%$ ï��(ë|ïcë�#��ë'&%ïcë|ðcë|ì(�)������ô§ìù�*�ì Å ägàPÛuÈ?Ö�à§×%ä�Ó&Õ,+�Þ�Ó�È.-�à§Þ0/PÈ�à§Þ21�ÚPÞßÚoÓÜÒ&Ûaá â ã�à§ä�ÒÔÓ&Õ�åçæ�è& &ù43(5§ø�673(ö'8%è*öP÷§÷%ö§ùú 9 5Rû:��ùuý���ðgò;�uðoèuü(ù0!8ë��ì=<ßë|ï��(è�uì �>� ù0?@�ÜùRáA-�à§ÞßÛ�Ú�BßÓÜ×4C§â@-dâ ×%æcÓ�Úoä�ÒÔÞ�ã�DqÚoÓ&Õ%à'E�/�à§äGFiÞßà(H�â Ú)Eoã�Ú�Ð Ò&æ�Ûcà�ÝRÚoä�ÇÒ&Þ�ÐIC�ÓJC�«�C�æ�Úoæ�ù��K� � ����ô§ì(ð�L*ë��þ%ì ��&è�öP÷§÷8%ùú 9 ö�û Ê ù�ý�ï)����ê�ô'�%ðFõ=�Üù(�"&(ïcô<���<4��ê���ð���������& &%ïcô(����þM�côN�|ê�í(ð��Fë|ï���ì �(ù Å C§ÓÜÓÜÚoä�ÞPOÎÚ�Û�àcã�Þ�ÒÔÓÜÒ&à�Þ�ÆÚPÓÜÓ�Úoä�æ+ö 94Q 3�R)S�öP÷T ÄöP÷§ø%è�öP÷§÷%ö§ùú 99 ûaé�ù�ý�ïcô������ ç èÎÌßÚ�£�ÓÜ×�äFÚPæUÎá Å Õ%à§Ó�à�ã§äVCB(Õ�Ò&Û�á â�«|×%åW/�à§ä á�ä�Ó;Ò&æ�Ó;æXC§ÞYE�ÐiÚPæ�Ò ã�ÞßÚoä�æcè�Z ô'��ëPïPèöP÷[[%ùú 9 TRûP\ÎùY�]�uìù *�ì4�PïFë|î�ëPì(���uê^��ê�í(ð��Fë|ï���ì �N�;ô§ï_Z/ÿ�ì��uî`����*�ì4�;ô§ïFîM������ô§ìaé+ïFô=�|ë|ðcð���ì �(ù(á>-@D Ì�äVC§Þ�æ|È@+�Þ0/�à�ä�å.C§ÏÓÜÒ&à�Þ ¾ ǧæcÓ�Úoå�æ�èö§öS�ö3(T�6�ö'[�3(è*öP÷§÷T%ùú 9 3uû:��ùY�]�uï�&ßë|ì(�cë|ï��uì �ba�ù�� ïcô§ðFð�<ßë|ï��(ù ���^L�T4Sdc_��ë|ï)�uï��cþ ���'�uê^a�ë'�uï��cþfe/ð���ì �`��þ(ë|î`���'�uêgL*ï)�uì(ðFî`� ���Fë|ïcð]��ìa�ë|ê �h6i$ ï��(�uì � ç ��ì ��éK���V�FëPïFìb��ë'�|ô�§ì � ����ô§ìf�/ï���þ � �Fë���cí(ïFë|ðoù�Á Úo×%äVC§â�Á ÚoÓJH©à§ä�j§æ�èYT4S�ö 9 ÷�6cö'8 9 è�öP÷§÷5%ùú 9 8Rû:��þ��uì �(ï��M�Îþ%ëPõ�í(ï��ÜèYkf����þ��uë|êlciù�� ô§ê��%ò;�uðFðcë|ïoèßé©ï)��<(þ��uõ��uï��_���§þ����uìèm�uì �f�©ê��@e_&4�J�uêÜù4!5ë<HðFë'�uï���þí(ð���ì4� �uí4�cô§îM������� �|ên�uðcð�� o �0������ô§ìù ðcí4<(î`� ���Fë� �&ô§ï &(í4<(ê����'������ô§ìèþ��V��&pS qq0�cþ%ëPô§ïgÿ�ù ð����uì4�;ô§ï��ù ë�(íYq�&ßë|ô&(ê�ë0qoò;�uðcð)q�&(í <(ê����'������ô§ì(ð�q0!8ë'< a�ë'�uï���þ�q0!5ë< a�ë'�uï���þ�ù þ��Fî�êÜùú 9 [Rû:� ù cÂù���þ(ë|ì �(ù4�yý�ï)�uì ��þ=67� ì �=6�ý�ô§í(ì �:��ê�í(ð��Fë|ï���ì �r� ê��§ô§ï�� �Fþ(îHù=+gË+Ë©ËIÌ�ä�C§Þ�æ|È ¾ ǧæ�Ó�ÚPåçæFÍlD�C§Þ%Í�C§ÞYE-dÇ�«cÚoä�ÞßÚPÓÜÒ;ÛPæ�è 9 84S ø§÷8�6�ø§÷§ø%è�öP÷§÷8%ù

Page 63: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

s_t(u)t v;w x(y�u)z={J|n}(~p�]���lz0�4| z0� � �4�

ú 9(� û�óçùG��þ(ë|ì ���uì �#�çùKa�ùd\�íùK��ô§ì �|ë&4�cí �uêX��ê�í(ð��Fë|ï���ì ����ì���ì%ôoò?ê�ë� �§ëb$ ï��(�uì ���'������ô§ìù�+gË+Ë+Ë Ì�äVC§Þ�æ|ÈÅ C§ÓÜÓ�ÚPä�Þ:á ÞYC�â ǧæ�ÒÔæIC�ÞYE`D�C�Û|Õ�ÒÔÞßÚI+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚoè � S 8§÷ 9 6i8§÷§ø%è*öP÷§ø8%ùú 9 øRû�óçùd��þ(ë|ì �(ù^kHë0�uì,a�þ � ���oèdkHô��(ëPa�ë|ë|õ���ì �(è��uì4����ê�í(ð��Fë|ï���ì �(ùl+FË©Ë+ËKÌ�äVC§Þ�æ|È Å C�Ó;Ó�Úoä�Þ7á ÞYC§â ǧæ�ÒÔæMC§ÞYED�C�Û|Õ�ÒÔÞßÚI+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚoè�ö � S � ÷5�6 � ÷§÷%è*öP÷§÷8%ùú 9 ÷Rû�óçù4LÂù���þ ��ë|ìùg+�Þ�Ó�ÚoäVC�ÛoÓÜÒÔÝuÚ Å C§ÓÜÓ�ÚPä�ÞfO�Ú�Û�àcã�Þ�ÒÔÓÜÒ&à§Þ�èYkb�uï��|ë|ê@Z ë|õ�õ§ë|ïoèßñ?ë|òeó©ô§ïcõßèöP÷ � ø%ùú T5Rû:a�ù(��þ(ô§í4�(þ�í%ïFÿ.�uì �>k7ùRñiù�kHí(ï���ÿ�ù��#Z�� �=��ð�� ��ë]a=��þ(ë|î�ë��&ô§ïd�Îô§ì%ð��Fïcí ������ì �Ikf��ì ��îM�uê=a=&��uì(ì4��ì �XL*ïcë|ë|ð��ìf��ô�ô§ï�� ��ì ���cëra=&����|ë§ù Å C�Ó;Ó�Úoä�ÞfO�ÚcÛ�à�ã§Þ�Ò&Ó;Ò;à§Þ!Æ�ÚPÓÜÓ�ÚPä�æ�è�ö§öS T§ø8�67T§ø§÷%è�öP÷§÷5%ùú T%ö�û:ü(���'��í(ë|ðM��ô§þ(ë|ìèdë� � �Fô§ïoù�-�à§åçå�×%Þ�Ò&Û)C§ÓÜÒ&à�Þ�æ:à�/�ÓÔÕ(Ú�á>-@D�U+ÐNC§Ó7CfDqÒÔÞ�Ò&Þ�ã§ù@� ðFðcô���n������ô§ì��;ô§ïr��ô§î>6&(í4����ì �`kb����þ4��ì(ë|ïFÿ�èßñ/ô'��ë|î.<ßë|ïÂöP÷§÷[%ùú T 9 û:��ù ý ù(��ô§ê�ë|îM�uì.�uì4�>ciù � ù0� ì �%ïcë�ò?ðoè*�îM���§ë;a�ë'�§î�ë|ì(�)������ô§ì><�ÿ.�Îê�í%ð��FëPï���ì �(è Å äFàPÛuÈ +FË©Ë+Ë�[ �=Q 8(R)S �� T Ä� ø8%è�öP÷ � ÷%ùú TTRû:a�ùK��ô§ì(ì(ë|ê�ê]�uì ����ù �çùdü(����ìèd?�ë'�uïcì4��ì �!é+ïFô��cô���ÿ=&ßëPðr�;ô§ï.$ ì467?@��ì%ëMc��uì �%ò?ï�� ���Fë|ì�Z����� �cðPù�é©ïcô��Pë|ë�46��ì �§ð ô��d�Fþ(ë:ö3��Fþb*�ì��Fë|ïcì�������ô§ì��uê��Îô§ì=�;ë|ïcë|ì �|ëiô§ì!éd�����Fë|ïcì��?ë�|ô�§ì � ����ô§ìè�öS�öPø 9 Ä öPø�3(è�ý�ï���ð�<��uì(ë§è� í �§í%ð��ÂöP÷§÷§ø%ùú T�3uû:a��Fë'&%þ(ë|ì��/ù;��ïFô§ðcðoè�ë� � �Fô§ïoù;+FË©Ë+Ë Ë©£B�Úoä�ÓiU ¾ B�Ú�ÛPÒ�C§â�ÒÔæ�æ�×%ÚSà§Þ�ÐNC§Ó7C�DqÒ&Þ�ÒÔÞ�ã�ùG*7�G�K����ô§î`&(í4�Fë|ïa�ô��'��ë���ÿ�èm$����cô<ßë|ïÂöP÷§÷[%ùú T8Rû k7ù�ý ùYZ��uê�ë§ùm$ ìf�Fþ(ë>��ô§î`&��uï���ðcô§ì:ô��]��ô§ì �|ë&4�Fí��uê���ê�í(ðV�cë|ï���ì �M�uì �qñ/í%î�ëPï����'�uê@Ll���%ô§ì%ô§î�ÿ�ùm+FË©Ë+ËÌ�ä�C§Þ�æ|È Å C§ÓÜÓ�ÚPä�Þ:á ÞYC�â ǧæ�ÒÔæIC�ÞYE`D�C�Û|Õ�ÒÔÞßÚI+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚoè � S 9 3(ö�6 9 33(è*öP÷§ø8%ùú T[Rû �Âù*ñiùlZ����ë§ùK� ëPì%ëPï��uê����|ë'��\�í4�'��ÿ���6ia�þ(ë|ê�ê�ðr�Îê�í%ð��FëPï���ì ���uì ��Z/ë�Fë������ô§ìzô�������ï��|í(ên�uïN�uì �,�©ê�ê���&4�����ý�ô§í(ì ���uï���ë|ðoù Å C§ÓÜÓ�Úoä�ÞfOÎÚ�Û�àcã�Þ�ÒÔÓÜÒ;à§Þ�è 9 84S � ö'T�6 ��99 è*öP÷§÷ 9 ùú T � ûP?+ù�Z��'�=��ð Q ë�ù R�ùg�IC§ÞYE�«càoà�j�à�/`1�ÚPÞßÚoÓÜÒ&Û á â ã�à§ä�Ò&ÓÔÕ%å�æ�è Ê �uìHñ?ô§ð��Fï)�uì �:�?ë��ì(þ(ô§ê���èßñiù�óçù�è�öP÷§÷%ö§ùú T§øRûM!-ù ciù=�/ù4Z��Pÿ�ù ��ô§î`&(ê�ë��4� ��ÿML�þ(ë|ô§ïFÿgSl� ìP*�ì(�cïFô=�(í4�����ô§ì:�&ô§ï�é+ï�������� ����ô§ì(ë|ïcð�ô��d��ên�uðcð�� o��'������ô§ì�ù *�ìaé�ù� ï���< ��ë]�uì �r?+ùc?í <ßëPïV�oèuë'�4� �cô§ïFðoè@-dâ ×�æ�Ó�ÚPä�Ò&Þ�ãrC§ÞYEM-dâ C§æ�æ�Ò �+Û)C§ÓÜÒ&à�Þ�è(!8ô§ïcê��.a=���ë|ì���� o��§è=a=��ì �(��&ßô§ïFë�èöP÷§÷ 9 ùú T§÷RûP��ù édù=Z ë|î`&(ð��Fë|ïoè%ñiù k7ù(?^����ï��è �uì4� Ziù ý ù4��í < ��ì�ù kb���=��îçí(î"ê���õ§ëPê���þ%ô�ô��`�;ïFô§î���ì �|ô§î`&(ê�ë��cë�� ���)�I�4�n��cþ%ëX��k��uê��§ô§ï�� �cþ%îHù É È@OÎà�Ç(C§â ¾ Ó7C§ÓÜÒÔæ�ÓÜÒ&Û)C§â ¾ àPÛoÒ&ÚoÓÜÇ�ý]T§÷ Q ö0R)S�ö Ä T§ø%è*öP÷ �� ùú 3(5RûP�/ù@Z������Pÿ�ù^L�þ(ëMZ?ÿ%ì��uî`���`�Îê�í%ð��FëPïrkHë��cþ%ô=����ìSñ/ô§ì=6ic���ë|ï)�uï���þ ���'�uê]��ê�í(ðV�cë|ï���ì �(ù É ÈN-�à§å�Bß×%ÓÜÚoäPC§ÞYE+�Þ0/�à§ä�å>C§ÓÜÒ&à§Þ ¾ ÛPÒ;ÚPÞßÛ�Úoæ�è 9 S [%ö�6�ø§ø%èöP÷ � T%ùú 3(ö�ûP�/ù4Z������|ÿP�uì �aü�ù � ù�a���î�ô§ìù4�Îê�í%ð��FëPï���ì �N� ì��uê ÿ�ð���ðPù4*�ìP�çù a�ù4\�í�è%ë� � �Fô§ïoèßÐÂÒ�ã§Ò&ÓJC�â Å C§ÓÜÓÜÚoä�Þ OÎÚ�Û�àcã�Þ�ÒÔÏÓÜÒ&à�Þ�è4& &ù�3 � Ä ÷�3(èYa=&(ï���ì4�§ëPï Ê ë|ïcên���(èßñ?ë|ò�ó+ô§ïFõ�è�öP÷ � [%ùú 3 9 ûP�/ù@Z������Pÿ�ùpL?þ%ëMa�ÿ�î.<ßô§ê����.��& &(ïcô(���cþ���ì��Îê�í%ð��FëPï���ì �(ù@*�ì�ciù@ciùý�ô=�cõ�èdë� � �Fô§ïoè�-dâ C�æcæ�Ò �+Û�C�Ó;Ò;à§Þ#C§ÞYEO�ÚPâ C§Ó�Ú)E>D8ÚoÓÔÕ(à'E§æià�/ ÐNC§Ó7Cçá�ÞYC§â ǧæ�Ò&æcè�ñ/ô§ïV�cþ:c/ô§ê�ên�uì ��è � î�ðV�cë|ï����uîHè�öP÷§ø§ø%ùú 3(TRû:� ùlZ ô§ï)���;�uì4�,��ùl�çù*ü�����ì�ùKa�þ���&ßë a=&ßë'���Fï)�qý]�uðcë� Ê ��ë|ò�� ïFô§í & ��ì �f�&ô§ïN\�ïcë|ë�67\�ô§ïcî�$�<4�gë'���Fðoùl*�ìÅ ägàPÛuÈ^+�Þ�Ó�È]-©à§Þ0/|È©à§Þ:+�å.Coã�Ú Å äFàPÛ�ÚPæ�æ�ÒÔÞ�ã���+-p+ Å ÏV�(���uè���ô§êÜù T%è & &�ù 9 3(5�6 9 3(T%è�öP÷§÷8%ùú 33uû �Âù�� ù�Z í <ßë|ð��uì �:�iù��çù�ü(����ìù���ê�í(ð��Fë|ï���ì �>L*ë��þ%ì ����í%ëPð'SGL�þ(ëIe?ðcë|ï0  ð;Z���ê�ëPî�îM�%ù Å C�Ó;Ó�Úoä�Þ:OÎÚ�Û�àcã�Þ�ÒÔÏÓÜÒ&à�Þ�è(ø4S 9 3 � Ä 9 [5%è*öP÷ � [%ùú 3(8Rû �Âù(��ùZ í <ßë|ð��uì �`�iù(�çù�ü(����ìù���ê�í(ðV�cë|ï���ì4�IkHë�Fþ(ô��(ô§ê�ô�uÿ>��ìr�K�=&(ê�ô§ï)���Fô§ïFÿ.Z������X� ì��uê ÿ�ð���ðPù�*�ì`k7ù�� ùó+ô'�4� �Fðoè%ë� � �cô§ïPè�á�E§Ý�C§ÞßÛ�ÚPæÂÒ&Þ�-�à§å�Bß×%ÓÜÚoä�æ�è�&4&ù�ö§ö'T Ä 99 8%èY���'���(ë|î`����é©ïcë|ðcðPè�ñ?ë|òeó©ô§ïcõßèöP÷§ø5%ùú 3([Rû �Âù�� ù�Z í <ßë|ðoù c/ôPò¡kb�uì�ÿ:��ê�í(ðV�cë|ïcð;�/ïcë ý�ë|ð��)¢ 6K� ìP�K�=&�ë|ï���î�ëPì(�Pù Å C§ÓÜÓÜÚoä�Þ:O�ÚcÛ�à�ã§Þ�Ò&Ó;Ò;à§Þ�è 9 54S [�3(8�6[[T%è�öP÷§ø � ùú 3 � û �Âù@� ù@Z/í <ßëPðPùl��ê�í(ðV�cë|ïX� ì �uê ÿ%ð���ðI�uì ����ë|ên���cë��*�ðcðcí%ëPðPù@*�ì�� ù@cÂù^��þ(ë|ìè^?©ùp\Îù�éK�uí�è^�uì �5é�ù@a�ù�é�ù!��uì �(è%ë� � �Fô§ïcðPè4�IC§ÞYE�«càPà�j�à�/ Å C§ÓÜÓ�ÚPä�ÞPOÎÚ�Û�àcã�Þ�ÒÔÓÜÒ;à§Þ:C�ÞYE -©à§å�B�×�Ó�ÚoäM£dÒÔæ�Ò;à§Þ�è!8ô§ïcê��Pa��'��ë|ì(��� o ��èa=��ì �(��&ßô§ïcë§è�öP÷§÷T%ùú 3�øRû k7ù é�ùgZ/í <(í ��ðFðcô§ì��uì �b�iù �çùßü(����ìùg�2kHô�� � o�ë��c��uí(ð��(ô§ï�¤�Z���ðV�)�uì �|ëI�;ô§ï�$�<4�gë���kb�����cþ ��ì �(ù Å ägàoÛRÈ+�Þ�Ó�È;-�à§Þ0/PÈ�à§Þ Å C§ÓÜÓ�Úoä�ÞfOÎÚ�Û�àcã�Þ�ÒÔÓÜÒ;à§Þ,��+�- Å O�¥ �'¦����ô§ê@��è4& &ù 8[[ Ä 8[§ø%è�öP÷§÷�3(ùú 3�÷Rû �Âù^$�ù^Z í4���f�uì �5é�ùp�/ù^c��uï��Pù Å C�Ó;Ó�Úoä�Þ�-dâ C§æ�æcÒ �+Û)C§ÓÜÒ&à§Þ"C§ÞYE ¾ Û�ÚPÞßÚ�á ÞYC§â ǧæ�ÒÔæ�è^!%��ê�ë|ÿ�è�ñ?ë|ò"ó+ô§ïFõ�èöP÷ � T%ùú 85Rû:a�ù�Z/í(ì(ìè=?+ù�ü(�uì(ô§ð_�uì �P��ù4��ô§ðcë|ì4�&ëPê���ù�ý���î�ë'�uìP��ê�í(ð��Fë|ï���ì �(ù Å C§ÓÜÓ�ÚPä�Þ O�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§ÞHÆ�ÚPÓÜÓ�ÚPä�æ?öS�ö'[§÷ Äö � T%è�öP÷§øT%ùú 8%ö�û:ý ùYa�ù�Z í(ï)�uì �uì �Hédù ?©ùY$��(ë|ê�êÜùG-dâ ×%æ�Ó�ÚPä/á ÞYC�â ǧæ�ÒÔæU?á ¾ ×%ä�ÝRÚoǧè�a=&(ï���ì4�§ëPïV6 Ê ëPïFên���(è(ñ?ë�òeó+ô§ïFõ�è�öP÷ � 3(ùú 8 9 ûM!-ù4\Îù �G�4�%ÿ�è ��ù4kHô���õ�í%ðoè��uì4�ba�ù $ í(ë§ù ��& &(ïcô'�4��îM���FëIa=��ì4�§ê�ë�?@��ì(õ����§ëN�Îê�í%ð��FëPï]�/ì��uê ÿ�ð���ð�ô��^?^�uï��§ëZ�������a�ë��Fð@��ìIc����§þIZ���î�ëPì%ð���ô§ì��uê�a=& ���Pë|ðPù0L*ë��þ%ì ���'�uê4��ë&�ô§ïV�l8§÷ 9 èZ/ë'&=�oùPô��Ya(�)������ð������|ðoè(�]�uïFì(ë���ëkHë|ê�ê�ô§ì:e?ì � ��ë|ïcð�� ��ÿ�è%éG� �V�cð�<(í(ï��§þ�è�öP÷§÷�3(ù

Page 64: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

�=§ � �I¨n©�¨pª�t4|n}Y«d¬�¨�­�¨�¬bx�{�ui®Pt�}�¯,°p¨ ª�¨K±mw ®�}�}

ú 8TRû:$ ïcë|ì:�d�����ô§ì �Üù4L�þ(ë�òÎô§ïcê�� Ä ò����%ë òÎë<pS�² í����§î`��ïcë/ô§ï_�§ô§ê��:î`��ì(ë0¢#-�à§åçåç×�Þ�Ò;Û�C�Ó;Ò;à§Þ�æià�/ÂÓ&Õ%Ú á.-@DqèT§÷ Q ö§ö0R)S [8 Ä [§ø%è�ñ/ô'��ëPîr<ßëPï öP÷§÷[%ùú 8�3uû:ý ùYa�ù �K��ë|ï�� �V�oùK-dâ ×%æcÓ�Úoä á ÞYC§â ǧæ�ÒÔæ�è��K�%ò;�uï�� � ïFì(ô§ê��è=?�ô§ì �(ô§ìè*öP÷§÷T%ùú 88Rû Ê �uì4�Pë]\Y��<ßë|ïoù��ê�í(ð��Fë|ï���ì ���uì �r�Fþ(ë��|ô§ì(����ì�í(ô§í(ð©õ Ä î�ë'�uì(ðl�uê��§ô§ï�� �cþ%îHù§Æà§æ©á â C§å�à§æ�³�ÛoÒ&ÚoÞßÛcÚoè 99 S�ö'T§ø Äö33(è�öP÷§÷�3(ù�þ(����&pS qqRê���<46;ò?ò�òÂù ên�uì(êÜù �§ô'��q�&(í4<(ð�qRên�%ù ð��'�Üù þ(�FîHùú 8[Rû Ê �uì4�PëP\Y��<ßë|ïoè+ü�í4� � �cþ#��ùdc?ô=�cþ=<ßë|ï��(è©éd���cï�����õ�k7ù^��ëPê�ê ÿ�èdL;��î�ô��cþ�ÿ��Âù^L�þ(ô§îM�uðPèK�uì �zü(�uî�ë|ð>k7ù!�þ4� �cë§ùY��ô§ì �|ë&4�?ë��=�Fï)��������ô§ì Ä �N� ���)� Ä î`��ì ��ì4�r�Fë'�cþ(ì ����í(ë§ù�Æà�æ�á�â C§å�à§æ�³�ÛoÒ&ÚoÞßÛcÚoè 99 S�ö 99 Ä ö3�÷%èöP÷§÷�3(ù�þ(����&pS qqRê���<46Üò�ò�òÂù ên�uì(êÜù �§ô0� q�&(í <%ð�qRên�%ù ð���Üù þ(�cîHùú 8 � û e/ð��uîM�>k7ù�\Y�Pÿ�ÿ����ùmZ�������î`��ì ��ì �.�uì �!õ�ì%ôoò?ê�ë� �§ër�4��ð��|ô0��ë|ïFÿgS;kb�uõ���ì ��ðcë|ì(ðFëÂô§í4��ô��d�������%ùm+FË©Ë+ËËG´�B%ÚPä�ÓÜèö§ö Q 8(R�S 9 5 Ä 9 8%èp$����Fô<�ë|ïiöP÷§÷[%ùú 8§øRû Z�ùY\l��ðcþ(ë|ï��uì �qé�ùY?^�uì4�§ê�ë|ÿ�ùp��ô§ì �|ë&4�cí �uê]��ê�í(ð��Fë|ï���ì �M�uì4��*J�FðX��ë|ên������ô§ìf�Fôañ/í(î�ë|ï����'�uê^Ll����ô§ì(ô§î�ÿ�ù*�ì�!Mù^��ù^���uê�ë�è�ë� � �Fô§ïoè+á ä�ÓÜÒ �+ÛoÒhC�âl+�Þ�Ó�ÚPâ&â Ò�ã�ÚoÞßÛ�Ú C§ÞYE�³�Ó7C§ÓÜÒÔæ�ÓÜÒ&Ûoæ�è@��� � ��ðFô§ì46J!8ë|ðcê�ë�ÿ�èK�?ë'��� ��ì �(èöP÷§ø8%ùú 8§÷Rû Z�ù�\l��ðFþ(ë|ïoù��ì%ôoò?ê�ë� �§ë;�����í4��ð�� ����ô§ìr�=�n��*�ì �|ïcë|î�ë|ì����uêY��ô§ì �|ë&4�Fí��uêg��ê�í(ð��Fë|ï���ì �(ù=D�C�Û�Õ�Ò&ÞßÚ?ÆÚ)C§ä�Þ�ÒÔÞ�ã�è9 S�ö'T§÷�6�ö ��9 è�öP÷§ø � ùú [5Rû Z�ù@\l��ðFþ(ë|ïoè@?©ù@µ í�èl�Âù^�]�uïcì(ë|ðoèóçùp�_����þ�èda�ù*ü(ùp\�ëPì(��ë|ðoè�ü(ùl��þ(ë|ìèd� ùla�þ �n�'�=�Üèd��ù*ý���ðgò;�uðoè@�uì �Sü(ù!8ë'��ì�<ßë|ï��(ù���& &(ê ÿ=��ì �>��*]�Îê�í%ð��FëPï���ì �r�Fô>�©ì ���ì(ë|ë|ï���ì �`Ll�uðFõ�ðPùY+gË+Ë+ËeËK´B�Úoä�ÓÜè(ø4S 8%ö�6i[5%è�öP÷§÷T%ùú [%ö�ûP?+ùK\d��ðFþ(ë|ï`�uì �·ü(ùd!Mù Ê �uìXñ/ë|ðFðoùK���(î`��ðFð���<(ê�ëP��ê�í(ðV�cë|ï���ì4�5é©ïcô��Pë�(í%ïcë|ðoù]¶?Ò;à§åçÚoÓÜä�Ò�j(C§è;8§ø4S ÷%ö�6�ö'5�3(èöP÷ � ö§ùú [ 9 ûaé�ù ü(ùl\dê ÿ�ì(ì��uì �,�iù �çùdü(����ìè�·�ý;$�ñ�a=��*)SdTZ¸$�<4�gë���>��ë�Pô�§ì4� ����ô§ì#e/ð���ì ����ô§ì(ðV�cï�����ì(ë�#a�ë'�uï���þè ¹+FË©Ë+Ë0Ì�äVC§Þ�æ|È Å C�Ó;Ó�Úoä�Þ:á ÞYC§â ǧæ�ÒÔæIC§ÞYEMD�C�Û�Õ%ÒÔÞßÚI+�Þ�Ó�ÚoâÔâ Ò ã�ÚPÞßÛ�Ú ö'T Q ö'5(R)S�ö'5[[ Ä ö'5 � 8%è�öP÷§÷%ö§ùú [TRû Z�ù�ý ù\�ô�§ë|êY�uì �çé�ù��çù�a=��î`&(ðFô§ìù��d��ô§ê �4��ì �X\�í4�'��ÿ>��ê�í(ð��Fë|ïcðoù�*�ì Å ägàPÛuÈà�/?Ó&Õ%Ú;+�Þ�Ó�ÈK-�à§Þ0/|Èà§Þ�Á Úo×%äVC§âÁÂÚPÓJH+à§ä�juæ�è & &�ù�öPø 9 ÷�6�öPøT�3(èma4�uì \�ï)�uì ���ð��|ô(è�öP÷§÷T%ùú [�3uû Z�ùßý ùY\�ô�§ë|êl�uì �b?+ù�ü�ùY\�ô�§ë|ê Q ë�(ð�R�ùpa=&ßë'��n�uê^*�ðFðcí(ëÂô���+FË©Ë+Ë Ì�ä�C§Þ�æ|È*ÁÂÚo×�äVC�â�Á ÚoÓJH©à§ä�j§æÎô§ìf�d��ô§ê�í46����ô§ì �uïFÿ:��ô§î`&(í4��������ô§ìè�ü��uì�ù�öP÷§÷�3(ùú [8RûP?+ù�ü(ù�\�ô�§ë|êÜè4��ù�ü(ù�$/òÎë|ì(ðoèY�uì4�fk7ù%ü�ù=!��uê�ðcþù�á ä�ÓÜÒ �+ÛoÒhC§âY+�Þ�Ó�ÚoâÔâ Ò ã�ÚPÞßÛ�Ú�ÌÕ�ägà§×�ãuÕ ³�Ò&å�×%â C�ÓÜÚ)E�ËÎÝuà§â ×�ÏÓÜÒ&à�Þ�è(ü§ô§þ(ì !%��ê�ë�ÿ�è�ñiù%ó�ù�èöP÷[8%ùú [[RûM!-ù�ý ù \�ï)�uõ§ë|ðX�uì �b� ùßý]�uë�'��6ÜóG���cë|ðoùp+�Þ0/|à§ä�å.C�Ó;Ò;à§Þ�OÎÚoÓÜä�Ò&ÚoÝ�C�â U�ÐIC�ÓJCM³�ÓÜä�×%ÛoÓÜ×�äFÚPæNC�ÞYE�á â ã�à§ä�ÒÔÓ&Õ�åçæ�èé+ïFëPì(�����PëIc��uê�êÜè �©ì �§ê�ë�òÎô�ô��b��ê�� ¤�ðoè�öP÷§÷ 9 ùú [ � ûP��ùp?+ù*ñÂù@\�ïcë���uì �Sü(ù^k7ù�ñiùp?�ë� �)�uô(ù^��kf��ì ��î�í(îº��ô=�%ëP?ëPì4���cþ,L*ë��þ%ì ����í%ëM�&ô§ïr��ê�í(ð��Fë|ï���ì �:ô��a�ÿ�ì������������qéd�����Fë|ïcì(ðPù�é©ïcô���ù+ô��X*�ì(�où]�Îô§ì=�Fù+ô§ì·éd���V�cë|ïcì"�?ë�|ô�§ì � ����ô§ìè Ê ��ë|ì(ì��%è;&4&ù][§ø5�6i[§ø�3(èöP÷§÷[%ùú [§øRûP��ùp?+ù*ñÂù@\�ïcë�ùl�Îê�í%ð��FëPï���ì ��ô���a�ë��í(ë|ì �|ë|ðçí(ð���ì �b�fkf��ì ��î�í(îº� ï)�uî�îM�uïX�Îô§î`&%ê�ë�=� ��ÿ���ï�� �FëPï���ô§ìù1ÎäVC�å�å>C§ÓÜÒ&Û)C§â=+�Þ0/�ÚoägÚPÞßÛ�Ú�U+ÆÚ)C§ä�Þ�Ò&Þ�ã�³�ǧÞ�Ó7C0´G/�ägà�塳�ÚoÞ�Ó�ÚPÞßÛ�Úoæg?+ù0kf���|ê�ë��l�uì �.� ù�c_���§í(ë|ï)� Q ë�(ðPù R�èa=&(ï���ì �§ë|ï�6 Ê ë|ïcên���(è=& &ù�ö'5 � 6�ö§ö'[%èöP÷§÷[%ùú [§÷Rû �çù�a�ù(\�í`�uì4�Ma�ù§óçù�?�íù���Îê�í%ð��FëPï���ì � é+ïFô=�|ë�(í(ïFë]�;ô§ïGa�ÿ�ì������������/éK���V�FëPïFì(ðoù=+gË+Ë©Ë Ì�äVC§Þ�æ|ÈY³�ǧæ�ÓÜÚoåçægÍD�C§Þ�C�ÞYE�-dÇ�»cÚoä�ÞßÚPÓÜÒ&Ûoæ�è � S � T�3�6 � 3 9 è*öP÷ �� ùú � 5Rû �çù a�ùl\�í��uì �Zü(ù �çùlkHí4�Üè�·��¼a�í(ïV��ë|ÿ5ô§ì�*�îM���§ë a�ë�§î�ë|ì���������ô§ì�è ¹ Å C§ÓÜÓÜÚoä�Þ�O�Ú�Û�àcã�Þ�ÒÔÓÜÒ&à§ÞXö'T4S T Ä ö'[%èöP÷§ø%ö§ùú � ö�û �çù^\�í(õ�í(ì����(�%ùG+�Þ�ÓÜägà0E§×(ÛPÓÜÒ&à�Þ·Ó�àf³�Ó7C§ÓÜÒ&æcÓÜÒ;Û�C�â Å C§ÓÜÓ�ÚPä�Þ�OÎÚ�Û�àcã�Þ�ÒÔÓÜÒ&à�Þ�èK���'���(ë|î`����é©ïcë|ðcðPè+ñ?ë�òbó+ô§ïFõ�èöP÷§÷5%ùú ��9 ûP\Îùg� ê�ô0��ë|ïoùY\�í=�cí(ïFëÂéK���Fþ(ð_�;ô§ï_*�ì��Fë�§ë|ï�é+ïFô�§ï)�uî�î`��ì �r�uì �f?@��ì%õ�ð;�cô`�/ï���� o���n�uê@*�ì(�cë|ê�ê����§ë|ì �|ë§ù_-�à§åçÏBß×%Ó�ÚPä�æIC�ÞYE�½^B�ÚoäVC§ÓÜÒ;à§Þ�æ�O�ÚPæ�Ú)C§ägÛ|Õ�èg84S 8TT�6i8�3�÷%è�öP÷§ø[%ùú � TRû Z�ùp� ô§ê�� <ßë|ï��(ù;1�ÚoÞßÚPÓÜÒ;Û á�â ã�à§ä�ÒÔÓ&Õ�åçæçÒÔÞ�³�Ú�C�ägÛ�Õ�Ír½^BßÓÜÒÔåçÒ Ø0C§ÓÜÒ&à�Þ�C§ÞYEPD�C�Û|Õ�ÒÔÞßÚ�ÆÚ)C§ä�Þ�ÒÔÞ�ã�èm��� �4��ðcô§ì!8ëPðFê�ë�ÿ�è��?ë'��� ��ì �(èöP÷§ø§÷%ùú � 3uûP��ù@Z�ù^� ô§ï��(ô§ì,�uì4�Sü(ù@L ù^c?ë|ì �(ë|ïcðFô§ìù@�/ê��§ô§ï�� �Fþ(îº�&ô§ïI�+í �|ê����(ë'�uì�a�í(îKô���a=��í �uïcë|ðoùl¶?Ò;à§å�ÚPÓÜä�Ò&Ûoæ�èTT4S T88�6iT[ 9 è�öP÷ �� ùú � 8Rû:��ù]� ùG� ô��Fê���ë'<#�uì �%a�ùG��í(îM�uïPùda�ë|îM�uì������b��ê�í(ðV�cë|ï���ì �5ô���*�ì �(ë���L*ë|ïcî�ðPù É à§×�ä�ÞYC�â à�/:Ó&Õ%Ú�á.-@Dqèö'84S 3�÷T�6i8%ö'T%è�öP÷[§ø%ùú � [Rû �çù � ùl� ôoò_���%è�·���\�ë0���Fí(ïFë:��ë�(í ������ô§ì,�uì ��e/ì%ðcí &ßë|ï��=��ðcë����ên�uðcð�� o��'������ô§ì�� ê��§ô§ï�� �cþ(îº�;ô§ïrkHí(ê ��� 6ð�&ßë���cï��uê^Z������%è ¹ Å C§ÓÜÓ�ÚPä�ÞfO�Ú�Û�àcã�Þ�ÒÔÓÜÒ&à§Þ!ö �=Q [(R)S [[ � Ä [ � [%èdöP÷§ø�3(ùú �� û �çù� ù�� ôoò_�����uì �.��ù���ï���ðcþ(ì��%ù'����§ê�ô§î�ëPï������ ��ë���ê�í(ð��Fë|ï���ì ��e/ð���ì �]�cþ(ë]�Îô§ì4�Pë&4��ô��YkHí=�cí��uê�ñ/ë'�uïFëPðV�ñ/ë���§þ�<�ô§ïFþ(ô�ô=�ù Å C§ÓÜÓ�ÚPä�ÞbOÎÚ�Û�àcã�Þ�ÒÔÓÜÒ&à�Þ�èö'54S�ö'58�6�ö§ö 9 è*öP÷ �� ù

Page 65: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

s_t(u)t v;w x(y�u)z={J|n}(~p�]���lz0�4| z0� � �4¾

ú � øRû �çùg� ùg� ôoò_���`�uì4�f�/ùYZ������Pÿ�ùga�ÿ�î.<ßô§ê����N��ê�í(ðV�cë|ï���ì4�`e/ð���ì �`��ñ/ë�òWZ���ðFð���î`��ên�uï�� ��ÿ`kHë'�uðcí(ïFë§ùg+FË©Ë+ËÌ�ä�C§Þ�æ|È@³�ǧæ�Ó�ÚPåçæFÍdD�C§Þ�C�ÞYE�-dÇ�»cÚoä�ÞßÚPÓÜÒ&Ûoæ�è 99 S T[§ø�6iT � ø%è*öP÷§÷ 9 ùú � ÷Rû:ü(ù� ù�� ôoòÎë|ïl�uì �.��ùuü(ù�a�ù��?ô§ðFðoù�kf��ì ��îçí(î�a=&��uì(ì4��ì ��L*ïcë|ë|ðl�uì �.a=��ì �§ê�ë�67?@��ì%õ����§ë;��ê�í(ðV�cë|ï^� ì �uê ÿ%ð���ðoùá;B(Bßâ Ò&Ú)EM³�ÓJC�Ó;Ò&æ�Ó;Ò;ÛPæ�è�öPø4S 8�3�67[�3(è�öP÷[§÷%ùú ø5Rû:ü(ù�ü�ù4� ïFë�&ë|ì(ð��Fë����Fë§ù�$�&=����î`���'������ô§ì�ô��^��ô§ì(�cïFô§êßéK�uï��uî�ë��cë|ïcðl�&ô§ï]� ë|ì(ë�������� ê��§ô§ï�� �cþ(î�ðPù(+gË+Ë©Ë Ì�äVC§Þ�æ|ȳ�ǧæ�Ó�ÚPåçæFÍdD�C§Þ�C�ÞYE�-dÇ�»cÚoä�ÞßÚPÓÜÒ&Ûoæ�è�ö'[4S�ö 99 6�ö 9 ø%è*öP÷§ø[%ùú ø%ö�û �Âù k7ùpc��uï��uê�����õb�uì �,��ù ?+ùp��ëPê�ê ÿ�è]·céK���V�FëPïFì���ë'�|ô�§ì � ����ô§ì5ò_� �Fþ�kHë'�uðFí(ïcë|î�ë|ì��ra�&����|ëM�uì �,a�&������n�uê��ê�í(ð��Fë|ï���ì �N�;ô§ï_kHí(ê ����&(ê�ë�*�îM���§ë|ðoè ¹ Å ägàoÛRÈ@+gË+Ë©Ë¿8 �=Q 3�R�S [8�3 Ä [[8%èdöP÷[§÷%ùú ø 9 û:ü(ù���ù c��uï������(�uìùK-�â ×%æ�ÓÜÚoä�ÒÔÞ�ã�á â ã�à§ä�ÒÔÓ&Õ�åçæ�è�ü�ô§þ%ì !%��ê�ë|ÿ�èßñ?ë�ò�ó+ô§ïFõ�èöP÷ � 8%ùú øTRû:a4�uï)����ë|ëPðFëPc/ë� <ßë|ï��(ùGa�ë'�uï���þ4��ì �b�;ô§ïI�cþ%ë:î�ô��Fþ(ë|ï�ê�ô��(ëSMLl�uê�ë|ðçô��_�cþ%ëMo(ïcð��r�������8î`��ì%ëPïFðoù@+FË©Ë+ËËG´�B%ÚPä�ÓÜèö§ö Q 8(R�S 3 Ä � èp$����Fô<�ë|ïÂöP÷§÷[%ùú ø�3uû:ü(ùpc?ë|ï�����èm��ùm��ïFô�§þè@�uì4��� ùm��ùm&��uê�î�ë|ïoùg+�Þ�ÓÜägà0E§×%ÛoÓÜÒ&à§ÞzÓ�à�Ó&Õ%ÚqÌÕ(Úcà�ä�ÇHà�/ÂÁ Úo×�ä�C§â�-©à§å�B�×�Ó7C§ÓÜÒ&à�Þ�è��� �4��ðcô§ì46J!8ë|ðcê�ë�ÿ�èY��ë'��� ��ì �(è�öP÷§÷%ö§ùú ø8Rû �Âù ?©ù�c?ô�¤�îM�uì#�uì �%��ù �çù©ü(����ìèr·�a�ë�§î�ë|ì���������ô§ì��uì ���Îên�uðFð�� o��'������ô§ì·ô��X���uì �§ëb*�îM���§ë|ðPè ¹�+FË©Ë+ËÌ�ä�C§Þ�æ|È Å C§ÓÜÓ�ÚPä�Þ:á ÞYC�â ǧæ�ÒÔæIC�ÞYE`D�C�Û|Õ�ÒÔÞßÚI+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚ?ég��kf*J6�÷ Q 8(R)S [5§ø Ä [ 9 5%è*öP÷§ø � ùú ø[RûPL ùlc/ô��&îM�uì(ì��uì �zü(ù k7ù*ý�í(þ%îM�uì(ìè�·céd����ïFò_��ðcë>Z����)����ê�í(ðV�cë|ï���ì �f<�ÿ�Z/ë�Fë|ïcî`��ì ��ðV�����.� ì(ì(ë'�uê���ì �(è ¹+FË©Ë+Ë0Ì�äVC§Þ�æ|È©à§Þ Å C§ÓÜÓ�ÚPä�Þ:á ÞYC�â ǧæ�ÒÔæIC�ÞYE`D�C�Û|Õ�ÒÔÞßÚI+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚoè�öP÷ Q ö0R)S�ö Ä ö3(è�ü��uì�í��uïgÿ8öP÷§÷ � ùú ø � ûPL ù_c/ô��&îM�uì(ìè ü�ù�é©í �����þ����uì �yü(ù k7ù�ý�í(þ%îM�uì(ìèM·)e?ì(ðcí4&�ë|ïV�4��ðFë'�"L*ë���Fí(ïcë,a�ë�§î�ëPì(��������ô§ì¡��ì��Z ë��cë|ïFî`��ì ��ð������.�/ì(ì(ë'�uê���ì �b\�ï)�uî�ë�òÎô§ïFõ�è ¹f+FË©Ë+Ë Ì�äVC§Þ�æ|È/à§Þ Å C§ÓÜÓÜÚoä�Þ7á ÞYC�â ǧæ�ÒÔæ`C§ÞYE�D�C�Û|Õ�ÒÔÞßÚ+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚoè 9 5 Q ø(R)S � ÷5 Ä ø5 9 èp�/í �§í(ðV�iöP÷§÷§ø%ùú ø§øRû:ü(ùdciùlc?ô§ê�ên�uì �ù�á�E(C�BßÓÜÒ&à�Þ·Ò&ÞSÁXC�Ó;×%äVC§â�C§ÞYEHá�ä�Ó;Ò �+ÛPÒ�C§âK³�ǧæ�ÓÜÚoåçæcèGe?ì � ��ù*ô���kf����þ ���(�uìSé©ïcë|ðcðPèK�/ì(ì� ï�<�ô§ïPè�öP÷ � 8%ùú ø§÷RûP��ùlc?ô�ô'��ë|ïoèK��ùdü§ë'�uì46�ý]��&4����ð��Fë§èGµiùdü�n�uì �(èdédù ü�ù@\�ê ÿ�ì(ìèdcÂù*ý�í(ì%õ§ë�èKZ�ùl� ô§ê�� �§ô��Fèd�çù*ý�ôoò�ÿ�ë|ïoèdZ�ù�G��§ë|ï��PèK��ùl\l� ������< <ßô§ì#�uì ��� ùl\l��ðcþ(ë|ïoè�·�� ì��K�=&�ë|ï���î�ëPì(���uê_�Îô§î`& �uï���ðcô§ì7ô����_�uì �§ë:*�îM���§ëa�ë�§î�ë|ì���������ô§ì"� ê��§ô§ï�� �Fþ(î�ðPè ¹�+FË©Ë+Ë Ì�äVC§Þ�æ|È Å C§ÓÜÓ�Úoä�Þ·á ÞYC§â ǧæcÒ&æ�C§ÞYE,D�C�Û|Õ�Ò&ÞßÚf+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚoèöPø Q7� R)S [ � T�6i[§ø§÷%è�ü§í(ê ÿ!öP÷§÷[%ùú ÷5Rû Z�ù édùbc/í=���Fë|ì(ê�ô=�cþ(ë|ïoè%��ù ��ùf��ên�uì �(ë|ïcîM�uìº�uì �º!-ù ü(ùf�?í �cõ�ê���� �§ë§ù���ô§î`&��uï���ì ��*�îM���§ëPðWe?ð���ì ��cþ%ë�c��uí(ð��(ô§ïV¤ÀZ���ð����uì �|ë§ù�+FË©Ë+Ë Ì�äVC�Þ�æ�Èçà§Þ Å C§ÓÜÓ�Úoä�Þ�á ÞYC§â ǧæ�ÒÔæ�C§ÞYE�D�C�Û|Õ�ÒÔÞßÚ�+�Þ�Ó�ÚoâÔâ Ò ã�ÚPÞßÛ�Úö'8 Q ÷(R)S ø85 Ä ø[T%èdöP÷§÷T%ùú ÷%ö�û k7ùG*7�cþ ��ì(ô,�uì4�"cÂù�óG���§í ��þ4�Üù;� ë|ì(ë|ï)�uê����|ë�"kf��ì%õ§ôoò?ðcõ���kHë��Fï����|ð>�&ô§ï`kf� �%ë��\�ë'���cí%ïcë�67L+ÿ=&ßë�Z����)�� ì��uê ÿ�ð���ðPù�+gË+Ë©Ë0Ì�ä�C§Þ�æ|È@³�ǧæ�Ó�ÚPåçæFÍdD�C§Þ%Í;C§ÞYE�-dÇ�»cÚPä�ÞßÚoÓÜÒ&Ûoæcè 9 3 S [§÷§ø�6 � 5§ø%èöP÷§÷�3(ùú ÷ 9 ûP*�ü���ñ/ñN  ÷%ö§ù Å ägàoÛRÈ+à�/ Ó&Õ%ÚI+�Þ�Ó�ÚPä�ÞYC�Ó;Ò;à§ÞYC§â É à§ÒÔÞ�ÓX-�à�Þ0/�ÚoägÚPÞßÛ�Úçà§Þ!ÁÂÚo×�äVC�â�ÁÂÚoÓ�H+à§ä�j§æcèöP÷§÷%ö§ùú ÷TRûP*�ü���ñ/ñN  ÷ 9 ù Å ägàoÛRÈ+à�/ Ó&Õ%ÚI+�Þ�Ó�ÚPä�ÞYC�Ó;Ò;à§ÞYC§â É à§ÒÔÞ�ÓX-�à�Þ0/�ÚoägÚPÞßÛ�Úçà§Þ!ÁÂÚo×�äVC�â�ÁÂÚoÓ�H+à§ä�j§æcèöP÷§÷ 9 ùú ÷�3uû k7ùp�iùp*�ðFîM����êd�uì ��k7ù@a�ù@�X�uî�ëPêÜùmkHí(ê ����� ��î�ë|ì(ð���ô§ì��uêdZ����)�:��ê�í(ð��Fë|ï���ì �:e_����ê����'��ì4�:c�ÿ4<(ï�����a�ë'�uï���þa��Fï)���Fë'���ë|ðPù Å C§ÓÜÓ�ÚPä�ÞfO�Ú�Û�àcã�Þ�ÒÔÓÜÒ&à§Þ�è 99 S � 8�6�ø§÷%è�öP÷§ø§÷%ùú ÷8RûP��ù��çùuü(����ì>�uì4�.� ù(� ù�Z í <ßë|ðoù�á â ã�à§ä�Ò&ÓÔÕ%å�æp/|à§äI-dâ ×%æcÓ�Úoä�ÒÔÞ�ã�ÐNC§Ó7C§è§é©ïcë|ì(�����|ë;c��uê�êÜè��+ì �§ê�ë�òÎô�ô��`��ê�� ¤�ðoèöP÷§ø§ø%ùú ÷[RûP��ù �çùdü(����ì��uì �,\Îù^\Y�uïcïFô§õ�þ%ì �n�%è�·)e/ì(ðFí &ßëPïV�4��ðFë�,L*ë��=�Fí(ïcë:a�ë�§î�ë|ì���������ô§ì�e/ð���ì ������<ßô§ï.\l��ê �cë|ïFðoè ¹Å C§ÓÜÓ�ÚPä�Þ:O�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§Þ 9 3 Q ö 9 R)Á�ö§ö'[ � Ä ö§öPø[%è�öP÷§÷%ö§ùú ÷ � ûP��ù �çù�ü�����ì��uì ��a�ùÎý�þ�����������þ��uïh�Fë|ë§èP·�L*ë����ba�ë�§î�ë|ì(�)������ô§ìeí(ð���ì4������<ßô§ï:\l��ê �cë|ïFðM�&ô§ïM� í4�Fô§îM�������Z ô��Pí%î�ëPì(�?é+ïFô=�|ë|ðcð���ì �(è ¹PD�C�Û|Õ�ÒÔÞßÚb£*Ò&æ�Ò&à§Þ�C�ÞYE�á;B(Bßâ Ò&Û)C§ÓÜÒ&à�Þ�æ]84S�ö'[§÷ Ä öPø�3(è*öP÷§÷ 9 ùú ÷§øRûP��ù �çùü(����ì��uì4�5édù ü(ùp\dê ÿ�ì(ì Q ë�(ðoù R�è ÌÕ�ägÚ�Ú�ÐÂÒÔå�ÚPÞ�æ�Ò&à�ÞYC§â�½_»;Ù|Ú�ÛoÓ]O�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§Þ�³�ǧæ�Ó�ÚPåçæ�èp�+ê�ðcë��=��ë|ïoèöP÷§÷T%ùú ÷§÷RûP��ùp�çù�ü(����ì��uì �5ü�ùpkb�uô(ùñ/ë|í(ï)�uê©ñ/ë���òÎô§ïFõ�ðN�uì �8éd�����Fë|ïcì��?ë�|ô�§ì � ����ô§ìù^*�ì5ü�ùpk7ùpÂ�í(ï������%èl� ù�ü(ùkb�uïcõ�ðoè��uì �`��ù�ü(ù���ô< ��ì(ðFô§ìè�ë'�4� �cô§ïFðoè^-�à§å�Bß×%Ó7C§ÓÜÒ&à§ÞYC§âY+�Þ�Ó�ÚoâÔâ Ò ã�ÚPÞßÛ�Ú�UK+�å�Ò&ÓJC�Ó;Ò&Þ�ãiÆ�Ò /|ÚPè& &ù�öP÷�3�69 ö 9 è�*7�G�K�·é©ïcë|ðcðPè%éK��ð��'�����Pò;�|ÿ�è�ñÂù�ü(ùèöP÷§÷�3(ùú ö'55Rû ��ùd�çù©ü(����ì��uì �Zé�ù�ü(ùd\dê ÿ%ì(ì�ùK*�îM���§ë:a�ë�§î�ë|ì���������ô§ì"e?ð���ì ����ê�í(ð��Fë|ï���ì �(ùl*�ìXñÂùl� þ�í������uì ���çùý�ôoò�ÿ�ë|ïoè�ë� � �Fô§ïcðPè�á�E§Ý�C§ÞßÛ�ÚPæÂÒ&Þ +�å>Coã�Ú�Ã*ÞYE�Úoä�æ�Ó7C§ÞYE§ÒÔÞ�ã=U?ámÖ�Úoæ�Ó;æ�Û|Õ�ä�Ò /�Óg/�à§ä á ØPä�Ò&ÚoâmOÎà§æ�ÚoÞ0/�Úoâ E�è& &ù [8�6�øT%è�*7�G�K����ô§î`&(í=�cë|ï�a�ô��'��ë���ÿ:é+ïFëPðFðoè�öP÷§÷[%ùú ö'5%ö�û ��ù��çù(ü(����ìb�uì �Hü(ùYkb�uô(ù � ï���� o���n�uê�ñ?ë|í(ï)�uê*ñ?ë���òÎô§ïcõ�ð0SK�ÀL*í=�cô§ï��n�uêÜùg+FË©Ë+Ë�-�à§å�Bß×%ÓÜÚoä�è 9 ÷4S T%ö�6733(èkb�uï���þqöP÷§÷[%ùú ö'5 9 û ��ù �çùPü(����ìèRñiù �çù'�_���cþ����uì �ra�ù'?^�uõ�ðcþ(îM�uì��uì�è�·�$�<=�Fë���dZ ë��cë������ô§ì�í(ð���ì ������<ßô§ï^\d��ê �Fë|ïcðPè ¹ Å C�Ó;Ó�Úoä�ÞO�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§Þ�è �Fô`��& &ßë'�uï���ìqöP÷§÷ � ù

Page 66: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

�4� � �I¨n©�¨pª�t4|n}Y«d¬�¨�­�¨�¬bx�{�ui®Pt�}�¯,°p¨ ª�¨K±mw ®�}�}

ú ö'5TRû�ñiù;� ù�ü�����ì�è��iù�*�ì �%ï)�Pÿ��uì�è��uì �%?+ù;� ù;� ô�ë|êÜù;kHô§ì��Fë��]�uïcê�ô,�Îô§î`& �uï���ðcô§ìXô��.a=� �#c���ë|ï��uï���þ ���'�uê��ê�í(ð��Fë|ï���ì �.kHë�Fþ(ô��(ð ô§ì:���uì4�(ô§î�Z������%ù Å C�Ó;Ó�Úoä�ÞfO�ÚcÛ�à�ã§Þ�Ò&Ó;Ò;à§Þ�è�öP÷4S ÷8�6�÷§÷%èöP÷§ø[%ùú ö'5�3uû:�Âù(ü�����ì�è�� ù��X�uð��Fí(ï��@�uì �!ý ù ��ù�a=��þ�í(ì ��õßèpD�C�Û|Õ�ÒÔÞßÚb£*Ò&æ�Ò&à§Þ�èYkf�0� ï)�|ò_67c���ê�êÜèßöP÷§÷8%ùú ö'58Rû:�Âù�iù�ü(�uï��=��ðG�uì4�>�/ù�iù§éd���cï�����õßù=�Îê�í%ð��FëPï���ì �Xe?ð���ì �I�Xa���î`��ên�uï�� ��ÿNkHë��cþ%ô=��ý]�uðFë��ô§ìMa�þ��uïFë'��ñ/ë'�uïñ/ë���§þ�<�ô§ïFðoù�+FË©Ë+Ë0Ì�äVC�Þ�æ�È_-�à§å�Bß×%Ó�ÚPä�æ�è 99 S�ö'5 9 8�6�ö'5T�3(è*öP÷ � T%ùú ö'5[Rû�ü�ù 67k7ù�ü§ô§ê���ô§ìè�é�ù=kHë|ë|ïoè=�uì �Pa�ù�ý]�����uô§í ��þ(ë§ù���ô<(í(ðV�_��ê�í(ð��Fë|ï���ì � ò_� �Fþ`��& &(ê����'������ô§ì(ð���ìP��ô§î`&(í4�Fë|ïÊ ��ð���ô§ìù�+gË+Ë©Ë0Ì�ä�C§Þ�æ|È Å C§ÓÜÓ�ÚPä�Þ�á�ÞYC§â ǧæ�Ò&æIC§ÞYE>D�C�Û|Õ�ÒÔÞßÚI+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚÂö'T Q ø(R)S � ÷%ö Ä ø5 9 è©öP÷§÷%ö§ùú ö'5 � û:Z�ù�ü�ô§ì%ëPðN�uì ��k7ù ��ù�ý�ë|ê �Fï)�uî�ô(ùpa�ô§ê �=��ì ��éd�uïV��� ����ô§ì ��ì �aé+ïFô<(ê�ë|î�ð�!"� �Fþ��§ë|ì(ë������`�/ê��§ô§ï�� �Fþ(î�ðoùY*�ìÅ ägàPÛuÈ+à�/�Ó&Õ%ÚÂÖ�à�×�ä�Ó&ÕM+�Þ�Ó�È;-�à�Þ0/|Èdà�Þ�1�ÚPÞßÚoÓÜÒ&Û á â ã�à§ä�Ò&Ó&Õ�å�æ�è�33 9 6733�÷%è*öP÷§÷%ö§ùú ö'5§øRû:Z�ù(ü§í �4�è(édù kf�'����ì(ê�ë�ÿP�uì �P��ù �çù%ü(����ìù ?@�uï��§ë�6Va=�'�uê�ë�éd�uï)�uê�ê�ë|êmZ������`��ê�í(ð��Fë|ï���ì �(ù Å ägàPÛuÈKÄ(ŧÓ&ÕM+�Þ�Ó�È-�à�Þ0/|È Å C§ÓÜÓ�Úoä�Þ:OÎÚ�Û�àcã�Þ�ÒÔÓÜÒ&à�Þ�è 3�ø§ø�673�÷T%è*öP÷§÷[%ùú ö'5§÷Rû�ý ù����ì �(ù�a(�cë&46J!%��ðcë���ê�í(ð��Fë|ï���ì � é+ïcô��|ë�(í(ïcë|ðPù É à§×%ä�ÞYC§â�à�/?Ó&Õ%Ú?á å�ÚPä�Ò;Û)C§Þ`³�Ó7C§ÓÜÒÔæ�ÓÜÒ&Û)C§â�áÂæ�æ�àPÛoÒhC§ÓÜÒ&à�Þ�è[§÷4S ø[�6�ö'5%ö§è�öP÷[ � ùú ö§ö'5Rûf��ùKZ�ùK����ïFõ=&����Fï����cõ�è_� ë|ên���V�aü§ïoù�è]�uì4�%k7ù�édù Ê ë���þ �Üù�$�&4����î`���'������ô§ì�<�ÿ#a���îçí(ên���Fë�#�/ì(ì(ë'�uê���ì �(ù³�ÛoÒ&ÚoÞßÛ�ÚPè 99 54S [ � ö�6i[§ø5%èöP÷§øT%ùú ö§ö§ö�û:�Âùd!-ùG��ê�ë��ì"�uì4�"� ù]� ùGZ í <ßë|ðoùG�K�=&�ë|ï���î�ëPì(�Fð`��ì·é©ïcô��gë�����ô§ì%�uì ����ê�í(ðV�cë|ï���ì ��<�ÿ%a=��îçí%ên���cë�� ì(ì%ë0�uê���ì4�(ù Å C§ÓÜÓ�ÚPä�Þ:O�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§Þ�è 99 S 9 ö'T�6 99 5%è*öP÷§ø§÷%ùú ö§ö 9 û:Z�ù �?ù���ì�í4�cþ�ùÎÌÕ(Ú�á ä�Ó�à�/`-�à�å�Bß×%Ó�ÚPä Å ägà�ã§ä�C§å�åçÒÔÞ�ã�èg��� �4��ð���ô§ì46J!8ë|ðcê�ë�ÿ�è���ë'��� ��ì �(è�öP÷ � T%ùú ö§ö'TRûP!-ùK?+ù���ù]��ô�ô§ì����§è�é�ùGk7ù�ñ��uïcë|ì �(ï��%è;�uì �%�çùG\�í%õ�í(ì ���(�%ù]� ý�ï)�uì �cþ"�uì ��ý�ô§í(ì �"��ê�í(ð��Fë|ï���ì ��uê��§ô§ï�� �Fþ(îHù +FË©Ë+Ë0Ì�äVC�Þ�æ�È_-�à§å�Bß×%Ó�ÚPä�æ�è 9 T4S ÷5§ø�6�÷%ö3(è*öP÷ � 8%ùú ö§ö3uû LÂù=��ô§þ(ô§ì%ëPì�ùg³�Úoâ /�ϽÎä;ã�C§Þ�Ò Ø0C§ÓÜÒ&à�ÞfC�ÞYE�á æ�æ�àPÛoÒhC�Ó;Ò&ÝRÚXD8ÚPå�à§ä�ǧè a=&(ï���ì4�§ëPïV6 Ê ëPïFên���(è�ñ/ë�ò�ó©ô§ïcõßè�öP÷§ø�3(ùú ö§ö'8Rû:k7ùY��ï)���� �i��ë|ê��èßü(ùgkb�uô(èg�uì �b��ùg�çù�ü�����ì�ùY�mñ/ô§ì=67?@��ì(ë'�uï é©ïcô��gë������ô§ìbkHë��Fþ(ô��qý]�uðcë�!ô§ì���ô§þ(ô�6ì(ë|ìp  ð_L*ô&�ô§ê�ô�uÿaé©ïcë|ðcë|ï��=��ì �`kb��&%ðoùY+gË+Ë©Ë0Ì�ä�C§Þ�æ|È@ÆÂÚP×%äVC§âmÆÂÚPÓJH+à§ä�juæ�èY[4S 8�3�ø�6i88§÷%è�öP÷§÷8%ùú ö§ö'[Rû:�ÂùG��ï���ðFþ(ì���&(í(ï��uîHè]cÂùG\�ï����§í �Üè;�uì �"$�ù�ñ��uðcï��uô§í �Üù�\�í ���ÿ%�uì �Xé+ïcô< ��< ��ê���ð������ba�þ%ëPê�ê���ê�í(ð��Fë|ï���ì �� ê��§ô§ï�� �cþ(î�ð��uì ��L?þ%ë'��ï���& &(ê����'������ô§ì��FôHý�ô§í%ì ���uïFÿ�Z/ë�Fë������ô§ì��uì ��a�í(ï������|ë>��&4&(ïcô'�4��îM������ô§ìù+FË©Ë+Ë0Ì�äVC§Þ�æÇ�Ö×�ØcØ'È.³gȧæ�Ó�ÚPåçæ�è T4S 9 ÷�6i[5%è�öP÷§÷8%ùú ö§ö � û LÂù ��í(ï�� ���%ù �/ì:�dÉ`���ëPì(�_����§ê�ô§î�ë|ï)����� ��ëN��ê�í(ð��Fë|ï���ì �.� ê��§ô§ï�� �Fþ(î�e/ð���ì �>�>c?ë'��&ùgÊ_C§ÓÜÓÜÚoä�ÞfO�Ú�Ûcà�ãËÞ�Ò&Ó;Ò;à§Þ�è 9 3 S 9 58�6 9 5§÷%è�öP÷§÷%ö§ùú ö§öPøRûbÌ_-W-dâ C�æcæ�Ò �+Û�C�Ó;Ò;à§Þ#½Î×%ÓÜâ Ò&ÞßÚPè ?@��<(ï��uïFÿ�ô��G��ô§ì �§ïFëPðFðoè=!��uðFþ ��ì ���Fô§ìègZ�ù � ù�è�öP÷§÷5%ùú ö§öP÷Rû:k7ù�?�ë<ßôoò_� ����ù(�d�4&ßë|ï���î�ë|ì(�cðl!%� �cþ>*�ì4�PïFë|î�ëPì(���uêY��ô§ì �|ë'&=��\�ô§ïcîM������ô§ìù=D�C�Û�Õ�Ò&ÞßÚ_ÌÚ)C§ä�Þ�ÒÔÞ�ã�è 9 S�ö'5T�6ö'T§ø%è�öP÷§ø � ùú ö 9 5Rû:c���ì ��6ÜóG�uì�?�ë|ë �uì4�,c?ò�ëPë�67?ëPì4��$ ì �(ù@Í���ðFí��uê����'������ô§ì5ðcí &4&�ô§ïV�I�;ô§ïI�������Hî`��ì ��ì �(ù@+�ÎKÎGÎ�ÎK´B�Úoä�ÓÜèö§ö Q 8(R)S [§÷0Ï � 8%èp$����cô<ßë|ïiöP÷§÷[%ùú ö 9 ö�û:�Âù=� ù�L ù(?�ë|ë�è%ü(ù=�Âù=a�ên���§ê�ë§è4�uì � � ù(LÂù=kHô§ì �(ù�L*ôPò;�uï��(ðG� í4�Fô§îM�������_� í4� � ����ì4��ô��p�?ë�|ô§ï��%ðoù4+�ÎKÎGÎÐ�ä�C§Þ�æÇ@³�à�/�ÓJHKC§ägÚIÎ�Þ�ã§Ò&ÞßÚ�ÚPä�Ò&Þ�ã§è 3 S 33(ö�6733�ø%è*öP÷ � ø%ùú ö 99 û:�Âù�� ù�L ùG?ëPë§ù_��ê�í(ðV�cë|ïM� ì �uê ÿ%ð���ðM�uì �"*J�FðM��& &(ê����'������ô§ì(ðoùG*�ì�ü(ù�L ùGL*ô§íè�ë� � �cô§ïPè/á�E§Ý�C§ÞßÛ�ÚPæ!Ò&Þ+�Þ0/�à§ä�å>C§ÓÜÒ&à§Þ�³gȧæ�ÓÜÚoåçæ_³�ÛoÒ&ÚoÞßÛ�ÚPè(é+ê�ë|ì�í(î0é©ïcë|ðcðPè(ñ?ë�òeó+ô§ïFõ�è�öP÷§ø%ö§ù

� ù@?@�G�uì �,��ù�ý���ðFò;�uðPùlFiÞßàH�â Ú�ERã�Ú0Ë�»�C§æ�Ú)Eb³�ÛoÒ&ÚoÞ�ÓÜÒ �+Û.ÑÂÒÔæ�Û�à§ÝuÚPä�È!Ò&Þ�1�Úcà�â à�ã§Ò;Û�C�âGÑIC�ÓJC=»�C�æ�ÚoæÇ*é+ïFô=�§ù\l��ïcð���*�ì��FêÜùg��ô§ì4�gù(ô§ìf��ì%ôoò?ê�ë� �§ëIZ���ð��|ô'��ëPïgÿP�uì �fZ����)�>kf��ì4��ì �(è�kHô§ì(�cïFë'�uêÜèY�]�uì������%è�&4&ù 9 5�3�69 5§÷%è�� í4�(ù 9 5�6 9 ö§è�öP÷§÷8%ùú ö 9 TRûfa�ù óçùp?�í��uì ���çù aßù^\�íùl�Òa�ë|ì��Fë|ì �|ë6��cô�6�ðFë|ì��Fë|ì �|ë��Îê�í%ð��FëPï���ì �!é+ïFô=�|ë�(í(ïFë`�;ô§ïiéd�����Fë|ïcì�� ì �uê ÿ%ð���ðoù+�ÎKÎGÎÒÐ�äVC§Þ�æÇ©à§Þf³gȧæ�Ó�ÚPåçæ�ÓdD�C§Þ�C�ÞYE�-lÈ�»cÚoä�ÞßÚPÓÜÒ&Ûoæ�a4k��G6�ø4S T§ø%ö)Ï=T§ø§÷%è�öP÷ � ø%ùú ö 9 3uû ��ù=?�í(ì �(ë|ïV��ô§ê��è �iù k7ù=\�ë|ì(ðV�)����è�?+ù=�+ïcðFên�uì � �uì � L ù=Ll���=�Pèd·�ý�ï�����ìPL;��ðFðcí(ë_Í+ô§ê�í(î�ë|ð��&ïcô§î�kHí(ê ��� 6ð�&ßë���cï��uêKTZ�kb�;*�Ï��A��ô§î`&��uï������ ��ë.a��Fí �%ÿ!ô��K\�ô§í(ïI��ên�uðcð�� o�ë|ïcðPè ¹:ÊÎägàoÛ�Çd³�àoÛPÒ;ÚPÓJÈHà�/ID�Coã�ÞßÚPÓÜÒ&ÛO�ÚPæ�à§ÞYC�ÞßÛcÚ Q �;ô§í(ïV�cþ:î�ë|ë����ì ��R�è�ñ?ë|òeó©ô§ïcõßè &�ùYTT%èöP÷§÷[%ùú ö 9 8Rûaó+ô�ë|ê�ê�ë�a�ù�kb��uïcë|õX�uì4�N*�ðFï)�uë|ê4ÂdùRý�ëPìra�þ �uí(êÜù��/í4�Fô§îM�������'�uê�ê ÿ ô§ï��(�uì �����ì ��<ßô�ô§õ�îM�uïFõ�ðp&�ë|ï^�|ô§ì(�cë|ì(�cðPù*�ì!Ö+Ò /�Ó&ÕM+�Þ�Ó�Úoä�ÞYC§ÓÜÒ&à§ÞYC�â/ÑHà§ä�â E7Ñ�Ò�E�ÚqÑHÚ�»P-�à§Þ0/|ÚPäFÚPÞßÛ�Úoè(éK�uï���ðoè=\�ï)�uì �|ë§èYkb�|ÿ8öP÷§÷[%ùú ö 9 [Rû�ü�ù@kf�0² í(ë|ëPì�ùla�ô§î�ë`kHë��Fþ(ô��(ðN�&ô§ïr��ên�uðcð�� o �0������ô§ì��uì ���/ì��uê ÿ%ð���ðÂô��_kHí(ê ��� ���uï��n���FëM$�<(ðFëPïV�������ô§ì(ðoùÖ+Ò /�Ó&ÕP¶/Úoä�j�ÚPâ Ú'Èr³gȧå�B�à§æ�Ò&×�å à�ÞfD�C§Ó&Õ%ÚPå>C§ÓÜÒ&Û)C§âm³�Ó7C§ÓÜÒÔæ�ÓÜÒ&ÛoæXC§ÞYE`ÊÎägà=»�C=»|Ò&â Ò&Ó�ȧè�öS 9 ø%ö�6 9 ÷ � è�öP÷[ � ùú ö 9(� û�ü�ùmkb�uô �uì ����ù �çù�ü(����ìùmL*ë��=�Fí(ïcë>��ên�uðcð�� o �0������ô§ì��uì ��a�ë�§î�ëPì(��������ô§ì�e/ð���ì �PkHí(ê ����ïFë|ðcô§ê�í4����ô§ì�a=� 6îçí(ê ���uì(ë|ô§í(ð_� í4�Fô§ïcë�§ïFëPðFð�� ��ëIkHô��(ë|ê�ðoù�Ê_C§ÓÜÓ�ÚPä�Þ:O�Ú�Û�àcã�Þ�ÒÔÓÜÒ&à§Þ 9 8 QJ9 R)S�ö � T0ÏßöPø§ø%è©öP÷§÷ 9 ùú ö 9 øRû�ü�ù4kb�uô>�uì4�:��ù4�çù%ü�����ì�ù � ïV��� o �'�n�uê�ñ/ë|í(ï��uê�ñ?ë��ò�ô§ïcõ�ð;�&ô§ï;\�ë'���cí(ïFëX�K���cï���������ô§ì:�uì �fkHí(ê ��� ��uï��n���cëZ������çé+ïFô��Fë������ô§ìùg+VÎGÎGÎÒÐ�äVC§Þ�æÇ^Æ Úo×�ä�C§âmÆ ÚoÓJH©à§ä�j§æ�è�[4S 9 ÷[�6iT%ö � è�öP÷§÷8%ù

Page 67: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

s_t(u)t v;w x(y�u)z={J|n}(~p�]���lz0�4| z0� � �4Ô

ú ö 9 ÷Rû�ü�ù�kb�uô`�uì �f�iùY�çùßü(����ìù��Õa�ë|ê �h6i$ ï��(�uì �����ì ��ñ?ë���òÎô§ïcõM�;ô§ï�c?ÿ=&ßë|ïcë|ê�ê���&(ðcô��� �uê^��ê�í(ð��Fë|ï���ì � Q c_�]�;R�ù+�ÎKÎGÎÒÐ�äVC§Þ�æÇ^Æ Úo×%äVC§âmÆ ÚoÓJH©à§ä�j§æ�è � S�ö'[�6 9 ÷%èöP÷§÷[%ùú ö'T5Rû ��ùßü(ùYkHë��=��ì(ðoù��"ý�ï)�uì �cþb�uì �!ý�ô§í(ì4�b*�ì �|ïcë|î�ë|ì����uêd��ô§ì �|ë'&=�cí��uêG��ê�í(ð��Fë|ïcë|ïoùgD�C�Û|Õ�Ò&ÞßÚrÌÚ)C§ä�Þ�ÒÔÞ�ã�èöPø4S 8�6 99 èöP÷§÷8%ùú ö'T%ö�û:�Âùlkf���cþ��uê�ðcõ��ÜèK�Âùl�?ùKa��cë& &�è]�uì ���?ùdZ������Pÿ�ùl�Ò�?ë�|ë|ì��`���4��uì4�Pë ��ì�Z������b� ì��uê ÿ�ð���ð'SP��ê�í(ð��Fë|ï�6��ì ��$�<4�gë��Fð>��ì(�cô���ên�uðcðFë|ð`��þ��uï)�����Fë|ï����|ë�#<�ÿ#��ô§ì��gí(ì ����� ��ëb��ô§ì �|ë&4�cðPùG*�ì�?©ùd�X�uì��uê_�uì ����ù�?ô§ðFë|ì4�;ë|ê��è%ë� � �cô§ïFðoè�Ê�ägà�ã§ägÚoæ�æÂÒÔÞfÊ;C§ÓÜÓ�Úoä�Þ:OÎÚ�Û�àcã�Þ�ÒÔÓÜÒ&à�Þ�è4Í+ô§êÜù�ö§è�ñ/ô§ïV�cþ=6ic/ô§ê�ên�uì ��è � î�ðV�cë|ï����uîHèöP÷§ø%ö§ùú ö'T 9 û:�Âù@a�ù^kf���cþ��uê�ðcõ����uì ��� ù@�/ù^a��Fë'&4&ù^� í=�cô§îM���Fë����ô§ì(ð��Fïcí4�����ô§ì7ô�����ên�uðFð�� o��'������ô§ì(ð0S.��ô§ì �|ë&4�cí �uê��ê�í(ð��Fë|ï���ì ��Í+ë|ïFðcí(ð�ñ?í(î�ë|ï����'�uê;Ll���%ô§ì(ô§îiÿ�ù;+VÎGÎGÎÖÐ�ä�C§Þ�æÇ�Ê_C§ÓÜÓÜÚoä�ÞZá ÞYC§â ȧæcÒ&æbC§ÞYE�D�C�Û|Õ�ÒÔÞßÚ+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚoè484S T§÷[�673(5§÷%è*öP÷§øT%ùú ö'TTRûfa�ùd�çùdkf��ðcþ(ï��f�uì �,Í�ù^Íçùd�_���§þ��'���uìùG�/ì��+î`& ��ï����'�uê]a��Fí �%ÿzô��_�Fþ(ë�édë|ï��&ô§ïcîM�uì �|ë�ô���c/ë|í(ï���ðV�����kHë��cþ(ô��(ð;�;ô§ï_��ê�í(ðV�cë|ï���ì �(ù *�ìP�/ù�a�ù�� ë|ê�ðFëPîM�r�uì �:?©ù(ñÂù��X�uì��uêÜè%ë'�4� �cô§ïFðoèYÊ;C§ÓÜÓ�Úoä�Þ:OÎÚ�Û�àcã�Þ�ÒÔÓÜÒ&à�ÞÒ&Þ ÊÎäVC�ÛPÓÜÒ&Û�Úoè�&4&ù 3 9 8�673(T[%è*öP÷§÷�3(ùú ö'T�3uû LÂù kf� ���cþ(ë|ê�êÜùgD�C�Û|Õ�ÒÔÞßÚIÌÚ)C§ä�Þ�ÒÔÞ�ã�ù !%�Îý;q�kf�0� ï)�|ò_67c���ê�êÜè�öP÷§÷ � ùú ö'T8Rû:�çù�k7ù�kHô§þ ��í �4� ��ìN�uì �çü(ù�kb�uô(ù��#��ô§î`&��uï������ ��ë�a��Fí �%ÿiô��YZ�� ¤�ë|ïcë|ì(�d��ên�uðcð�� o(ëPïFð@�;ô§ï@c��uì �46J&(ï���ì(�cë���þ��uï)�����FëPï��?ë�|ô�§ì � ����ô§ìùg*�ìb�/ùgaßùg� ë|ê�ðcë|îM�`�uì �f?+ù�ñiùY�X�uì��uêÜèßë� � �Fô§ïcðPèmÊ_C§ÓÜÓ�ÚPä�Þ�OÎÚ�Û�àcã�Þ�ÒÔÓÜÒ&à�ÞÒ&Þ ÊÎäVC�ÛPÓÜÒ&Û�Úoè�3(T � 6J33�ø%è�öP÷§÷�3(ùú ö'T[Rû�ý ùY�çùYkHô�ô§ïoù����lLböN�uì �!éd���V�cë|ïFì��Îê�í%ð��FëPï���ì �(ù�*�ì�ÊÎäFàPÛ�ÇKÄ��(×(×,-�à§Þ�ÞßÚ�ÛoÓÜÒ&à§Þ�Ò&æcÓ]³�×�åçåçÚoäX³�Û|Õ%àoà§â è& &ù�ö � 3�6�öPø8%ègkHô§ï��(�uì467�X�uí4�;îM�uì�è�öP÷§ø§ø%ùú ö'T � û \�ùkHí(ï������§þù(��ðFí(ï���ë�ÿ�ô��@��ë�|ëPì(�����4��uì4�Pë|ð]��ì.c���ë|ï)�uï���þ ���'�uêg��ê�í(ð��Fë|ï���ì �X�/ê��§ô§ï�� �Fþ(î�ð^!�þ ���cþMe/ðcë��ê�í(ð��Fë|ï_�|ë|ì(�cë|ïcðPù;ÐÕ(ÚP-�à�å�Bß×%Ó�ÚPärØ�à§×%ä�ÞYC§â è 9 [4S T8�3�6iT8§÷%èöP÷§ø�3(ùú ö'T§øRû:k7ù�ñiù kHí(ï���ÿ �uì �b��ùY��ï���ðFþ(ì��%ù �Õ��ô§î`&(í4��������ô§ì �uê�ê ÿ �dÉ`���ë|ì���L*ë��þ(ì ����í(ëI�;ô§ï_Z������M��ê�í(ð��Fë|ï���ì �(ùÊ_C§ÓÜÓ�ÚPä�Þ:O�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§Þ�è*ö 9 S�ö'8T�6�ö'8§ø%è�öP÷§ø5%ùú ö'T§÷Rû:k7ù�ñiù�kHí(ï���ÿ �uì �b�iù��çùßü(����ìùg��ì(ôPò?ê�ë'�4�§ë6�ý]�uðcë����ê�í(ð��Fë|ï���ì �Pa���þ(ë|î�ë��;ô§ï���ô§ê�ê�ë�����ô§ìbkb�uì����§ë�6î�ë|ì��_�uì �:�?ë��Fï���ë���uêô��K?p��<(ï)�uïgÿaý�ô�ô§õ�ðoù�Ê_C§ÓÜÓ�ÚPä�ÞbOÎÚ�Û�àcã�Þ�ÒÔÓÜÒ&à�Þ�è 9 ø4S ÷�3�÷�6�÷[�3(è*öP÷§÷8%ùú ö3(5Rûf��ù�ñ����uÿ�ùga(�)���FëÂô��d�Fþ(ëX�/ï��;��ì�éd���V�cë|ïFìb�?ë�|ô�§ì � ����ô§ìùgÊÎäFàPÛ�Ç@+�ÎKÎGÎ�è�8[4S øT[�6�ø[ 9 è*öP÷[§ø%ùú ö3(ö�û:�Âù�ñ_�M�uì �8ü�ùgc��uìùg�KÉ`���ë|ì(�X�uì �që�¤�ë'����� ��ë.�|ê�í(ðV�cë|ï���ì4�aî�ë��Fþ(ô��f�;ô§ï/ð�&������n�uêl�����)��î`��ì ��ì �(ùYÊ�ägàoÛ�ÇÄ(���'¦:+�Þ�ÓiÇ;-�à�Þ0/Ç�£�Úoä�È.ÌpC§ä;ã�ÚNÑIC�ÓJC`¶�C§æ�ÚPæ�è & &�ù�ö33�Ïßö'88%èma4�uì(���n���§ô(èm��þ ��ê�ë§èYa�ë'&=�cë|î.<ßë|ïÂöP÷§÷�3(ùú ö3 9 û:ciù ciù�ñ_�§í%ÿ�ë|ì#�uì �Zé�ùG��ô§þ(ë|ìùG����< <(ðM�_�uì �(ô§îÖ\l��ë|ê��(ðoèK\�í ���ÿ#��ê�í(ð��Fë|ï���ì �(è��uì ���cþ(ë:e/ì(ðFí &ßë|ï�6�4��ðFë�.a�ë'�§î�ë|ì(�)������ô§ìçô�� L*ë���Fí(ïcë�N*�îM���§ëPðPùm-�£G1K+VÊ�Ud1ÎäVC�B(Õ�Ò;Û)C§â4D8à'E�Úoâ æ]C§ÞYE�+�å>Coã�Ú�Ê�ägàPÛ�Úoæ�æcÒ&Þ�ã88 Q ö0R)S�ö)ÏßöP÷%è*öP÷§÷T%ùú ö3(TRû:�çù�?+ù_$ ë|þ(ê�ë|ï:�uì ��� ù;k7ù;� ï��Pÿ�ù���ô§î.< ��ì ��ì4��*�îM���§ë���ô§î`&(ïcë|ðcð���ô§ì"�uì4�¡��ên�uðcð�� o �0������ô§ì�e?ð���ì �Í+ë���Fô§ïI² í��uì(�����'������ô§ìùl+VÎGÎKθÐ�äVC§Þ�æÇlÊ_C§ÓÜÓÜÚoä�Þqá ÞYC§â ȧæcÒ&ærC§ÞYEPD�C�Û|Õ�ÒÔÞßÚ.+�Þ�Ó�ÚPâ&â Ò�ã�ÚoÞßÛ�ÚPè*ö � S 3([%ö)Ï3 � T%è�öP÷§÷8%ùú ö33uû �/ùY$G���%ù��Õa=��î`&(ê�� o�ë�:ñ/ë|í(ïFô§ìfkHô��(ë|ê^�uð��çé©ï���ì ���&��uê^�Îô§î`&ßô§ì(ë|ì(�_� ì��uê ÿ=�|ëPïPù^Ø%à§×�ä�ÞYC�â�à�/�D�C�ÓÔÕ4ËÚoå.C�Ó;Ò;Û)C§âm¶?Ò&à§â àcã(ȧè�ö'84S 9 [ � 6 9(� T%è*öP÷§ø 9 ùú ö3(8Rû:�çù=$��0�|ò;�%ù���a��Fï)����� o��'������ô§ì��uê@$���ë|ïFên��& & ��ì �r��ê�í(ð��Fë|ï;a=��þ%ëPî�ë§ù=Ê;C�Ó;Ó�Úoä�ÞMO�Ú�Û�àcã�Þ�ÒÔÓÜÒ&à§Þ�è�öPø4S 9(� ÷�6 9 ø[%èöP÷§ø8%ùú ö3([Rû�ý ù^�X�uî`�(�uï�6ÜéK�uïFð��Üèü(ù^��ù^� í��uê ����ë|ï��Üè�ü�ùp��ù@Z ë���uì(ë�ÿ�è��uì4�,�çù^�X�uî`�(�uïV6�éd�uïcð��Üù@��ê�í(ðV�cë|ï���ì �:!%� �cþñ/ë|í(ï��uê�ñ/ë���òÎô§ïFõ�ðPùm¶?Ò&à�â à�ã§Ò;Û�C�â]-lÈ�»cÚPä�ÞßÚoÓÜÒ&Ûoæcè [T4S 9 5%ö�6 9 5§ø%è*öP÷§÷5%ùú ö3 � û�ñiù��Âùoéd�uêÜè�ü(ù� ùRý�ë'��(ë|õßè=�uì �r�?ù� ù 6i�çù0L�ð)�uô(ù�� ë|ì(ë|ï)�uê����|ë�`��ê�í(ð��Fë|ï���ì � ñ/ë���òÎô§ïFõ�ðK�uì �r��ô§þ(ô§ì(ë|ìp  ða�ë|ê �h6i$ ï��(�uì �����ì �>a=��þ(ë|î�ë§ùY+VÎGÎKÎÒÐßäVC§Þ�æÇ@ÆÂÚo×�äVC�âpÆ ÚoÓJH©à§ä�j§æ�è43 S 8�3�÷�6i88 � è�öP÷§÷T%ùú ö3�øRû�ü�ùm� ù^² í4��ì(ên�uìùmZ ë���ð���ô§ì�L*ïcë|ë|ðI�uì ��Z ë�'��ð���ô§ì�kb�uõ=��ì4�(ù^+VÎGÎKκÐ�äVC�Þ�æ�ÇG³gȧæcÓ�Úoå�æ�Ó;D�C§Þ�C§ÞYE�-lÈË»cÚoä�ÞßÚPÓÜÒ&Ûoæ�è 9 54S TT§÷�6iT�3([%è*öP÷§÷5%ùú ö3�÷RûPÍçù4Í�ù��_���§þ��'���uì��uì �f�çù�ý���ï���þ��uì4�ù��À��ê�í(ð��Fë|ï���ì �Ma(�cï����cë�uÿ!ý]�uðFë��ô§ìb�.\�ô§ïFîM�uê���ðcîbô��l�Fþ(ëN�?ë�6&(ïcô��(í ����� ��ë�é+ïFô=�|ë|ðcðG��ì:ñ����cí%ï)�uêma�ÿ�ð��FëPîHù�*�ì Ê�ägàPÛ�Çdà�/�ÓÔÕ(Ú�³�Ú�Û�à§ÞYEr+�Þ�ÓiÇG-�à�Þ0/Ç*à§ÞP+�Þ0/�à§ä�å>C§ÓÜÒ&à§Þ³�Ó�à§äVCRã�Ú>C§ÞYE`OÎÚoÓÜä�Ò&ÚoÝ�C§â è�& &�ùö'5�6 99 è�öP÷ � ÷%ùú ö'85RûPÍçù'Íçù�_���§þ����uìM�uì �>��ù�L ùRó©íù��%��ô§î`&��uï���ðFô§ì�ô����Fþ(ë�a�����< ��ê�� ��ÿ.��þ��uï)�����FëPï���ð������|ð©ô��ma�ô§î�ë]� ï)��&(þL�þ(ë|ô§ïcë���������ê�í(ð��Fë|ï���ì �NkHë��Fþ(ô=�%ðoù4+�ÎKÎGÎ2Ð�äVC�Þ�æ�ÇmÊ;C§ÓÜÓ�Úoä�Þ�á ÞYC§â ȧæ�ÒÔæ�C§ÞYErD�C�Û�Õ%ÒÔÞßÚ�+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚoèT4S T§÷T�673(5 9 è�öP÷§ø%ö§ùú ö'8%ö�û �/ù��_�uðcî�í(ðcðFë|ìù���ê�í(ðV�cë|ï���ì �>� ê��§ô§ï�� �cþ%î�ðoù=*�ì !Mù�ý ù�\�ï��uõ§ëPð��uì �:�Âù(ý]�uë'�'��6ÜóG���FëPðPèßë� � �cô§ïFðoè�+�Þ0/�à§ä�Ëå>C§ÓÜÒ&à§Þ.O�ÚoÓ;ä�Ò;ÚPÝ�C§â�UKÑNC§Ó7C�³�ÓÜä�×%ÛoÓÜ×�äFÚPæ�C§ÞYE á�â ã�à§ä�ÒÔÓ&Õ�åçæ�è&4&ù'3(öP÷0Ï�3 9 è�é+ïcë|ì(�����|ë]c��uê�êÜè��©ì �§ê�ë�òÎô�ô=���ê�� ¤�ðPè�öP÷§÷ 9 ù

Page 68: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

�4Ù � �I¨n©�¨pª�t4|n}Y«d¬�¨�­�¨�¬bx�{�ui®Pt�}�¯,°p¨ ª�¨K±mw ®�}�}

ú ö'8 9 û �/ù��;����þù�á ä�ÓÜÒ �+ÛPÒ�C§âg+�Þ�Ó�ÚPâ&â Ò�ã�ÚoÞßÛ�ÚPè kf�0� ï)�|ò;6ic���ê�êÜè%ñiù�óçù�è�öP÷§øT%ùú ö'8TRû�ý ù Z�ù �;��&(ê�ë�ÿ�ùg³�Ó7C§ÓÜÒÔæ�ÓÜÒ&Û)C§âg+�Þ0/|ÚPägÚoÞßÛ�Ú;/�à§ä�³�B4C§ÓÜÒhC§âmÊ�ägàoÛcÚoæ�æ�ÚPæ�ùm�]�uî.<(ï���� �§ë�e?ì � ��ë|ïcð�� ��ÿ:é©ïcë|ðcðPèöP÷§ø§ø%ùú ö'8�3uû:�çù@��ô§ðcë§èl�/ù^� í(ïcë�ò_� ����èd�uì4����ùl� ùp\�ô0��ù^Z ë��FëPïFî`��ì ��ð������>�/ì(ì(ë'�uê���ì �f��& &(ïcô(���cþ��Fô���ô§ì(ð��Fï)����ì(ë���ê�í(ð��Fë|ï���ì �(ù�+�ÎKÎGÎÒÐ�äVC�Þ�æ�Ç@Ê_C§ÓÜÓÜÚoä�Þ:á ÞYC§â ȧæ�ÒÔæIC§ÞYEMD�C�Û|Õ�ÒÔÞßÚI+�Þ�Ó�ÚoâÔâ Ò ã�ÚPÞßÛ�Úoè�ö'84S � ø8�6 � ÷�3(è*öP÷§÷T%ùú ö'88Rû ��ù���ô§ðcë|ì4�&ë|ê��:�uì4�f��ù � ù4�X�uõ�èmÑ Ò�ã§Ò&Ó7C§â�Ê�Ò&ÛoÓÜ×�äFÚ�Ê�ägàPÛ�Úoæ�æcÒ&Þ�ã QJ9 ì ��ë'��ù R�è����'���(ë|î`����é+ïFëPðFðoè�öP÷§ø 9 ùú ö'8[Rû ��ù��ô§ðcë|ì4�&ë|ê��è�k7ù �çùc?í��uì �I�uì �NÍçù ý ùa=��þ(ì(ë���(ë|ïPù(� ì.��& &(ê����'������ô§ì�ô��p�Îê�í%ð��FëPïKZ ë��Fë'������ô§ì>�côXL*ë�����uì ��éK�����cí(ïFë é+ïFô=�|ë|ðcð���ì �(ùY+VÎGÎKÎÒÐßäVC§Þ�æÇp+�Þ0/�à§ä�å>C§ÓÜÒ&à�Þ%ÐÕ%Ú�à§ä�È�ö'8 Q [(R)S [ ��9 Ï=[§ø%ö§èdöP÷[§÷%ùú ö'8 � ûf��ùü(ùpa�ùm��ô§ðcðoùp��ên�uðcð�� o��'������ô§ì�L*ë��þ(ì4����í(ë|ðX�&ô§ï�?^�uï��§ë>a�ë��cð ô���Z������%ùp*�ì���ù�ü(ùp��ô§ê�ë�è�ë� � �Fô§ïoè^Æ ×4Ëå�ÚPä�Ò;Û)C§â]ÐYC0´�à§Þßà§å.ȧè ���'���(ë|î`����é+ïFë|ðcðoè(ñiù�óçù�èöP÷[§ø%ùú ö'8§øRû �/ù�cÂù���í(ð�&4��ì �Üù4�-ñ/ë�ò���& &(ïFô(����þ:�FôM��ê�í(ð��Fë|ï���ì �(ù�+�Þ0/�à§ä�å`ÇGC§ÞYE�-©à§Þ�ÓÜägà§â è*ö'84S 99 67T 9 è�öP÷[§÷%ùú ö'8§÷Rûf��ùYa4�uê �Fô§ìùYZ ë���ë|ê�ô&(î�ë|ì(����ìP� í4�Fô§îM�������XL*ë�����?ë��Fï���ë���uêÜùg³�ÛoÒ&ÚoÞßÛ�ÚPè 9 8T4S ÷ � 3�Ï�÷§ø5%è*öP÷§÷%ö§ùú ö'[5Rû ��ùYa=�uîM�uê@�uì �:é�ù4*Üÿ�ëPì4�(�uïoùY� í=�cô§îM�������I�?ë�|ô�§ì � ����ô§ìb�uì �f�/ì��uê ÿ�ð���ð�ô��dc/í(îM�uìP\Y���|ë|ð��uì �f\Y����n�uê�K�=&(ïcë|ðFð���ô§ì(ð'SK�Àa�í%ï���ë�ÿ�ù�éd�����Fë|ïcìb��ë�Pô�§ì4� ����ô§ìè 9 84S [8�6 �� è�öP÷§÷ 9 ùú ö'[%ö�û�ü�ù=!-ùYa4�uî�î�ô§ìè%ü�ïPù4�-ñ/ô§ì%ê���ì(ë'�uï�kb��&4& ��ì �>�&ô§ï;Z����)�Ma(�cïFí ���cí(ïFëI� ì��uê ÿ�ð���ðPùY+VÎGÎGÎ�ÐßäVC§Þ�æÇ�-�à§å.ËBß×%Ó�ÚPä�æ�èöPø4S 3(5%ö�673(5§÷%è*öP÷[§÷%ùú ö'[ 9 û:�Âù�a4�uì �(�uêÜùgÊÎäFàcã�äVC§åçå�Ò&Þ�ãMÊ;C�äVC(E§Ò�ã§åçæÂÒÔÞbÌ@+�³ Ê�è kf�0� ï)�Pò;6ic_��ê�êÜè(ñ?ë�ò�ó+ô§ïFõ�èöP÷§÷%ö§ùú ö'[TRû�ý ù ü�ù a=��þ ����þ��Fë|ïoè�?©ù a�ù�Z���4��ð_�uì �P��ù4��ô§ðcë|ì4�&ëPê���ùYa�ô§î�ë��d�4&ßë|ï���î�ë|ì(�cð]��ìP*�îM���§ëIa�ë�§î�ë|ì(�)������ô§ì:<�ÿ��ê�í(ð��Fë|ï���ì ��ô��K?ô=�'�uê@\�ë'���Fí(ïcëXÍG�uê�í(ë|ðoùYÊ;C§ÓÜÓ�Úoä�ÞfOÎÚ�Û�àcã�Þ�ÒÔÓÜÒ;à§ÞHö§öS�öP÷0Ï 9 ø%è*öP÷ � ÷%ùú ö'[�3uû:ciù(édùYa���þ�ò�ë�&ë|êÜùmÆ ×�å�ÚPä�Ò;Û)C§â�½^BßÓÜÒÔåçÒ Ø0C§ÓÜÒ&à§Þ5à�/`-©à§å�B�×�Ó�Úoä�D8à'E�Úoâ æ�è�ü§ô§þ(ì !%��ê�ë�ÿ�è�ñiù%ó�ù�è�öP÷§ø%ö§ùú ö'[8Rûfa�ù4Âdù4a�ë|ê���î��uì �Pk7ù=�iù�*�ðcîM����êÜù���6ikHë'�uì(ðV67L+ÿ=&�ë_� ê��§ô§ï�� �cþ%î�ð0S^�¡� ë|ì(ë|ï��uê����Pë�:��ô§ì���ë|ï��§ë|ì �|ëXL�þ(ë�6ô§ïcë|î��uì � ��þ��uï)�����FëPï����'������ô§ì:ô��^?�ô��0�uêp$�&4����îM�uê�� ��ÿ�ù +VÎGÎKÎ�Ð�äVC§Þ�æÇgÊ_C§ÓÜÓ�ÚPä�Þ:á�ÞYC§â ȧæ�Ò&æ�C§ÞYE>D�C(ËÛ|Õ�ÒÔÞßÚX+�Þ�Ó�ÚoâÔâ Ò ã�ÚPÞßÛ�Úoè [4S ø%ö�6�ø � è�öP÷§ø�3(ùú ö'[[Rûfa�ù(Â*ù(a�ë|ê���îÀ�uì �`�çù0� ê 6Va�í%ê �)�uìù��"a���îçí(ên���Fë�r�/ì(ì(ë'�uê���ì ���/ê��§ô§ï�� �Fþ(îW�&ô§ï^�cþ%ë���ê�í(ðV�cë|ï���ì � é©ïcô<(ê�ë|îHùÊ_C§ÓÜÓ�ÚPä�Þ:O�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§Þ�è*ö'54S�ö'55T�6�ö'55§ø%è*öP÷§÷%ö§ùú ö'[ � û ��ù:a�ë|ìf�uì �fk7ùfa�ï�� ��uðV�)���%ùmOÎÚ�ã�ägÚPæ�æ�Ò&à�ÞHá ÞYC§â ȧæ�ÒÔæ�ùga=&%ï���ì �§ë|ï�6�Í+ë|ïcên���ié+í4<(ê����'������ô§ì(ðPè�öP÷§÷5%ùú ö'[§øRû *�ù a�ë�Fþ �m�uì �M��ù=�çù�ü(����ì Q ë�(ðPù RÎá�ä�Ó;Ò �+ÛPÒ�C§â ÆÂÚP×%äVC§âgÆÂÚPÓJH©à�ä�juæ�C§ÞYErÊ_C§ÓÜÓÜÚoä�ÞPOÎÚ�Û�àcã�Þ�ÒÔÓÜÒ&à�ÞgU.½Îâ E`C§ÞYEÆÂÚ'HÀ-�à§Þ�ÞßÚ�ÛoÓ;Ò;à§Þ�æ�è��©ê�ðcë��=��ëPïPèöP÷§÷%ö§ùú ö'[§÷Rû�ý ùga�þ(ë|õ��uïPègk7ù�ñÂùYkHí(ï���ÿ�èg�uì �b��ùY��ï���ðFþ(ì��%ù��À��ì(ôoò?ê�ë� �§ë�6�ý]�uðFë'����ê�í(ðV�cë|ï���ì �Ma=��þ%ëPî�ë§ùmÊ;C�Ó;Ó�Úoä�ÞO�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§Þ�ÌÚPÓÜÓ�Úoä�æcè 84S 9 8T�6 9 8§÷%è�öP÷§ø � ùú ö � 5Rû�ü�ù \ÎùXa=��ê ��ë|ïcîM�uìÀ�uì ��Z�ù ý ùX�Îô�ô&ßë|ïoùÂý]�|ÿ�ëPð��n�uìA��ê�í(ð��Fë|ï���ì �%�;ô§ï�e/ì(ðFí &ßë|ï��=��ðcë�Õ�©ð�����îM������ô§ì-ô��a�í(ïV�J���|ëM�uì ��L*ë���Fí(ïcëPkHô��(ë|ê�ðoùd+VÎGÎKÎÚÐ�ä�C§Þ�æÇGÊ_C§ÓÜÓ�ÚPä�Þ5á ÞYC�â ȧæ�ÒÔæMC�ÞYEbD�C�Û|Õ�ÒÔÞßÚ`+�Þ�Ó�ÚoâÔâ Ò ã�ÚPÞßÛ�Úö'5 Q 3�R)S 3�ø 9 Ï�3�÷8%èdöP÷§ø§ø%ùú ö � ö�û �K��uì4�§ëPê�ô§ð:a=��î�ô§í �4��ðoùG�?ë'�uê�� ��ÿ#��þ(ë��õ��;ô§ïM�������Sî`��ì ��ì �(ùG+VÎGÎKÎ�ÎG´�B%ÚPä�ÓÜèÂö§ö Q 8(R)S 9 [0Ï=TT%èN$����cô<ßë|ïöP÷§÷[%ùú ö ��9 û�ü�ù�Âù=a�ên���§ê�ë§è=� ù(?+ù���þ��uì4�(è4�uì4�Pa�ù(� ù�c/ë|ê�ê�ë|ïoù�����ê�í(ð��Fë|ï���ì �I�uì �>Z����)��67�?ë|ô§ï��(�uì4���'��ì4�r�/ê��§ô§ï�� �Fþ(îHù+�ÎKÎGÎÒÐ�äVC§Þ�æÇ^³gȧæ�ÓÜÚoåçæVÓKD�C§Þ�C§ÞYE�-lÈ�»cÚPä�ÞßÚoÓÜÒ&Ûoæcè 84S�ö 9 8�6�ö 9 ø%è*öP÷ � 8%ùú ö � TRû:é�ù ciù �iùYa�ì%ë0���Fþb�uì �:�Âù �Âù�a�ô§õ��uêÜùgÆ ×%åçÚoä�Ò&Û)C§â;ÐYC�´�à§Þßà�årȧè \�ïFëPë|îM�uìè�a4�uì:\�ï��uì ���ð��|ô(è�öP÷ � T%ùú ö � 3uû:ciù�a=&����Fþùp-dâ ×%æ�Ó�ÚPä�á ÞYC§â ȧæ�ÒÔæ�á â ã�à�ä�ÒÔÓ&Õ�åçæY/|à§äGÑNC§Ó7C�OÎÚ)E§×(ÛoÓ;Ò;à§ÞPC§ÞYEM-dâ C�æcæ�Ò �+Û�C�Ó;Ò;à§Þ�è�©ê�ê���ð@c/ô§ïgòÎô�ô=�é+í <%ê���ðcþ(ë|ïcðPè4�©ì �§ên�uì �èöP÷§ø5%ùú ö � 8Rû ��ùla�ô§ê�<�ë|ï��(èKL ù^Ll�����.�uì �,��ù �çù�ü(����ìùl�Òkb�uïFõ§ô0���_�uì �(ô§î�\l��ë|ê��,kHô��(ë|ê��;ô§ïr��ên�uðcð�� o��'������ô§ì7ô��kHí(ê ����ðcô§í(ï��Përa4���Fë|ê�ê�� �cëI*�îM���§ë|ïFÿ�ùg+VÎGÎKÎ�ÐßäVC§Þ�æÇ�1�Úcà�æ�ÛoÒ&ÚoÞßÛ�Ú`C§ÞYEPOÎÚoå�à§Ó�Úr³�ÚPÞ�æ�ÒÔÞ�ãNT�3 Q ö0R�S�ö'55�6ö§ö'T%èßü(�uì�í �uïFÿqöP÷§÷[%ùú ö � [Rû ��ù=a�ï�� ��uð����'���I�uì �Mk7ù�ñiù�kHí(ïV��ÿ�ù(�¡��ô§î`&��uï���ðFô§ì�ý�ë���òÎë|ë|ì:��ô§ì �|ë&4�Fí��uê^��ê�í(ðV�cë|ï���ì �I�uì �añ/í(î�ë|ïV6���'�uêpLl����ô§ì(ô§î�ÿ�ùgÊ;C�Ó;Ó�Úoä�Þ:OÎÚ�Û�àcã�Þ�ÒÔÓÜÒ;à§Þ�è 9 T4S ÷ � 8�6�÷§ø%ö§èöP÷§÷5%ùú ö �� û:ciù4a����uþ(êÜùY��ê�í(ðV�cë|ï]� ì �uê ÿ%ð���ðÎô��^?^�uï��§ë�Z����)�.a�ë��cðPù4*�ìM!MùY���uí(êm�uì � k7ù�a=�cþ����(ë|ïoè%ë'�4� �cô§ïFðoèd-�â C§æ�æ�Ò�Ë�+Û)C§ÓÜÒ&à�Þ�C§æIC�Ð�àPà§âdà�/�OÎÚoæ�Ú)C§ägÛ|Õ�èY& &�ù�3 9 T�673(T5%è��©ê�ðcë��4��ë|ïPè � î�ðV�cë|ï����uîHùßöP÷§ø[%ùú ö � øRû:�Âùl�?ù�a(�cë& &%�uì �#�ÂùGa�ùKkf����þ �uê�ðcõ��ÜùK�Îô§ì4�Pë&4�Fí��uê��Îê�í%ð��FëPï���ì �qô��Ia��Fïcí4��Fí(ïFë'�"$�<4�gë���cð'S:�¼� ô(�uê$ ï���ë|ì(�cë�:��& &(ïFô(����þù�á ä�ÓÜÒ �+ÛoÒhC§âg+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚoè 9 ø4S 3(T�6i[§÷%è�öP÷§ø[%ùú ö � ÷Rû:k7ù;a�í4�V�Fô§ìè�?+ù;a��)�uïFõ�è��uì �"�çù�ý�ôoò�ÿ�ë|ïoù]\�í%ì ������ô§ì46�ý]�uðcë�¡� ë|ì(ë|ï�������ë'�|ô�§ì � ����ô§ì��&ô§ï kHí%ê ����&(ê�ë$�<4�gë��`�]���cë�§ô§ï���ë|ðPùG*�ì��iùd�çù+ü(����ì��uì �zédù©ü(ùl\�ê ÿ�ì(ìè+ë� � �cô§ïFðoèrÐÕ%ägÚ�Ú'ËJÑÂÒ&åçÚoÞ�æ�Ò&à§ÞYC§âr½_»&ÙPÚ�ÛPÓO�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§Þ�³gȧæcÓ�Úoå�æ�è4�©ê�ðcë��=��ëPïPè�ñÂù%óçù�èöP÷§÷T%ùú öPø5Rû:k7ùRü(ùa�ÿ%î�ô§ì�ù��ê�í(ðV�cë|ï���ì4�X��ï�� �Fë|ï���ô§ìN�uì �rkHí(ê ��� 6�Í��uï��n���cë+ñ/ô§ïcîM�uê=kf� ���cí(ïFë§ù(¶?Ò&à§å�ÚoÓ;ä�Ò;ÛPæ�è �� S T8�673(T%èöP÷ �� ù

Page 69: Data Clustering: A Review - Catch-all siteusers.eecs.northwestern.edu/~yingliu/datamining_papers/...gGtS qwTk*wT|& 8wEx s=bed*fPgPh=iGjek*l gGh=s m;k*je qd;h:fLtEk*r jer;h:k~gPj xK

s_t(u)t v;w x(y�u)z={J|n}(~p�]���lz0�4| z0� � �4Û

ú öPø%ö�û �/ù_Ll�uì��uõ��%ù�L�þ(ë|ô§ïcë������0�uêr� ð�&�ë���Fð!ô��Ma�ÿ�ì������������zéd���V�cë|ïFìÕ��ë�Pô�§ì4� ����ô§ìù�Ê_C§ÓÜÓÜÚoä�ÞWOÎÚ�Û�àcã�Þ�ÒÔÓÜÒ&à�Þ�è9 ø4S�ö'58T�6�ö'5[%ö§è*öP÷§÷8%ùú öPø 9 û LÂù(Ll�����;�uì �M�iù(?�í(ì �(ë|ïV��ô§ê��ù kHí%ê ����ð�&�ë���Fï)�uêY� ì��uê ÿ�ð���ð©ô��p�Fþ(ë�ý�ï�����ì`e/ð���ì �Nkb���§ì(ë��������?ë|ðFô§ì��uì �|ë*�îM�����ì �(ùY+VÎGÎKÎÒÐ�ä�C§Þ�æÇ@D8Ú)E§Ò&Û)C§âg+�å.Coã�ÒÔÞ�ã�ö'T Q T(R�S 3 � 50Ï�3�ø%ö§è�öP÷§÷�3(ùú öPøTRû:Z�ù k7ù�L;� ���Fë|ï���ì ���Fô§ìèm��ù \Îù k7ùga�î`� �Fþèg�uì ��eÂù �/ùgkb�uõ§ô'��ù@³�Ó7C§ÓÜÒÔæ�ÓÜÒ&Û)C§â�á ÞYC�â ȧæ�ÒÔæçà�/ Ö+Ò&Þ�ÒÔÓ�ÚrDqÒ ´�Ó;×%ägÚÑÂÒÔæ�ÓÜä�Ò�»P×%Ó;Ò;à§Þ�æ�ù(ü�ô§þ%ì !%��ê�ë|ÿ ÜÕa�ô§ì(ðoè�ñ?óçè�öP÷§ø8%ùú öPø�3uûf��ù L ù L*ô§í(ðFð)����ì(�où L?þ%ëI�?ë|ên����� ��ë�ñ?ë���§þ=<ßô§ïcþ%ô�ô���� ï)��&%þ�ô��d�.\l��ì � �Fë é+ên�uì��uï�a�ë��PùgÊ_C§ÓÜÓÜÚoä�ÞfO�Ú�Ûcà�ãËÞ�Ò&Ó;Ò;à§Þ�èö 9 S 9 [%ö�6 9 [§ø%è�öP÷§ø5%ùú öPø8Rûf$�ù Z�ù(L*ï���ë|ï��uì4�P�iù �çù�ü(����ìù4� ô(�uê 6iZ���ïcë���Fë'�M�d��uê�í�������ô§ì�ô��*ý���ì��uï����0������ô§ìPkHë��cþ(ô��(ðPù�+VÎGÎKÎAÐ�äVC§Þ�æÇÊ_C§ÓÜÓ�ÚPä�Þ:á ÞYC�â ȧæ�ÒÔæIC�ÞYE`D�C�Û|Õ�ÒÔÞßÚI+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚÂö �=Q ö 9 R)S�ö§öP÷%ö)Ïßö 9 5%ö§è©öP÷§÷8%ùú öPø[Rû LÂù=e_��þ � ÿ��uîM�N�uì �Pk7ù=�/ï�< ��<�ù ��ô§ê�ô§ï]*�îM���§ë�a�ë�§î�ëPì(��������ô§ì e/ð���ì �>��ô§î`&ßë���� ��� ��ë�?ë0�uïFì ��ì �(ù +�ÎKÎGÎÐ�ä�C§Þ�æÇpÊ_C§ÓÜÓ�ÚPä�Þ:á ÞYC�â ȧæ�ÒÔæIC�ÞYE`D�C�Û|Õ�ÒÔÞßÚI+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚÂö'[ Q ö 9 R)S�ö§öP÷ � Ïßö 9 5[%è©öP÷§÷�3(ùú öPø � û:�ÂùPý ù0e/ï���í%þ��uï��Pù� ï���&(þXL�þ(ë|ô§ïcë������0�uê ��ê�í(ð��Fë|ï���ì �?ý]�uðcë�Âô§ìI?@��î`� �Fë'��ñ/ë���§þ=<ßô§ïFþ(ô�ô��.a�ë��cðPùÊ;C�Ó;Ó�Úoä�ÞO�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§Þ�è�ö'84S�ö � T�6�öPø � è*öP÷§ø 9 ùú öPø§øRû�ñiùoý ù0Í©ë|ì(õ����Fë|ðFò;�uïFê�í>�uì �iédùa�ù'Íçù�a�ù��çù��_���gíù'\Y�uð��l*Va $�Z;�dL^�"��ê�í(ðV�cë|ï���ì ���/ê��§ô§ï�� �Fþ(î�ðoù�Ê;C�Ó;Ó�Úoä�ÞO�Ú�Ûcà�ã§Þ�Ò&ÓÜÒ&à§Þ�è 9 84S TT8�6iT�3 9 è*öP÷§÷ 9 ùú öPø§÷RûPÍçù Íçù0Í���ì(ô��è�aßù=�Îþ �uí �(þ�í(ïFÿ�è�ü(ù(kHí(õ�þ(ë|ï��gë|ë��uì4�Ma�ù�� þ(ô§ðFë§ù(����ô§ì(ì(ë������ô§ì ��ð��G��& &(ïFô(����þ.�&ô§ï���ê�í(ðV6�cë|ï���ì �/ò_� �Fþr��& &(ê����'������ô§ì%ðd��ìN*�îM���§ë��/ì��uê ÿ%ð���ðoù�+�ÎKÎGÎÕÐ�äVC§Þ�æÇ ³gȧæcÓ�Úoå�æ�ÓpD�C§Þ4ÓdC§ÞYEM-lÈ�»cÚoä�ÞßÚPÓÜÒ;ÛPæ9 3 Q T(R)S T[80Ï=T§ø�3(èdöP÷§÷�3(ùú öP÷5Rû�ý�ëPì����uî`��ì�!Mù!��uþè§ë� � �Fô§ïoù�+�ÎKÎGΡÐßäVC§Þ�æ�C�ÛoÓ;Ò;à§Þ�æÎà§Þ.FiÞßàH�â Ú)Eoã�Ú_C§ÞYE�ÑNC§Ó7C_Î�Þ�ã§Ò&ÞßÚ�ÚPä�Ò&Þ�ã�UK³�B%Ú�ÛPÒ�C§â³�Ú�ÛoÓ;Ò;à§Þqà§ÞfDqÒ&Þ�ÒÔÞ�ãaà�/�ÑNC§Ó7C�»�C§æ�Úoæ�ù *7�G�G�"��ô§î`&(í4�Fë|ï�a�ô����ë���ÿ�è�Z ë�Pë|îr<�ë|ïÂöP÷§÷[%ùú öP÷%ö�û�ü�ùmcÂùg!��uï��è�ü§ïPùpc_��ë|ï)�uï��cþ ���'�uêG� ïFô§í & ��ì �M�Fôf$�&4����î`���|ë.�uì�$�<=�Fë����� ��ë.\�í(ì ������ô§ì�ùKØ�à§×%ä�ÞYC§â�à�/çÓ&Õ%Úá å�Úoä�Ò&Û)C§Þf³�Ó7C§ÓÜÒÔæ�ÓÜÒ&Û)C§â�áÂæ�æ�àoÛPÒ�C§ÓÜÒ&à§Þ�èY8§ø4S 9 T[�6 9 33(è*öP÷[T%ùú öP÷ 9 ûfa�ù^!����)�uì���<ßë§ù�Ê_C§ÓÜÓ�ÚPä�Þ�OÎÚ�Û�àcã�Þ�ÒÔÓÜÒ;à§ÞgUf� ×%å.C§Þ�C§ÞYE�D8ÚcÛ|Õ4C§Þ�Ò;Û)C§â èÎü§ô§þ(ì,!%��ê�ë|ÿ,ܼa�ô§ì(ðPè�ñÂù*óçù�èöP÷§ø8%ùú öP÷TRû�ü�ùd!8ë|ð��|õ��%ùG��a�í(ï���ë�ÿZô��XL�þ(ïFëPðFþ(ô§ê��"a�ë|ê�ë'������ô§ì%L*ë��þ%ì ����í%ëPðPù_Ê_C§ÓÜÓÜÚoä�Þ%OÎÚ�Û�àcã�Þ�ÒÔÓÜÒ;à§Þ � S 9 8§÷0Ï 9 [8%èöP÷ � ø%ùú öP÷�3uû:Z�ù(!�þ � �Fê�ë�ÿ�è�L ù a(�)�uïFõ�òÎë'���Fþ(ë|ïoèY�uì4�:Z�ù=\�í ��í��Pÿ�ù�a=��þ(ë�(í(ê���ì4��é+ïFô<(ê�ë|î��uì4� L*ï��'��ë|ê���ì �`a=�uê�ëPðFîM�uìpSL�þ(ëX� ë|ì(ë��������G�4�§ë���ë'�|ô§îr< ��ì�������ô§ì:$�&ßë|ï)���Fô§ïoù�*�ì Ê�ägàPÛ�Çdà�//Ó&Õ%ÚPÐÕ�ÒÔä�Er+�Þ�ÓiÇG-�à§Þ0/'Ç*à§Þ,1�ÚoÞßÚPÓÜÒ&Ûá â ã�à§ä�ÒÔÓ&Õ�åçæ�è & &ù�ö'TT�6�ö3(5%èöP÷§ø§÷%ùú öP÷8Rû:Z�ùY� ù !"��ê�ðFô§ìb�uì �bL ù � ùYkb�uï�����ì(ë�§ùY*�î`&(ïcô'��ë'�fc/ë��cë|ïFô�§ëPì%ëPô§í%ðIZ���ð����uì �|ër\�í%ì ������ô§ì(ðPùlØ%à§×%ä�ÞYC§â�à�/á ä�ÓÜÒ �+ÛPÒ�C§â�+�Þ�Ó�ÚPâ&â Ò�ã�ÚoÞßÛ�ÚXO�ÚPæ�Ú)C§ägÛ|Õ>[4S�ö)Ï=T�3(è*öP÷§÷ � ùú öP÷[RûfÂdù�!8í��uì ��� ùY?�ë'�uþ�ÿ�ùg� ì�$�&4����îM�uêl� ï���&(þbL�þ(ë|ô§ïcë������r��& &%ïcô(����þf�FôPZ����)�P��ê�í(ðV�cë|ï���ì4� S;L?þ%ëPô§ïgÿ�uì �>*J�Fð���&4&(ê����'������ô§ì.�FôI*�îM���§ë�a�ë�§î�ëPì(��������ô§ìù4+VÎGÎKÎ�Ð�äVC§Þ�æÇYÊ_C§ÓÜÓÜÚoä�Þ�á�ÞYC§â ȧæ�Ò&æ�C§ÞYEND�C�Û|Õ�ÒÔÞßÚ+�Þ�ÓÜÚoâÔâ Ò ã�ÚoÞßÛcÚÂö'8 Q ö§ö0R)S�ö§ö'5%ö)Ïßö§ö§ö'T%è©öP÷§÷T%ùú öP÷ � û:kb�uï���ê ÿ�ì�!8í(ê �&ëPõ�í(þ(ê�ë|ï`�uì4�,!"��ê�ê��n�uîKé+í(ì �cþùd\d��ì4� ��ì �!ð)�uê���ë|ì(�.�&ë'���cí(ïFë|ð.�;ô§ïN&ßë|ïcðcô§ì �uê�ò�ë'<�& ���§ë�'���cë�§ô§ï���ë|ðPù�*�ì�³�Ò ´�Ó&Õ`+�Þ�Ó�Úoä�ÞYC§ÓÜÒ&à§ÞYC§â?ÑHà�ä�â EzÑ�ÒhE�ÚHÑHÚ�»P-�à§Þ0/�ÚoägÚoÞßÛ�ÚPèYa4�uì(���M�Îên�uï��%è����iè ��&%ï���êöP÷§÷ � ùú öP÷§øRû ?+ù �iùYÂm���%ëPþ�ù�\�í ���ÿba�ë��Fðoùg+�Þ0/�à�ä�å.C§ÓÜÒ;à§Þ�C§ÞYE�-�à§Þ�ÓÜägà�â èßø4S TT§ø�6iT8T%è�öP÷[8%ùú öP÷§÷Rûf��ùKL ù;Âg�uþ(ìù_� ï���&(þ467L�þ(ë|ô§ïcë������'�uêXkHë��cþ(ô��(ðP�;ô§ïMZ ë��Fë�����ì �#�uì �"Z ë|ð��|ï���< ��ì4��� ë|ð����uê �:�Îê�í%ð��FëPïFðoù+�ÎKÎGÎÒÐ�äVC§Þ�æÇ_-�à§å�Bß×%ÓÜÚoä�æ�è 9 54S [§ø�6�ø[%è�öP÷ � ö§ùú 9 55Rû:�çù=Â�þ��uì �(ù=� ê��§ô§ï�� �cþ%î�ðK�&ô§ïK�Fþ(ëI��ô§ì(ð��Fï)����ì%ë'�M�K� � ����ì4�rZ���ð����uì �|ë ý�ë���òÎë|ëPì:$ ï��%ëPïFë��ên��<�ë|ê�ë�ML*ïcë|ë|ð�uì �f��ë|ên���cë�Hé©ïcô<(ê�ë|î�ðPù Ê;C§ÓÜÓ�Úoä�ÞfOÎÚ�Û�àcã�Þ�ÒÔÓÜÒ;à§Þ�è 9 ø4S 3([T�6J3 � 3(è*öP÷§÷8%ùú 9 5%ö�û�ü�ù(Â�þ��uì �I�uì4�`�Âù(a�ù(kf����þ��uê�ðFõ=�Üù�� ì.*�ì(�Fë'�§ï�������ô§ì�ô��p��í(ê�ë]*�ì �(í ������ô§ìM�uì �>�d�%ë|î`&(ên�uïV6�ý]�uðcë�.?ë0�uïFì46��ì �r�&ô§ï�� ï)���(ë����ô§ì �|ë&4�FðoùpD�C�Û�Õ%ÒÔÞßÚIÌÚ)C§ä�Þ�ÒÔÞ�ã�è 9 öS 9 T8�6 9 [ � è�öP÷§÷8%ùú 9 5 9 û LÂùmÂßþ��uì �(èp�Âùg�_�uîM�uõ�ï���ðcþ%ì��uìèg�uì ��k7ù�?@� ��ì�ÿ�ù�ý�*i�;�]cNSm�uìb�dÉ`���ëPì(�XZ����)� ��ê�í(ð��Fë|ï���ì �PkHë��cþ%ô=��;ô§ï^Í©ë|ïFÿN?^�uï��§ë;Z����)��<��uðFë|ðoù(*�ìçé©ïcô��§ù(öP÷§÷[����;k:6ia=*V��k�$�Z#*�ì(�Pù=�Îô§ì=�Fù�kb�uì����§ë|î�ëPì(�©ô��gZ����)�%è& &ù�ö'5T0Ïßö§ö3(ègkHô§ì��Fïcë'�uêÜèg�]�uì������%è�ü�í%ì(ë�öP÷§÷[%ùú 9 5TRû�ü�ù�Â�í & �uìù�-dâ ×�æ�Ó�Úoä�ÒÔÞ�ã:à�/�Ì@C§ä;ã�ÚIÑNC§Ó7C`³�ÚPÓÜæ�è �?ë|ðcë'�uï���þba��Fí � ��ë|ð/é+ïcë|ðFðoè%ñiù%ó�ù�èöP÷§ø 9 ùú 9 5�3uû ?ÿ4�|ô§ðPè(þ(����&pS qqoò�ò�òiù ê ÿ=�|ô§ðoù �|ô§îHùú 9 58Rû � ê ���NÍ���ðV�)�%è%þ��V��&pS qq��uê �)��4��ðV�)�%ù �4���� �)�uêÜù �|ô§îHùú 9 5[Rûf$�&�ë|ì L*ë���Pè�þ��V��&pS qq���ì �(ë���ù ô&�ë|ì(�cë����où ì%ë�Pù