nonlinear discriminant analysis

�L?*�?i@h _�tUh�4�?@?| @?@*)t�t

Krqjelq ]kdqj d/e/ Hulf Fodunvrq d dqg Kduulvrq K1 Eduuhww d/f

dGhsduwphqw ri Udglrorj|/ Xqlyhuvlw| ri Dul}rqd/ Wxfvrq D] ;8:57eHohfwulfdo dqg Frpsxwhu Hqjlqhhulqj/ Xqlyhuvlw| ri Dul}rqd/ Wxfvrq D] ;8:54

fRswlfdo Vflhqfhv Fhqwhu/ Xqlyhuvlw| ri Dul}rqd/ Wxfvrq D] ;8:54

DEVWUDFW

Zh ghvfuleh d qhz qrqolqhdu glvfulplqdqw dqdo|vlv phwkrg iru ihdwxuh h{wudfwlrq1 Wklv phwkrg dssolhv d qrqvlqjxoduwudqvirup wr wkh gdwd vxfk wkdw wkh wudqviruphg gdwd kdyh d Jdxvvldq glvwulexwlrq1 Wkhq d Ed|hv olnholkrrg udwlrlv fdofxodwhg iru wkh wudqviruphg gdwd1 Wkh qrqvlqjxodu wudqvirup pdnhv xvh ri zdyhohw wudqvirupv dqg klvwrjudppdwfklqj1 Zdyhohw wudqvirupv duh dq h�hfwlyh wrro lq dqdo|}lqj gdwd vwuxfwxuhv1 Klvwrjudp pdwfklqj lv dssolhg wrwkh zdyhohw frh!flhqwv dqg wkh ruglqdu| lpdjh sl{ho ydoxhv lq rughu wr fuhdwh d wudqviruphg lpdjh wkdw kdv wkhghvluhg Jdxvvldq vwdwlvwlfv1

Nh|zrugv= qrqolqhdu glvfulplqdqw dqdo|vlv/ zdyhohwv/ klvwrjudp pdwfklqj/ qrqvlqjxodu wudqvirup/ k|srwkhvlv whvwlqj

41 LQWURGXFWLRQ

Lq sdwwhuq uhfrjqlwlrq/ fodvvlfdo vwdwlvwlfldqv xvh wkh Ed|hv fodvvl�hu/ zklfk dvvljqv wkh lqsxw gdwd lqwr wkh fodvv zlwkwkh kljkhvw ydoxh ri wkh suredelolw| ghqvlw| ixqfwlrq +SGI,1 Iru d elqdu| sureohp/ wkh Ed|hv fodvvl�hu fdofxodwhv wkhudwlr ri wzr SGIv/ rqh xqghu hdfk fodvv/ fdoohg wkh olnholkrrg0udwlr1 Wkh Ed|hv fodvvl�hu lv dq rswlpdo fodvvl�hu lqwhupv ri wkh Ed|hv huuru dqg rwkhu phdvxuhv ri shuirupdqfh1 Krzhyhu/ zh qhhg wr hvwlpdwh wkh SGIv ri wkh fodvvhviru fdofxodwlqj wkh olnholkrrg udwlr1 Wkh wdvn ri hvwlpdwlqj d SGI iru kljk0glphqvlrqdo gdwd/ h1j1 lpdjhv/ lv gl!fxow1Wkhuhiruh/ rwkhu dowhuqdwlyh fodvvl�huv kdyh ehhq sursrvhg lq rughu wr vroyh wkh uhdo0zruog sureohp lq ihdvleoh zd|v1Lq frqwudvw wr wkh Ed|hv fodvvl�hu/ prvw ri wkh sursrvhg phwkrgv hvwlpdwh wkh glvfulplqdqw ixqfwlrq gluhfwo| e| �qlwhvdpsohv ri gdwd1 Wkhvh fodvvl�huv lqfoxgh Ilvkhu*v olqhdu glvfulplqdqw ixqfwlrq dqg vxssruw yhfwru pdfklqhv19

Ilvkhu*v olqhdu glvfulplqdqw pd{lpl}hv Ilvkhu fulwhulrq iru d fodvv vhsdudelolw|1 Wklv olqhdu fodvvl�hu lv hdv| wrlpsohphqw dqg urexvw djdlqvw qrlvh1 Krzhyhu/ iru prvw uhdo0zruog gdwd d olqhdu glvfulplqdqw lv qrw frpsoh{ hqrxjkwr vhsdudwh wkh wzr fodvvhv1 Uhfhqwo|/ vxssruw yhfwru pdfklqhv kdyh ehfrph pruh srsxodu1 Lq frqwudvw wr Ilvkhu*volqhdu glvfulplqdqw/ d vxssruw yhfwru pdfklqh gh�qhv d k|shusodqh lq d qrqolqhdu wudqviruphg ihdwxuh vsdfh1 Wkhk|shusodqh lq wkh qrqolqhdu wudqviruphg vsdfh +zklfk dozd|v kdv d kljkhu qxpehu ri glphqvlrqv wkdq wkh lqsxw gdwdvsdfh, pd| eh hqrxjk wr glvfulplqdwh wkh wzr fodvvhv1 Qhyhuwkhohvv/ wkh ghvljq ri wkh qrqolqhdu pdsslqj iurp wkhlqsxw gdwd vsdfh wr wkh wudqviruphg vsdfh lv vwloo dq rshq lvvxh1

Lq rughu wr ryhufrph wkhvh gl!fxowlhv/ zh ghvfuleh d qrqolqhdu glvfulplqdqw dqdo|vlv phwkrg zklfk lv ghvljqhg wrdssur{lpdwh wkh Ed|hv fodvvl�hu/ zlwkrxw hvwlpdwlqj wkh ixoo kljk0glphqvlrqdo ghqvlw| ri gdwd1 Wklv phwkrg ehjlqve| dsso|lqj d qrqvlqjxodu wudqvirup +d qrqolqhdu wudqvirup, wr wkh lqsxw gdwd lq rughu wr jhqhudwh qhz gdwd wkdwkdyh dq dssur{lpdwh Jdxvvldq glvwulexwlrq/ dqg wkhq fdofxodwhv wkh olnholkrrg0udwlr iru wkh wudqviruphg gdwd1 Lizh gh�qh wkh fodvv vhsdudelolw| lq whupv ri uhfhlyhu rshudwlqj fkdudfwhulvwlf +URF, fxuyh/ lw lv lqyduldqw xqghu dq|qrqvlqjxodu wudqvirup1 Wkh olnholkrrg0udwlr ri wkh wudqviruphg gdwd lv d txdgudwlf ixqfwlrq zklfk lv uhodwlyho| hdv|wr frpsxwh1

Zh zloo uhylhz Ilvkhu*v olqhdu glvfulplqdqw dqg vxssruw yhfwru pdfklqhv lq vhfwlrq 51 Zh zloo lqwurgxfh rxuqhz qrqolqhdu glvfulplqdqw dqdo|vlv lq vhfwlrq 61 Lq vhfwlrq 7/ zh zloo lqwurgxfh wkh qrqvlqjxodu wudqvirup/ zklfklwhudwlyho| dssolhv d glvfuhwh zdyhohw wudqvirup dqg dq lqyhuvh glvfuhwh zdyhohw wudqvirup iroorzhg e| klvwrjudppdwfklqj1 Lq vhfwlrq 8/ zh zloo suhvhqw vlpxodwlrq uhvxowv dorqj zlwk d glvfxvvlrq1

Ixuwkhu dxwkru lqirupdwlrq= +Vhqg fruuhvsrqghqfh wr K1],K1]1= H0pdlo= krqjelqChfh1dul}rqd1hgx

Medical Imaging 2001: Image Processing, Milan Sonka, Kenneth M. Hanson, Editors,Proceedings of SPIE Vol. 4322 (2001) © 2001 SPIE · 1605-7422/01/$15.00448

51 DOWHUQDWLYH FODVVLILHUV

Ilvkhu*v olqhdu glvfulplqdqw ghvfulehv d olqhdu wudqvirupdwlrq iurp d Q0glphqvlrqdo gdwd yhfwru { wr d vfdodu yduldeoh

�> wkdw lv/ lw gh�qhv d k|shusodqh lq wkh lqsxw gdwd vsdfh/ jlyhq e|

� @ zW{> +4,

zkhuh z lv wkh qrupdo yhfwru ri wkh k|shusodqh/ dqg { lv gudzq iurp rqh ri wkh wzr fodvvhv1 Wkh Ilvkhu fulwhulrqiru glvfulplqdwlqj wkhvh wzr fodvvhv lv gh�qhg e|

M +z, @zWVez

zWVzz> +5,

zkhuh

Ve @ +p5 �p4,+p5 �p4,W

Vz @

4

5+N4 .N5,

duh wkh ehwzhhq0fodvv vfdwwhu pdwul{ dqg wkh zlwklq0fodvv vfdwwhu pdwul{ uhvshfwlyho|/ dqg pl/ Nl duh wkh vdpsoh

phdq dqg vdpsoh fryduldqfh pdwul{ iru hdfk fodvv15/7 Ilvkhu*v glvfulplqdqw xvhv wkh yhfwru z wkdw pd{lpl}hv M +z,1

Wklv rswlpdo z lv dq hljhqyhfwru ri V�4zVe dqg/ vlqfh wkh udqn ri V

�4

zVe htxdov 4 iru wzr0fodvv sureohpv/ z lv

xqltxh dqg jlyhq e|

z @ V�4

z+p5 �p4,= +6,

Wkxv Ilvkhu*v olqhdu glvfulplqdqw lv jlyhq e|

� @ zW{ @+p5 �p4,

WV�4

z{= +7,

Rqh k|shusodqh fdq qrw vxffhvvixoo| glvfulplqdwh wkh wzr fodvvhv li wkh| duh qrw olqhduo| vhsdudeoh1 Wkhuhiruh/vxssruw yhfwru pdfklqhv +VYP, dsshdo wr Fryhu*v wkhruhp/6 zklfk vd|v wkdw d frpsoh{ sdwwhuq0fodvvl�fdwlrq sureohp

fdvw lq d kljk0glphqvlrqdo vsdfh yld d qrqolqhdu wudqvirupdwlrq ri wkh gdwd lv pruh olnho| wr eh olqhduo| vhsdudeoh

wkdq lq wkh ruljlqdo orzhu0glphqvlrqdo gdwd vsdfh1

Dvvxph wkdw zh kdyh d gdwd vhw G @ i+{l> |l,jo

l@4ri odehohg h{dpsohv/ zkhuh {l lv wkh Q0glphqvlrqdo wudlqlqj

vdpsoh dqg |l 5 i�4> 4j ghqrwhv wkh fodvv wr zklfk {l ehorqjv1 Lq frqwudvw wr Ilvkhu*v olqhdu glvfulplqdqw/ d VYP

fuhdwhv d k|shu0sodqh lq d qrqolqhdu wudqviruphg ihdwxuh vsdfh I jlyhq e|

� @zWj +{, > +8,

zkhuh j +{, @ ^j4 +{, > ===> jP +{,`W lv d yhfwru lq I / dqg P Q 1 Lq dgglwlrq/ d VYP grhv qrw fuhdwh wkh k|0

shusodqh fodvvl�hu lq I e| wkh Ilvkhu fulwhulrq1 Wkh edvlv ri wkh Vxssruw Yhfwru dojrulwkp olhv lq wkh Ydsqln0

Fkhuqryhqnlv ohduqlqj wkhru| dqg wkh vwuxfwxudo ulvn plqlpl}dwlrq sulqflsoh1 D pruh ghwdlohg ghvfulswlrq ri wkh

Ydsqln0Fkhuqryhqnlv ohduqlqj wkhru| dqg VYP fdq eh irxqg lq Vfkronrsi hw do118 Wkh vroxwlrq wr wklv sureohp lv d

olqhdu fodvvl�hu lq I lv jlyhq e|

� @

o[

l@4

�lj +{l,Wj +{, > +9,

zkhuh wkh �l duh vroxwlrqv ri wkh iroorzlqj txdgudwlf surjudpplqj +TS, sureohp=

pd{lpl}ho[

l@4

�l �

4

5

o[

l>m@4

�l�m|l|mj +{l,Wj +{m,

vxemhfw wr �l � 3> l @ 4> ===> o> dqg

o[

l@4

�l|l @ 3=

Dprqj wkhvh �l/ rqo| d ihz duh qrq}hur1 Wkh wudlqlqj vdpsohv {l zkrvh � frh!flhqwv duh qrq}hur duh fdoohg vxssruw

yhfwruv/ dqg wkh| olh rq wkh erxqgdu| k|shu0vxuidfhv udwkhu wkdq lq wkh lqwhulruv ri fodvvhv1 Wkh wudlqhg glvfulplqdqw

ixqfwlrqv ghshqg rq rqo| wkhvh vxssruw yhfwruv1

Proc. SPIE Vol. 4322 449

61 QRQOLQHDU GLVFULPLQDQW DQDO\VLV

Wkhuh duh dw ohdvw wzr sureohpv zlwk VYP lq rxu ylhz1 Wkh �uvw sureohp lv wkdw zh gr qrw nqrz zklfk qrqolqhdu

wudqvirup lv rswlpdo1 Wkh vhfrqg sureohp lv wkdw wkh qxpehu ri yduldeohv lq wkh TS sureohp lv odujh dv wkh qxpehu

ri wudlqlqj vdpsohv lqfuhdvhv1 Lq rughu wr ryhufrph wkhvh sureohpv/ zh jlyh d qhz qrqolqhdu glvfulplqdqw dqdo|vlv

phwkrg edvhg rq wkh Ed|hv fodvvl�hu1 Zh frqvlghu d elqdu| sureohp/ wkdw lv/ zh zdqw wr ghflgh li wkhuh lv d ohvlrq

lq wkh lpdjh1 Lq rqh fodvv/ lpdjhv duh dqdwrplfdo edfnjurxqgv zlwk dq dgglwlyh ohvlrq dqg lq wkh rwkhu fodvv/ lpdjhv

duh rqo| edfnjurxqgv1 Wkh ohvlrq lv prghohg dv d ghwhuplqlvwlf ixqfwlrq dqg nqrzq h{dfwo|1 Iru wklv elqdu| sureohp/

wkh rswlpdo Ed|hv fodvvl�hu fdofxodwhv wkh udwlr ri wzr suredelolw| ghqvlw| ixqfwlrqv ri gdwd=

� @su[+{� v,

su[+{,= +:,

Khuh wkh vljqdo yhfwru v lv wkh vljqdo iurp wkh ohvlrq lq wkh gdwd { dqg su[ lv wkh suredelolw| ghqvlw| ixqfwlrq ri wkh

edfnjurxqgv1 Vlqfh su[ lv xqnqrzq dqg gl!fxow wr hvwlpdwh/ zh zlvk wr �qg d qrqvlqjxodu wudqvirup vxfk wkdw wkh

qhz udqgrp yhfwru

| @ j+{, @ ^j4 +{4> ===> {Q , > ===> jQ +{4> ===> {Q ,`W

kdv d pxowlyduldwh Jdxvvldq ghqvlw|1 Wkhuhiruh/ wkh suredelolw| ghqvlw| ixqfwlrq ri { fdq eh h{suhvvhg dv

su[ +{, @ su\ +|,

��M�

|4> ===> |Q

{4> ===> {Q

�� +;,

@ su\ ^j+{,`

��M�

|4> ===> |Q

{4> ===> {Q

�� > +<,

zkhuh wkh Mdfreldq lv jlyhq e|

M

�|4> ===> |Q

{4> ==={Q

�@

��

C|4C{4

===

C|4C{Q

C|5C{4

===

C|5C{Q

=

C|QC{4

===

C|QC{Q

��

9@ 3= +43,

E| vxevwlwxwlqj Htx1+;, lqwr Htx1+:, dqg fdqfhoolqj rxw wkh Mdfreldq whup lq wkh ghqrplqdwru dqg wkh qxphudwruri Htx1+:,/ zh kdyh

� @su\ ^j+{� v,`

su\ ^j+{,`= +44,

Wkh orj0olnholkrrg lv

� @ orjsu\ ^j+{� v,`

su\ ^j+{,`= +45,

Li zh dvvxph | kdv d Jdxvvldq ghqvlw|/ wkhq wkh orj0olnholkrrg lv d txdgudwlf ixqfwlrq ri |= Lq whupv ri wkh ruljlqdogdwd yhfwru {/ wklv glvfulplqdqw lv jlyhq e|

� @ j+{,WN�4j+{,� j+{ � v,WN�4j+{ � v,> +46,

zkhuh N lv wkh fryduldqfh pdwul{ ri |1

71 QRQOLQHDU QRQVLQJXODU WUDQVIRUPDWLRQ

Qh{w/ zh zloo glvfxvv krz wr ghvljq wkh qrqvlqjxodu wudqvirup1 Lw lqfoxghv erwk olqhdu sduwv dqg qrqolqhdu sduwv>wkh olqhdu sduwv xvh wkh glvfuhwh zdyhohw wudqvirup +GZW, dqg wkh lqyhuvh glvfuhwh zdyhohw wudqvirup +LGZW,/ wkhqrqolqhdu sduwv xvh klvwrjudp pdwfklqj1 Erwk surfhgxuhv duh lqyhuwleoh wudqvirupv/ wkhuhiruh/ wkh| duh qrqvlqjxoduwudqvirupv1

Wkh zdyhohw wudqvirup lv dq h�hfwlyh zd| wr dqdo|}h gdwd vwuxfwxuh1 Iru h{dpsoh/ lqghshqghqw frpsrqhqw dqdo|vlv+LFD,/ zklfk rswlpl}hv kljkhu0rughu vwdwlvwlfdo phdvxuhv/ kdv ehhq xvhg wr frqvwuxfw rswlpdo edvhv iru lpdjhv1 Wkhvhrswlpdo edvhv duh vsdwldoo| rulhqwhg dqg kdyh vsdwldo iuhtxhqf| edqgzlgwkv ri urxjko| rqh rfwdyh/ zklfk duh vlploduwr wkh zdyhohw edvlv ixqfwlrqv1 E| xvlqj gl�huhqw zdyhohw edvlv ixqfwlrqv/ zh fdq urwdwh wkh frruglqdwhv lq wkh gdwd

Proc. SPIE Vol. 4322450

DWTHistogramMatching

IDWTHistogramMatching

x g(x)DWT

HistogramMatching

IDWTHistogramMatching

x g(x)

Iljxuh 41 Wkh qrqvlqjxodu wudqvirup lv dq lwhudwlyh surfhgxuh ri GZW dqg LGZW iroorzhg e| wkh klvwrjudppdwfklqj

g(-n)

h(n)

g(n)

h(-n) 2

2

2

2

cj+1

dj

cj

cj+1

g(-n)

h(n)

g(n)

h(-n) 2

2

2

2

cj+1

dj

cj

cj+1

Iljxuh 51 Wzr0edqg dqdo|vlv2v|qwkhvlv �owhu edqn

vsdfh/ dqg hvwlpdwh wkh pdujlqdo ghqvlw| rq hdfk frruglqdwh1 Wkh klvwrjudp pdwfklqj wudqvirupv wkh pdujlqdoghqvlw| rq hdfk frruglqdwh wr d Jdxvvldq ghqvlw| ixqfwlrq1 Wklv phwkrg lv vlplodu wr frpsxwhu wrprjudsk|/ zklfkuhfrqvwuxfwv wkh remhfw e| phdvxulqj wkh surmhfwhg {0ud| frxqwv rq hdfk surmhfwhg ylhz dqjoh1 Wkh remhfw fdq wkhqeh uhfrqvwuxfwhg e| wkh fhqwudo0volfh wkhruhp1 Lq rxu fdvh/ wkh remhfw lv d pxowlglphqvlrqdo suredelolw| ghqvlw|ixqfwlrq/ dqg wkh ylhz dqjohv fruuhvsrqg wr wkh gl�huhqw zdyhohw wudqvirupv1

Wklv dojrulwkp lv dovr vlplodu wr wkrvh xvhg iru wh{wxuh v|qwkhvlv e| s|udplg0edvhg whfkqltxhv zklfk vwduw zlwkdq lqsxw wh{wxuh lpdjh dqg d zklwh qrlvh lpdjh/ wkhq pdwfk wkh klvwrjudp ri erwk lpdjhv diwhu d vwhhudeoh s|udplgwudqvirup/ vhh Khhjhu dqg Ehujhq1; Exw Khhjhu hw do1 xvh d vwhhudeoh s|udplg wudqvirup zklfk lv qrq0ruwkrjrqdo

dqg ryhufrpsohwh/ vr wkh qxpehu ri sl{hov lq wkh s|udplg lv pxfk juhdwhu wkdq wkh qxpehu ri sl{hov lq wkh lqsxw

lpdjh1 Udwkhu wkdq v|qwkhvl}lqj wkh wh{wxuh iurp zklwh qrlvh/ zh duh prylqj lq wkh rssrvlwh gluhfwlrq/ wkdw lv/ zh

�jdxvvldql}h� wkh lqsxw lpdjh e| d qrqvlqjxodu wudqvirup1

7141 Glvfuhwh Zdyhohw Wudqvirup

714141 Rqh0Glphqvlrqdo GZW

Wkh zdyhohw h{sdqvlrq doorzv d pruh dffxudwh orfdo ghvfulswlrq ri gdwd fkdudfwhulvwlfv1 Wkh pdjqlwxghv ri wkh zdyhohwh{sdqvlrq frh!flhqwv gurs r� udslgo| zlwk vfdoh dqg wudqvodwlrqdo sdudphwhuv iru d odujh fodvv ri ixqfwlrqv14 Wkhiruzdug glvfuhwh zdyhohw wudqvirup +GZW, lv fdofxodwhg xvlqj Pdoodw*v dojrulwkp lpsohphqwhg e| d edqn ri orz0sdvvk+q, dqg kljk0sdvv j+q, dqdo|vlv �owhu edqnv iroorzhg e| d ghflpdwru1

fm +n, @[

p

k +p� 5n, fm.4 +p, +47,

gm +n, @[

p

j +p� 5n, fm.4 +p, +48,

Wkh uhfrqvwuxfwlrq surfhvv/ ru lqyhuvh glvfuhwh zdyhohw wudqvirup +LGZW,/ lv olnhzlvh frpsxwhg yld wkh v|qwkhvlv�owhuv/ k+�q, dqg j+�q, iroorzlqj xs0vdpsolqj1

fm.4 +n, @[

p

k +n � 5p, fm +p, .[

p

gm +p, j +n � 5p, +49,

Ilj1 5 looxvwudwhv wkhvh vwhsv lq zdyhohw wudqvirup dqg lqyhuvh zdyhohw wudqvirup1


Lq frqwudvw wr wkh Irxulhu wudqvirup/ wkh GZW kdv qr xqltxh edvlv ixqfwlrqv1 Dprqj wkhvh zdyhohwv/ Gdxehfklhv*v

zdyhohwv: duh ruwkrqrupdo zdyhohwv zlwk frpsdfw vxssruw zlwk wkh pd{lpxp qxpehu ri ydqlvklqj prphqwv1 Ehfdxvh

Gdxehfklhv*v zdyhohwv duh yhu| dv|pphwulf/ zh xvh wkh V|ppohw �owhuv ri Gdxehfklhv1

714151 Wzr0Glphqvlrqdo GZW

Wkh glvfuhwh zdyhohw wudqvirup fdq eh xvhg iru d wzr glphqvlrqdo vljqdo vxfk dv dq lpdjh1 D vhsdudeoh zdyhohw

ruwkrqrupdo edvlv lv frqvwuxfwhg zlwk surgxfwv ri vfdolqj ixqfwlrqv dqg zdyhohw ixqfwlrqv lq wkh wzr yduldeohv dqg

Pdoodw*v dojrulwkp fdq eh h{whqghg lq wzr glphqvlrqv e| lpsohphqwlqj wkh orzsdvv �owhu k+q, dqg wkh kljksdvv �owhu

j+q, lq urzv dqg froxpqv ri wkh lpdjh1 Dw hdfk vfdoh ohyho m/ wkhuh duh wkuhh �ghwdlov� lpdjhv ig4m > g5m > g

6mj/ zklfk duh

riwhq whuphg orz0kljk+OK,/ kljk0orz+KO,/dqg kljk0kljk+KK, uhvshfwlyho|1 Wkh OK vxeedqg lv iruphg e| orz0sdvv�owhulqj wkh urzv iroorzhg e| kljk0sdvv �owhulqj wkh froxpqv/ wkh KO vxeedqg lv iruphg e| kljk0sdvv �owhulqj wkhurzv iroorzhg e| orz0sdvv �owhulqj wkh froxpqv dqg wkh KK vxeedqg lv iruphg e| kljk0sdvv �owhulqj erwk wkh urzvdqg wkh froxpqv1 Wkhuh lv rqh �vprrwk� yhuvlrq ri wkh ruljlqdo lpdjh f4 iruphg e| vxffhvvlyh orz0sdvv �owhulqj erwk

wkh urzv dqg froxpqv1

7151 Klvwrjudp pdwfklqj

Klvwrjudp pdwfklqj wudqvirupv wkh pdujlqdo ghqvlw| ixqfwlrq wr d sduwlfxodu ghqvlw| ixqfwlrq1 Li wkh ghvluhg ghqvlw|

lv d Jdxvvldq ghqvlw| ixqfwlrq Q+3> 4,/ wkh klvwrjudp pdwfklqj pdsv { prqrwrqlfdoo| rqwr d qhz yduldeoh | e|

|@ hui lqy+fgi+{,,> +4:,

zkhuh fgi+{, lv wkh fxpxodqw glvwulexwlrq ixqfwlrq ri { dqg hu�qy+�, lv wkh lqyhuvh fxpxodqw glvwulexwlrq ixqfwlrq riJdxvvldq udqgrp yduldeohv1 Erwk fgi+�, dqg huilqy+�, duh prqrwrqlf ixqfwlrqv/ wkhuhiruh/ huilqy+fgi+�,, lq htxdwlrq+4:, lv dovr prqrwrqlf1 Lq rwkhu zrugv/ wkh rshudwlrq ri klvwrjudp pdwfklqj lv lqyhuwleoh1

Zh vwloo qhhg wr ghflgh wkh yduldqfh ri wkh qhz yduldeoh |1 Zh gr wklv e| ohwwlqj wkh hqwurs| K ri wkh qhz yduldeoh

eh wkh vdph dv wkdw ri {1 Wkhuh duh wzr phwkrgv iru hvwlpdwlqj K1 Wkh vlpsohu phwkrg lv edvhg rq dssur{lpdwlqj

wkh ghqvlw| ixqfwlrq xvlqj wkh sro|qrpldo h{sdqvlrqv ri Judp0Fkduolhu ru Hgjhzruwk/ zklfk dssur{lpdwhv K e|

vnhzqhvv dqg nxuwrvlv1 Dqrwkhu phwkrg e| K|ydulqhq43 lv edvhg rq dq dssur{lpdwh pd{lpxp hqwurs| surfhgxuh/

zklfk lv jlyhq e|

K +{, @4

5

�4 . orj

�5��5

{

��

�n4

�Hie{ h{s+�e{5@5,j�5 . n5

�Hime{mj �

s5@�

�5�> +4;,

zkhuh n4 @ 69@�;s6� <

�>n5 @ 4@ +5� 9@�,/ �5

{lv wkh yduldqfh ri {> dqg e{ lv wkh vwdqgdugl}hg {1 Wkh h{shfwdwlrq

ydoxhv lqvlgh wkh eudfnhw lq Htx1+4;, duh fdofxodwhg e| dyhudjlqj wkh vdpsohv ri e{1 Wklv dssur{lpdwlrq ri hqwurs| lv

pruh dffxudwh wkdq wkh dssur{lpdwlrq ghulyhg xvlqj wkh Judp0Fkduolhu h{sdqvlrq1 Zh zloo xvh K|ydulqhq*v phwkrg

lq rxu vlpxodwlrq h{dpsoh1 Ilqdoo|/ zh ohw wkh hqwurs| ri | htxdo wr K +{,/ dqg jhw wkh yduldqfh ri | e|

K +|, @4

5

�4. orj

�5��5

|

��= +4<,

81 H[DPSOH

Zh vlpxodwh dq hqvhpeoh ri edfnjurxqgv zklfk kdv d orj0qrupdo ghqvlw|1 Zh nqrz wkdw wkh Ed|hvldq lghdo revhuyhudssolhv d sl{ho0zlvh orjdulwkp ixqfwlrq wr jdxvvlql}h dq lqsxw lpdjh1 Ilj1 6 vkrzv wkh lqsxw lpdjh zlwk d orjqrupdo0ghqvlw| dqg wkh rxwsxw lpdjhv e| rxu qrqolqhdu wudqvirup phwkrg dqg wkh orj0ixqfwlrq1 Ilj1 7 vkrzv wkh sl{ho0zlvhixqfwlrq e| wkh deryh qrqolqhdu wudqvirup phwkrg dqg wkh orj0ixqfwlrq1 Zh vhh wkdw wkh qrqolqhdu wudqvirup lv forvhwr d orj0ixqfwlrq1

Zh dovr fdofxodwh wkh duhd xqghu wkh URF fxuyh iru dq lghdo Ed|hvldq revhuyhu/ rxu qrqolqhdu glvfulplqdqwdqdo|vlv dqg olqhdu glvfulplqdqw dqdo|vlv1 Wkh lghdo revhuyhu xvhv wkh qrqvlqjxodu wudqvirup j+{, @ orj+{,/ wkhqfdofxodwhv d whvw vwdwlvwlf e| Htx1+46,1 Rq wkh rwkhu kdqg/ j+{, lq wkh qrqolqhdu glvfulplqdqw dqdo|vlv pdnhv xvh rizdyhohw wudqvirupv dqg klvwrjudp pdwfklqj lwhudwlyho|1 Ilqdoo| j+{, @ { iru d olqhdu glvfulplqdqw ixqfwlrq1 Vlqfh


(a) (b) (c)(a) (b) (c)

Iljxuh 61 +d, lv wkh orj0qrupdo lpdjh> +e, lv wkh rxwsxw lpdjh iurp d qrqvlqjxodu wudqvirup> +f, lv wkh rxwsxwlpdjh iurp d orj ixqfwlrq

0 1000 2000 3000 4000 5000 6000-150

-100

-50

0

50

100

150

200

gray level x

g(x)

0 1000 2000 3000 4000 5000 60005

5.5

6

6.5

7

7.5

8

8.5

9

gray level x

log(

x)

(a) (b)

0 1000 2000 3000 4000 5000 6000-150

-100

-50

0

50

100

150

200

gray level x

g(x)

0 1000 2000 3000 4000 5000 60005

5.5

6

6.5

7

7.5

8

8.5

9

gray level x

log(

x)

(a) (b)

Iljxuh 71 +d, lv d sl{ho0zlvh ixqfwlrq iru wkh qrqvlqjxodu wudqvirup j +{, > +e, lv d orj ixqfwlrq1

wkh udqgrp edfnjurxqg lv d vwdwlrqdu| surfhvv lq wklv h{dpsoh/ wkh fryduldqfh pdwul{ fdq eh gldjrqdol}hg e| wkhIrxulhu wudqvirup/ zh fdofxodwh Htx1+46, lq wkh Irxulhu grpdlq e| xvlqj wkh IIW/ wkdw lv

� +{, @[

�

[

�

mIIW ^j+{,`m5�>� � mIIW ^j+{ � v,`m5�>�S +�> �,

> +53,

zkhuh S +�> �, lv d srzhu vshfwuxp ghqvlw| ri j+{,1 Wkh surfhgxuh xvhg wr hvwlpdwh d srzhu vshfwuxp ghqvlw| iurp

dq hqvhpeoh ri lpdjh lv wkh wzr glphqvlrqdo h{whqvlrq ri Zhofk*v phwkrg144 Zh hvwlpdwh wkh shuirupdqfh ri wkhderyh revhuyhuv xvlqj wkh duhd xqghu URF fxuyh +DXF,1 Zh fdofxodwh wkh DXF e|

DXF @4

Q5

Q[

l@4

Q[

m@4

vwhs +� +{4l,� � +{3m,, > +54,

zkhuh wkh gdwd yhfwruv {4l duh gudzq iurp wkh vljqdo0suhvhqw vhw dqg wkh {3m duh gudzq iurp wkh vljqdo0devhqw vhw1

Wkh shuirupdqfh ri rxu qrqolqhdu glvfulplqdqw dqdo|vlv lv forvh wr wkh shuirupdqfh ri wkh lghdo revhuyhu zkloh wkh

olqhdu glvfulplqdqw dqdo|vlv lv ehorz wkh ohyho ri wkh rwkhu wzr phwkrgv1

91 FRQFOXVLRQ

Wkh nh| wr wkh vxffhvv ri wklv phwkrg lv zkhwkhu zdyhohw wudqvirupv fdq h{soruh wkh vsdwldo vwuxfwxuh ri lpdjhv1

Wklv txhvwlrq fdq qhyhu eh dqvzhuhg zlwkrxw nqrzlqj wkh vwdwlvwlfv ri lpdjhv/ zklfk duh krzhyhu yhu| gl!fxow wr

nqrz1 Qhyhuwkhohvv/ wkh vxffhvv ri zdyhohw wudqvirupv lq lpdjh frglqj dqg wh{wxuh v|qwkhvl}h;< r�hu hqrxjk vxssruw

iru wklv dujxphqw1


9 10 11 12 13 14 15 16 170.56

0.58

0.6

0.62

0.64

0.66

0.68

0.7

0.72

0.74

correlation length (pixels)

arae

un

der

RO

C c

urv

e

Linear DF

Nonlinear DF

Ideal Observer

9 10 11 12 13 14 15 16 170.56

0.58

0.6

0.62

0.64

0.66

0.68

0.7

0.72

0.74

9 10 11 12 13 14 15 16 170.56

0.58

0.6

0.62

0.64

0.66

0.68

0.7

0.72

0.74

correlation length (pixels)

arae

un

der

RO

C c

urv

e

Linear DF

Nonlinear DF

Ideal Observer

Iljxuh 81 Wkh duhd xqghu URF fxuyh e| wkuhh gl�huhqw phwkrgv1

Djdlq/ wkh vxffhvv ri wklv qrqolqhdu glvfulplqdqw dqdo|vlv ghshqgv rq wkh vhohfwlrq ri zdyhohw edvlv ixqfwlrqv/

wkh qxpehu ri wudlqlqj gdwd xvhg lq hvwlpdwlqj wkh klvwrjudpv dqg wkh qxpehu ri lwhudwlrqv wr frqyhujh1 Lq rxu

h{shulphqw/ zh pdnh xvh ri 533 wudlqlqj lpdjhv zlwk lpdjh vl}h dv 97� 97 sl{hov1

:1 DFNQRZOHGJPHQWV

Zh zrxog olnh wr wkdqn Eudqgrq Jdoodv dqg rwkhu phpehuv lq rxu uhvhdufk jurxs iru khosixo glvfxvvlrqv1 Wklv vwxg|

zdv pdgh srvvleoh e| judqw qxpehu UR4 FD85976 dqg N34 FD;:34:034 iurp wkh Qdwlrqdo Fdqfhu Lqvwlwxwh1 Lwv

frqwhqwv duh vroho| wkh uhvsrqvlelolw| ri wkh dxwkruv dqg gr qrw qhfhvvdulo| uhsuhvhqw wkh r!fldo ylhzv ri wkh Qdwlrqdo

Fdqfhu Lqvwlwxwh1

UHIHUHQFHV

41 F1 Vlgqh| Exuuxv/ Udphvk D1 Jrslqdwk dqg Kdlwdr Jxr/ Lqwurgxfwlrq wr Zdyhohwv dqg Zdyhohwv Wudqvirupv/ d

sulphu/ s1 6/ Suhqwlfh Kdoo/ Qhz Mhuvh|/ 4<<;1

51 N1 Idnxqdjd/ Lqwurgxfwlrq wr Vwdwlvwlfdo Sdwwhuq Uhfrjqlwlrq/ Vhfrqg hg1/ Dfdghplf Suhvv/ Qhz \run/ 4<<31

61 W1P1 Fryhu/ �Jhrphwulfdo dqg vwdwlvwlfdo surshuwlhv ri v|vwhpv ri olqhdu lqhtxdolwlhv zlwk dssolfdwlrqv lq sdwwhuq

uhfrjqlwlrq�/ LHHH Wudqvdfwlrqv rq Hohfwurqlf Frpsxwhuv/ HF047/ 6590667/ 4<981

71 V1 Kd|nlq/ Qxhudo Qhwzrun/ D Frpsuhkhqvlyh Irxqgdwlrq/ Vhfrqg hg1/ s1 534/ Suhqwlfh Kdoo/ Qhz Mhuvh|/ 4<<<1

81 E1 Vfkronrsi/ F1 Exujhv dqg D1M1 Vprod/ Dgydqfhv lq nhuqho phwkrgv/ s1 4/ Wkh PLW Suhvv/ Fdpeulgjhv/

Pdvvdfkxvhwwv/ 4<<;1

91 D1N1 Mdlq/ U1S1Z1 Gxlq dqg M1 Pdr/ �Vwdwlvwlfdo sdwwhuq uhfrjqlwlrq= d uhylhz�/ LHHH Wudqvdfwlrq rq Sdwwhuq

Dqdo|vlv dqg Pdfklqh Lqwhooljhqfh/ 55/ qr14/ 53331

:1 L1 Gdxehfklhv/ �Whq Ohfwxuhv rq Zdyhohwv�/ VLDP/ 4<<51

;1 G1M1 Khhjhu dqg M1U1 Ehujhq/ �S|udplg0edvhg wh{wxuh dqdo|vlv2v|qwkhvlv�/ Surfhhglqjv1/ Lqwhuqdwlrqdo Frqihu0

hqfh rq Lpdjh Surfhvvlqj 6/ 97;0984/ 4<<81

<1 M1S1 Uroodqg dqg U1Q1 Vwulfnodqg/ �Dq dssurdfk wr wkh v|qwkhvlv ri elrorjlfdo wlvvxh�/ Rswlfv H{suhvv/ 4/ qr146/

7470756/ 4<<:1


431 D1 K|ydulqhq/ �Qhz dssur{lpdwlrqv ri gl�huhqwldo hqwurs| iru lqghshqghqw frpsrqhqw dqdo|vlv dqg surmhfwlrq

sxuvxlw�/ Whfkqlfdo Uhsruw D7:/ Khovlqnl Xqlyhuvlw| ri Whfkqrorj|/ Oderudwru| ri Frpsxwhu dqg Lqirupdwlrq

Vflhqfh/ 4<<:1

441 S1G1 Zhofk/ �Wkh xvh ri idvw irxulhu wudqvirup iru wkh hvwlpdwlrq ri srzhu vshfwud= d phwkrg edvhg rq wlph

dyhudjlqj ryhu vkruw/ prgl�hg shulrgrjudpv/� LHHH Wudqv1 Dxglr Hohfwurdfrxvw1 48/ :30:6/ 4<9:1


nonlinear discriminant analysis

Documents