Outlier detection in logistic regression and its application ... - IEEE Xplore

2012 IEEE Colloquium on Humanities, Science & Engineering Research (CHUSER 2012), December 3-4, 2012, Kota Kinabalu, Sabah, Malaysia

2XWOLHU'HWHFWLRQLQ/RJLVWLF5HJUHVVLRQDQG,WV $SSOLFDWLRQLQ0HGLFDO'DWD$QDO\VLV 6DQL]DK$KPDGDQG1RUD]DQ0RKDPHG5DPOL

+DEVKDK0LGL 0DWKHPDWLFV'HSDUWPHQW )DFXOW\RI6FLHQFH 8QLYHUVLWL3XWUD0DOD\VLD 6HUGDQJ6HODQJRU0DOD\VLD KDEVKDK#VFLHQFHXSPHGXP\

)DFXOW\RI&RPSXWHUDQG0DWKHPDWLFDO6FLHQFHV 8QLYHUVLWL7HNQRORJL0$5$ 6KDK$ODP6HODQJRU VDQL]DK#WPVNXLWPHGXP\ QRUD]DQ#WPVNXLWPHGXP\

RXWOLHU RFFXUV ZKHQ \ = DQG WKH FRUUHVSRQGLQJ ILWWHG SUREDELOLW\ LV FORVH WR ]HUR RU ZKHQ \ = DQG WKH ILWWHG SUREDELOLW\LVFORVHWRXQLW\>@0DQ\GHWHFWLRQPHWKRGVKDYH EHHQ SURSRVHG IRU LGHQWLI\LQJ UHVLGXDO RXWOLHUV LQ ORJLVWLF UHJUHVVLRQEDVHRQUHVLGXDOPHDVXUHV>@>@>@>@ 2EVHUYDWLRQV SRVVHVVLQJ ODUJH UHVLGXDOV DUH VXVSHFWHG DV RXWOLHUV)LUVWZHGLVFXVVRQVRPHGHWHFWLRQPHWKRGVDYDLODEOH LQ WKH OLWHUDWXUH IROORZHG E\ VRPH QXPHULFDO H[DPSOHV XVLQJ EHQFKPDUN GDWDVHWV WR FRPSDUH WKH SHUIRUPDQFHV )LQDOO\ WKLVSDSHUSURYLGHVVRPHGLVFXVVLRQDQGFRQFOXVLRQ

,1752'8&7,21

287/,(50($685(6,1/2*,67,&5(*5(66,21

$EVWUDFW²7KH DSSOLFDWLRQ RI ORJLVWLF UHJUHVVLRQ LV ZLGHO\ XVHG LQ PHGLFDO UHVHDUFK 7KH GHWHFWLRQ RI RXWOLHUV KDV EHFRPH DQ HVVHQWLDO SDUW RI ORJLVWLF UHJUHVVLRQ ,W LV RIWHQ REVHUYHG RXWOLHUV KDYH D FRQVLGHUDEOH LQIOXHQFH RQ WKH DQDO\VLV UHVXOWV ZKLFK PD\ OHDGWKHVWXG\WRWKHZURQJFRQFOXVLRQV0DQ\SURFHGXUHVIRUWKH LGHQWLILFDWLRQRIRXWOLHUVLQORJLVWLFUHJUHVVLRQDUHDYDLODEOHLQWKH OLWHUDWXUH,QWKLVSDSHUIRXUPHWKRGVIRURXWOLHUGHWHFWLRQKDYH EHHQLQYHVWLJDWHGDQGFRPSDUHGWKURXJKQXPHULFDOH[DPSOHV .H\ZRUGVORJLVWLFUHJUHVVLRQRXWOLHUUHVLGXDOGHWHFWLRQ

7KH DSSOLFDWLRQ RI ORJLVWLF UHJUHVVLRQ PRGHOV LQ PHGLFDO UHVHDUFK KDV JUHDWO\ LQFUHDVHG LQ UHFHQW \HDUV 7KH VWDQGDUG ORJLVWLF UHJUHVVLRQ PRGHO LV DSSOLFDEOH IRU GLFKRWRPRXV RXWFRPHV ,W LV SDUWLFXODUO\ DSSURSULDWH IRU PRGHOVLQYROYLQJGLVHDVHVWDWHGLVHDVHGKHDOWK\ DQGGHFLVLRQ PDNLQJ \HVQR 7KH PRVW SRSXODU PHWKRG WR HVWLPDWH WKH SDUDPHWHUV LQ ORJLVWLF UHJUHVVLRQ LV XVLQJ WKH PD[LPXP OLNHOLKRRGHVWLPDWRU0/( ,WLVZHOONQRZQWKDWHVWLPDWLRQ RI WKH 0/( FDQ EH VHYHUHO\ DIIHFWHG E\ WKH SUHVHQFH RI RXWOLHUV LQ WKH GDWD 7R WKLV HIIHFW GLDJQRVWLFV SOD\ DQ LPSRUWDQW UROH LQ UHJUHVVLRQ VWXGLHV ,Q UHFHQW \HDUV GLDJQRVWLFVKDVEHFRPHDQHVVHQWLDOSDUWRIORJLVWLFUHJUHVVLRQ >@ >@ >@ ,W LV RIWHQ REVHUYHG RXWOLHUV JUHDWO\ DIIHFW WKH FRYDULDWH SDWWHUQ DQG FRQVHTXHQWO\ WKHLU SUHVHQFH ZLOO JLYH PLVOHDGLQJLQWHUSUHWDWLRQV7KHUHIRUHLWLVQHFHVVDU\WRGHWHFW WKHVHRXWOLHUVDQGWDNHDSSURSULDWHPHDVXUHVLQRUGHUWRREWDLQ DJRRGILW7KHUHDUHPDQ\GHILQLWLRQVIRURXWOLHUV>@GHILQHG DQ RXWOLHU LQ D GDWD VHW WR EH ³DQ REVHUYDWLRQ RU VXEVHW RI REVHUYDWLRQV ZKLFK DSSHDUV WR EH LQFRQVLVWHQW ZLWK WKH UHPDLQGHU RI WKDW VHW RI GDWD´ >@ GHILQHG RXWOLHU DV ³DQ REVHUYDWLRQWKDWGHYLDWHVVR PXFK IURPRWKHUREVHUYDWLRQVDV WR DURXVH VXVSLFLRQV WKDW LV ZDV JHQHUDWHG E\ D GLIIHUHQW PHFKDQLVP´ 7KH RULJLQV RI RXWOLHUV PD\ EH GXH WR KXPDQ HUURULQFRUUHFWGDWDHQWU\RUXVDJHRIPLVVLQJYDOXHFRGHVDV UHDO GDWD 8QOLNH RUGLQDU\ UHJUHVVLRQ RXWOLHUV LQ ORJLVWLF UHJUHVVLRQKDYHWREHUHWKRXJKWLQWKHFRQWH[WRIELQDU\GDWDLQ ZKLFK DOO WKH \V DUH RU $Q HUURU LQ WKH \GLUHFWLRQ FDQ RQO\RFFXUDVDWUDQVSRVLWLRQ → RU → >@7KLVW\SH RIRXWOLHULVDOVRNQRZQDV\RXWOLHURUUHVLGXDORXWOLHUZKHUH WKH YDOXHV RI WKH [YDULDEOHV DUH QRW H[WUHPH 7KLV UHVLGXDO

978-1-4673-4617-7/12/$31.00 ©2012 IEEE

503

'LDJQRVWLF PHWKRGV RQ GHWHFWLQJ RXWOLHUV DUH FRPPRQO\ XVHG LQ DOO EUDQFKHV RI UHJUHVVLRQ DQDO\VLV LQFOXGLQJ ORJLVWLF UHJUHVVLRQ ,W LV RIWHQ REVHUYHG WKDW DQ\ XQGHWHFWHG RXWOLHUV PD\ FDXVH PLVOHDGLQJ VWDWLVWLFDO UHVXOWV 6XSSRVH WKDW ZH KDYH Q ELQDU\ REVHUYDWLRQV RI WKH IRUP \ L L = Q *LYHQDELQDU\UHVSRQVHYDULDEOH < DQG D ( S × ) YHFWRU ; RI LQGHSHQGHQW YDULDEOHV WKH ORJLVWLF UHJUHVVLRQPRGHOLVRIWKHIRUP H[S [ L7 ȕ 3 < = ; = [ L = π L = + H[S [L7 ȕ ZLWK β = β β β S EHLQJ WKH YHFWRU RI SDUDPHWHUV

(

)

6LQFHWKH \ L V DUHLQGHSHQGHQWELQDU\YDULDEOHVWKHREVHUYHG YDOXHV DUH GHQRWHG DV \ L = RU ZLWK SUREDELOLWLHV π L DQG − π L UHVSHFWLYHO\ )RU HVWLPDWLRQ RI SDUDPHWHUV β GHQRWHG E\ ȕÖ FODVVLFDOO\ RQH XVHV WKH PD[LPXP OLNHOLKRRG HVWLPDWRU0/( GHILQHGE\DQREMHFWLYHIXQFWLRQ Q βÖ = DUJPD[ O ( \ [ β ) 0/(

ȕ

¦

L =

L

L

7KH HVWLPDWHG SUREDELOLWLHV DUH FDOFXODWHG IRU HDFK LQGHSHQGHQWYDULDEOHGHQRWHGE\ πÖ L = π [L ȕÖ 7KHORJOLNHOLKRRGFRQWULEXWLRQVDUH O ( \ L [ L ȕ ) = \ L OQ πÖ L + ( − \ L ) OQ − πÖ L ZKLFK JLYH DQ DV\PSWRWLFDOO\ HIILFLHQW SURFHGXUH IRU HVWLPDWLQJ β

[

]


,QORJLVWLFUHJUHVVLRQWKHUHVLGXDOLVLPSRUWDQWLQGHWHFWLQJLOO ILWWLQJSRLQWV>@7KHUHIRUHWKHREVHUYDWLRQVSRVVHVVLQJODUJH UHVLGXDOV DUH VXVSHFWHG DV RXWOLHUV +RZHYHU WKH UHVLGXDOV GHILQHG LQ DUH XQVFDOHG WKDW LV ZK\ WKH\ DUH QRW UHDGLO\ DSSOLFDEOH LQ GHWHFWLQJ RXWOLHUV 7KH VFDOHG YHUVLRQ RI WKH DERYHUHVLGXDOVWKDWDUHFRPPRQO\XVHGLQGLDJQRVWLFVIRUWKH LGHQWLILFDWLRQRIRXWOLHUVLVNQRZQDVWKH3HDUVRQUHVLGXDO35 ZLWKWKHJHQHUDOIRUPRI \ − πÖ L U3 L = L L = Q YL

W\SHVRIRXWOLHUPHDVXUHVWKHLUYDOXHVKDYHEHHQFDOFXODWHGIRU WKUHH EHQFKPDUN UHDO GDWD VHWV WKH 9DVRVNLQ GDWD WKH (65 GDWDDQGWKH/HXNHPLDGDWD $ 9DVRVNLQ'DWD 7KH9DVRVNLQGDWDLVDZHOONQRZQGDWDVHWUHIHUUHGWRDV VNLQGDWDLQWURGXFHGE\>@DQGZDVDQDO\]HGH[WHQVLYHO\E\ >@ 7KH ELQDU\ RXWFRPHV SUHVHQFH RU DEVHQFH RI 9DVR FRQVWULFWLRQ RI WKH VNLQ RI WKH GLJLWV DIWHU DLU LQVSLUDWLRQ DUH H[SODLQHGE\WZRH[SODQDWRU\YDULDEOHV [ WKHYROXPHRIDLU LQVSLUHGDQG [ WKHLQVSLUDWLRQUDWHERWKLQORJDULWKPV )LJ SURYLGHVDVFDWWHUSORWRIWKH9DVRVNLQGDWD >@SRLQWHGRXW WKDWWKLVGDWDVHWPLJKWFRQWDLQWZRRXWOLHUVFDVHVDQG

7KH 3HDUVRQ UHVLGXDOV DUH HOHPHQWV RI WKH 3HDUVRQ χ VWDWLVWLFV WKDW FDQ EH XVHG WR GHWHFW LOOILWWLQJ FRYDULDWH SDWWHUQV $Q REVHUYDWLRQ LV GHFODUHG D UHVLGXDO RXWOLHU LI LWV FRUUHVSRQGLQJ 3HDUVRQ UHVLGXDO H[FHHGV WKH YDOXH LQ DEVROXWHWHUP>@WKDWPDWFKHVZLWKWKH σ GLVWDQFHUXOHXVHG LQ WKH QRUPDO WKHRU\ $ EHWWHU SURFHGXUH LQ RUGHU WR KDYH DSSUR[LPDWHXQLWYDULDQFHLVWRGLYLGH E\WKHLUVWDQGDUGHUURU JLYHQ E\ VH( \ L − πÖ L ) = YL ( − KL ) ZKHUH Y L = π L − π L DQG

5DWH

\ \

7KHRUGLQDU\RUVLPSOHUHVLGXDOVDUHWKHPRVWFRPPRQO\XVHG PHDVXUHVIRUGHWHFWLQJRXWOLHUV,IZHXVHWKHOLQHDUUHJUHVVLRQ OLNH DSSUR[LPDWLRQ >@ IRU WKH LWK FRYDULDQFH SDWWHUQ LW LV REVHUYHGWKDWWKHLWKUHVLGXDOLVGHILQHGDV UL = \ L − πÖ L L = Q

KL LV WKH LWK GLDJRQDO HOHPHQW RI WKH Q × Q PDWUL[ + = 9 ; ; 7 9; − ; 7 9 9 LV D GLDJRQDO PDWUL[ ZLWK GLDJRQDO HOHPHQWV YL 7KHUHIRUH WKH UHVXOWLQJ VWDQGDUGL]HG 3HDUVRQUHVLGXDOV635 LVGHILQHGDV \ L − πÖ L U63L = L = Q Y L ( − KL ) $QRWKHUW\SHRIUHVLGXDONQRZQDVWKHGHYLDQFHUHVLGXDO'5 FDQEHFRQVWUXFWHGIURPWKHGHYLDQFHJLYHQE\

\ ( − \ L )½ U'L = VJQ ( \ L − πÖ L ) ® \ L OQ L + ( − \ L ) OQ ¾ πÖ L − πÖ L ¿ ¯ ZKHUH VJQ ( \ − πÖ L ) LV WKH IXQFWLRQ WKDW PDNHV U'L SRVLWLYH ZKHQ \ L ≥ πÖ L DQG QHJDWLYH ZKHQ \ L < πÖ L 6LPLODUO\ WKH GHYLDQFH UHVLGXDOV FDQ EH VWDQGDUGL]HG WR KDYH DSSUR[LPDWH XQLW YDULDQFH E\ GLYLGLQJ U'L ZLWK − KL +HQFH WKH VWDQGDUGL]HGGHYLDQFHUHVLGXDOV6'5 LVGHILQHGDV U'L U6'L = − KL

>@VXJJHVWHGLWLVH[SHFWHGWKDWWKHVWDQGDUGL]HGUHVLGXDOVRI JRRG REVHUYDWLRQV RI ELQDU\ ORJLVWLF UHJUHVVLRQ LV WR KDYH YDOXHVZLWKLQ±5HVLGXDOVRXWVLGHRIWKLVUDQJHDUHGHFODUHG DVSRWHQWLDORXWOLHUV+HQFHWKHFXWRIIYDOXHZKHQXVLQJDOO WKHVHPHDVXUHVLV 180(5,&$/(;$03/(6 7R LOOXVWUDWH WKH SHUIRUPDQFH EHWZHHQ WKH IRXU GLIIHUHQW BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB 2XU VLQFHUH DSSUHFLDWLRQ LV GLUHFWHG WR WKH 0LQLVWU\ RI +LJKHU (GXFDWLRQ 0DOD\VLD DQG 8QLYHUVLWL 7HNQRORJL 0$5$ 6KDK $ODP 6HODQJRU 0DOD\VLD 7KH UHVHDUFK LV IXQGHG E\ )XQGDPHQWDO 5HVHDUFK *UDQW 6FKHPH 50,67)5*6)VW

504

9ROXPH

)LJXUH6FDWWHUSORWRI9DVRVNLQ'DWD

,WFDQEHVHHQWKDWLWLVGLIILFXOWWRLGHQWLI\WKHWZRFDVHVMXVW E\ UHIHUULQJ WR WKH VFDWWHU SORW :KHQ FDOFXODWLQJ WKH ILWWHG SUREDELOLWLHV ERWK FDVHV ZLWK \ JLYH WKH YDOXHV DQG UHVSHFWLYHO\ ZKLFK DUH FRQVLGHUHG FORVH WR ]HUR 7KLV PHDQV WKDW WKHVH WZR REVHUYDWLRQV DUH FRQVLGHUHG DV SRWHQWLDO RXWOLHUV 7KH UHVXOWV RI 7DEOH VKRZ WKDW DOO IRXU RXWOLHUPHDVXUHVDUHDEOHWRLGHQWLI\ERWKFDVHVDVRXWOLHUVDV DJUHHGE\>@

% (65'DWD 7KH HU\WKURF\WH VHGLPHQWDWLRQ UDWH (65 LV WKH UDWH DW ZKLFKUHGEORRGFHOOVHU\WKURF\WHV VHWWOHRXWRIVXVSHQVLRQLQ EORRGSODVPDZKHQPHDVXUHGXQGHUVWDQGDUGFRQGLWLRQV7KH (65 GDWD FROOHFWHG E\ >@ LV D VWXG\ FDUULHG RXW E\ WKH ,QVWLWXWH RI 0HGLFDO 5HVHDUFK .XDOD /XPSXU 0DOD\VLD WR H[DPLQHWKHH[WHQWWRZKLFKWKH(65LVUHODWHGWRWZRSODVPD SURWHLQV ILEULQRJHQ DQG γ JOREXOLQ IRU D VDPSOH RI LQGLYLGXDOV 7KH VFDWWHU SORW RI WKH (65 GDWD LV SUHVHQWHG LQ )LJ7KHUHVXOWVLQ7DEOHVKRZWKDWFDVHVDQG KDYHUHVLGXDOYDOXHVJUHDWHUWKDQWKHFXWRIISRLQWRIE\WKH 35DQG635PHWKRGVZKHUHFDVHLVMXVWDVXVSHFWHGRXWOLHU EHFDXVHWKHYDOXHLVVOLJKWO\DERYH+RZHYHURQO\FDVHV DQGDUHLGHQWLILHGDVRXWOLHUVE\WKH'5DQG6'5PHWKRGV


:KHQFDOFXODWLQJWKHILWWHGSUREDELOLW\RIFDVHZLWK\ LWJLYHVWKHYDOXH6LQFHWKHILWWHGYDOXHLVQRWFORVHWR ]HUR FDVH LV FRQVLGHUHG QRW KDUPIXO DQG KHQFH VKRXOG EH NHSWZLWKWKHUHVWRIWKHGDWD 7$%/(2XWOLHU0HDVXUHVIRUWKH(65'DWD

,QGH[

*DPPDJORE XOLQ

\ \

)L EULQR JHQ

)LJXUH6FDWWHUSORWRI(65'DWD 7$%/(2XWOLHU0HDVXUHVIRUWKH9DVRVNLQ'DWD ,QGH[ 35 '5 635 6'5

35

'5

635

6'5

/HXNHPLD'DWD 7KH /HXNHPLD 'DWD DYDLODEOH LQ >@ LQYHVWLJDWHG E\ >@ DPRQJ RWKHUV 7KH GDWD VHW FRQVLVWV RI PHDVXUHPHQWV RQ OHXNHPLD SDWLHQWV 7KH UHVSRQVH YDULDEOH LV LI WKH SDWLHQW VXUYLYHG PRUH WKDQ ZHHNV DQG RWKHUZLVH 7KHUH DUH WZR FRYDULDWHV LQ WKH PRGHO ZKLFK DUH ZKLWH EORRG FHOO FRXQW :%& DQG $* VWDWXV SUHVHQFH RU DEVHQFH RI FHUWDLQ PRUSKRORJLF FKDUDFWHULVWLF LQ WKH ZKLWH FHOOV >@ FRQVLGHUHG WKHVH GDWD WR LOOXVWUDWH WKH LGHQWLILFDWLRQ RI LQIOXHQWLDO REVHUYDWLRQ DQG GHWHFWHG RQHREVHUYDWLRQFDVH FRUUHVSRQGLQJWRDSDWLHQWZLWK :%& ZKRVXUYLYHGIRUDORQJSHULRGRIWLPHWR EHLQIOXHQWLDOZKHQWKH0/(ZDVXVHG7KHSORWLQ)LJXUH &

505


7$%/(2XWOLHU0HDVXUHVIRUWKH/HXNHPLD'DWD

VXJJHVWV WKDW WKH REVHUYDWLRQ ORRNV OLNH D KLJK OHYHUDJH SRLQW RXWOLHU H[WUHPH LQ WKH FRYDULDWH 7KH 35 DQG 635 PHWKRGV DOVR VXJJHVW WKDW FDVHV DQG DV SRWHQWLDO RXWOLHUV DV VHHQ LQ 7DEOH EXW WKH UHVLGXDO YDOXH LV RQO\ VOLJKWO\ DERYH WKH FXWRII YDOXH RI 7KH ILWWHG SUREDELOLWLHVRIWKHVHWZRFDVHVZLWK\ DUHDQG ZKLFKHQFRXQWHUVVLPLODUVLWXDWLRQDVFDVHLQWKH /HXNHPLD GDWD ,Q VXSSRUW ZLWK WKH ILQGLQJ RI >@ RQO\ FDVH LV GHFODUHG DV RXWOLHU )XUWKHU LQYHVWLJDWLRQ LV QHHGHGIRUWKHVHVRUWVRIFDVHVDVZKHWKHUWRLQFOXGHRUQRW LQWKHGDWDDQDO\VLV

,QGH[

DJ

\ \

ZEF

)LJXUH6FDWWHUSORWRI/HXNHPLD'DWD

',6&866,21$1'&21&/86,21 0HGLFDO UHVHDUFK ZRUNHUV LQYROYLQJ ZLWK GDWD FROOHFWLRQ DUH PDNLQJ LQFUHDVLQJ XVH RI ORJLVWLF UHJUHVVLRQ DQDO\VLV +RZHYHU LW LV DQ XQIRUWXQDWH IDFW RI UHVHDUFK WKDW GDWDDUHQRWDOZD\VZHOOEHKDYHG2XWOLHUVRFFXULQDOPRVWDOO UHVHDUFK7KLVW\SHRIDEQRUPDOGDWDLQDPHGLFDOGDWDVHWLV RIWHQ D SUREOHP LQ VWDWLVWLFDO DQDO\VLV ZKHUH RXWOLHUV PD\ HVSHFLDOO\ORZHUWKHPRGHOILW7KHUHIRUHRXWOLHULGHQWLILFDWLRQ LV D YLWDO LVVXH WR EH DGGUHVVHG EHIRUH IXUWKHU DQDO\VLV LV FDUULHG RXW ,W LV LPSRUWDQW IRU PHGLFDO SUDFWLWLRQHUV ZKHQ DQDO\]LQJ GDWD WR EH DEOH WR LGHQWLI\ RXWOLHUV LI WKH\ H[LVW VR WKDW DSSURSULDWH PHDVXUHV PD\ EH WDNHQ ,Q WKLV SDSHU IRXU RXWOLHUGHWHFWLRQSURFHGXUHVIRULGHQWLI\LQJUHVLGXDORXWOLHUVLQ ORJLVWLF UHJUHVVLRQ EDVHG RQ UHVLGXDOV DUH DQDO\]HG DQG FRPSDUHGXVLQJWKUHHUHDOGDWDVHWVIURPWKHPHGLFDOGRPDLQ %DVHGRQWKHIRXURXWOLHUPHDVXUHVGLVFXVVHGLQWKLVSDSHUWKH PRVWSUHIHUUHGRXWOLHUGHWHFWLRQPHWKRGIRUORJLVWLFUHJUHVVLRQ LV WKH 3HDUVRQ UHVLGXDO RU VWDQGDUGL]HG 3HDUVRQ UHVLGXDO IROORZHG E\ GHYLDQFH UHVLGXDO DQG VWDQGDUGL]HG UHVLGXDO PHWKRGV+RZHYHUDPRUHUREXVWGLDJQRVWLFPHWKRGLVQHHGHG IRULGHQWLI\LQJPXOWLSOHRXWOLHUVLQORJLVWLFUHJUHVVLRQ>@

506

35

'5

635

6'5

$&.12:/('*0(17 $XWKRUV ZRXOG OLNH WR WKDQN WKH 0DQDJHPHQW 5HVHDUFK ,QVWLWXWH 50, 8QLYHUVLWL 7HNQRORJL 0$5$ 8L70 6KDK $ODPIRUWKHLUVXSSRUWDQGHQFRXUDJHPHQW 5()(5(1&(6 >@ 6$KPDG+0LGLDQG105DPOL³'LDJQRVWLFVIRUUHVLGXDORXWOLHUV XVLQJGHYLDQFHFRPSRQHQWLQELQDU\ORJLVWLFUHJUHVVLRQ´:RUOG$SSOLHG 6FLHQFHV-RXUQDOYRO SSí >@ '&ROOHWW0RGHOOLQJ%LQDU\'DWDQGHG&KDSPDQ +DOO&5& >@ ':+RVPHUDQG6/HPHVKRZ $SSOLHG/RJLVWLF5HJUHVVLRQQG HG 1HZ@ 9 %DUQHWW DQG 7 /HZLV 2XWOLHUV LQ 6WDWLVWLFDO 'DWD -RKQ :LOH\ 6RQV1RUZLFKQGHG >@ '+DZNLQV,GHQWLILFDWLRQRI2XWOLHUV&KDSPDQDQG+DOO


>@ - % &RSDV ³%LQDU\ UHJUHVVLRQ PRGHO IRU FRQWDPLQDWHG GDWD´ ZLWK GLVFXVVLRQ -RXUQDORIWKH5R\DO6WDWLVWLFDO6RFLHW\6HULHV%YRO SS >@ '3UHJLERQ³/RJLVWLFUHJUHVVLRQGLDJQRVWLFV´$QQDOVRI6WDWLVWLFVYRO SS >@ 5 &KULVWHQVHQ /RJ/LQHDU 0RGHOV DQG /RJLVWLF 5HJUHVVLRQ QG HG 6SULQJHU9HUODJ,QF1HZ@ ' - )LQQH\ ³7KH HVWLPDWLRQ IURP LQGLYLGXDO UHFRUGV RI WKH UHODWLRQVKLSEHWZHHQ GRVH DQGTXDQWDO UHVSRQVH´ %LRPHWULND YRO SS >@ ' &ROOHWW DQG $$ -HPDLQ ³5HVLGXDOV RXWOLHUV LQIOXHQWLDO REVHUYDWLRQVLQUHJUHVVLRQDQDO\VLV´6DLQV0DOD\VLDQDYROSS >@ 5' &RRN DQG 6 :HLVEHUJ 5HVLGXDOV DQG ,QIOXHQFH LQ 5HJUHVVLRQ &KDSPDQDQG+DOO/RQGRQ >@ 5- &DUUROO DQG 6 3HGHUVRQ ³2Q UREXVW HVWLPDWLRQ LQ WKH ORJLVWLF UHJUHVVLRQ PRGHO´ -RXUQDO RI WKH 5R\DO 6WDWLVWLFDO 6RFLHW\ 6HULHV % >@ $+05,PRQDQG$6+DGL³,GHQWLILFDWLRQRIPXOWLSOHRXWOLHUVLQORJLVWLF UHJUHVVLRQ´ &RPPXQLFDWLRQV LQ 6WDWLVWLFV7KHRU\ DQG 0HWKRGV YRO SS

507