Towards a truthful world wide web from a humanitarian perspective

2 downloads 0 Views 268KB Size Report
Crowd funding projects liNe Niva1 , which connects willing lenders to the many underprivileged entrepreneurs wanting loans. Crowdsourcing websites such as ...
7RZDUGVD7UXWKIXO:RUOG:LGH:HE IURPD+XPDQLWDULDQ3HUVSHFWLYH  9LVKQX63HQG\DOD 'HSDUWPHQWRI&RPSXWHU(QJLQHHULQJ 6DQWD&ODUD8QLYHUVLW\ 6DQWD&ODUD&$86$ YSHQG\DOD#VFXHGX  Abstract² (FRQRP\ JURZV DV PRUH DQG PRUH SHRSOH MRLQ LWV FRUH HFKHORQV 3HRSOH DUH WKH PRVW LPSRUWDQW HFRQRPLF UHVRXUFHV DW DOO WLPHV 7KH :HE EHLQJ KXPDQLW\¶V ODUJHVW VRXUFH RI LQIRUPDWLRQ DQG LQWHUDFWLRQ SUREDEO\ KDV WKH PRVW WHFKQRORJLFDO SRWHQWLDO WR JHW SHRSOH LQWR PDLQVWUHDP ,W FDQ VHUYH DV D FRQGXLW RI KXPDQLWDULDQ VHUYLFHV WR WKH XQGHUSULYLOHJHG DQG SUHVHQWV D KXJH RSSRUWXQLW\ WR PHHW KXPDQLWDULDQFKDOOHQJHV,QWKLVSDSHUZHGLVFXVVWKHUROHWKDW D WUXWKIXO :RUOG :LGH :HE FDQ SOD\ LQ DFKLHYLQJ KXPDQLWDULDQJRDOV:HVXUYH\ZKDWLVFXUUHQWO\DYDLODEOHDQG GLVFXVV VRPH RI RXU RZQ LGHDV RQ PDNLQJ WKH :HE PRUH UREXVW DQG WUXWKIXO LQ RUGHU WR PHHW WKH KXPDQLWDULDQ FKDOOHQJH .H\ZRUGV²World Wide Web, Truth, Logic, Machine Learning 

, ,1752'8&7,21 2QO\ WUXWK VXVWDLQV $OO HOVH IDGHV LQWR WKH REOLYLRQ +RZHYHU RI ODWH WKH :HE LV LQFUHDVLQJO\ EHLQJ XVHG WR SHUSHWXDWH OLHV 7KH :HE LV WKH PDLQ VRXUFH RI UDZ DQG SURFHVVHG LQIRUPDWLRQ IRU WKH ZRUOG SDUWLFXODUO\ IRU WKH XQGHUSULYLOHJHG ZKR FDQ FRQQHFW WR LW XVLQJ PRELOH GHYLFHV 7KH\ PD\ QRW KDYH DFFHVV WR QHZVSDSHUV DQG RWKHU QHZV FKDQQHOV EXW KDYH WKH DELOLW\ WR DFFHVV WKH :HE 0RVW RI WKH DSSOLFDWLRQVWKDWWKH\XVHRURWKHUVXVHWRKHOSWKHPUHO\RQWKH WUXWKIXOQHVV RI WKH XQGHUO\LQJ LQIRUPDWLRQ RQ WKH :HE ,I WKH JURXQGWUXWKLVXQUHOLDEOHWKHHQWLUHPRGHOEXLOWEDVHGRQLWWR SURYLGH XVHIXO VHUYLFHV WR WKH  XQGHUVHUYHG SRSXODWLRQV FROODSVHV )RU LQVWDQFH WKHUH KDYH EHHQ D QXPEHU RI GLVDVWHU UHOLHIDSSOLFDWLRQVWKDWGHSHQGRQWKHWZHHWVSRVWHGRQWZLWWHU $OOVXFKDSSOLFDWLRQVDVVXPHWKDWWKHLQIRUPDWLRQLQWKHWZHHWV LVWUXH 7KH :HE LV DOVR D SULPDU\ PHGLXP IRU LQIRUPDWLRQ H[FKDQJH 7KHUH KDYH EHHQ D QXPEHU RI DSSOLFDWLRQV WKDW XVH VRPHNLQGRI606PHFKDQLVPWRH[FKDQJHLQIRUPDWLRQRQWKH :HEVRWKDWWKHHPHUJLQJPDUNHWVFDQWDNHDGYDQWDJHRILW)RU WKHLQIRUPDWLRQH[FKDQJHWREHHIIHFWLYHWKHLQIRUPDWLRQQHHGV WR EH WUXWKIXO DV ZHOO DQG IORZ IUHHO\ ZLWKRXW KLQGUDQFHV +RZHYHUDVLJQLILFDQWFRQWHQWRQWKH:HELVQRWHQWLUHO\WUXH &DQWKH:HEFRQWDLQRQO\WKHWUXWKDQGQRWKLQJEXWWKHWUXWK" &DQWKHUHEHDUHSUHVHQWDWLRQRQWKH:HEWKDWFDQDFFHSWRQO\ WUXWK DQG UHMHFW ZKDW LV QRW LQ FRQIRUPDQFH ZLWK WKH WUXWK HVWDEOLVKHGVRIDU"&DQZHFRPHXSZLWKPHFKDQLVPVVXFKDV YRWLQJ WR LPSURYH WKH UHOLDELOLW\ RI WKH FRQWHQW RQ WKH :HE" 7KHVH DUH VRPH RI WKH TXHVWLRQV ZH DGGUHVV LQ WKH SDSHU WR PDNH WKH :HE UREXVW HQRXJK IRU IXUWKHULQJ WKH KXPDQLWDULDQ FDXVH:HDUHORRNLQJLQWRDVSHFWVRIIRUPDO PHWKRGVVXFKDV ORJLF V\VWHPV DV ZHOO DV PDFKLQH OHDUQLQJ WHFKQLTXHV WR VHHN DQVZHUVWRWKHVHTXHVWLRQV 978-1-4673-6561-1/15/$31.00 ©2015 IEEE

6LOYLD)LJXHLUD 'HSDUWPHQWRI&RPSXWHU(QJLQHHULQJ 6DQWD&ODUD8QLYHUVLW\ 6DQWD&ODUD&$86$ VILJXHLUD#VFXHGX $ WUXWKIXO :HE HQDEOHV D SOHWKRUD RI KXPDQLWDULDQ XVHV 7KH SUROLIHUDWLRQ RI PRELOH GHYLFHV WKDW FDQ FRQQHFW WR WKH ,QWHUQHW KDV PDGH WKH :HE DOPRVW XELTXLWRXV DQG DFFHVVLEOH IURPHYHQUHPRWHFRUQHUVRIWKHZRUOGSRVLWLRQLQJWKH:HEDV WKH8ELTXLWRXV&RPSXWHU>@6RPHRIWKHIXWXULVWLFDVSHFWVRI WKH:HEDQGLWVSRWHQWLDOIRUKXPDQLWDULDQXVHDUHH[SODLQHGLQ >@ :H GHPRQVWUDWHG WKH FRQFHSWV LQYROYHG LQ XVLQJ PRELOH GHYLFHV LQ FRQMXQFWLRQ ZLWK WKH :HE XVLQJ WKH H[DPSOH RI SHUIRUPLQJ LQWHOOLJHQW VHDUFKHV LQ >@ 7KHUH DUH DOUHDG\ D QXPEHURIKXPDQLWDULDQSURMHFWVWKDWKDYHEHHQPDGHSRVVLEOH E\ WKH :HE 7KHUH DUH PRUH WKDW DUH SRVVLEOH 2QH VXFK SRVVLEOH DSSOLFDWLRQ LV PHGLFDO GLDJQRVLV XVLQJ WKH WHFKQLTXHV SUHVHQWHG LQ ODVW \HDU¶V *OREDO +XPDQLWDULDQ 7HFKQRORJ\ &RQIHUHQFH >@ 7KH :HE KDV DOUHDG\ HQDEOHG 0LFURILQDQFH &URZG IXQGLQJ SURMHFWV OLNH NLYD   ZKLFK FRQQHFWV ZLOOLQJ OHQGHUV WR WKH PDQ\ XQGHUSULYLOHJHG HQWUHSUHQHXUV ZDQWLQJ ORDQV &URZGVRXUFLQJ ZHEVLWHV VXFK DV $PD]RQ 0HFKDQLFDO 7XUNKDYHKHOSHGFUHDWHMREVIRUSHRSOHDOODURXQGWKHZRUOG &LWL]HQ VFLHQFH SURMHFWV XVLQJ WKH :HE KDYH DOVR EHHQ XQGHUWDNHQ LQ WKH UHFHQW SDVW WR LQYROYH FRPPRQ SHRSOH LQ VFLHQWLILFUHVHDUFKSURMHFWV,QWKLVSDSHUZHGHOYHLQWRKRZWKH :HEFDQEHPDGHWUXWKIXOWRKHOSZLWKSURMHFWVWKDWFDQFRQQHFW GHPDQGWRVXSSO\DFURVVFRQWUDVWLQJHFRQRPLHVRIWKHZRUOG 7KHSDSHUWDFNOHVLQWKLVDJHRIWKH:HEZKHQLQIRUPDWLRQ VSUHDGV LQ PLFURVHFRQGV D SUREOHP NQRZQ IURP WLPHV LPPHPRULDO³ZKDWLVWUXWK´IURPDWHFKQRORJLFDOSHUVSHFWLYH $ QXPEHU RI LGHDV RQ KDQGOLQJ WUXWK KDYH EHHQ SUHVHQWHG LQ WKHSDSHU0XOWLSOHGLVFLSOLQHVKDYHDOVREHHQEULHIO\H[SORUHG WR FRYHU KRZ WHFKQLFDO VROXWLRQV WR WKH SUREOHP DUH YLHZHG HOVHZKHUHWRJLYHDFRPSUHKHQVLYHRXWORRN 7KHUHVWRIWKHSDSHULVRUJDQL]HGDVIROORZV6HFWLRQ,,LVD OLWHUDWXUHUHYLHZ8VLQJFDVHVWXGLHVDQGH[DPSOHV6HFWLRQ,,, GLVFXVVHVKRZWUXWKKDVEHHQUHVHDUFKHGLQYDULRXVGLVFLSOLQHV RIVWXG\DQGWHFKQRORJ\¶VUROHLQHVWDEOLVKLQJWUXWK3UREOHPV FRQFHSWXDO VROXWLRQV DQG WHFKQLTXHV HQYLVDJHG IRU YHULI\LQJ WUXWK RQ WKH LQIRUPDWLRQ RQ WKH :HE DUH SUHVHQWHG LQ 6HFWLRQ ,97KHFRQFOXVLRQRIWKHSDSHULVSUHVHQWHGLQ6HFWLRQ9 ,, /,7(5$785(5(9,(: 7KHUHKDVEHHQDQLQFUHDVLQJQXPEHURISXEOLFDWLRQVLQWKH DUHD RI YHULI\LQJ RQOLQH LQIRUPDWLRQ UHFHQWO\ LQGLFDWLQJ WKH JURZLQJ LPSRUWDQFH RI WKH SUREOHP ,Q 0DFKLQH /HDUQLQJ HVWDEOLVKLQJJURXQGWUXWKLVDVXEVWDQWLDOO\VLJQLILFDQWWDVN7KH DXWKRUV RI >@ VWXGLHG  VRFLDO LQIRUPDWLRQDO DQG FROODERUDWLRQ QHWZRUNV WR DUULYH DW WKH JURXQG WUXWK IRU GHWHFWLQJ FRPPXQLWLHV DPRQJ WKH UHDO ZRUOG QHWZRUNV 7KH\

137

  KWWSZZZNLYDRUJ KWWSVZZZPWXUNFRP



IEEE 2015 Global Humanitarian Technology Conference

FRQVLGHUYDULRXV VFRULQJ IXQFWLRQV IRU HYDOXDWLQJ FRPPXQLWLHV DQGXVHWKHPRQKXJHGDWDVHWVWRGHWHFWZKDWWKH\FDOO³JURXQG WUXWK FRPPXQLWLHV´ 8VLQJ H[DPSOHV %RULV *DOLWVN\ >@ SURSRVHG DQ 1/3 EDVHG DSSURDFK WR VHJUHJDWH GLVLQIRUPDWLRQ DQG UXPRUV E\ FRPSDULQJ ZKDW LV DYDLODEOH RQ WKH :HE +H K\SRWKHVL]HV WKDW QHZ SKUDVHV FDQQRW EH LQYHQWHG ± WKH\ DUH DOUHDG\ SUHVHQW LQ VRPH IRUP RQ WKH :HE DQG WKHQ XVHV WKH µ3DUVH7KLFNHW¶WHFKQLTXHWRFRPSDUHDJLYHQWH[WVHJPHQWZLWK ZKDWLVDYDLODEOHRQWKH:HEWRGHWHUPLQHZKHWKHULWLVDUXPRU RU GLVLQIRUPDWLRQ 7KH SDSHU DOVR SUHVHQWV DQ DOJRULWKP WR JHQHUDWHGLVLQIRUPDWLRQ7KHSDSHULVXQLTXHLQSURSRVLQJ1/3 WHFKQLTXHV IRU YHULI\LQJ WUXWKIXOQHVV RI D JLYHQ WH[W ,Q >@ 3DVFXDOHWDODSSO\IX]]\ORJLFSULQFLSOHVWRORJLFSURJUDPPLQJ WR KDQGOH WUXWK GHJUHHV DV D ZD\ RI GHDOLQJ ZLWK XQFHUWDLQW\ 7KH\ GHYHORS D 352/2* OLNH ODQJXDJH FDOOHG )$6,// DQG SURYLGHWKHIRUPDOLVPDORQJZLWKWKHLPSOHPHQWDWLRQGHWDLOVLQ WKHSDSHU ,QIRUPDWLRQ 5HWULHYDO WHFKQLTXHV SURYLGH JRRG WRROLQJ IRU GUDZLQJFRQFOXVLRQVDERXWWKHZHEFRQWHQW7KHDXWKRUVRI>@ XVHWKHQHDUHVWQHLJKERUDSSURDFKWRGHWHFWDFRQWURYHUVLDOZHE SDJHEDVHGRQDFRUUHVSRQGLQJSDJHRQ:LNLSHGLD7KH\XVH GLIIHUHQW VFRUHV WR PHDVXUH FRQWURYHUV\ LQ D :LNLSHGLD SDJH ZKLFKZHUHSURSRVHGE\RWKHUDXWKRUVLQHDUOLHUZRUNDQGXVH WKHVHVFRUHVWRDXWRPDWLFDOO\ODEHOWKHSDJHV$YRWLQJVFKHPH LV XVHG WR FRPELQH WKH ODEHOV DQG GHSOR\ D ZHDNO\VXSHUYLVHG FODVVLILFDWLRQ DSSURDFK WR GHWHUPLQH LI D JLYHQ ZHESDJH LV FRQWURYHUVLDO 7KH 1HDUHVWQHLJKERU DSSURDFK LV DJDLQ XVHG LQ >@ WR FRQFOXGH WKDW WKH PHWDGDWD DQG WDJVDYDLODEOH LQ ODVWIP SURYLGHUHOLDEOHJURXQGWUXWKLQWKHPXVLFGRPDLQ7KHDXWKRUV RI>@XVHDSDUWLWLRQLQJDSSURDFKWRILQGWUXWKLQJLYHQGDWDE\ DVVXPLQJDQGORRNLQJIRUVWUXFWXUHLQLW,Q>@WKHDXWKRUVWHUP WKHWUXWKRUODFNWKHUHRILQDZHESDJHWREHDQHQGRJHQRXVVLJQDODV FRQWUDVWHGWRWKHSDJHUDQNZKLFKLVDQH[RJHQRXVVLJQDO .QRZOHGJHH[WUDFWLRQWHFKQLTXHVDUHXVHGLQ>@WREXLOGD WULSOH VWRUH IURP WKH H[LVWLQJ ZHE SDJHV $ WUXVWZRUWKLQHVV VFRUHZKLFKWKHDXWKRUVFDOODVWKH.QRZOHGJH%DVHG7UXVWLV FRPSXWHGIURPLWXVLQJLQIHUHQFHLQDSUREDELOLVWLFPRGHO7KH ZRUN LQ >@ LV D FRQJORPHUDWLRQ RI WZHOYH WUXWK GLVFRYHU\ PRGHOV WKDW ZHUH SUHYLRXVO\ SUHVHQWHG LQ WKH OLWHUDWXUH $ FROOHFWLYH LQIHUHQFH LV FRPSXWHG IURP WKHVH WZHOYH PRGHOV RQ WKH SUHVXPSWLRQ WKDW QRQH RI WKH WZHOYH PRGHOV LQGLYLGXDOO\ ZRUNV WKH EHVW 7KH V\VWHP GHYHORSHG DOVR SURYLGHV H[SODQDWLRQV DQG DOOHJDWLRQV WR VXSSRUW LWV WUXWKIXOQHVV FODLPV 7KH DXWKRUV RI >@ SUHVHQW DQ LWHUDWLYH DOJRULWKP IRU IDFW ILQGLQJ DQG SURSRVH D IUDPHZRUN EDVHG RQ SUREDELOLVWLF DQG UHJUHVVLRQ PRGHOV WR FRPSXWH WKH FRQILGHQFH RI IDFWV DQG WUXVWZRUWKLQHVVRIWKHZHEVLWHV 6RFLDOPHGLDKDYLQJHQDEOHGDQ\RQHZLWK,QWHUQHWDFFHVVWR SRVW RQ WKH ZHE LV SUREDEO\ WKH ZRUVW KLW LQ WHUPV RI FUHGLELOLW\ 7KH ZRUN LQ >@ H[DPLQHV WKLV SUREOHP IURP D PDFKLQHOHDUQLQJSHUVSHFWLYH7KHDXWKRUVH[WUDFWDQXPEHURI IHDWXUHVRIWKHWZHHWVWU\RXWDQXPEHURIOHDUQLQJDOJRULWKPV RQWKHPDQGFRQFOXGHWKDWWKH-GHFLVLRQWUHHJLYHVWKHEHVW UHVXOWV 7KH GHJUHH RI IRUPDOLW\ LQ WKH FRQWHQW LV D SRVVLEOH LQGLFDWLRQ RI LWV WUXWKIXOQHVV 8VLQJ 1/3 WHFKQLTXHV WKH DXWKRUVRI>@PHDVXUHWKHLQIRUPDOLW\LQYDULRXVZHEVLWHV VXFKDVP\VSDFHWZLWWHUDQGGLJJ7ZLWWHUKDVEHHQDKRXVHRI VRPH RI WKH RQOLQH UXPRU PLOOV VR 4D]YLQLDQ HW DO LQ >@ H[WUDFW FRQWHQW DQG QHWZRUN EDVHG IHDWXUHV RI WZHHWV DQG DSSOLHG%D\HVFODVVLILHUVRQWKHPWRGHWHFWUXPRUV7KHZRUNLQ

>@JLYHVJRRGLQVLJKWVLQWRDQDO\]LQJWZLWWHUGDWDWKDWFDQEH XVHG WR FRPH XS ZLWK JURXQGWUXWK DQG LGHQWLI\ IHDWXUHV 7KH DXWKRUV RI >@ IURP 0LFURVRIW LPSURYLVH RQ SUHYLRXV PXOWL FODVV 690V EDVHG LWHUDWLYH DSSURDFK WR VHPLVXSHUYLVHG WUXWK GLVFRYHU\ E\ GHULYLQJ DQ RSWLPDO VROXWLRQ WKDW WKH\ SURYH WR FRQYHUJH ,Q>@WKHDXWKRUVVXUYH\WKHZRUNWKDWKDVEHHQGRQHWR VKRZ WKDW SRVWV RQ WZLWWHU FDQ SUHGLFW GLVHDVH RXWEUHDNV 7KH DXWKRUV FRQFOXGH WKDW UHOLDELOLW\ RI WKH LQIRUPDO LQIRUPDWLRQ SRVWHGRQWZLWWHULVVWLOODQLVVXHWKDWVKRXOGEHDGGUHVVHG7KH ZRUNLQ>@XVHV(0EDVHGRSWLPL]DWLRQDOJRULWKPWRGLVFRYHU WUXWK LQ VRFLDO PHGLD DQG HYDOXDWHV LW XVLQJ VLPXODWLRQV 7KH ZRUNLQ>@SRVHVDQGVROYHVSUREOHPV L *LYHQDV\PSWRP VILQGF FLUFXPORFXWRU\ V ZKLFKJHQHUDWHVWKHWUDLQLQJGDWD LL  *LYHQ V DQG F ILQG ZD\V WR DXWRPDWLFDOO\ UHSUHVHQW VLPLODULW\ VF  LLL *LYHQVDQGFGHVLJQZD\VWRDXWRPDWLFDOO\ LQIHUVIURPF6RPHRIWKHDSSURDFKHVSUHVHQWHGLQWKDWSDSHU FDQEHDSSOLHGWRWKHYHUDFLW\SUREOHPDVZHOO7KHZHEJUDSK JLYHVPDQ\LQVLJKWVLQWRWKHZHEFRQWHQWKHOSLQJLQFRPLQJXS ZLWKDOJRULWKPVWRKDUQHVVLWEHWWHU7KHDXWKRUVRI>@LQWKHLU SLRQHHULQJZRUNSUHVHQWWZRDOJRULWKPVRSHUDWLQJRQWKHZHE JUDSKWRKHOSZLWKZHEVHDUFKDQGFRPPXQLW\GLVFRYHU\7KH ZHEJUDSKEHLQJDIXQGDPHQWDOGDWDVWUXFWXUHPD\EHRIXVHLQ WKHSUREOHPRIYHUDFLW\ 7KHUH KDV EHHQ FRQVLGHUDEOH UHVHDUFK LQ KDQGOLQJ XQFHUWDLQW\ RQ WKH :HE XVLQJ RQWRORJLHV 7KH WUHDWLVH LQ >@ LQWHJUDWHV WKH RQWRORJ\ ODQJXDJH 2:/'/ DQG %HOLHI DXJPHQWHG )UDPHV %$)  WR DUULYH DW WKH FRQILGHQFH LQ LQIRUPDWLRQ 2:/ LV D ILUVWRUGHUORJLF EDVHG V\VWHP WKDW ZRUNVRQWKHSUHVXPSWLRQRIWUXWKIXOSUHGLFDWHVZKHUHDV%$) WDNHV FDUH RI WKH XQFHUWDLQW\ 7KH DXWKRUV RI >@ UHYLHZ HYDOXDWH DQG FRPSDUH D VHOHFWLRQ RI  H[LVWLQJ WUXWKILQGLQJ DOJRULWKPVLQFOXGLQJVRPHRIWKRVHGLVFXVVHGDERYH7KH\XVH H[WHQVLYH GDWDVHWV WR SHUIRUP WKHLU H[SHULPHQWV ZKLFK DUHWKH EDVLVIRUWKHLUILQGLQJV7KHZRUNLVUHODWHGWRWKHVDPHDXWKRUV¶ ZRUNSUHVHQWHGLQ>@7KHDXWKRUVRI>@SUHVHQWDFROOHFWLRQ RI +LGGHQ 0DUNRY 0RGHOV WR GHWHUPLQH GDWD LQWHJULW\ ZKHQ FRS\LQJ IURP PXOWLSOH VRXUFHV ,Q VXFK VFHQDULRV RXWRIGDWH GDWD FDQ SRVH VHULRXV LQWHJULW\ LVVXHV DQG WKH WHFKQLTXHV SUHVHQWHGLQWKHSDSHUKHOSGHWHUPLQHWKHDFFXUDF\RIFRS\LQJ GDWD7KHZRUNLQ>@SUHVHQWVDOJRULWKPVWRFRPSXWHHUURU IDFWRUVDVVRFLDWHGZLWKLQFRQVLVWHQWLQIRUPDWLRQ ,W LV RIWHQ VDLG WKDW WKH GHHS ZHE LV DW OHDVW  WLPHV WKH VL]HRIWKHVXUIDFHZHEWKDWZHNQRZ$ORWRIGDWDRQWKH:HE LVQRWLQGH[HGDQGLVDYDLODEOHRQO\G\QDPLFDOO\7KHZRUNLQ >@ XVHV ZHOONQRZQ WHFKQLTXHV WR FKHFN WKH WUXWKIXOQHVV RI WKHGDWDLQWKHGHHSZHEDQGGUDZVDVXUSULVLQJFRQFOXVLRQWKDW DVLJQLILFDQWSRUWLRQRIWKHGDWDLVQRWWUXH7KH\DOVRFDWHJRUL]H DQG DQDO\]H WKH UHDVRQV IRU WKLV ILQGLQJ 7KH DXWKRUV RI >@ SUHVHQWDSUREDELOLVWLFJUDSKLFDOPRGHOZKLFKWKH\FDOO/DWHQW 7UXWK 0RGHO WR VROYH WKH WUXWK ILQGLQJ SUREOHP GXULQJ GDWD LQWHJUDWLRQ7UXWKLVDODWHQWYDULDEOHLQWKHPRGHO7KHDXWKRUV GHYHORS DQ LQIHUHQFH DOJRULWKP EDVHG RQ FROODSVHG *LEEV VDPSOLQJ'DWDIXVLRQWHFKQLTXHVDUHRIWHQHPSOR\HGWRFKHFN WKHWUXWKIXOQHVVRILQIRUPDWLRQ>@LVDVXUYH\RIVHYHUDOVXFK GDWDIXVLRQWHFKQLTXHV





KWWSZZZNVOVWDQIRUGHGXNVWZKDWLVDQRQWRORJ\KWPO

FOLFN 7UXWKIXOQHVV WKHUHIRUH LV RI WUHPHQGRXV LPSRUWDQFH RQ +XPDQLWDULDQSURMHFWVKDYHRIWHQEHHQPLUHGLQDFORXGRI WKH:HE 7UXWK LV DOVR RI SDUDPRXQW LPSRUWDQFH LQ VRFLDO DFWLYLWLHV GRXEW)RULQVWDQFHWKHHIIRUWVRI$PHULFDQ5HG&URVVIRUWKH 7KHJUDYLW\RIRIIHQFHVLQKXPDQLWDULDQSURMHFWVLVVXEVWDQWLDO +DLWLHDUWKTXDNHYLFWLPVDUHEHLQJTXHVWLRQHGE\WKH86 &RQJUHVVWKLVZHHN$ERXWKDOIDELOOLRQGROODUVZDVVXSSRVHG 7KHEHQHILFLDULHVDUHW\SLFDOO\WKHPRVWQHHGLHVWRIWKHQHHG\ WRKDYHEHHQVSHQWIRUWKHGLVDVWHUUHOLHIEXWWKHRXWFRPHRIWKH 'HQ\LQJ WKHP RI WKH JRRGV DQG VHUYLFHV GRQDWHG IRU WKHP LV HIIRUWVLVDSSDUHQWO\QRWPDWFKLQJWKHPDJQLWXGHRIWKHPRQH\ LQH[FXVDEOH 7KHUH KDYH EHHQ LQVWDQFHV RI IUDXGXOHQW DFWLYLW\ VSHQW6XFKLQVWDQFHVFDQDGYHUVHO\LPSDFWERWKWKHSURVSHFWLYH UHODWHGWRKXPDQLWDULDQFDXVHVWRWKHWXQHRIPLOOLRQVRIGROODUV ZLWK *'3¶V QRW H[FHHGLQJ D IHZ KXQGUHG GRQRUV¶ FRQILGHQFH DQG WKH FUHGLELOLW\ RI WKH LQVWLWXWLRQ LQ FRXQWULHV  6WLOOLWLVVXEVWDQWLDOO\KDUGWRSURYHIUDXGDQGEULQJ GROODUV $FFRXQWLQJ WKHRULHV DORQH KDYH QRW EHHQ VXIILFLHQW HQRXJK WR GLVSHO WKH GRXEWV LQ VXFK SURMHFWV &RPSOHPHQWDU\ 6RFLDO WKH FXOSULWV WR ERRN &DQ WHFKQRORJ\ SURYLGH WRROV WR ILQG WKH WKHRULHVVXFKDV$FWRU1HWZRUN7KHRU\ $17 KDYHDOVREHHQ WUXWKZKHQWKHUHLVDGRXEW"7KHDQVZHULV\HVEXWZLWKVRPH SUREDELOLW\ )RUPDO ORJLF DQG SUREDELOLW\  VWDWLVWLFV DUH WKH XVHGWRHVWDEOLVKWUXWKLQKXPDQLWDULDQHIIRUWV>@ 7UXWK KDV EHHQ H[WHQVLYHO\ UHVHDUFKHG LQ PXOWLSOH GHIDXOWWHFKQLTXHVWKDWFRPHWRPLQGZKHQLWFRPHVWREXLOGLQJ GLVFLSOLQHV SDUWLFXODUO\ SKLORVRSK\ :RUNV RI SKLORVRSKHUV WKHVHWRROV $FFRUGLQJ WR WKH SKLORVRSKHU 'DYLG +XPH UHDVRQ LV WKH OLNH$OIUHG-XOHV$\HUDQG'DYLG+XPHSURYLGHGHHSLQVLJKWV SULPDU\ PHFKDQLVP WR GLVWLQJXLVK EHWZHHQ WUXWK DQG IDOVLW\ LQWR WKH FRQFHSWV RI ZKDW LV WUXH DQG ZKDW LV QRW +RZHYHU +RZHYHURIWHQQDWXUDOREVHUYDWLRQVGRQRWFRQILUPWRORJLFDO SKLORVRSKLFDO WKHRULHV KDYH QRW EHHQ DEOH WR FRQFOXVLYHO\ GLVWLQJXLVK WUXWK IURP IDOVLW\ 7HFKQRORJ\ KDV SURJUHVVHG LQ UHDVRQLQJ$SSO\LQJORJLFDOUHDVRQLQJWRHPSLULFDOHYLGHQFHVWR OHDSVDQGERXQGV,IVRFLRORJ\SURJUHVVHGDWWKHVDPHSDFHDV GUDZ FRQFOXVLRQV LV IUDXJKW ZLWK GDQJHU )RU LQVWDQFH OHW XV WHFKQRORJLHV VXFK DV HOHFWURQLF GHVLJQ RU FRPSXWHU QHWZRUNV WDNHLQGXFWLYHUHDVRQLQJ3HUVRQµ$¶KDVEHHQKRQHVWZLWKWKH ZH ZRXOG SUREDEO\ EH KDYLQJ KHDYHQ RQ HDUWK E\ QRZ 6WLOO IXQGVLQKLVFRQWUROLQDOOWKHSURMHFWVKHKDVH[HFXWHG3URMHFW VRFLDOVFLHQFHVDOZD\VKDYHDQXSSHUKDQGIRUREYLRXVUHDVRQV µ;¶ KDV KDG VHYHUDO PDQDJHUV ZKR KDYH DOO EHHQ KRQHVW ZLWK ,Q WKLV VHFWLRQ ZH H[DPLQH WKH UROH RI WHFKQRORJ\ LQ WUDFLQJ WKH IXQGV %\ ORJLFDO LQGXFWLRQ RQH LV OLNHO\ DQG SRVVLEO\ WUXWK LQ VRFLDO VHWWLQJV DQG DOVR WRXFK XSRQ KRZ WKH :HE KDV LQFRUUHFWO\FRQFOXGHWKDWSHUVRQµ$¶LVZRUNLQJRQ3URMHFWµ;¶VR KHLVGHHPHGWREHKRQHVWZLWKWKHIXQGVUDLVHGIRU3URMHFWµ;¶ EHHQXVHGIRUFULPLQDODFWLYLW\E\ZD\RIOLHV ,Q SUREDELOLW\ DQG VWDWLVWLFV WKH IXQGDPHQWDO EDVLV IRU 7KHUHKDYHEHHQDQXPEHURILQVWDQFHVLQWKHUHFHQWWLPHV HVWDEOLVKLQJ WUXWK LV WKH %D\HV¶ WKHRUHP   /LNHOLKRRG 5DWLR RI WKH :HE EHLQJ XVHG IRU VSUHDGLQJ OLHV DQG VXSSRUWLQJ FULPLQDO DFWLYLW\ 7ZR \HDUV DJR LQ 2KLR   XQVXVSHFWLQJ MRE /5 LVRIWHQXVHGZLWKWKH%D\HV¶WKHRUHPWRLQYHVWLJDWHWUXWK VHHNHUV ZHUH OXUHG WR ZRUN LQ D FDWWOH IDUP E\ SRVWLQJ DQ LQ FULPLQDO FDVHV 7KHUH DUH D QXPEHU RI FDVHV ZKHUH %D\HV¶ ZKLFK LV JLYHQ LQ WKH ZHESDJH DGYHUWLVHPHQWLQ&UDLJVOLVWEXWZHUHUXWKOHVVO\H[HFXWHGZKHQ SOD\HG D PDMRU UROH D OLVW RI   /5 LV VLPSO\ WKH UDWLR RI WKH OLVWHG LQ WKH IRRWQRWH EHORZ WKH\ WXUQHG XS DW WKH IDUP %\ SURYLVLRQLQJ DQRQ\PLW\ DQG SUREDELOLWLHV RI WZR PXWXDOO\ H[FOXVLYH HYHQWV WKH HYLGHQFH IDOVH LGHQWLW\ WKH :HE KDV DOVR IDFLOLWDWHG VHULRXV FULPLQDO LVVXHV EDVHG RQ IDOVHKRRG VXFK DV RQOLQH LPSHUVRQDWLRQ JLYHQ WKH DVVXPWLRQ LV WUXH DQG WKH HYLGHQFH JLYHQ WKH ³UHYHQJH SRUQ´ DQG LGHQWLW\ WKHIW E\ DJJULHYHG H[ER\IULHQGV DVVXPSWLRQLVIDOVH,QFULPLQDOFDVHVW\SLFDOO\WKHDVVXPSWLRQ  8QLWHG 6WDWHV Y 6D\HU  LV SRSXODUO\ FLWHG LQ WKDW FDWHJRU\ LV WKDW WKH VXEMHFW LV JXLOW\ %D\HVLDQ 1HWZRUNV DUH XVHIXO ZKHUHWKHH[ER\IULHQGOXUHGXQH[SHFWHGFXVWRPHUVWRWKHJLUO¶V ZKHQ WKHUH DUH D QXPEHU RI HYLGHQFHV ZLWK FRPSOH[ KRXVH E\ SRVWLQJ KHU SLFWXUHV DQG FRQWDFW LQIRUPDWLRQ LQ LQWHUGHSHQGHQFHV(IILFLHQWDOJRULWKPVDQGVRIWZDUHH[LVWWRGR ³FDVXDO HQFRXQWHUV´ VHFWLRQ RI WKH &UDLJVOLVW ZLWKRXW KHU LQIHUHQFLQJ LQ %D\HVLDQ 1HWZRUNV +RZHYHU QRW DOO MXGJHV KDYHEHHQIDYRUDEOHWRXVLQJSUREDELOLW\DQGVWDWLVWLFVLQJLYLQJ FRQVHQWRUNQRZOHGJH YHUGLFWV ,Q D IDU UHDFKLQJ MXGJPHQW DQ (QJOLVK FRXUW RSLQHG 7KH DXWKRUV RI >@ GHWDLO LQ WKHLU SDSHU KRZ ³KRPLFLGH ³«DQG WR H[SUHVV WKH SUREDELOLW\ RI VRPH HYHQW KDYLQJ SHUSHWUDWRUV KDYH XVHG 6RFLDO 1HWZRUNLQJ :HEVLWHV ± DV   KDSSHQHGLQSHUFHQWDJHWHUPVLVLOOXVRU\´ UHDFWRUV LQIRUPHUV DQWDJRQLVWV SUHGDWRUV IDQWDVLVWV DQG (VWDEOLVKLQJ WUXWK LV WKH FUX[ RI OHJDO EDWWOHV 7UXWK LV LPSRVWHUV´ DQ DODUPLQJ WUHQG EDVHG RQ IDOVHKRRG 7KHUH DUH FDVHV RI VFKRROJRLQJ NLGV OLNH -XVWLQ &DUWHU   &DPHURQ SDUDPRXQWWRWKHH[LVWHQFHRIODZDQGLWVDSSOLFDWLRQ+RZHYHU '¶$PEURVLR DQG ³6DUDK´ WKH 'XWFK WHHQDJHU ZKR SRVWHG ³ZKDW LV WUXWK´ LQ OHJDO SURFHHGLQJV LV D KLJKO\ GHEDWDEOH YLROHQW IDOVH WKUHDWV RQ 6RFLDO 0HGLD :HEVLWHV DQG JRW LQWR DVSHFW,IERWKDGYHUVDULDOSDUWLHVWRDGLVSXWHDFFHSWDPDWHULDO GHHSWURXEOH,QTXLWHDIHZRIVXFKFDVHVWKHFRXUWDGMXGLFDWHG DYHUPHQWLWLVXVXDOO\GHHPHGWUXWK$WRWKHUWLPHVWUXWKLVD WKH SRVWLQJV DV ³WUXH WKUHDWV´ 7KH SRZHU RI WKH :HE LV PDWWHURISURRI$WVRPHRWKHUWLPHVWKHMXGJH¶VLQWHUSUHWDWLRQ LPPHQVH DQG FDQ PHVV ZLWK LQGLYLGXDO ULJKWV E\ MXVW DPRXVH RI ZKDW LV ODLG GRZQ LQ ODZ LV KHOG DV WKH WUXWK 7KHUH LV SUREDEO\ D UHDVRQ XQLTXH WR WKH OHJDO IUDPHZRUN WKDW RIWHQ ,,, 75$&,1*7587+,1+80$1(1'($9256





KWWSZZZQSURUJLQVHDUFKRIWKHUHG FURVVPLOOLRQLQKDLWLUHOLHI  KWWSSODWRVWDQIRUGHGXHQWULHVD\HU  KWWSSODWRVWDQIRUGHGXHQWULHVKXPH  KWWSZZZFQQFRPMXVWLFHRKLRFUDLJVOLVWNLOOLQJV  KWWSFDVHODZILQGODZFRPXVVWFLUFXLWKWPO  KWWSZDSRVWHZ(%OU  KWWSKXIIWR]Y);  KWWSZDSRVWQ.JV





KWWSZZZLFDFRUJKNQHZVOLVVXHHQJEXWWRQKWP  KWWSZZZWHOHJUDSKFRXNQHZVZRUOGQHZVDIULFDDQGLQGLDQRFHDQO LEHULD/LEHULDQVJHWQHDUO\\HDUVIRUPLOOLRQWKHIWRI 86DLGKWPO  KWWSSODWRVWDQIRUGHGXHQWULHVED\HVWKHRUHP  KWWSVVLWHVJRRJOHFRPVLWHED\HVOHJDOOHJDOFDVHVUHOHYDQWWR ED\HV  KWWSDLDWRPV0,7(&6(QWU\SHDUOKWPO  KWWSZZZEDLOLLRUJHZFDVHV(:&$&LYKWPO

ZLWK H[SHULHQFH D VFLHQWLVW HVWDEOLVKHV PDQ\ VXEWOH WUXWKV ZKHUHDV D ODZ\HU GLVFRYHUV KRZ WR VDIHO\ HVWDEOLVK RQHVHOI LQ JURVVOLHV%RWKDUHVWLOOTXDOLILHGZLWKDGRFWRUDWH 7HFKQRORJ\ KDV EHHQ XVHG WR PLVFDUU\ MXVWLFH 2QH RI WKH PRVWWUXVWHGDQGRIWHQXVHGIRUHQVLFWHFKQRORJ\QDPHO\'1$ WHVWLQJ LV DOVR QRW GHYRLG RI HUURUV DV SHU )%,¶V UHFHQW DFNQRZOHGJHPHQW   7KHUH DUH QXPEHU RI FDVHV ZKHUH ³MXQN VFLHQFH´ SOD\HG D NH\ UROH LQ WKH WUDYHVW\ RI MXVWLFH ,W LV WKHUHIRUHQDWXUDOWKDWWHFKQRORJLFDOHYLGHQFHLVDGPLWWHGE\WKH FRXUWVZLWKDTXLWHVRPHVNHSWLFLVPDQGFDXWLRQLQLWVTXHVWIRU WUXWK ,Q >@ WKH DXWKRUV H[WHQVLYHO\ GLVFXVV WKH OHJDO IUDPHZRUN JRYHUQLQJ H[SHUW RSLQLRQ DQG VFLHQWLILF WHFKQLFDO HYLGHQFH 2QH RI WKH IDFWRUV WKDW WKH FRXUWV XVH WR ZHLJK WKH WHFKQLFDOHYLGHQFHLVWKHJHQHUDODFFHSWDQFHRIWKHWHFKQLTXHE\ WKH WHFKQLFDO H[SHUWV DQG WKH VFLHQWLILF FRPPXQLW\ UHOHYDQW WR WKDW ILHOG $ORQJ WKH OLQHV SHHU UHYLHZ DQG SXEOLFDWLRQ RI WKH WHFKQLTXH LV DQRWKHU IDFWRU WKDW DLGV WKH FUHGLELOLW\ RI WKH WHFKQLFDO RSLQLRQ LQWURGXFHG DV HYLGHQFH $FFXUDF\ RI WKH UHVXOWV LV D QDWXUDO PHDVXUH RI WKH UHOLDELOLW\ RI D WHFKQLFDO SURFHVV ,Q VSLWH RI D IHZ OHWGRZQV WHFKQRORJ\ LV EHLQJ LQFUHDVLQJO\DGDSWHGWRGLVWLQJXLVKEHWZHHQWUXWKDQGILFWLRQ ,9 7587+)8/:(% $V ZH LQGLFDWHG LQ WKH SUHYLRXV VHFWLRQ WUXWKIXOQHVV RI LQIRUPDWLRQ EHFRPHV LQFUHDVLQJO\ LPSRUWDQW LQ WKH :HE RI 7KLQJV HUD :H VDZ KRZ IDOVHKRRG LQ VRFLDO PHGLD ZHEVLWHV FDQ FUHDWH KDYRF )DOVHKRRG LQ WHFKQLFDO PHGLD WRR FDQ EH D GLVDVWHU )RU LQVWDQFH IDLOXUH LV TXLWH FRPPRQ LQ VHQVRUV DQG LQIRUPDWLRQFROOHFWHGIURPVHQVRUVPD\QRWEHHQWLUHO\UHOLDEOH :KHQ VHQVRU QHWZRUNV DUH GHSOR\HG LQ D FULWLFDO HQYLURQPHQW VXFKDVLQPHGLFLQHRUDFRXQWU\¶VGHIHQVHWKHUHLVDQHHGIRU DQ HIILFLHQW PHFKDQLVP WR GHDO ZLWK WKH SRVVLEO\ LQFRPSOHWH XQFHUWDLQ DQG DPELJXRXV LQSXWV HPDQDWLQJ IURP WKH VHQVRUV DQGHVWDEOLVKWKHWUXWK 7KHOLWHUDWXUHVXUYH\HGLQVHFWLRQ,,JLYHVJRRGLQVLJKWVLQWR DQXPEHURIWRROVDQGWHFKQLTXHVWKDWFDQEHXVHGWRVROYHWKH SUREOHP RI WUXWK ILQGLQJ RQ WKH :HE +RZHYHU WKHUH DUH D QXPEHURIVKRUWFRPLQJVWKDWQHHGWREHRYHUFRPH/HWXVILUVW FRQVLGHUDPDFKLQHOHDUQLQJDSSURDFKWRWKHSUREOHPOLNHGRQH LQPRVWSDSHUVVXUYH\HG7ZLWWHUKDVEHHQDXVHIXOUHVRXUFHIRU TXLWH D IHZ KXPDQLWDULDQ DSSOLFDWLRQV VXFK DV SUHGLFWLRQ RI D GLVHDVH EUHDNRXW >@ DQG GLVDVWHU PDQDJHPHQW :H WKHUHIRUH VWDUW ZLWK WKH SUREOHP RI YHULI\LQJ WUXWK LQ WZLWWHU SRVWV DOVR FDOOHGDV³WZHHWV´ A. Establishing Ground Truth $UULYLQJ DW WKH WUDLQLQJ GDWD RU WKH JURXQG WUXWK LV D VXEVWDQWLDO WDVN LQ PDFKLQH OHDUQLQJ DSSOLFDWLRQV 0RVW RI WKH PDFKLQH OHDUQLQJ OLWHUDWXUH VXUYH\HG DERYH XVHV PDQXDO DQQRWDWLRQ IRU FROOHFWLQJ WKH GDWDVHW FRPSULVLQJ WKH JURXQG WUXWK )RU LQVWDQFH >@ FODLPV WKDW WKHLU GDWDVHW RI  PDQXDOO\ DQQRWDWHG WZHHWV LV WKH ODUJHVW GDWDVHW LGHQWLILHG IRU WKHSUREOHP0DQXDODQQRWDWLRQUHTXLUHVFURZGVRXUFLQJDQGLV SURKLELWLYHO\ H[SHQVLYH 2XU LQLWLDO H[SHULPHQWV VKRZ WKDW DXWRPDWHGDQQRWDWLRQLVSRVVLEOH 7UXH WZHHWV FDQ EH DXWRPDWLFDOO\ H[WUDFWHG EDVHG RQ D QXPEHU RI FKDUDFWHULVWLFV 2QH RI WKHP LV WR VHDUFK IRU WZHHWV ZKLFK LQFOXGH D UHSXWHG 85/ VRXUFH )RU LQVWDQFH XVLQJ D 



KWWSZDSRVW+%R(-9

GR]HQDXWKHQWLFDQGKLJKO\UHSXWHGKHDOWKUHODWHG85/VLQWKH VHDUFKSDWWHUQRQWKH7ZLWWHUZHEVLWHZHFRXOGJHWPRUHWKDQ WZHHWVWKDWDUHWUXH:HEURZVHGWKURXJKWKHWZHHWVDQG YHULILHG WKDW WKH\ DUH LQGHHG WUXH VR DQQRWDWHG WKHP DV WUXH $QRWKHUWHFKQLTXHLVWRVHDUFKIRURWKHUUHSXWHGVRXUFHVVXFKDV MRXUQDOERRNRUH[SHUWUHIHUHQFHVLQWKHWZHHWV )DOVH WZHHWV FDQ DOVR EH FROOHFWHG EDVHG RQ VLPLODU FRQVLGHUDWLRQV$WZHHWZKLFKUHLWHUDWHVDP\WKLVERXQGWREH IDOVH7RFRQILUPZHVHDUFKHGWZLWWHUIRUYDULRXVKHDOWKUHODWHG P\WKV DQG PLVFRQFHSWLRQV OLVWHG LQ UHSXWHG ZHEVLWHV VXFK DV ³0LFURZDYLQJ GHVWUR\V QXWULHQWV´ DQG FROOHFWHG VHYHUDO WKRXVDQGVRIIDOVHWZHHWV:HKDQGFKHFNHGDQXPEHURIWZHHWV DQGIRXQGWKHPWREHLQGHHGIDOVHDQGSHRSOHVWLOOEHOLHYHWKRVH P\WKV7KHVHWZHHWVDUHDXWRPDWLFDOO\DQQRWDWHGDVIDOVH7KHUH DUHDIHZIDOVHSRVLWLYHVWRRWKRXJKEXWQRWVLJQLILFDQWHQRXJK WRVNHZWKHPDFKLQHOHDUQLQJFODVVLILFDWLRQDOJRULWKPV B. Feature Extraction 0DFKLQH OHDUQLQJ DOJRULWKPV GHSHQG RQ IHDWXUHV H[WUDFWHG IURP WKH UHDO ZRUOG WR FODVVLI\ WKH GDWD 7KH IHDWXUHV DUH LQGLFDWLYH RI WKH FODVV WRZKLFK WKH GDWDEHORQJV 6RPH RI WKH IHDWXUHVWKDWZHEHOLHYHLQGLFDWHWKHYHUDFLW\RIWKHWZHHWVDUH JLYHQLQ7DEOH7KHIHDWXUHVDUHTXLWHLQWXLWLYH)RULQVWDQFHD XVHU ZKR LV UHSXWHG DV PHDVXUHG E\ WKH IHDWXUHV OLVWHG LQ WKH VHFRQGFROXPQRI7DEOHLVPRUHOLNHO\WRWZHHWWUXHYHULILHG VWDWHPHQWV$UHODWHGIHDWXUHLQ7DEOHLVZKHWKHUWKHWZHHWLV SLQQHG3LQQHGWZHHWVLPSDFWWKHUHSXWDWLRQRIWKHXVHUVRWKH SUREDELOLW\WKDWWKH\DUHWUXHLVKLJKHU4XRWDWLRQPDUNVLQWKH WZHHW XVXDOO\ LQGLFDWH VRPHWKLQJ VDLG E\ D UHSXWHG VRXUFH KHQFHLVDIHDWXUHIRURXUSXUSRVHV C. Classification 2QFH ZH KDYH WKH JURXQG WUXWK WUDLQLQJ GDWD  DQG WKH IHDWXUH VHW GHWHUPLQLQJ WUXWK LV D PDWWHU RI DSSO\LQJ DQ DSSURSULDWH FODVVLILHU 7KH FODVVLILFDWLRQ DOJRULWKP HVVHQWLDOO\ OHDUQVKRZWRLGHQWLI\WUXHWZHHWVDQGZKDWPDNHVDWZHHWIDOVH E\ DQDO\]LQJ WKH WUDLQLQJ GDWD ZLWK UHVSHFW WR WKH IHDWXUHV ,W ORRNV IRU SDWWHUQV LQ WKH GDWD FROOHFWHG DV JURXQG WUXWK DQG IRUPXODWHVLWVFRQFOXVLRQV6RLIDODUJHQXPEHURIWUXHWZHHWV LQ WKH WUDLQLQJ GDWD KDYH D QXPEHU RI UHSOLHV WKH IHDWXUH ³QXPEHURIUHSOLHV´LQ7DEOHLVJLYHQDKLJKHUZHLJKWDJHIRU WUXH WZHHWV 7KH SDWWHUQ OHDUQW LV WKDW LI D WZHHW KDV SOHQW\ RI UHSOLHV LW LV OLNHO\ WR EH WUXH 6LPLODU SDWWHUQV DUH OHDUQW DQG ZHLJKWVDVVLJQHGWRHDFKRIWKHIHDWXUHV 6RPHRIWKHWHFKQLTXHVXVHGLQWKHFODVVLILFDWLRQSURFHVVDUH OLVWHG LQ 7DEOH  (DFK RI WKHP KDV LWV RZQ DGYDQWDJHV DQG GLVDGYDQWDJHV EXW PRUH WKDQ WKH WHFKQLTXH RU DOJRULWKP LW LV RIWHQIRXQGWKDWWKHTXDQWLW\DQGTXDOLW\RIWKHGDWDFROOHFWHGWR HVWDEOLVKJURXQGWUXWKLVZKDWPDWWHUVPRVWWRWKHFODVVLILFDWLRQ 7KHELJJHUWKHGDWDWKHKLJKHUWKHFKDQFHVRISUHFLVHUHVXOWV )LJXUH  VKRZV WKH HQG UHVXOW RI WKH FODVVLILFDWLRQ HQYLVLRQHGLQWZRGLPHQVLRQV7KHOLQHRIVHSDUDWLRQRIWKHWUXH WZHHWVIURPWKHIDOVHRQHVLQWKHILJXUHLVWKHFODVVLILHUWKDWLV OHDUQWE\XVLQJRQHRIWKHFODVVLILFDWLRQWHFKQLTXHVLQ7DEOH 7KHFODVVLILHULVWKHPDWKHPDWLFDOHTXDWLRQSORWWHGDVWKHFXUYH LQWKHILJXUHZLWKWKHIHDWXUHVH[WUDFWHGLQVXEVHFWLRQ%DVWKH LQGHSHQGHQW YDULDEOHV 6LQFH WKHUH DUH PXOWLSOH LQGHSHQGHQW YDULDEOHV IHDWXUHV  WKH WZLWWHU VSDFH LV PXOWLGLPHQVLRQDO DQG WKH FODVVLI\LQJ FXUYH LV UHDOO\ D K\SHUSODQH LQ WKH VSDFH )RU VLPSOLFLW\ RI YLVXDOL]DWLRQ WKH VSDFH LV SURMHFWHG LQ WZR GLPHQVLRQVLQWKHILJXUH(DFKRIWKRVHIHDWXUHVLVZHLJKHGLQWR

)HDWXUH 1XPEHURIKDVKWDJVLQWKHWZHHW 1XPEHURIUHWZHHWV 1XPEHURIIDYRULWHG 1XPEHURIUHSOLHV 3UHVHQFHRI85/ 3DJHUDQNRIWKH85/ 3UHVHQFHRIUHIHUHQFHWRDQRWKHUXVHU )RUPDOLVPLQWKHWRQHRIWKHWZHHW QRDEEUHYLDWLRQVOLNH µG¶¶Q¶HWF  8VHRIDIILUPDWLYHGHILQLWLYHDEVROXWHZRUGVUDWKHUWKDQ ³PD\EH´ 0XOWLPHGLDFRQWHQW SKRWRYLGHRDXGLR  :KHWKHUJHRORFDWLRQHQDEOHG +DVKWDJXVHGLVOLVWHGDV ZRUOGZLGH WUHQGLQJ 3LQQHGWZHHWV 4XRWDWLRQPDUNV 8VHRIVRPHNH\ZRUGVXVHIXOUHVHDUFKFRQFOXGH FRQILUPDQQRXQFHFRQIHUHQFHDQVZHU'UVWXG\UHSRUW LQQRYDWLRQEORJIDFWVKHHW 3UHVHQFHRIQXPEHUV QXPEHUVXVXDOO\GRQ¶WOLH  3UHVHQFHRIDXWKHQWLFHQWLWLHVLQWKHWZHHWOLNH1,0+ :+21&, 8VHRIVODQJLQIRUPDOZRUGVW\SRVPHVVDJH DEEUHYLDWLRQVOLNHµG¶IRUµWKH¶DEXVHVOHWWHUVDQGI ZRUGV

)HDWXUH &RQWG 8VHUUHSXWDWLRQUHODWHG 1XPEHUIROORZLQJ 1XPEHURIOLVWVXVHULVRQ 6RFLDO6WDWXV,VWKHXVHUDFHOHEULW\" 1XPEHURIOLVWFDWHJRULHVLQZKLFKXVHULVIHDWXUHG 4XDOLW\RIOLVWQDPHV 1XPEHURIUHWZHHWVRIKLVSRVWV 1XPEHURIIDYRULWHG 1XPEHURIUHSOLHV 1XPEHURIWZHHWVRYHUDSHULRG 1XPEHURIUHIHUHQFHVWRWKHXVHULQRWKHUV¶WZHHWV #XVHU LQWZHHWV  1XPEHURISKRWRVDQGYLGHRV :KHWKHUWKHDFFRXQWLVDYHULILHGDFFRXQW 1XPEHURIIROORZHUVZHLJKWHGE\WKHLUIROORZHUVDQGVR RQ±VRPHNLQGRIDSDJHUDQNDOJRULWKP 1XPEHURI#XVHUUHIHUHQFHVLQWKLVXVHU¶VWZHHWVDQGWKH TXDOLW\RIWKRVHXVHUV 7UXVWZRUWK\FKDUDFWHULVWLFVRIXVHU¶VSURILOHDXWKHQWLF QDPHSKRWRSURIHVVLRQVFKRROLQJDVVRFLDWLRQVGDWHRI MRLQLQJGRPDLQQDPHVLQWKHHPDLOLG OLNHVWDQIRUGHGX  HWF 3DJHUDQNRIWKHXUOLQKLVSURILOH 1XPEHURI85/VLQKLVSRVWV NQRZOHGJHPRQJHU RYHUD SHULRGRIWLPH 3UHVHQFHRIWLWOHVOLNH³GU´³SURI´³JRYHUQRU´³PD\RU´LQ WKHKDQGOH

7DEOH)HDWXUHVWREHH[WUDFWHGIURPWKHWZHHWVGDWDIRU YHULI\LQJWKHLUYHUDFLW\

FRPLQJ XS ZLWK WKH FODVVLILFDWLRQ FXUYH 7KHVH ZHLJKWV DUH FRPSXWHGDQGWKHFXUYHLVILWWHGEDVHGRQWKHJURXQGWUXWKWKDW ZHFROOHFWHGLQVXEVHFWLRQ$7KHFXUYHLVILWWHGLQVXFKDZD\ WKDW WKH FODVVLILHU VHSDUDWHV WKH WUXH DQG IDOVH WZHHWV WKDW ZHUH FROOHFWHGDVJURXQGWUXWK 7KH ZHLJKWV IRU WKH IHDWXUHV FRPSXWHG XVLQJ WKH JURXQG WUXWKUHPDLQWKHVDPHIRUWKHHQWLUHVSDFH7KHZHLJKWVKHOSLQ GHWHUPLQLQJWKHVKDSHDQGHTXDWLRQFRUUHVSRQGLQJWRWKHFXUYH :KHQ D QHZ WZHHW QHHGV WR EH FODVVLILHG LW LV SORWWHG RQ WKH WZLWWHUVSDFHEDVHGRQLWVIHDWXUHVVXFKDVZKHWKHULWUHIHUVWRD 85/ WKH QXPEHU RI KDVKWDJV LQ WKH WZHHW LI WKH WZHHW LV SLQQHGKDVDQ\NH\ZRUGVDQGVRRQ%DVHGRQWKHVHIHDWXUHV WKHWZHHWLVFODVVLILHGDVWUXHRUIDOVHXVLQJWKHHTXDWLRQRIWKH FXUYH 

D. An Example to tie it all together /HWXVIRULQVWDQFHDVVXPHWKDWWKHIHDWXUHV³SUHVHQFHRID 85/ PXOWLPHGLD RU DXWKHQWLF HQWLWLHV VXFK DV :+2 LQ WKH WZHHW´ DUH ZHLJKHG KLJKHVW IRU WUXH WZHHWV EDVHG RQ WKH FODVVLILHU IURP 7DEOH  WKDW ZH XVHG DQG WKH JURXQG WUXWK ZH FROOHFWHG/HWXVIXUWKHUDVVXPHWKDWWKRVHIHDWXUHVDUHIROORZHG E\ WKH QXPEHU RI UHWZHHWV UHSOLHV DQG IDYRULWHV LQ WHUPV RI ZHLJKWDJH,IWKHQHZWZHHWKDVDOORIWKHVHIHDWXUHVWKHWZHHW LVOLNHO\WREHFODVVLILHGDVWUXHE\WKHDOJRULWKP2QWKHRWKHU

KDQGLIWKHQHZWZHHWGRHVQRWKDYHDQ\RIWKHVHIHDWXUHVLWLV OLNHO\ WR EH FODVVLILHG DV IDOVH 6LPLODUO\ LI WKH IHDWXUHV ³SUHVHQFHRIVODQJW\SRVDQGDEEUHYLDWLRQV´LVUDQNHGKLJKIRU WKH IDOVH WZHHWV DQG WKH QHZ WZHHW LV UHSOHWH ZLWK WKHP LW LV OLNHO\WREHFODVVLILHGDVIDOVH E. Other Approaches $ VXPPDU\ RI DSSURDFKHV DQG WKH WHFKQLTXHV WKHUHLQ WKDW KDYH EHHQ XVHG LQ WKH H[LVWLQJ OLWHUDWXUH WR YHULI\ WUXWKIXOQHVV DUH SUHVHQWHG LQ 7DEOH  $ IHZ DXWKRUV KDYH XVHG YRWLQJ WR GHWHUPLQHWUXWKEDVHGRQWKHQXPEHURIVRXUFHVWKDWFRQILUPD

)DOVH 7ZHHWV 7UXH7ZHHWV )LJXUH7ZLWWHU6SDFH&ODVVLILHGLQWR7UXHDQG)DOVH7ZHHWV

VWDWHPHQW +RZHYHU LW LV QRW OLVWHG LQ WKH WDEOH EHFDXVH WKH DSSURDFKLVQRWHIIHFWLYHRQWKH:HE:LWKWKHDGYHQWRI:HE  DQG :HE &RQWHQW 6\QGLFDWLRQ WKH VDPH LQIRUPDWLRQ LV RIWHQDYDLODEOHIURPPXOWLSOHVRXUFHVDOORIZKLFKPD\EHIDOVH 7KH :HE VSUHDGV LQIRUPDWLRQ UDSLGO\ DQG HDVLO\ HLWKHU DXWRPDWLFDOO\ WKURXJK ZHE V\QGLFDWLRQ RU WKURXJK PDQXDO SRVWLQJ$YRWLQJPDMRULW\ZLOOQRWWKHUHIRUHKHOS $SSURDFK

7HFKQLTXHV

6WDWLVWLFDO&ODVVLILFDWLRQ

/RJLVWLF 5HJUHVVLRQ 1DwYH %D\HV'HFLVLRQ7UHHV690 NQHDUHVWQHLJKERU

2WKHU0DFKLQH/HDUQLQJ

)X]]\ /RJLF ,QIHUHQFH LQ SUREDELOLVWLF PRGHOV (0 EDVHGRSWLPL]DWLRQ

1DWXUDO /DQJXDJH 3URFHVVLQJ 3DUVH 7KLFNHW 0HDVXULQJ 1/3  IRUPDOLW\ /RJLF3URJUDPPLQJ

 

%HOLHIDXJPHQWHG )UDPHV %$) XVHGZLWK2:/

7DEOH([LVWLQJDSSURDFKHVWRHVWDEOLVKLQJWUXWK

$OORIWKHDSSURDFKHVVRIDUZRUNDIWHUWKHIDFWYHULI\LQJ ZKHWKHU WKH LQIRUPDWLRQ DOUHDG\ SRVWHG RQ WKH :HE LV WUXH RU IDOVH7KHUHLVQRLQGLFDWLRQRIDQ\ZRUNWKDWFDQSUHYHQWIDOVH LQIRUPDWLRQ IURP JHWWLQJ SRVWHG RQ WKH :HE .QRZOHGJH UHSUHVHQWDWLRQ FDQ KHOS LQ GHWHFWLQJ DQDPROLHV DQG LQFRQVLVWHQFLHVLQWKHUHSUHVHQWHGVWDWHPHQWVDQGSRVVLEO\KHOS LQWKHWDVN F. Formal Methods and Knowledge Representation )DOVHKRRG SUHYDLOV ZKHQ WKH VRXUFHV RI LQIRUPDWLRQ DUH GLVFRQQHFWHG DQG FURVVYHULILFDWLRQ EHFRPHV DQ LVVXH &RQQHFWLQJ WKH LVODQGV RI LQIRUPDWLRQ RQ WKH :HE DQG UHDVRQLQJ ZLWK LW FDQ KHOS YHULI\ WKH WUXWK RI DQ\ LQFRPLQJ LQIRUPDWLRQ RQ WKH :HE ,QWHOOLJHQFH LV HVVHQWLDOO\ DERXW FRQQHFWLQJ GLYHUVH EORFNV RI LQIRUPDWLRQ DQG GHULYLQJ QHZ FRQFOXVLRQV2QHRIWKHFRQFOXVLRQVFDQEHWKHYHUDFLW\RIWKH LQIRUPDWLRQ+XPDQEUDLQKDVLQVSLUHGDQXPEHURIFRPSXWLQJ FRQFHSWV DQG FDQ SRWHQWLDOO\ JXLGH VROXWLRQV WR WKH YHUDFLW\ SUREOHPDVZHOO 7KH EUDLQ FRQQHFWV GLVFUHWH SLHFHV RI LQIRUPDWLRQ WR IDFLOLWDWHUHDVRQLQJOHDUQLQJIRUPLQJQHZSRROVRINQRZOHGJH DQG YHULI\LQJ WKH WUXWKIXOQHVV RI QHZ LQIRUPDWLRQ ,R7 KDV SURYLVLRQHG WKH :HE ZLWK VHQVRU\ FDSDELOLWLHV 7KH LPSRUWDQW VWHSV WRZDUGVPDNLQJ WKH:HE HQWLUHO\ WUXWKIXO DUH WR FRQQHFW DOOUHOHYDQWLQIRUPDWLRQVRXUFHVLQFOXGLQJWKRVHVHQVHGWKURXJK WKH:HERI7KLQJVDQGWRLQFRUSRUDWHLQWRWKH:HEUHDVRQLQJ DQG WKH DELOLW\ WR OHDUQ $W WKH FUX[ RI WKLV SUREOHP LV .QRZOHGJH5HSUHVHQWDWLRQ ,QWHOOLJHQWSURFHVVLQJDQGWUXWKYHULILFDWLRQLVSRVVLEOHRQO\ YLDDVXLWDEOHUHSUHVHQWDWLRQRIWKHNQRZOHGJH7RLOOXVWUDWHWKH VLJQLILFDQFH RI VXLWDEOH UHSUHVHQWDWLRQ OHW XV VXSSRVH WKH )LOH 6\VWHP LQ 8QL[ ZDV UHSUHVHQWHG DV DUUD\V LQVWHDG RI DV WUHHV 1R DPRXQW RI DOJRULWKPV ZRXOG KDYH KHOSHG LQ XVLQJ WKH ILOH V\VWHPZLWKWKHVDPHHDVHDVZHGRWRGD\6RUHSUHVHQWDWLRQRI LQIRUPDWLRQLVNH\WRZKDWZHFDQGRZLWKLW7KHSUREOHPRI 



KWWSZZZZRUJ:R7

.QRZOHGJH 5HSUHVHQWDWLRQ .5  KDV H[LVWHG IRU GHFDGHV 7KH ¶V VDZ D JUHDW LQWHUHVW LQ ([SHUW DQG 3URGXFWLRQ V\VWHPV ZKLFK SUHGRPLQDQWO\ UHOLHG RQ +RUQ &ODXVH UHSUHVHQWDWLRQ RI WKH NQRZOHGJH 352/2*  ZDV XVHG IRU LPSOHPHQWLQJ WKH V\VWHPV 7KUHH GHFDGHV ODWHU WKH SUREOHP RI .QRZOHGJH 5HSUHVHQWDWLRQ LV VWLOO QHZ DQG ZH DUH FRQWLQXLQJ WR ORRN IRU QHZZD\VWRVROYHLW7KHFXUUHQWO\SRSXODU)LUVW2UGHU/RJLF )2/  EDVHG DSSURDFK LV WR XVH 'HVFULSWLRQ /RJLFV FDOOHG 2:/EDVHGRQ5')WKDWKDVEHHQVWDQGDUGL]HGE\WKH:& FRQVRUWLXPDQGLVWKHEXLOGLQJEORFNRIWKHVHPDQWLFZHE 2EMHFW 2ULHQWHG 3URJUDPPLQJ FKDQJHG WKH ODQGVFDSH RI VRIWZDUH0RVWSURJUDPPLQJDQGHYHQVFULSWLQJODQJXDJHVVXFK DV 3HUO KDYH LQFRUSRUDWHG 2EMHFW 2ULHQWHG IHDWXUHV LQ WKHP .QRZOHGJH 5HSUHVHQWDWLRQ LV QRW DQ H[FHSWLRQ HLWKHU ,W QRZ LQFRUSRUDWHV 2EMHFW 2ULHQWHG FRQFHSWV ± QRW LQ WKH IRUP RI +RUQ¶V &ODXVHV EXW LQ WKH RUWKRJRQDO V\VWHP RI 5') EDVHG ODQJXDJHV,QIDFWPRVWRIWKHLQIHUHQFLQJLQVXFKORJLFV\VWHPV LV EXLOW DURXQG WKHVH 2EMHFW 2ULHQWHG FRQFHSWV 5') LV RUWKRJRQDO WR WKH FRQYHQWLRQDO ORJLF UHDVRQLQJ ODQJXDJHV OLNH 352/2* 7KDW PHDQV NQRZOHGJH UHSUHVHQWHG DV +RUQ¶V &ODXVHVFDQQRWHDVLO\EHUHSUHVHQWHGLQ5')DQGYLFHYHUVD 1HLWKHU WKH +RUQ &ODXVH EDVHG PHFKDQLVPV QRU WKH 'HVFULSWLRQ /RJLFV EDVHG RQ 2:/ DUH HQWLUHO\ ORJLF WKRXJK 7KHUHIRUH V\VWHPV EXLOW XVLQJ WKHVH DUH VRXQG EXW QRW FRPSOHWH7KDWLVZKDWHYHULVLQIHUUHGIURPWKHV\VWHPLVWUXH XQGHUHYHU\LQWHUSUHWDWLRQRIWKHV\VWHPPRGHOHGEXWQRWHYHU\ WUXWK LQ WKH V\VWHP FDQ EH LQIHUUHG ORJLFDOO\ 6RXQG DQG FRPSOHWH V\VWHPV  DUH FRPSXWDWLRQDOO\ FRPSOH[   VR WKH .QRZOHGJH 5HSUHVHQWDWLRQ PHFKDQLVPV VR IDU KDYH WUDGHG LW RIIIRUHIILFLHQF\ 7KH GRZQVLGH RI WKH WUDGHRII FKRLFHV RI WKH FXUUHQW .QRZOHGJH 5HSUHVHQWDWLRQ PHFKDQLVP LV WKDW WKH\ DUH QRW DV SRZHUIXORUJHQHUDODV)2/6\VWHPV9HULI\LQJWUXWKIXOQHVVLQ )LUVW 2UGHU /RJLF LV GRQH PXFK PRUH V\VWHPDWLFDOO\ E\ YHULI\LQJORJLFDOFRQVHTXHQFHZKHUHDVWKHH[LVWLQJ.QRZOHGJH 5HSUHVHQWDWLRQ PHFKDQLVPV GHSOR\ DGKRF LQIHUHQFLQJ PHFKDQLVPV VXFK DV VXEVXPSWLRQ IRU UHDVRQLQJ 6XEVXPSWLRQ LV WKH LGHD ZKHUH RQH FRQFHSW LV D VXSHUVHW VXEVXPHV  RI DQRWKHU FRQFHSW $ JRRG H[DPSOH LV WR VD\ WKDW WKH )2/ VXEVXPHV 'HVFULSWLRQ /RJLFV XVHG LQ WKH FXUUHQW .QRZOHGJH 5HSUHVHQWDWLRQPHFKDQLVPV)2/ZRUNVLQWHUPVRISUHGLFDWHV ZKHUHDVWKH.QRZOHGJH5HSUHVHQWDWLRQ PHFKDQLVPV LQWHUQDOO\ ZRUN ZLWK DGKRF GDWD VWUXFWXUHV VXFK DV JUDSKV 6XFK D UHSUHVHQWDWLRQ LV FORVH WR WKH WHFKQLTXHV VXFK DV %D\HVLDQ 1HWZRUNV VR LV D JRRG FDQGLGDWH IRU XVLQJ 3UREDELOLVWLF *UDSKLFDO0HWKRGVIRUFKHFNLQJYHUDFLW\ ,QVXPPDU\UHYLVLWLQJIRUPDOPHWKRGVLQVHDUFKRIDUREXVW .QRZOHGJH5HSUHVHQWDWLRQRQWKH:HEVHHPVWRKROGSURPLVH LQVROYLQJWKHSUREOHPRIYHUDFLW\ 

9 &21&/86,21 7KH :HE LV D FUXFLDO PHGLXP IRU GHOLYHULQJ KXPDQLWDULDQ LQIRUPDWLRQ DQG VHUYLFHV 7UXWKIXOQHVV RI LQIRUPDWLRQ LV D 

KWWSSODWRVWDQIRUGHGXHQWULHVUHDVRQLQJDXWRPDWHG KWWSSODWRVWDQIRUGHGXHQWULHVPRGHOWKHRU\IR  KWWSZZZZRUJ5')  KWWSZZZZRUJVWDQGDUGVVHPDQWLFZHE  KWWSSODWRVWDQIRUGHGXHQWULHVORJLFFODVVLFDO  KWWSSODWRVWDQIRUGHGXHQWULHVFRPSXWDWLRQDOFRPSOH[LW\  KWWSSJPVWDQIRUGHGXLQWURSGI  

IXQGDPHQWDO DVSHFW RI WKH :HE LQ LWV KXPDQLWDULDQ UROH 7KH SDSHU SUHVHQWHG KRZ WKH QRWLRQ RI WUXWK KDV EHHQ UHVHDUFKHG DQGHVWDEOLVKHGLQPXOWLSOHILHOGVRIVWXG\$QXPEHURILGHDV RQ KRZ WHFKQRORJ\ FDQ KHOS WUDFH WKH WUXWK KDYH DOVR EHHQ SUHVHQWHG7KHLGHDVSUHVHQWHGOHDGWRSOHQW\RIVFRSHIRUIXWXUH UHVHDUFK SDUWLFXODUO\ LQ PDNLQJ WKH:HE HQWLUHO\ WUXWKIXO:H ZLVK WR FRQWLQXH H[SORULQJ .QRZOHGJH 5HSUHVHQWDWLRQ PHFKDQLVPV RQ WKH :HE DV ZHOO DV 0DFKLQH /HDUQLQJ WHFKQLTXHVWKDWFDQKHOSLQHVWDEOLVKLQJYHUDFLW\RILQIRUPDWLRQ RQ WKH :HE )RU LQVWDQFH D 0DFKLQH /HDUQLQJ DSSURDFK WKDW KDV QRW EHHQ H[SORUHG LQ WKH H[LVWLQJ OLWHUDWXUH LV WR XVH ./ 'LYHUJHQFH WR HYDOXDWH KRZ PXFK D JLYHQ WH[W GHYLDWHV IURP WKHWH[WNQRZQWREHWUXH:HKRSHWRHYHQWXDOO\FRPHXSZLWK DUHSUHVHQWDWLRQDQGDOJRULWKPVWKDWZRUNRQWKHUHSUHVHQWDWLRQ WRDOORZWUXWKDQGRQO\WUXWKWREHSRVWHGWRWKH:HE $&.12:/('*0(17 The authors gratefully acknowledge Dr. Yi Fang, Santa Clara 8QLYHUVLW\ for thought provoking discussions and advice pertaining to the material presented in section IV 5()(5(1&(6 >@3HQG\DOD96 6KLP66  7KH:HEDVWKHXELTXLWRXV FRPSXWHU&RPSXWHU  ,((( >@3HQG\DOD966KLP66 %XVVOHU&  7KH:HE7KDW ([WHQGVEH\RQGWKH:RUOG&RPSXWHU  ,((( >@ 3HQG\DOD 9 6  +ROOLGD\ -  6HSWHPEHU  3HUIRUPLQJ ,QWHOOLJHQW 0RELOH 6HDUFKHV LQ WKH &ORXG 8VLQJ 6HPDQWLF 7HFKQRORJLHV,Q,(((*U& SS  >@ 3HQG\DOD 9 6 )DQJ @@-XOLiQ,UDQ]R30RUHQR*3HQDEDG- 9i]TXH]&   $ )X]]\ /RJLF 3URJUDPPLQJ (QYLURQPHQW IRU 0DQDJLQJ 6LPLODULW\ DQG 7UXWK 'HJUHHV (OHFWURQLF 3URFHHGLQJV LQ 7KHRUHWLFDO &RPSXWHU 6FLHQFH (37&6 9ROXPH  SS    ,661  $YDLODEOH KWWSG[GRLRUJ(37&6 >@ 'RUL+DFRKHQ 6  $OODQ -   $XWRPDWHG &RQWURYHUV\ 'HWHFWLRQRQWKH:HE,Q$GYDQFHVLQ,QIRUPDWLRQ5HWULHYDO SS  6SULQJHU,QWHUQDWLRQDO3XEOLVKLQJ >@ *HOHLMQVH * 6FKHGO 0  .QHHV 3  6HSWHPEHU  7KH 4XHVWIRU*URXQG7UXWKLQ0XVLFDO$UWLVW7DJJLQJLQWKH6RFLDO :HE(UD,Q,60,5 SS  >@ %D 0 / +RULQFDU 5 6HQHOODUW 3  :X +  0D\  7UXWK )LQGLQJ ZLWK $WWULEXWH 3DUWLWLRQLQJ ,Q 3URF :HE'% 6\GQH\$XVWUDOLD >@'RQJ;/*DEULORYLFK(0XUSK\.'DQJ9+RUQ: /XJDUHVL &   =KDQJ :   .QRZOHGJH%DVHG 7UXVW (VWLPDWLQJ WKH 7UXVWZRUWKLQHVV RI :HE 6RXUFHV DU;LY SUHSULQW DU;LY >@:DJXLK'$*RHO1+DPPDG\+0 %HUWL(TXLOOH/   $OOHJDWRU7UDFN &RPELQLQJ DQG 5HSRUWLQJ 5HVXOWV RI 7UXWK'LVFRYHU\IURP0XOWLVRXUFH'DWD,&'( >@ @.ÕFÕPDQ( 0D\ 20*LKDYHWRWZHHWWKDWDVWXG\RI IDFWRUV WKDW LQIOXHQFH WZHHW UDWHV ,Q 3URFHHGLQJV RI WKH 6L[WK ,QWHUQDWLRQDO$$$,&RQIHUHQFHRQ:HEORJVDQG6RFLDO0HGLD >@ @ 6W /RXLV &  =RUOX *   &DQ 7ZLWWHU SUHGLFW GLVHDVH RXWEUHDNV"%0- >@ :DQJ ' .DSODQ / /H +  $EGHO]DKHU 7  $SULO  2Q WUXWK GLVFRYHU\ LQ VRFLDO VHQVLQJ $ PD[LPXP OLNHOLKRRG HVWLPDWLRQ DSSURDFK ,Q 3URFHHGLQJV RI WKH WK LQWHUQDWLRQDO FRQIHUHQFH RQ ,QIRUPDWLRQ 3URFHVVLQJ LQ 6HQVRU 1HWZRUNV SS  $&0 >@6WDQWRQ,,HRQJ6 0LVKUD1 -XO\ &LUFXPORFXWLRQ LQ GLDJQRVWLF PHGLFDO TXHULHV ,Q 3URFHHGLQJV RI WKH WK LQWHUQDWLRQDO $&0 6,*,5 FRQIHUHQFH RQ 5HVHDUFK  GHYHORSPHQWLQLQIRUPDWLRQUHWULHYDO SS $&0 >@ .OHLQEHUJ - 0 .XPDU 5 5DJKDYDQ 3 5DMDJRSDODQ 6  7RPNLQV $ 6   7KH ZHE DV D JUDSK PHDVXUHPHQWV PRGHOV DQG PHWKRGV ,Q &RPSXWLQJ DQG FRPELQDWRULFV SS   6SULQJHU%HUOLQ+HLGHOEHUJ >@'RQJ-6)HQJ@ *DOODQG $ $ELWHERXO 6 0DULDQ $  6HQHOODUW 3  )HEUXDU\ &RUURERUDWLQJLQIRUPDWLRQIURPGLVDJUHHLQJYLHZV,Q 3URFHHGLQJVRIWKHWKLUG$&0LQWHUQDWLRQDOFRQIHUHQFHRQ:HE VHDUFKDQGGDWDPLQLQJ SS $&0 >@ /L ; 'RQJ ; / /\RQV . 0HQJ :  6ULYDVWDYD '   7UXWK ILQGLQJ RQ WKH GHHS ZHE LV WKH SUREOHP VROYHG" 3URFHHGLQJVRIWKH9/'%(QGRZPHQW   >@ =KDR % 5XELQVWHLQ % , *HPPHOO -  +DQ -   $ ED\HVLDQDSSURDFKWRGLVFRYHULQJWUXWKIURPFRQIOLFWLQJVRXUFHV IRUGDWDLQWHJUDWLRQ3URFHHGLQJVRIWKH9/'%(QGRZPHQW    >@ %OHLKROGHU -  1DXPDQQ )   'DWD IXVLRQ $&0 &RPSXWLQJ6XUYH\V &685    >@ -DUGDW 5   $FFRXQWLQJ 7UDQVSDUHQF\ DQG ³7UDQVODWLRQ´ 7KH &DVH RI +80$1,7$5,$1 &URVV &XOWXUDO *RYHUQDQFH ,VVXHVLQ6RFLDODQG(QYLURQPHQWDO$FFRXQWLQJ   >@ 0RVV . /   7KH $GPLVVLELOLW\ RI 7UXH$OOHOH $ &RPSXWHUL]HG'1$,QWHUSUHWDWLRQ6\VWHP:DVK /HH/5HY  >@