Home
Add Document
Sign In
Create An Account
Dynamic Trees: A Structured Variational Method Giving Efficient ...
Recommend Documents
No documents
Dynamic Trees: A Structured Variational Method Giving Efficient ...
Download PDF
1 downloads
0 Views
208KB Size
Report
Comment
Amos
J Storkey. Institute of ... nodes into layers; nodes
can
only choose a parent from the layer .... Here we
will
quickly outline the general variational ap- proach ...
!#"$% & '()+*,-'.!0/1 32 4576987 :( ;$'(
C
=9
,
,
9
D
]ZhgÜgl]Þ ` aR_S hg\ l]r-ja_EHftz Z]`NC \ e_Wg^gsl]SU` e_LN\wbyY[SajZ]ll]\ ajgOth_^_E Z]Z]\ -j\rsajSvW\wGNYxG \ \wWgY &fjZ]Y ^_gbyZx` ajZ]n \hPn Wgatfc£lmfcY4fcrs¥ n n` Z]Z]`4glm\wYYacZ]bPajZ]jg` `:Z]gfc`4h_lN¢ { \ÂjWP¥ Y[ZmfcajWUlsZ]\wft`NZ]fj`NzmeDFit`4fcivn \w^ge_`%`4WUacZ]bp\wñ´fcn ìò ¥ Wga_e_`j{q\ Wg\ Z]\wfcn \wYx`DZ]g;` 4Hìò Z]a Z]g` Ã_¥ l]ajhPfcUftZ]`:Z]g` 4itfcn ^g`NY^ghZ]g`%Wg` Z[£ ajl]¤^PYx\ WgAÊ UË3¥ ÇgfcWP¥eo hgfcl]nwz aj^ghPnwfcftUZ]ft`µZ]Z]`gZ]`=g`z ajrsWPe_`Nfc\ Z]WP\ ajYWPe_fcatn £ WZ]e_g\wY[` Z]e_l]\ }vgWP^_fcZ]rs\ ajWP\wzY Z]^Pl]`4Yx`\ Wg^P©Yx\ Ê Wgc Ë Ê UË3¥ fc n¥ l]`N:fje_h_}.Z]\ rsz4fc\wnwYxz `.^gnwZ]ftgZ]` `NeM¥ ^PYx\ Wg+Ê[ÂjÂRËfcWPeZ]gB` 4¶Ï Y(fcWPeªç Ï Y jijg`4`4¥ WPl] jz `4`j`4WPhH¥ z `Noq`ftajZ\wYWv^gijl]WU`N`4Z]e_l]\ j^Pnp`4z YxWP`N^gz es\ `&Zmftfc\wZqgY n `Nj`fj^Pzmz fcsajlmWvfcY[ijZ]WU`4`4Z]l]h.`4j`Nfc`4eDWPWPHz es`&`N\wz4Y\ fcWH^PZ]ajYxg^g`µ`WPZ]e_g%`N`=èªes%He_èª\`4ijn at`4e_lx£ \ ¢¢ vhH} aj\ WUô4Zµ`4l]acaPb¥Z]¦g`sg`.%hHèaje_\ WU\ ijZ=`4acl]bj`4z WPajz Wv`jij{H`4Hl]j`N`4z4WPfc^Pz `sYx`s\wYftZ:fAZ]n Pa_ftz4ZµfcnhHZ]aj^g\ WUl]WgZ%\ Wgfcn n Z]g`%l]`4n `4itfcWUZ hPfclxZ]\wfcn¶e_`4l]\ itftZ]\ ij`NYfcl]`µô4`4l]aP¥ %ضP¾xÕØ º _ (´»qÕ :P¾xU» º ¾X [»» Ô %Ø x¾[ Ø :g» : pg¾[» º V°n \ZrsP\ fjZNYp{PZ]fcgn l]\w`NYfjite_fc}&l]\wHft`4Z]`4\ ajWWPrsfcn³`4fcWUhgZ]\ hgajl]WgaU`Nfje%zmZ]PHft`NZpz \ ajWrsZ]g`NY`HYx\ `4Wgn j\ ` n b`qhghPl]fcajl]hP`4WUftZ¢ Uhgftl]ajZ]\rsajW¶\wYx{R\ WgfcWPPeµ{tHg`N`4z4WPfcz ^P`Yx`j\ \ ijZq`NYxYH^gZ]jgj` `Nz Y[ajZmY¶l]l]Z]`NPz3ftZMZ` \gWsfjYxz3\Z³Z]^Pl]`NftYxZ]^g\ ajn ZNWP¥³Y¦£ gg\wY¶`4l]\w`Y Z]\ rg`4fcl]j``\wY Ê«fsajWghH`=`Nfce_¤jaj`NrseA\ é¬WPfce_WU\wZ:Y[Z]Y[l]Z]\ l]g^P^_z3Z]Z]\ ^gajlmWHfcË3n¶{_\ Z]WUgZ]`4`4Wl]hgZ]l]g` `%ZmfthgZ]l]\ ajajWPfcacgb\ nZ]\ gZ[}` e_\wY[Z]l]\ g^_Z]\ ajWatij`4l Z]g`µWga_e_`Y[ZmftZ]`NY Yxgaj^gnweH`fjz4z ^glmftZ]`j¥ VX\ Z=Wz fjajeg^ge_nw\e§Z]\ aj£ W(`4n Z]na%HWg`ac\Z]WP\ WgY[Z]µl]Z]^Pgz3` Z]\ ijH`(`4n \Z]` a©bMhgz ajl]ajrshPhPfcfcUl]ft`=Z]\ Z]ajgW=`n \l]rs`NYx\ ^gZ n z4ZmfjYµYxac`jb { Z]fcgU\wftYZ]it\ ajfcW¶l]\w¥ÖftZ]\è¶ajavWPajfchvn_}rshg` Z]l]gaja_hPesfcU£ ft\Z]Z]\ (ajW¡Z]gfc`nwYxl]a`NYxP^gfjn ZmY.YZ]acgb´`n avajY]fchvrs}`§hgl]ajajWgh_` ¢ hPfcl]`4WUZ n \ rs\ ZN{gg^_Zj\ ij`NY e_\ Å´`4l]`4WUZhgl]ajhPfcUftZ]\ ajW.l]^gn `NY4¥ naj¦av_gajZm\whvfcY}\ W%ithgfcf l]l]aj\wn atfthP£Z]fc\ aj`4UlMWPftHZ]fc\ nqajaj^gW¶fcWPhg¥ eµhg l]aj\aUlmW&fjY[Z&zmZ]gfc`WPPn efjajY% byajhgrl]l]`4fcajrsWvP}aUfcgY[fjZ:\ ne_\\ Z[itZµ}:fcfcWUacn ZmnbUatfcZ]£jg`NY ` Y%eg^PatftY ijZmZ]`4fga l ¥ ¦õ±ge_\wY\wY[z4Z]fcl]W\ gH^_`Z]\ aj^PW¶Yx`N¥(eµ®vZ]`Na:z naj`NWPfceAl]W%Z]gZ]g`s` ititfcfcl]l]\w\ftajZ]^P\ ajY¶WPhPfcfcnlmfcfchgrshg` l]Z]aU`4fjlmzmY¶AacbghgZ]l]gac` ¢ ivfcWP\we_e`NYÀ[ajf(\ WUbyZ%^gn hgnPl]À[ajajP\ WUfcZ:g\e_n \\wZ]Y[\Z]`Nl]Y\ gZ]^_aZ]\ Haj`W¶¥z4fc¦nwz g^g\wY:nwftfcZ]n`Nn eMat£¥ Y ajz ajlµWP` e_g\ fcZ]\rsajWPhgfcn ` n Z]Y[gZ]l]`=^Pz3hgZ]l]^gajl]P`(fcgz4fc\ n W©\ Z[}DH`sacbqz4fcz `4nwz lx^gZmfcnwft\ WAZ]`NWgeMa_¥µe_¦`NY g\ bylmajeMl&{´YxHhH`N`Nz4z fc\ ¨H^Pz=Yx`=zmZ]ggaj`\wz by`NajY l]racb hHhgfcWPl]aUaRe¡Y]_Yx\ \ rsgrn ` `ftZ]Z]gZ]\ ajaªa_WDe¡P£ fRacij\b%n `An¶Z]HgYxaj`%` rsjfcav`Ahga_hg\ eMWUl]¥aRZ]^g_\\ Z]r\ ajftW¡Z]\ ajfcWKHajfc^_l]ZD`A£ ` _ghg`4nW+\wz \Z]ZNg{:`§\ Zfch_\wY¢ `4hgè¶ijl]avaj`4ajlsPhvfc}©\ Z.g\hg\wn \Ysl]Z]aj\ ¤vhP`NWgY4fc{&atU£ fte_Z]W`N\ YxajhgZ]W§a\ Z]P` Hfj`A\YµZmYjWgavajfca_Wghge+`hgl]acftaRb Z._Z]\ z4rgfc`NnwftYxz Z]`s^g`§nwbyft`NWPZ]ftft\ Z]WgZ]^g^gl]l]`Nr`jY4¥ ¥Dfcl]j\atfcWP£l]fc\ ¢¢ n Z]jftl]Z]av\ \ a_gaje^_WPZ]fcr\ nqajfcW9rsl]j` \wYZ]\ WPgfFfca_nwegY4jYs¥av¦a_z4fceKgWF\wY:fcHhg\w`DYhgl]Hl]aR`4`N_nwz4ft\ fcrZ]^P\ ijftYx`4Z]`=\n aj} `4W¶ijhH`4{ avWAZ]ajg\ lsb\wYZ]ftgZ(e_`\whgY[À[Z]l]ajl]a_\\ e_WUg^PZµ^_z Z]e_\\ ajWg\wY[W ¢ z ajl]l]`NYxhHajWPegY´Z]a:ajWg`qrs\ Wg\ rfacb_Z]g`%è.e_\ ij`4l]j`4WPz `j¥ `4W_¢ %*
#
,
0
$
"
#"
$
"
$
$
+'
$
`4rlmftfcZ]n n \ } ajW£ Z]\ `4Z]WPFegZ]YqgZ]\wa=Y=Hbyaj`=l]r1Î WPfcacl]b:l]at%£ è9`4lNÏte_Z]\ ijP`4fcl]Wj`4Z]WPgz `:`jZ]{³l]^gZ]g`:`hHfcaUhgY[Z]hg`4l]l]aR\ aj_lN\ ¢ { hgg\w^_zmZ¤v\hHWgaU.Y]Yxaj\ ^_gZ&n }.aj\ Wgj`Wgajhgl]l]\ ` Wgby(`4l]acl]Z]`Nge§`4Îlm\ Y4WU¥Z]`4÷¡l]hggl]`4` WZmftZ]Z]g\ aj`µW¶rÏPacfcbl]jZ]\ gWP`(fcnwegYftfcZml]fg` { atz4Yx^gfcijnnw`4Z]z l&\^gWgZ]nwftgZ]\wit`NY%fceajn ^gWgZ]`&g``=by\ajWUaclZ]Z]`4Z]gl]g`4hg`%l&l]` ritZmfcftfcl]Z]l]\wfc\jajg\ W¶WPn `Nfc{¶Y:nhH¥ fcaUl]Y]`Yx\ gajWgn }§n }Yx¤j\ WU`4Z]£ `4\ jWglmftZ]Z]`Nge`ajl]^_` Z¢ b«Z]V°fcZgl]\w\w`NY=YY&Z]fAg\ W Yx`4\ l]rsZ]` `4byhgl]ajrn l]`.`:Yµhgfacl]bjajavgz4a_nfc`4e(nwrz ^gZ]`Nnw\wftY[YZZ]\ Yxacaj` bMW Z=Z]^gacgbqh¶\wYq¥Z]rsgVX`` WZ]rgaja_fclme_l]ej`4Z]\l%WPa(Z]fcYxaAnw`4Y4`:¥(rg¦³fcat¤jaA£¡`e_\\ a ZZ Z]Wgatgijaj`q`4WUl Z]hHl]Z]aU\ l]ivY[`4Z]\w`%fc`4l]nY[{³\ Z]aj£l]l³^P`sY[z3Z]Z]`4l]^gWP^Pl]Yxz3`N^gZ]Y4^gl]¥ `sl]`Z]£ Pft\ n Z%nUWgZ]gacZp`DPegfRftijZm`ff \wYhH`Nzmfcg¤jaU`NYxe%`4WhHaUYxY[aZ]`4Z]l]P\ ftajZl \wd~qYµfje_byzmaj` +^g¨Pl.WgWg`Na_nweMe_fR}j{¶`A`4£ ls\ W\ Z]Wg Z]` gZ[`N£`Afjajzm¨Pl]©lm¤´Y[Wg{qZa_£ Z]e_g\ `(Z]l]+`4Zm`Afcby¤vajnw\^gfRWg}jlD`4WglmajY(a_Wge_`(P`NfjYacYsb\ WZ[Z]£g`Nl]a`4fj`szmhH+aUY[ZmY]nwftYxfR\Z]}jg`N`4nY4`l ¥ hPajWgfcl]`©`4WUÊyl]ZmacYDZmft\ WKZ]\ ajZ]WPgfc` n n }gnwfRË}jZ]`4alDZ]fcgH`.atijl]`j\ j{UajZWgac` b e_Z]\Pl]ft`NZNz3¥Z]n }K¦gfc`.HatWgija_`je_{`.fce_WP\e ¢ l]hg`Nl]z3ajZ]Pn }ªfcgfc\ nH\ Z[at}&ij`.Zmfc\wgY=n `NhgYpl]£` by`4`4l]l]`l]`NzmeKgaUÊ Yx `4Wâ lmfcgäWPUe_Ë3aj¥ rs¦n }jg{R`£ \ z Z]ajsWPf:e_\Y[Z]Z]\ l]ajajWPWgfc n ^ge_Y[Zm\wWgfcfc\ WUjbyajZ]ajl]\wWPftrAfcZ]`Nn:Ê g{eMÊy¥WgÂRajË=l]r`4n `4fcrsn \wYx`4`UWUÊ«ZmÇYm Ë3¥¡¦gË%`A£ Hgac`4Zxl]Z]` ajr Wg\wY=a_e_r`NftYsZ]£l]\ `4l]`£ \\ Z]W_ ¢ HÐÊ[ ` `Nz4fjfcz4%Y^Pz Yx^g]`%fclmrsftZ]Z]ghg`4\wnn Y:}`NYWgz4` £ fcZ[nw`4£ z l]^gaj` nwl]ft^P¤DZ]Yx`N`N\weY&ePË3Z]Yx¥grl]VXfcajWDn ^gn³fjjZ]eg=ge_`=\ \ rsZ]` \ ajhHgWsfjajz3lxZ]ZmZ:gfchH`:WPaUz n avY[` Z]ajY]`4hvfcl]}=\rsajhgl:hgl]n z4aj\ fcWgh_W ¢ fcz4fcUnwftz Z]^g\ ajnwftWAZ]`NreMfc¥l]dj\ WPZ[}vfchgnwY\wz4fcfcWPnge` gZ]fcgrs`(hgitn fc`l]ac\wftbHZ]Z]\ gajWP`fcl]n³`NYxr^gfcn Zml]Yj\w\ YWPfcjnw\ Y ij`4£ Ws`4\l]W ` ZmhHfc`4glxbyn `(ajl]Ê[rÂRË3Y¥ H` `4ZxWgZ]`4`4llmfcZ]n Pn }=fcW¯Z]g`&n avY[ajZ]hvl]^P}z3Z]hg^gl]lmajfchPnPfcitUfcftl]Z]\w\ ftajZ]W¶\ aj¥±WPfc¦nPgrs` ` Z]itgfca_l]\e ¢ ftfcZ]n n \ }ajWPz fcajnl]rsl]`N` z3Z]Zga_Z]ae\w£ Y(\ Z]\ Wg\ W¿b«fjz3ajZNWg{q`Kl]`Ne_fj`NYxz aj\ WPrfcfcgnDn }hgfjnwfjz4z z `+^glmbyftajZ]lF`jÉ.`4ij^P`4Yxl]^_} ¢ hgfl]ajWvP^gfcr=gH\ n `4\ lDZ[}jac¥ b%©e_fc\ Å´l]j`4\ l]WP`4fcWUn´ZD%l]è ^gWPe_Y©\ ijÊ«`4fcl]WPje¡`4WPY[z Z]`&l]^Pz4z3fcZ]nw^gz ^gl]`NnwftYmZ]Ës\ aje_WPaYqz atajijW_`4l¢ ¨PZ]`4l]lr1rZ]fcPl]ftjZ(\ WPZ]fcgnw`Y4{itbyfcajl]ls\wftitZ]fc\ ajl]WP}vfc\ Wgn rsz ` ajZ]WPge_a_\ eZ]\ aje_WPavY4`N¥+Y(z4¦fcgnwz `A^grnwftZ]fc`l]jH\ WP` fcZx¢ n `4%%lmè§èfcje_`Ne_\e\ ijij`4`4atl]l]ijj`4`4`4WPl WPz z `N `NY©eYqH_£ ` \ `4Å´Z[l]£ `4`&l]`4`4Yx`4WU^gW¡Zsrs`Nl]rsfj^gzm`NWPKe.Y4¥atfcijhg¦`4hgglql]`DaR`N_fjl]\zm`Nr.Yx^gftWgnZ]Z]a_\ \aje_WgW`j {gfcfcfRWPijWPe`4e.lmfcZ]fRgjiU``¢ Z]rsl]^g` Z]`.ge_a_\weY[Z]fcl]WP\ geD^_Z]byaj\ ajl Wªn av£ aj`4hvl]}` hg l]ä aj hPfcfcWPUfte Z]\ vajä WDDbl]yaj`NYxl%hHZ]`Ngz3`.Z]\ ijit`4fcn l]}j\w¥ftZ]\ ajWPfcn VXhgWl]a_z e_aj^PWPz z ` n ^Pl]`NYxfj\ ajYxW¬ajWPZ]fcgg`4n W¶` {(rZ]fcgl]\wjY \ WPitfcfcnwY4l]\w{cftfjZ]Y\ aj£ WP`4fcn n=nPfjhgYl]a_hgz l]`Nate_iv^g\we_l]\ `Wg&e_Z]avg`N`Y Wgg`Navz a_`NeY]Y]acfcbl]}%fcWvÀ[}.aj\ hPWUZ&fclme_fc\wrsY[Z]` l]Z]\ g`4lm^_Y Z]\ acajbWPõsY:fc¥ WPeHaj^gWPegY Z]aZ]g`=n \ ¤j`4n \ ¢ %ضP¾xÕØ º _ (´»qÕ :P¾xU» º ¾X Õض º Ø x¼ÍÕØM » ¼ VXhgW l]aUajfjlmzme_µ`4£ l©\ Z]Z]%a¯Z]gz aj`qrsrshP`Nfcfcl]W%`¨PZ]`4gnwe%`rsY[Z]` l]Z]^Pgz3a_Z]eM^g{Rl]`NZ]e¬`NY[ZmitY¶fc£ l]\w`4ftl]Z]`q\ aje_WPajfcWgn(`fc^Ph_Y[¢¢ \l]Wg`4(hgl]f `NYx`4WUnwfRZ:}jZ]`4glN`({UajZ[Wg£ `&aDe_hH\ rsaUY]`4YxWP\ gYxn\ `(ajWPWgfca_n´e_e_`}vWPY[ZmfcftrsZ]`N\wY&z Z]vl]}`4`jZ]{vg£ `gz `4ajl]n `aj^g£ lm` Y gnwfjzm¤DfcWPeD£ g\ Z]`j¥
D
%
$
#"
"
$
+'
+'
jrs¦\ gij`N`N`NfcYxYWD`f%¨Pl]H`4`NnwYx` e^gZxZ]n rsZm`4Yl` \ Z]fcWPghge_a_hg\weMz4l]ftaR¥ Z]_`\ rZ]PftftZ]\ZqajZ]W=gZ]`:au&Z]¦g`¢XY[hHZ]l]aU^PY[Z]z3`4Z]^gl]\ l]aj`NleZ]rsPfc` WZ]gZ]a_ge `
! ! !! " # " " " " "
35
)''*+, " !" ! ! " -" "" " ! ! " ! " "
srn¦pavfcaj\wegghve_n }.`n `hgÂjl]Z[É aj£ hPa.oqfcajl]Ursatft£Z]hP\ YajfcW.l]ac\wbYxajajZ]l Wgv`=}DacWgb&fs` Z]Z[gu&£ `¦ajl]Z]¢°¤gitl]^gËfc`Al]£ \wftr\ Z]Z]\Afcajl]WPZ]jgfc\ WPn´aUYxfcrs`%nwY` byZ]ajÊg^gbya_ajWPeMle¥ Z]vg} ` jhH `4`4Wg(zWP`4e_4lm`4fjftWUYxZ]Z `N`NYqe(Wgacajbybpl]\wYxajaj`rÖWg£`%ffje_YqYx\ \rsfjrseg`4hge_WPn`NYx` eM\ aj©¥WP¦fcfcl]nMg¤j\wegYqatftiv`4Zm\wWPf=fcfcW(£ ghg`4n `Nl]l]Y`&a_z ^P\ `NWPYY]e_Z]Y4`4a={vhHfce_`4WPa(WPese_f%`4\ WPWUhge_Z]l]n` ` } ¢¢ neg\ rsftZm\fFWPfcY[l]Z]}l]^PZ]z3`NZ]Y[^gZl]ac`NY4b¥ gat £Kajl£ `4egn ftnMZmZ]fªg`%j`4rsWga_`4lme_ft`4Z]n³`Ne_e+`Nfcbyl]nwYajr £ \ Z]Z]g`§gn hga_l]zm\ ¤vaj} l ijacb`4l]Z]}&g`=Yx\ rszmg\ ajnwfc\wz l³`%l]`NacYxb^gfsn ZmY¶hPfcfcl]l]``4WUajZ_Zm£fcfj\ WgY `NjeM\ ij¥p`4¦Wgv`}hgl]f \ ajl¶fchg^Pl]ajY]YxP\wfcfcgWA\ n e_\ Z[` } ¢ z4fcfRWP}.e©atZ]ijg`4`sl hgZ]gl]aU`YxhHe_\w`NY[z3ZmZ]fc\ ijWP`(z `hPÊyfcgl]aj`4WUl]\ ZNô4¥sajWU¦Zmgfcn`sn }ghHËaUHYx\` Z]Z[\ £ ajWP`4`4fcWnY[Z]Z]gl]`%^Pz3WgZ]a_^ge_l]`` acYx\ bprsZ]hggn`%}sWgPa_fje_e.`NYY[Zmz4fcfcWPWegfcHlm`eYxe_`4`4`4Wiv\wft\ WZ]\ aj¨PWPjYq^gl]ac`%bMÇgZ]g¥l]¦`4`g`NZ]Yx\ rs` `NYfcZ]^PgY]`&Yx\we_fc\wWPY[Y¢ Zm`4fcWPWPYx^gz `©l]`NeªH` YxZ[\£ j`4Wg`4\ ¨HWz4fcZ]gWU`§ZhgWgl]a_\ e_aj`NlY.hgajl]ajWPfcZ]gg`§\ n \ Z[hP}§fcl]ac`4bWUZDz ajnwWgfRWg}j`4`NlNz3Z]¥¬\ Wg¦gZ]\wa Y Z]acgb¶`z ajWgWg`NWgfcl]`N`Nz3Y[Z]Z\ WgÇ:µhHby^gaUY]lxYxZ]\gg`4n l `qfthP¨Pfc`4l]nw`4eMWU¥ZmY4¦{tg£ `:\ Z]z sajWPf:e_Yx\ rZ]\ fcajnWPnvfchgngl]hgajl]PajfcPgfc\ gn \ Z[\ n } ¢ \ajZ[WD}DZ]rg`%ftZ]acl]ÅH\wz ¢X`Ne_Y\wfcPjfjaje WPfcg¥n¥ e_at£ WDZ]g`=e_\wfcjajWPfcn¶fcWPeg`4WPz ` g¥  \by¦nwajfcgl³l ``NZ]fj\ arszm%Z]hgPl]n `4ft`Nrsz4Z:fc`4\ nwWWUz ^gZmÁftnwÂ3ftZ]Äp\Z]aj£ \ ajW\ WµZ]ac acbvb Z]à gs\`qÊ°é:rsZ]`4Ë3`Nlm¥ fcftWµZ]\ ajaj¨Pl¶WP`4Z]Y nweµgac` rsbY[Z]` Z]gZ]l]g^P` a_z3Z]e%^gÊy£l]ð `NfjeµËY¶ithPYxfc\ fjr(l]Y]\ Y¢¢ ftegZ]ft\ Z]aj` WPhgfcl]n´a_fcz hg`Nhge_l]^gaUl]fj`jzm¥p¶d{ Wv}=hPYxfjhHY]Yx`4`N`NYe(£ z aj`4l]rs`hPrfcl]fj\we_Yxaj`:WPZ]Y¶gjl]aj\ ij^g`4jW=sgZ]`4gl]`&`^gfch_l]` ¢ ajz4fcWgnwn z }^g\nwWPftZ]e_`N\we=z4ft` Z]g\ ijfj`jz3¥Z]n }=at\ Ws£ `4ajijWg`4`l hPHfj`NY]z4Y4fc{c^PjYx\ `:ij`4Z]W=g` Z]g` itfcitn ^gfcn`N^gY`Nz4Y4fc{UWz ajHW_` ¢ ijaj`4^_l]Z¶jZ]`4aWPHz `:` acYx\ b³jZ]Wgg\ ¨H`%z4Y[fcZ]WUl]^PZ]n z3}Z]^gb«fjl]Y[`NZ]e.`4l itfcÊ«z l]aj\wftWvZ]ij\ aj`4l]WPjfc`4n´WPfcz hg`hg£l]aUfjfjY¶zmfj.Y]Yx£ ^grsajl]`N¤_e Y \z b³^gZ]l]gl]`4`WU%Zè Y[Z]`4e_hH\ ijË3`4¥ l]j`4WPz `&zmPfcWgj`Ne.v}n `NY]Y Z]PfcW g¥ gÂ:ajWDZ]g` aZ]_¦³gega`Y4z {_e_aj£ \wrsY[`Z]hPl]z \ fcajgl]rs^_`Z]hPZ]\ ajfcgWPl]`(`:Y:rsZ]bygaj`N^g`%fcWPW©ite§fc¨Pl]v`4\wftnw}©e§Z]\ `NajfcfjWPWPzmfce§§nHu&byrsl]`4¦ ` `µZ]¢XgY[`4Z]a_Wgl]e `4^Pl]z3fcjZ]WP\ ^g`NeAl]Y `NZ]He©g` `(rsZ[£ Z]` `4l]Z]`4^g_W ` ¢ e_f\wY[n atZ]l]£ \ g`4l=^_Z]%\ ajè¡W¶¥:e_d$\ ij`4n l]atj£ `4`4WPlz `jit{pfcl]fc\wWPfte Z]\ ajgWP`4fcWPnMz by`Dl]`4f`H`4` WgZx`4Z]l]`4jl(\ `NrYft\ rsZmzmhg n \ Z]`Na Y Z]g`Z]l]^g`=hHaUY[Z]`4l]\ ajlN¥:¦g`=l]`NYx^gn ZmYacbZ]g\wY&fcl]`\ WA¨Pj^gl]`(Ã_¥
-,
,
,
mean field
$% & ' ( " ! ! ! ! ! " - ! " ! ! " ! " "
KL divergence differences: mean field v structured 40
30
25
20
15 15
yb aj\ lj^gZ]gl]`©`u&Ã_É©¦ ¢XoqY[ajZ]l]rs^PhPz3Z]fc^gl]l]\wYx`NajeWfcacWPb:eZ]rsg`A`NfcitWDfcl]¨P\w`4ftnwZ]e\ ajfcWPhgfchgnql]byaUl]fj`4zm`g`4`NWgY `4l]j} V°£ Z=g\w\wY=zmfcnwZ]YxgaA`\ WPZ[Y[£ Z]a l]^Prsz3Z]` \ ijZ]g`sa_Z]ega©Ysn avhgajl]a_¤ e_ft^PZz `jZ]¥g` by\ ajlml]Y[rZ\ ZDacbYxgYxajajn ^g^_nwZ]e\ ajHWP`Y Z]Wge_gac\wY[`©Z]Z]`Nl]u&eF\ g¦ ^_Z]P¢XZ]Y[\ftZ]ajZl]W+^PZ]z3gPZ]`Afj^gY l]rs`Ne`N òfcfc Whgâ hg¨Pl]`4aRç nw_e+ò\ rl]`NbyftajYxZ]l^g\ najfcZW¶n nq\w¥YïjV°ãfb&[{qYxZ]hHg\ Z`N`Az \w\wY(Y[fcZ]n:l]\we_^Pz4`4z3fjWUZ]Yx^gZ]`\wl]z4`Nacfce bn Z]fcghg`hgl]rsaUfj`NfczmsW\w¨PY`4ajnweAh_Z]e_\ rs\wY[\wZ]Yxl]ì `Ní \ geM^_{UZ]g\ ataj£ W¶ì ¥`4ij÷¡`4lNg{c`4£ W` Z]¨PgWP`=esu&Z]P¦ ft¢XZqY[Z]Z]l]g^P` z3Z]¬^gl]e_`Nea Z]Wg\ WgaªacZ:HYxl]`©aj`NrsYxg`4\`µr=jacggbpn n }`%Z]gZ]e_`g\wfc\wz Y:jajaje_WPWP`4e_jfc\ Z]`4n{\Wgaj`4fcWPlmWPfcften¶Z]`µe_fc`4byl]ajhH`l]`4rWPZ]ge_¥ `4`4l]VXWPWP` z byY[\ajZ]`Nl]`NY `fjHe\ ` WPZ[Z]z £gaj`4`4l]}`4hHWajZ]lm`4Z]ftWPgZxe ` ¢ Wga_e_`NY4¥ V°hgZl]a_\we_YD^P\ z WU`NZ]e`4l]v`NY[}.Z]\ Z]Wggª`=Z]e_a+\ Å´Yx`4`4l]`©`4WU£ Z:Prsft` ZDZ]gZ[}va_hHeg`NY4YD¥ acb=\ jY[^gZ]l]l]`^Pz3ÇZ]^gjl]\ ij`N`NYDY fcfcl]W ` ` hggl]aRfc_rs\ rhgn ft`:Z]ac\ Wgb¶sZ]ge_`&\wY[gZ]l]\ j\ gg^_`NZ]Y[\Z ajhgWPl]Y ajbyPajfclgH\ nac\ Z[Z]}=Z]Z]l]g`4`%`NYqrs^g`NWPfce_WD`4l¨P`4Z]nwge`µfcfcWPh_e ¢ Z]Z]gl]`4`(` u&\wY¦ z4¢XfcY[nwZ]z l]^g^Pnwz3ftZ]Z]^g`Nl]e`Ne©byl]ajfcr hghgZ]l]gaU`:fjzme_g\wY[`NZ]Y4l]¥ \ g¦^_gZ]`=\ ajWsg\ atjijg`4`NlpY[Z&Z]l]hH`4aU` Y[vZ]`4}(l]\Yxaj` l¢ Z]nÊ«`Ngfcz3WP\wZ]Ye\ Wgzm£DgajfcZ]\wWUgz Z3`.`(Ëq\wé$hHY&aUbyY[Y[ajZ]Z]l%l]`4^Pl]\ \z3n ajn Z]^Pl^gY[l]Z]`=lmft£ Z]\gaj\wW zm§hgr^gl]fthH_aUat\ Yxrsij`N`4Y&\wlYx`NajZ]Y Wgl]`4n }j`N¥sY4Ê°é:¥ ÷ Ë3¥`skPfRacijZ]`` 3w3 3 _ 3« 2g ¦fcl]g`F`z gajrs\ jghP`NfcY[lmZªfcghgn `jl]aj{µPgfc^_gZ§\ n \ WgZ[}¬acZ Z]l]fc`4n £`NY§fR}_byYajl \we_Z]`4gWU`Z]\wz4Z[£fcna¯¥ rs ` ajZ]lAga_Z]geg`Y rsWg`4`Najfc^PWYpYx¨P}v`4rsnwe¡rsrs` Z]` l]Z]}µgga_l]e`NfcZ]¤vg\ `4Wgl]P`§{N£ fcl]g`A\wzmhg(l]ajz4fcg^Pn `4Yxr`Z]Y.g£ ` \gZ]\ 9jgYx`4hHlpajn WU`4Zmijft`4¢n Wgfchga_hHe_`N`NY:fclmZ]fcaWPz hH`.ajnwacfcbl]\wÎYx5H`ftZ]ZxaZ]`4ajWgWg\ Wg`( ajajlµ^_acZNZ]ϳgZ]`4gl%`Y[ZmZ]ftl]`4Z]`j`¥=Y[Z]¦l]g^P\wz3YµZ]^gPl]fj`NY:Y=Z]l]g` ` ¢ Z]nwYxft`4`4Z]l]`4\\WWgaj.l\ WZ]Z]l]aD`4¨P`=jZ]g^gÊ«Yx`(l]`4`D`acÃtZ]Á g¶Â `4ÄP¥l%byaj¦Y[lqZmgftrs`.Z]`=ajWgl]a_it`fce_e_l]`N\w` YfcZmgfc\ W n\ `NnwYmY:Z]Ë3g¥\ W©`.¦Z]Z]ggg\w\`(Ylme ` gÅ´\ nwj`NfRgz3}jZ `N`4Y[lµz4ZµfcbyWhHl]ajaUHr Y[` ¢ Z]ijg`4`WUZmZ]Y ajZ]h©gfc`=l]Z]`l]`4fc`=n npY[e_Z]l]aj^Prsz3\Z]WP^gftl]Z]`N`NY:el]`4vnw}ftZ]f.\ WgYx\ WgZ]ja.n `=Z]gz `DnwfjÏY]gY4nw¥ fjzm¦¤´gÏP\wWgYa_hge_l]`N` Y¢ bybyl]ajajlr1Z]g^_`=Z]u&\ n \w¦ Yx\ ¢XWgY[§Z]l]^PZ]gz3Z]\wY(^gl]nw`NfReA}j`4fclNhg¥ hg¦l]aRg_\w\ Y=r` ftÅ´Z]`N\ ajz3WZs\wÊY(¨PjWg^gacl]Zs`(fcÃchgfUhPË3fc{Hl]fc`4WPWUe Z \wfcY l]`&fbyhHajaU^gY]WPYxe\ gvn `&}.l]\`NZNfj¥ YxajW(byajlqb«fjz3Z Z]PftZg\ jg`4l hHaUY[Z]`4l]\ ajlZ]l]`4`NY 20
25
30
35
40
structured
,
,
,
6
6
5
5
4
4
3
3
2
2
1
1
-&' & B C- D ' +E# *F AG#'H #&
−1 −1
M- :NE M- &' +7NHO - N (P (Q D SRUT :V EW# E+- G%& ## &'YX *-# #& & & Q & & ' %'F #BG# ' ( & & S :G#' & ' N
J +KHL
«Ê fUË ÊyHË byÊyajH\ ^gjËqWP^gZ]e+l]g``%vÇgrs}ªÉ `NZ]oqfcgajW`Frs¨PÊ«hP`4fUfcnwË(el]\wu&Yxfcajhg¦ Whg¢XY[l]acZ]aRbpl]_^PZ]\ grz3Z]`%ft^ggZ]l]\ `N\ ajje+W¶g¥ `NfcY[hgZhghgl]aRl]aj_P\ rfcgft\Z]n \ \ ajZ[}.W¶{qZ]l]fc`4WP`Ne Y » º x½:v¾[» º `4¦z najgn WP\ `Wge_§rs\ Z]\e_`Najfc}vWPWµWPfcfc¨Pnrs`4e_nw\we%`4zshHrsZ]`4l]WP` `4Z]e_`Ng`4Y4a_WP¥Ae%z }£atfjY[£ Z]Y´l]`4by^Pijajz3`4^gZ]lWP^geµl]\ Z(`Z]ae_\ WavH`N`qZ]Yg^PWg`©Yxac` e_byZs^g\wY[fcncZ]nbyl]najat\ l³g£Ö^_rsZ]fca_\ ajWvevW} ¢ atY[Z]ijl]`4^Plz3Z]Z]g^g`=l]`NWge¬a_e_itfc`NY4l]\w¥ft¦³Z]\ a.ajWPatfcijn=`4lmfcz hgajhgrsl]aU`&fjZ]zmg¯\wYPn \fjrsY©\ ZmHft`4Z]`4\ WajW¶hg{Pl]Z]ajghH`(aUu&Yx`N¦ eM¢ ¥ bylm®vajft^Pl%Z]zm`N(Z]Y gfcZ]`DgW(`%Wgfc` hgrsZ[hg£ `Nl]fcajaUWDl]fj¤©zm¨P%Wg`4nwa_hgee_l]at`DfjivY Y[\we_Zmfsft`NZ]YxY³`NhHfY4`N{rsz \wffcajn¶l]rs`z4a_fjYxYxe_aj`j`4hg¥ nqg\w£ Y[Z]g\w\wz4zmftªZ]`N\ e%WPz rsaja_l]hHe_ac`4¢n ¦Y[Z]gl]^P` z3Z]Z]^g`NY[l]Zm`NYAe§e_fcajhgWghg`l]aU\ fjW9zm§Z]gYx\w^PYz4z hP`4fc`NhHeg`4Y&l©\ WYx^gz4jfcjh_`NZ]Y[^gZDl]\Z]WgP.ftZAZ]gZ]`sg`ªhHaUu&Y[Z]¦ ` ¢¢ ¨Pl]fc\ j`4ajnwajleMWP¥e_fc\wnMY[¦Z]WPgl]ft\ `.gZ]^g^_`4l]Z]iv`%\ \waje_acWA`4bpWPatZ]z ijg``4`=lbyz ajZ]ajl%gWP`Z]e_gWg\ \wZ]a_Y=\ aje_z WP`NajfcY rsnMHhg`N` Yµl]ZxajZ]byP`4l]lajfcrgZ]P\ n fc\HZ[Wac}DZ]Z]rg`ftZ]Z]grsl]`D\wz `Ne_`NfcY4\W ¢ { Z]Z]fcg\ WPaj`%eFWPfcfcZ]hgnPghgrs`l]` aR\ Z]rs_g\ hga_rel]ftatZ]l]ij\`N`4ajz rsWatij`4fcWU`4WPlmZ(e.Yp\ Z]WZ]gg`:Z]`&g` Z]`©gl]^gfj%z3`µZè¯hHYxaUaje_Y[n \ Z]^_ij`4Z]`4l]\ l]\ajajjWlN`4WP¥\ Wz ¦`DZ]ggH\w`&Y ` Z[itYx£ \fcWgl]`4j\w`4ftn W ` ¢ Z]£ l]g`4`D`4l]n`\ rsf\ ZNe_{qajfcrsWP\ eªWPfcgWU`4ZWPY[z Z]`Dl]^Pbyajz3Z]l=^grslmfcaUnY[\ZsWUZ]l]`4`Nl]fchgnql]\` rZmftfcZ]j\ aj`DW Yx\ £ Z]^Pajft^gZ]nw\e§ajWPHY4` { ` _hH`Nz3Z]`NeM{_Z]g`fchghgl]aR_\ rftZ]\ ajWYxgaj^gnweDH`%java_eM¥ VXjWs`NY[fjZµegZ]e_g\ Z]\wY\ ajfcWhgZ]hga:l]aUZ]gfj` zm©fcH¨PatWPijeg`jY{Rhgfjl]z4`4z n^g\ rslmft\ Z]WP`sfcl]r}%fc` l]_jhH\ WP`4fcl]\nrshg`4l]WUajZmPYfcYxg^g\ nc\ ¢¢ Z]z4\fc`NnwY4z ¥µ^gnw¦ftZ]g`N`Ne+Yx`=^PrYx\ Wgfcl]Fj\ n WPavfcajnwhvY}fchghghHl]aj`NhPfcl:fcUZ]ftaDZ]\ Haj`=W¶{H` \ bµZxZ]Z]`4gl&`§Z]Pl]`NfcYxWA^gnZ]ZmgYaUYxac` b Z]fFfc\ gajZ]n WP`µatfc}¡Z]nge_Z]l]`N`4ajzmrs^ggjajWgWP\ · Y[Z]^gZ]glm`D`%ftZ]P^P\ fjajYxY(`%W9acfjfcbe_l]itn`§avfcajWUl]hv`4Zmhgfc}.jl]hg`N`NYxl]Y%`4ajWU£ hPZmfcgftU\wZ]zmft\ ijZ]\`jajfc¥ÖW¶l]`¥¦¦Wggacg`Zs`NYxitfR`fcitl]fcfj\w\evftn ¢¢¢ it\ WPfcz WUn Zm^Pfce_j` `NYqZ]gfc` l]`hgl]ivat\ Zmivfc\wYxng\ byajajW(lqacZ]bMg`:fµ^Pn atYx£ `:`4aclbMHZ]ajg^g`&WPe_e(}vWPZ]aµfcrsZ]g\w`z nZ]ajl]µ`4`jhg{vl]fcajWP_e ¢ itfcfcgl]\ n\w\ftZ[Z]}F\ ajatfcWPijWPfc`4eFn´lfcZ]Z]hggl]hg``4l]`aUhgfjY[l]Z]zmatl]iv^P\wfcz3YxZ]\nwajYx^ga=WFl]`NhgacY4l]¥bqatÀ[iv aj\we_\\ WUWP`NZ.fcYqn nZ]e_}jg\w{Y[`µZ]Z]l]l]g\ ` g`4· l]^_^g`Z]\ \ l]ajfc`NWPl]e `Y4¥+ Yx3whH3¦`4`Ng3e ` ¨PU _fc`4nw\ eMWP3« Y(¥2 ¦byl]gaj`NrYx`^PUYxfc\ \WgWP Yz Z]gajrs\wY` rsbyl]` ajZ]rga_Z]e+g` lmftb«fjZ]gz3Z`4lsZ]PZ]ftPZfcajWWgZ]n }%g`AZ[£ rsa&`NajfclxW ¢ Z]Z]e_g\ `4ij`:l`åD` hg· l]hP^ga_fj\ z itY]`NfcYxY]`Nn Y4`4Y¥³WUfc¦Zl]`gY[Z]`Wg`4rh.`4`Nfc\e_W\ `NWµeZ]gn \Z]rs`:aµrs\ ^gZmh´ft`NZ]fceg\ WsftajZ]W%¨P``4acZ]nwbUge.Z]` g\ Wv`q9iju&ajfcn¦ WPije=¢X`NY[YZ]ç¿l]fc^PWitz3fcZ]\ Z]^gn ^g`4l]lm`N`NftY4e ¢ Ñ Z]fcghg`(hgl]é9aUfjitzmfc§l]\w\wfcY&gZ]n `NPY ftZ%Y[Z]Z]\ ngn´`.Zmfcfc¤jhg`NhgY l]aRf=_b«\ fjrz3Z]ftajZ]l]\ Wg\wYx`Ne.e_\wbyY[ajZ]l]l]r\ g¥^_Z]\ ajWatij`4l B -NQ # E S * SvCFS # LNG 0
Ø mضgØ º ´Ø³
I
0
−0.8
−0.6
−0.4
−0.2
0
0.2
0.4
0.6
0.8
1
−1 −1
−0.8
−0.6
−0.4
−0.2
0
0.2
0.4
0.6
0.8
1
J K
J lKmZ
' ' '&' + ** ' &,&-' & "!) " #$&%(')('+*, *.-/*10324%576+, -98:% $";6@?A0@6@-
O
$&),% f w>/) /*1% ? N V @ k- N
D # D R-#: %' :G &# ' X # + *-'* & ' n '-# %' X & + &'* ' ' + G@ G #* ' & Yo3 Z !!CT \ \ No p & + : ' 3 ' & Z # +%' *-& mG# #BG#nT #* &&\ # & N M
J lKE
J lKE
J
lK
J
+K
D # BG@ T _Z X $% & ' mX # + &} ' ' **-'- & F #BG# Q ) '-& % $ e-# q #B AN%- &':N #$&%0@66&5 *.?g -h%b8/.xB6h(l/.x `N%* # : 6@/.xB6@$+, ) ?A5 -F 6+, g *.> f % ?86@$6@?A0@6% ? k " D Q N " D
L
P Q D **-' G@ & '_ G@ G
&- '-# &'X *BX & Fp BG## #- Q F ' & 'S('7G## n+- &:
J
K
P t Q D L M- T :VT +- G & ## "Q
×
Report "Dynamic Trees: A Structured Variational Method Giving Efficient ..."
Your name
Email
Reason
-Select Reason-
Pornographic
Defamatory
Illegal/Unlawful
Spam
Other Terms Of Service Violation
File a copyright complaint
Description
×
Sign In
Email
Password
Remember me
Forgot password?
Sign In
Our partners will collect data and use cookies for ad personalization and measurement.
Learn how we and our ad partner Google, collect and use data
.
Agree & close