Learning matrix space image representations - UF CISE Department

30 downloads 688 Views 785KB Size Report
Learning Matrix Space Image Representations. Anand Rangarajan1. Department of Computer and Information Science and Engineering. University of Florida.
      "!#$ %&'$(% *)+ & , -/.0-/1 2.3-/45.367.98:.0-7@BADCFEHG>7I9E%JDKMLJNG@5O5EH>PCQADISR+TUI5KVJ CHGWADEHXYJ I[Z0\7XY>7I5\7>A IBR(]IB^ X_I5>7>PCHXYIB^ `aIBXYbc>PCHdFXeEgf JDKhjiYJ CHX_RBA k A XYIB>7dFb3XYiYiY>Nlmhon pNq r3sNsPtUr3s*q u3lv`Z wDx0wDxcy9z3{c|c}D~o€9‚3ƒ7IW>?dF>7>P‘WEHJR5XeCH>7\PEHief iY>ADCHI(’SA dFXYdKVOBIB\“EHX_J IBd%KVCHJ G”ISA*EHO5C:ADi dF\7>PIB>7d7lD>A*CH>%\7JNI0KVCHJNI9EH>RXeE  E  >@5CHJN’5iY>7G•J KBdFX_G$OBieE:A I5>7JNO5do>7d–EHXYGWADEHXYJNIJ K E  >7dF>’SADdFX_d%KVOBIB\“EHX_J IBdQA IBR E  >—\7J9>P˜™\7XY>7I9EHdaJDKo>A \  XYGWAD^N>š›  >PI(@5CHJ*œ–>P\PEH>R J I3EHJ™E  ADEa’SADdFX_d:“žSTgI(E  X_dJDCH‘mlS>ŸADCH>ŸGWA XYI5iYf+XYI9EH>PCH>7d–EH>R XYI¡iY>ADCHI5XYIB^WGWADt EFCHXe¢ dF@BA \7> ’SADdFXYdK›O5IB\PEHXYJNI5d™ADISR£E  >W@0CHJDœg>7\PEHXYJNI¤\7J9>P˜\PX_>PI3EHdŸKVCHJ G¥A¡dF>PEJ K IBADEHO5C:ADimXYGWA ^N>Pd7ž Œ >Q\A d–EE  XYd@0CHJN’BiY>7G¦XYI A%œgJNXYI9E%JN@0EHXYGX_§7ADEHXYJNIKVC:ADG>PJDCH‘mž ¨  >h5CHJN’m>PIBXYOBdI5J CHG©XYdOBdF>R[EHJ(>P¢0@0CH>7dFd?E  >R0XYd–E:A IB\P>™’m>PEg>7>7I£A+ISA*EHO5C:ADi XYGWA ^ >A IBR¡XYEHdGWA*EFCHXe¢¡dF@SAD\7>$CH>7\PJNIBd–EFCHO5\PEHXYJNI/žPCHISA*EHX_I5^ ADi_^ J CHXeE  G«X_d R0>PCHXYbc>R(EHJdFXYGO5iYE:ADIB>7J OBdFief¡dFJ i_bN>KVJ C?E  >’SA dFXYdabc>7\PEHJDCHd—ADISR(E  >@0CHJDœg>7\PEHXYJNI \7J9>“˜\7XY>7I9EHd7ž0Z0XYI5\7>JNO5CKVOBISR5A G>7I9E:ADi5^ JcA iBX_dM\7i_A dFdFXe¬B\ADEHXYJNI ADISR™XYISR0>P¢0X_I5^5lD> R0>7bc>7iYJN@+AGWADEFCHXe¢dF@BA \7>—R5XYd–E:A I5\7>—G>ADdFO5CH>a’m>PEg>7>7IWXYGWA ^N>PdXYI E  >QEFC:ADX_I5XYIB^ dF>PEžB­a>PdFOBieEHdADCH>d  J*I(JNI(K›A \7>XYGWA ^ >7dQA ISR ISA*EHO5C:A i/dF\7>7I5>7d7ž ®

B¯ °Q±m²v³´$µŸ¶ ×FÍ ÒôB× ÜÆ_»P¿ »“¿v¹ÉÊ/-/1m¹D67½:»P.3-ç1mÆÐ-/4껓¿/.3»a_ 2 1mƛ.34 Ò 4 9 C 0#8+×ÎaÖ?¿/¹ UM.3456P.0-v40¹£Å/C .06P.0Ç(¹D»“¹ 6 Ç .3»“6PÆVºD¹ ½ì.3-/1£.36P¹$À ×FÍ  »“67.0º*¹¡Ë oRÒ 8;9 8"\ > ×FÍ C C ÖMÃ(1m¹D6PÆÐÝ5¹»“¿/¹$.3Âл“¹ 6“-ç.9»“ÆV-v4 .0ÂÐ45Ã06PÆ_»P¿vÇ ¾0ܗ¹ /67½:»a¿vÃ5ÂV1 8PXY\“‘3XaA IShR aLž )—iYd  ADOBdF>7I/dž +oCHJN’SAD’BXYiYXYd–EHX_\¡KÐC:A G>PJ CH‘ K›JDCE  >¡A RBA @0E:ADEHXYJNIìA IBR \PJNG@SA*CHXYdFJNI JDKoXYGWA ^N>\PJ3R5>7d7Až ij5Lkl8:5lVT4"\5=SA7g @%("# lçsr5š  ] s  EBsrNu3sNlMs - ž ž Qjž )—iYd  A O5dF>7IWA IBR=ž9hjXY>7i_R/=ž m—ADEHO5C:ADiSXYGWA ^ >Qd–E:A*EHXYd–EHX_\Pd%A IBR™>P˜\7XY>7I9E\PJ3R5XYIB^0Wž  Dl  X] pNpN4p E3p p los - r0ž ž Qnž )—iYd  A OBdF>PIA IB[R o™-ž N(XYi_iYGWADIBIçž5n/>ADCHI5X_I5^?dF@SA*CHdF>%\7J3R5>PdXeE  A—GXe¢0EHO0CH>'JDK k A O5dFdFX_A IBd  @0CHXYJ Cž¡TU*I SA>M :"@p%B, - q/@4 @7r %(?s 14"@@#%'X$?V&t@7[KCA/1VnDKuvNlo@SAD^N>7d 5s@E =ž N(Tg< ¨ +oCH>7dFd7lmLA G’0CHX_R5^N> :l N ªlmqDuNu u0ž ž o™ž­—ADJìADISwR +jž x?XY@çz  ž y%'"J {2@%BG*F& 1 &| 7r}~S9 $n @%'BY 7[@US>M €f 4$X~ T> SL8n8T %"@ %(&Hž'ªa\7ANR5>PGX_O \ +CH>7dFd7lSnçJ ISR5J Içl5e` o™lvs  u3ž s7u0ž P0ž xA I5^£ADISRíLaž'nçOçžêLJNG$’BXYIB>7R EH>P\  IBIX 9OB>7d™JDKdFXYIB^ OBi_ADCWb A iYOB>(R5>7\PJNG@mJNdFXeEHXYJNIìA IBR bN>7\PEHJ ZC 9OSADI3EHXY§A*EHXYJNIìKVJ C XYGWAD^N>[\7J3R5XYI5^5‚ ž /10003F€ €5e/@7r 4$Xƒs 14"\5_l ] sNs 0sEBsNs Nr0l s -" ž Z

4

Log−log plot of Lenna SVD components

6

10

3.5

x 10

Lenna SVD

component value

component value

3 4

10

2

10

0

10

2.5 2 1.5 1 0.5

−2

10

0

10

1

2

10 10 component index

3

10

0

0

100 200 component index

300

„…B† X‹ ‡S‹ Z3@m>7\PEFCHOBG J K'E  >$nç>7I5ISAWX_GWAD^N>+šq rGˆ'q rc“žon/>PKVE ] n/JN^DtUiYJ ^ @BiYJ E?J KE  >dF@m>7\“EFCHOBG ž ­QXY^  E ] Z0@m>7\PEFCHO5G©@BiYJ Ež^m—JDEH>™E  >WADi_GJ d–EiYXYIB>7ADC$ISADEHO0CH>™J K%E  >iYJN^ tiYJN^[dF@m>7\“EFCHOBG K›JDC$E  > R0JNGXYISADI9E%dFXYIB^NO5i_ADCabNADi_O5>7d7ž

s7u

„…B† ‹ /‹ç‰áˆ 0Š j†7‡7ˆ jŠ ‡ … j†É‰”Š  v‡†  ¨P\7JNI5d–EFCHOB\PEHXYJNI5dOBd–t XYI5^£sNl lMsu3l's A IBR q u+\7JNG@mJ IB>7I9EHd7ž^J EFEHJ G CHJ ] ¨  >Zj_—= \7JNG@mJ IB>7I9EXYGWA ^ >7d   \PJ CFCH>7dF@mJ ISR5XYI5^™EHJ$E  >?¬5CHd–E%¬Sbc>—\7JNG@mJ IB>7I9EHd7ž

„…B†

‹!v‹"™ˆ …B†:… “KVE ] hBA \7>™s žB­QXY^  E ] hBA \7>Ÿq9ž 0.4

Projection value

0.2 0 −0.2 −0.4 −0.6 −0.8 −1

1

2 Dimension index

0.4

Projection value

0.2 0 −0.2 −0.4 −0.6 −0.8 −1

1

2

‹ %&0 Š j†7‡7ˆ jŠN‡')(U‰BŠ 0† j† …  † Š  v‡† n/>PKVE ] hBA \7>¡sNžqN(XÐR5R5iY> ] hBA \7>+q3ž „…B† ‹ $7\“EHX_J IBd7ž Dimension index

s s 1.2

Projection value

1 0.8 0.6 0.4 0.2 0 −0.2

1

2

3

4

5

6 7 8 Dimension index

9

10

11

12

1

2

3

4

5

6 7 8 Dimension index

9

10

11

12

1.2

Projection value

1 0.8 0.6 0.4 0.2 0 −0.2

„…B† ‹ /‹ % 0 Š j†7‡Pˆ PKVE ] hBA \7> sNž^N(X_RBR0i_> ] hSA \7>q3ž ­QXY^  E ] +CHJ*œ–>7\“EHX_J IBd7ž 1

Projection value

0.8 0.6 0.4 0.2 0 −0.2 −0.4

0

10

20

30 Dimension index

40

50

60

0

10

20

30 Dimension index

40

50

60

1

Projection value

0.8 0.6 0.4 0.2 0 −0.2 −0.4

„…B† ‹ v‹ % 0 Š j†7‡Pˆ 7\“EHX_J IBd7ž ‡

£Š

/‡7† nç>PKÐE ] hBA \7>s ž&N(XÐR5R5iY> ] hSAD\7>q3ž

  

„…B† ‹ /‹ % 0 Š j†7‡7ˆ jŠ ‡ …  PI3EHdìJ K£E  > d  ADCH>RCH>P@5CH>7dF>7I9E:A*EHX_J Içžc¨7I9EHdMJNI5>E  CHJNO5^  E  CH>7>Nž-J EFEHJ G ] LJNG@mJ IB>7I9EHdoK›J O5C E  CHJNO5^  dFXe¢vž ­Q>7\7J IBd–EFCHO5\PEHXYJNI¡]oCFCHJ C

3u ž uNrcq u0ž u q u0žYs7u  ‰5… # ?‡B‹ ­a>7\PJNIBd–EFCHO5\PEHXYJNI >PCFCHJ CHd%KVJ CE  >a’SA ’mJ9J Içl5’mJcA*EQA ISR ^NXeCHi/X_GWAD^N>7d%O5dFXYIB^ u\7J G@mJ t I5>7I9EHd7ž5¨  >iY>ANR0XYIB^dFXYIB^ OBi_ADCabNADiYOB>—KVJ C—A iYi/E  CH>7>XYGWA ^ >7dX_dO5IBXeEgf9ž

s7p

„…B† X‹ ‡

ç‹ ¨çJN@?CHJ ] )aCHXY^NXYISADi0’BA ’mJ9J Içl’mJNADEoADISR^NXeCHi9XYGWA ^ >7d7žJDEFEHJNGÿCHJ ] ¨  >'dHADG>MXYGWAD^N>7d A*KVEH>PCadF@m>7\PEFCHO5G”IBJDCHGWA iYXY§ADEHXYJ Içž

„…B† X‹ ‡:‡S‹