The Development And Evaluation Of A Speech To Sign Translation ...

1 downloads 0 Views 287KB Size Report
Nov 6, 2001 - domain of discourse (e.g. train timetable enquiries [L+97], e-mail access [W+98], direc- tory enquiries ... lates the clerk's speech into British Sign Language (BSL) and displays the signs using a ..... polygons at 50 frames/s using Direct-X [Cor] on a Pentium class PC. ..... Speech Communication, 17:313-320,.
  

                   £

 Þ

    £

  Þ

      Ý   Þ

  



                                       Æ                 Æ                   ! "#         $                          %      "            &          '                     Æ  (     Æ             &    &                               )                               

                                          

                                 ·! "                  



 

  

   



 

 

  



Ý            !"#$ %       &' ( ) *&  Þ+   & '  ,     ,       

#

$ %   & '  '     '        (     ) *·!+   ,·-+   ) .'/           Æ  

     0 1      +                        

       ,22+ 3"4$5+ 6·  7                           



     ,8 ,   

          

            9                                            :  ;Æ (:;/            

    

$ %   & '  '     '         

    

      A6 :  ;Æ+          ?  A  @     B + C'$"' 4$*·22+   @   D              

     

   

;    

        :  ;Æ                 

   +               +         >/ 9          4'*               @    

        

  

 

L #                :  ;Æ         9        +       0   1              +      +                        0  1                          0:  1+ 0JC*"1+ 04

:   1+ 0:  1 ' 

                     5

$ %   & '  '     '  

L #&  :  ;Æ             E +          = 

    (    /   +             9  +                                :      +         :;     

     A6+  

  %      9  + 

  

                             E +                                                "      +  

 ##             )      2M

             %         (    7/                    72 

    

9  @       +        ?   E":9 (E6 "    9 /    ;;C,!+       E6 (E     

 /    ;;,8        

  %                     

$ %   & '  '     '    E6           94 CC   +  G     N%         @          4            &     @     )   +          >2O72       %                             0  1 (        % /+   

          $ %2       F %                   "            +                  )    J                                   )

              (                       CC   +    !/ "                                                        (0    1/+          +    1                 #22+                          

 0     1+ 0   1+ 0  1   "           L >     @          

            E +         

        8

$ %   & '  '     '   >#              L  +                           +          +    +             

     & # J      )            %            0 1    +              

                

     3              %   ) 

    

             @      >          0   1 +         

0

1              

         

   N%           (L   +   0:     +  1+         +        0:       1/ E                &          

        

  %   +   %                       H     +                  +     G                           +  G        %           )     4    +   G  N%                  @               

     )   0 1                   9      +   %                 

                          @  

        N%             (

          P#22 222         !

$ %   & '  '     '   have

the renewal form

know

your National Insurance number

want

a copy of the signature

Do you

first or second-class it to get there tomorrow I

need

a receipt for that

MoT to see your

certificate insurance

L >& "              /   %  )    0 1      )       "    +            

               9   +                   (      %     /  

  +           %

 

  

                                       

  

                 $*                $* %             $II                            

    $:Q9:       

      

          @                                              E +    

  %           ( /    %    ,:·  9       +               +            

-

$ %   & '  '     '     (                   +     

  / "               :  ;Æ      +         C'$"'  B     0 %  1     

                    =                       "           G @   

   2  >5+          +   % +   + 

  +        "   @          & # 4     @         > 4     %  0    1     L  % +   09        2M        @          8#M   ½ - 

      ' Æ  .   '          ' 

 /            ' '               .    

        01*23

#7

$ %   & '  '     '  

       

E

7 > #

* 

>2> 57> 788

  #&                     5>M !2M       (L / L    @        +    -#M     8!M -M (L  / ' )             @     Percentage correct

100 80 60

C om plete phrases Sign units

40 20 0 1

2

3

4

5

6

ParticipantN um ber

L & "                           72M    (8M  

  /            !2M (#7M  

  /      

  

:                 %   4'* (   7      #O0* 1 7O0E1/   #                                >>     #! >-

#5

$ %   & '  '     '   

  

"   @        8#M         -#M     +   )             (  >-M  >2M+   /                                9  +             %          A6     )    B    @     (!2M/                             G     B +         5!M 88M                

    E +                              ;  58   

              +  75   (!5M/                               G                  

    3                  >2M           87M         +             )     +   222# (L 8/ "        !    ?''"  ##>   ?''" ; +            

Tim e (s)

160 120 N o TESSA W ith TESSA

80 40 0 1

2

3 4 5 Participant

6

L 8& "         ?''" ( /    ?''" (  /        ?      M  @         ?''"                     ?''" A(#+#!-/T82>+   222# (L !/ ;  7    (  #O K* 1 7O0E1/     #   ?''"  >8     #8

Transactions (% )

$ %   & '  '     '   70 60 50 N o TESSA W ith TESSA

40 30 20 10 0 1 Low

2

3

A cceptability

H igh

L !& :                         7      #0* 1 7 0E1 +    ?''" ( /    ?''" (  / $                  ?''"   

            ?''" ;  7        >   ?''"  >8    (L -/ Transactions (% )

70 60 50 N o TESSA W ith TESSA

40 30 20 10 0 1

2

3 H igh

Low

A cceptability

L -& :                    

  7      #0* 1 7 0E1+    ?''" ( /    ?''" (  / 

  

$        ?''"+        ?''"



    

    +      +    #!

$ %   & '  '     '   %    +                          G      B         ?''" " % + 

              

                                             Æ         

    %        +  %       +  

       0 1+ 

 )        "            

      

     ?''"& #                            :;                 :  ;Æ   +   % +    +   )          E           +       +           @    @  :  ;Æ  G                   

   )     @            ?''"                              ?''" >       

 

     

      

 E              +  Q                       )                            +       (           /        %  + %     

       7       0 1  

                      $       ?''"       

      +                 

 #-

$ %   & '  '     '    

E     

@       :  ;ÆU E     @      ?''"U 9   +                ?''"U

    

>

 ! "     # Æ # Æ

7 5 8 # >

# 

# > 7 5

8



8

5

7 

  >& 3         )     

       :;&   +       ?''"           ?''" ?              5                            H           

            

                       

! 

S               B  

   %        :;+     % G          G     ?''" 3      )              :;+ 

 +       ?''"           ?''"         %        >   7                          :;+ 

 +       ?''"     ,     +                   ?''"      +        "

        0'  1

 0 1   ?''"     +                    0 1   ?''" (  /   5  +   +                         :;+   +   ?''"        #

$ %   & '  '     '    

9   +            :  ;Æ  +     U 9   +            ?''"   :  ;Æ  +     U

   "

    

#

5 

7

$  

8

> 

8

# > 7 5

  7& 3         )              :  ;Æ  +         ?''"     ?               

    

E     

@         U # > 7 E     @      ?''"U 7 # > 9   +                ?''"U > 7 #

 ! "     # Æ # Æ

  5& 3        )                &   +       ?''"           ?''" ?             ?''"    +                  ?''"+              "

          ?''"                Æ +     

         0' 

1   ?''"

          ;  %    +                 ?''"                 ?''"   :;+             Æ          >2

$ %   & '  '     '    

 "  $ "       # % & &

$         +    ?''"     & 7 9   +      ?''"   :  ;Æ        & # > 7

# >

  & 3        )              :  ;Æ       ?''"+             ?                    :; 

    +      ?''"   :;        

 ,                 +           

                      B   )        @    ?''"        +                   %      +        ?''"       B   '     

                         +             4'*    +  #! 4$*· 22

" 4+ '  $ %+  * + 9 

+   +   ,

 '         9    

         

     + " >222

4>

J 4            L   L + #>

$ !

3 $  !     E  3 + #!

$ 

   $      &QQ    Q %

$ %2

'  $ % E               & 

      9 $ ,   3 *+  + 

      +  >2O>72 $  E

+ #2

EE-

$* E  ,. E '              7  @      "  #     + #2(8/&>> O 72!+ " #-

 ·!

3J      $  %         

        ?  

   + >7(#O>/&O #8+ #!

  !

L       "   

    9 :+ #!

 8

3J   4   

   V     %      ! !  $ + #5(#/O##2+  #8

 ;;,8

 +  ;

+ J ;

 +  : ,

  ! %!& ' ?   3 *   9+ #8 >5

J %

 



$ %   & '  '     '   6·

, 6

   6''& "                                     9 (  )   (  

     ! +  #>>!O#>72+ '   #

62#

3 6  '            9 9 , +  + )     *'   +        

%      + '  *  H   " @ 9 

 ' C + >22#    

6,-

 6   4 ,

     , !               $  A :+ #-

*·!

*L *     *9'9 3    & @                 

   + >7(#O>/&8!O->+ #!

*E-

$ $ *  $ * E                            + #8(>/&#># O #75+ L #-

 7

    "3#O#>5+ '   #7



4 D   4 *         

             

   + #!&7#7O7>2+ H   #

;;C,!  ;

+ J ;

 + C C +  J ,   ! % ' ?   $  3 *   + #! :?4 L :D + 9 

+ 3 ?

 +  " 4 J

  

       9  "

     

.// 0 ".//1+  777O77-+  # >

$ %   & '  '     '   3"4$5  3 + E " + 9 4 +  J $  "   

               9 ( 2 %     !  *'  ./-+  >#!O>>>+ : + H + #5 '2#

? '  9 

       ?  %  ' *        9 F "     +  + 2     #   3        0231+  >>7O>>-+ '   >22#

',:-

 ' +  ,+  " :  3                      !            "     + >2(#>/!# O #7!+ J #-

,·-

: ,     '     V        9 L" , 

+ 3J  +  "C *+  + 

 !      +  5-!O>2 $  E

+ #-

,22

, ,  +     , 4   

  

 !     'C + >222

,8

" ,   9               + >(!/+ #8

,:·   ,

+ L :D +   + " 4+  9 

 '               9 (        # +  5!!O5->+ '   # ,,FE-8 J ,

+ E ,

+ " FÆ +  9 E   !    ' 5

     ,   ' + #-8 .'

; .  + . +  6 '  "  

                              + ?!-J(8/&8#8O8>#+ # >8