Stan Sclaroff
2012
Detecting Reduplication in Videos of American Sign Language
Zoya Gavrilov
|
Stan Sclaroff
|
Carol Neidle
|
Sven Dickinson
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
A framework is proposed for the detection of reduplication in digital videos of American Sign Language (ASL). In ASL, reduplication is used for a variety of linguistic purposes, including overt marking of plurality on nouns, aspectual inflection on verbs, and nominalization of verbal forms. Reduplication involves the repetition, often partial, of the articulation of a sign. In this paper, the apriori algorithm for mining frequent patterns in data streams is adapted for finding reduplication in videos of ASL. The proposed algorithm can account for varying weights on items in the apriori algorithm's input sequence. In addition, the apriori algorithm is extended to allow for inexact matching of similar hand motion subsequences and to provide robustness to noise. The formulation is evaluated on 105 lexical signs produced by two native signers. To demonstrate the formulation, overall hand motion direction and magnitude are considered; however, the formulation should be amenable to combining these features with others, such as hand shape, orientation, and place of articulation.
2008
Benchmark Databases for Video-Based Automatic Sign Language Recognition
Philippe Dreuw
|
Carol Neidle
|
Vassilis Athitsos
|
Stan Sclaroff
|
Hermann Ney
Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)
A new, linguistically annotated, video database for automatic sign language recognition is presented. The new RWTH-BOSTON-400 corpus, which consists of 843 sentences, several speakers and separate subsets for training, development, and testing is described in detail. For evaluation and benchmarking of automatic sign language recognition, large corpora are needed. Recent research has focused mainly on isolated sign language recognition methods using video sequences that have been recorded under lab conditions using special hardware like data gloves. Such databases have often consisted generally of only one speaker and thus have been speaker-dependent, and have had only small vocabularies. A new database access interface, which was designed and created to provide fast access to the database statistics and content, makes it possible to easily browse and retrieve particular subsets of the video database. Preliminary baseline results on the new corpora are presented. In contradistinction to other research in this area, all databases presented in this paper will be publicly available.
Search
Co-authors
- Carol Neidle 2
- Philippe Dreuw 1
- Vassilis Athitsos 1
- Hermann Ney 1
- Zoya Gavrilov 1
- show all...
Venues
- LREC2