22 Simultaneous spotting of signs and fingerspellings based on hierarchical conditional…….pdf

ARTICLE IN PRESS Pattern Recognition 43 (2010) 2858–2870 Contents lists available at ScienceDirect Pattern Recognition journal homepage: /locate/pr Simultaneous spotting of signs and fingerspellings based on hierarchical conditional random fields and boostmap embeddings Hee-Deok Yang a, Seong-Whan Lee b,c, a School of Computer Engineering, Chosun University, Seosuk-dong, Dong-ku, Gwangju 501-759, Republic of Korea b Department of Computer Science and Engineering, Korea University, Anam-dong, Seongbuk-ku, Seoul 136-713, Republic of Korea c Department of Brain and Cognitive Engineering, Korea University, Anam-dong, Seongbuk-ku, Seoul 136-713, Republic of Korea a r t i c l e i n f o a b s t r a c t Article history: A sign language consists of two types of action; signs and fingerspellings. Signs are dynamic gestures Received 19 October 2009 discriminated by continuous hand motions and hand configurations, while fingerspellings are a Received in revised form combination of continuous hand configurations. Sign language spotting is the task of detection and 3 March 2010 recognition of signs and fingerspellings in a signed utterance. The internal structures of signs and Accepted 7 March 2010 fingerspellings differ significantly. Therefore, it is difficult to spot signs and fingerspellings simultaneously.