Cited 0 time in webofscience Cited 4 time in scopus

Korean Sign Language Recognition Using EMG and IMU Sensors Based on Group-Dependent NN Models

Korean Sign Language Recognition Using EMG and IMU Sensors Based on Group-Dependent NN Models
Shin, Seong JooBaek, Young MiLee, Jin HeeEun, Yong SoonSon, Sang Hyuk
DGIST Authors
Eun, Yong SoonSon, Sang Hyuk
Issue Date
2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017, 1-7
Automatic sign language recognition systems can help many hearing and speech-impaired people communicate with the public. To recognize sign language, the system should first determine the shape of the hand and the movement of the arm. Since sign language consists of a sequence of movements, it is difficult to distinguish a certain gesture from gestures (movements). It also has various lengths of gestures. It is effective to make the fixed length input data (gestures) rather than predefine the length of each gesture for recognition. Furthermore, in order to improve recognition accuracy, the effective way is to exploit multiple heterogeneous sensors (both an electromyography (EMG) sensor and an inertial measurement unit (IMU) sensor) which can produce the redundant information to the same physical variable. Specially, we focus on the fact that EMG signals depends on physical features of people because the amount of muscle and the thickness of the fat layer are different for each person. To address these issues, we propose an automatic recognition method for Korean sign language, which based on a sensor fusion technology and group-dependent Neural Network (NN) models. Our approach on group-dependent NN models is to separate the models so that different people can use different models. Finally, the results of recognition show that the proposed method has high accuracy (99.13% of CNN without dropout and 98.1% of CNN with dropout). © 2017 IEEE.
Institute of Electrical and Electronics Engineers Inc.
Related Researcher
  • Author Son, Sang Hyuk RTCPS(Real-Time Cyber-Physical Systems) Lab
  • Research Interests Real-time system; Wireless sensor network; Cyber-physical system; Data and event service; Information security; 실시간 임베디드 시스템
There are no files associated with this item.
Department of Information and Communication EngineeringDSC Lab(Dynamic Systems and Control Laboratory)2. Conference Papers
Department of Information and Communication EngineeringRTCPS(Real-Time Cyber-Physical Systems) Lab2. Conference Papers

qrcode mendeley

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.