Cited 0 time in
Cited 0 time in
얼굴영상과 음성을 이용한 멀티모달 감정인식
- 얼굴영상과 음성을 이용한 멀티모달 감정인식
- Translated Title
- Multimodal Emotion Recognition using Face Image and Speech
- 이현구; 김동주
- Issue Date
- (사)디지털산업정보학회 논문지, 8(1), 29-40
- Face; Speech; Emotion Recognition
- A challenging research issue that has been one of growing importance to those working in human-computer interaction are to endow a machine with an emotional intelligence. Thus,emotion recognition technology plays an important role in the research area of human-computer interaction, and it allows a more natural and more human-like communication between human and computer. In this paper, we propose the multimodal emotion recognition system using face and speech to improve recognition performance. The distance measurement of the face-based emotion recognition is calculated by 2D-PCA of MCS-LBP image and nearest neighbor classifier, and also the likelihood measurement is obtained by Gaussian mixture model algorithm based on pitch and mel-frequency cepstral coefficient features in speech-based emotion recognition. The individual matching scores obtained from face and speech are combined using a weighted-summation operation, and the fused-score is utilized to classify the human emotion. Through experimental results, the proposed method exhibits improved recognition accuracy of about 11.25% to 19.75% when compared to the most uni-modal approach. From these results, we confirmed that the proposed approach achieved a significant performance improvement and the proposed method was very effective.
There are no files associated with this item.
- ETC1. Journal Articles
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.