Cited 0 time in webofscience Cited 0 time in scopus

얼굴영상과 음성을 이용한 멀티모달 감정인식

Title
얼굴영상과 음성을 이용한 멀티모달 감정인식
Translated Title
Multimodal Emotion Recognition using Face Image and Speech
Authors
이현구김동주
DGIST Authors
이현구; 김동주
Issue Date
2012-03
Citation
(사)디지털산업정보학회 논문지, 8(1), 29-40
Type
Article
ISSN
1738-6667
Abstract
A challenging research issue that has been one of growing importance to those working in human-computer interaction are to endow a machine with an emotional intelligence. Thus,emotion recognition technology plays an important role in the research area of human-computer interaction, and it allows a more natural and more human-like communication between human and computer. In this paper, we propose the multimodal emotion recognition system using face and speech to improve recognition performance. The distance measurement of the face-based emotion recognition is calculated by 2D-PCA of MCS-LBP image and nearest neighbor classifier, and also the likelihood measurement is obtained by Gaussian mixture model algorithm based on pitch and mel-frequency cepstral coefficient features in speech-based emotion recognition. The individual matching scores obtained from face and speech are combined using a weighted-summation operation, and the fused-score is utilized to classify the human emotion. Through experimental results, the proposed method exhibits improved recognition accuracy of about 11.25% to 19.75% when compared to the most uni-modal approach. From these results, we confirmed that the proposed approach achieved a significant performance improvement and the proposed method was very effective.
URI
http://hdl.handle.net/20.500.11750/5907
Publisher
(사)디지털산업정보학회
Files:
There are no files associated with this item.
Collection:


qrcode mendeley

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE