Cited 0 time in webofscience Cited 0 time in scopus

얼굴영상과 음성을 이용한 멀티모달 감정인식

Title
얼굴영상과 음성을 이용한 멀티모달 감정인식
Translated Title
Multimodal Emotion Recognition using Face Image and Speech
Authors
이현구김동주
Issue Date
2012
Citation
(사)디지털산업정보학회 논문지, 8(1), 29-40
Type
Article
Keywords
FaceSpeechEmotion Recognition
ISSN
1738-6667
Abstract
A challenging research issue that has been one of growing importance to those working in human-computer interaction are to endow a machine with an emotional intelligence. Thus,emotion recognition technology plays an important role in the research area of human-computer interaction, and it allows a more natural and more human-like communication between human and computer. In this paper, we propose the multimodal emotion recognition system using face and speech to improve recognition performance. The distance measurement of the face-based emotion recognition is calculated by 2D-PCA of MCS-LBP image and nearest neighbor classifier, and also the likelihood measurement is obtained by Gaussian mixture model algorithm based on pitch and mel-frequency cepstral coefficient features in speech-based emotion recognition. The individual matching scores obtained from face and speech are combined using a weighted-summation operation, and the fused-score is utilized to classify the human emotion. Through experimental results, the proposed method exhibits improved recognition accuracy of about 11.25% to 19.75% when compared to the most uni-modal approach. From these results, we confirmed that the proposed approach achieved a significant performance improvement and the proposed method was very effective.
URI
http://hdl.handle.net/20.500.11750/5907
Publisher
(사)디지털산업정보학회
Files:
There are no files associated with this item.
Collection:
ETC1. Journal Articles


qrcode mendeley

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE