Cited 0 time in webofscience Cited 0 time in scopus

3d face reconstruction for VR HMDs in eye region

Title
3d face reconstruction for VR HMDs in eye region
Authors
Ji, Seoyoun
DGIST Authors
Ji, Seoyoun; Chwa , Hoonsung; Cho, Sunghyun
Advisor(s)
좌훈승
Co-Advisor(s)
Cho, Sunghyun
Issue Date
2020
Available Date
2020-08-06
Degree Date
2020/08
Type
Thesis
Description
3d reconstruction
Abstract
The study of 3D reconstruction using video or photos has been a big issue since the past. As machine learning advances facial wrinkles can be reconstructed in detail and facial expressions can be reconstructed in real-time, but there are no paper about the contents that reconstruct the eyes part intensively. In this pa-per, I introduce a new method for reconstructing the eye area and a new method for real-time 3d reconstruc-tion using only the head-mounted displays(HMDs) without complicated hardware device environment. For the reconstruction, neural networks were constructed using machine learning and lightest neural networks were used to operate in real-time. Using HMD, collect dataset for learning and make ground truth reconstruction object manually. Then I make our own dataset for eye region reconstruction. This neural net-work model enables 3d reconstruction with only one image and allows create expressions such as surprised and frowning to express more diverse expressions while the previous 3d reconstruction models only can realize the expression of closing or opening eyes.
Table Of Contents
Ⅰ. Introduction 1 Ⅱ. Related Work 4 2.1 Real-time Facial animation 4 Ⅲ. Method 5 3.1 Collecting Dataset 5 3.2 Make Blendshape Parameters and Training Dataset for Network 6 3.3 Learning a Network 9 3.4 Reconstruction 9 Ⅳ. Experiments 10 4.1 Training Result and Processing time 10 Ⅴ. Conclusion 12 References 14 요약문 15
URI
http://dgist.dcollection.net/common/orgView/200000287477
http://hdl.handle.net/20.500.11750/12152
DOI
https://doi.org/10.22677/thesis.200000287477
Degree
Master
Department
Department of Information and Communication Engineering
University
DGIST
Related Researcher
  • Author Chwa, Hoon Sung Real-Time Computing Lab
  • Research Interests Real-Time Systems; Real-Time AI Services; Cyber-Physical Systems; Mobile Systems
Files:
Collection:
Department of Information and Communication EngineeringThesesMaster


qrcode mendeley

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE