Cited 0 time in webofscience Cited 2 time in scopus

Interactive and Automatic Navigation for 360 degrees Video Playback

Title
Interactive and Automatic Navigation for 360 degrees Video Playback
Authors
Kang, KyoungkookCho, Sunghyun
DGIST Authors
Kang, Kyoungkook; Cho, Sunghyun
Issue Date
2019-07
Citation
ACM Transactions on Graphics, 38(4), 108
Type
Article
Article Type
Article
Author Keywords
360 degrees videospherical panoramauser interaction360 degrees video navigation
ISSN
0730-0301
Abstract
A common way to view a 360? video on a 2D display is to crop and render a part of the video as a normal field-of-view (NFoV) video. While users can enjoy natural-looking NFoV videos using this approach, they need to constantly make manual adjustment of the viewing direction not to miss interesting events in the video. In this paper, we propose an interactive and automatic navigation system for comfortable 360? video playback. Our system finds a virtual camera path that shows the most salient areas through the video, generates a NFoV video based on the path, and plays it in an online manner. A user can interactively change the viewing direction while watching a video, and the system instantly updates the path reflecting the intention of the user. To enable online processing, we design our system consisting of an offline pre-processing step, and an online 360? video navigation step. The pre-processing step computes optical flow and saliency scores for an input video. Based on these, the online video navigation step computes an optimal camera path reflecting user interaction, and plays a NFoV video in an online manner. For improved user experience, we also introduce optical flow-based camera path planning, saliency-aware path update, and adaptive control of the temporal window size. Our experimental results including user studies show that our system provides more pleasant experience of watching 360? videos than existing approaches. © 2019 Copyright held by the owner/author(s). Publication rights licensed to ACM.
URI
http://hdl.handle.net/20.500.11750/10395
DOI
10.1145/3306346.3323046
Publisher
Association for Computing Machinary, Inc.
Files:
There are no files associated with this item.
Collection:
Department of Information and Communication EngineeringVisual Computing Lab1. Journal Articles


qrcode mendeley

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE