APSIPA Transactions on Signal and Information Processing > Vol 7 > Issue 1

An overview of augmented visualization: observing the real world as desired

Shohei Mori, Graz University of Technology, Austria, s.mori.jp@ieee.org , Hideo Saito, Keio University, Japan
 
Suggested Citation
Shohei Mori and Hideo Saito (2018), "An overview of augmented visualization: observing the real world as desired", APSIPA Transactions on Signal and Information Processing: Vol. 7: No. 1, e12. http://dx.doi.org/10.1017/ATSIP.2018.13

Publication Date: 18 Oct 2018
© 2018 Shohei Mori and Hideo Saito
 
Subjects
 
Keywords
OverviewDiminished realityAugmented realityFree-view point image generationHuman-computer interaction
 

Share

Open Access

This is published under the terms of the Creative Commons Attribution licence.

Downloaded: 1534 times

In this article:
I. INTRODUCTION 
II. FREE-VIEWPOINT IMAGE/VIDEO 
III. FREE-VIEWPOINT TO CONTROLLABLE REALITY 
IV. DIMINISHED REALITY: PRINCIPLES 
V. CASE STUDY OF FREE-VIEWPOINT IMAGE-GENERATION-BASED DR 
VI. CONCLUSIONS 

Abstract

Over 20 years have passed since a free-viewpoint video technology has been proposed with which a user's viewpoint can be freely set up in a reconstructed three-dimensional space of a target scene photographed by multi-view cameras. This technology allows us to capture and reproduce the real world as recorded. Once we capture the world in a digital form, we can modify it as augmented reality (i.e., placing virtual objects in the digitized real world). Unlike this concept, the augmented world allows us to see through real objects by synthesizing the backgrounds that cannot be observed in our raw perspective directly. The key idea is to generate the background image using multi-view cameras, observing the backgrounds at different positions and seamlessly overlaying the recovered image in our digitized perspective. In this paper, we review such desired view-generation techniques from the perspective of free-view point image generation and discuss challenges and open problems through a case study of our implementations.

DOI:10.1017/ATSIP.2018.13