2021 IEEE International Conference on Acoustics, Speech and Signal Processing

6-11 June 2021 • Toronto, Ontario, Canada

Extracting Knowledge from Information

2021 IEEE International Conference on Acoustics, Speech and Signal Processing

6-11 June 2021 • Toronto, Ontario, Canada

Extracting Knowledge from Information

Technical Program

Paper Detail

Paper IDIVMSP-16.6
Paper Title GEOMETRY CONSISTENCY OF AUGMENTED REALITY BASED ON SEMANTICS
Authors Hongyan Quan, Mingwei Yao, XiaoXiao Qian, East China Normal University, China
SessionIVMSP-16: Point Clouds and Depth
LocationGather.Town
Session Time:Wednesday, 09 June, 15:30 - 16:15
Presentation Time:Wednesday, 09 June, 15:30 - 16:15
Presentation Poster
Topic Image, Video, and Multidimensional Signal Processing: [IVARS] Image & Video Analysis, Synthesis, and Retrieval
IEEE Xplore Open Preview  Click here to view in IEEE Xplore
Virtual Presentation  Click here to watch in the Virtual Conference
Abstract In augmented reality, for achieving geometric consistency in the perspective projection virtual-real, we propose a semantic consistency method to achieve the fusion between virtual and real objects with selected segmented objects in the real scene as references. The proposed framework maintains the three-dimensional structure of the scene by satisfying the global semantic map of the real scene. It takes the segmented objects in the scene as the basic unit, and executes the virtual and real fusion for ensuring the accuracy of the relative geometric position of the virtual objects. In addition, a multi-task network architecture is proposed to optimize the camera parameters based on the scene segmentation. The experiment results demonstrate the effectiveness of the proposed augmented reality geometric consistency framework, and confirm that our strategy has the capability of fusing the virtual and real geometric consistency.