Dr. Zi Siang See

School

University of newcastle

Keywords

Virtual Reality, Augmented Reality, Extended Reality, Spherical Panorama, High Dynamic Range Imaging, Computational Photography, User Experience, Human Computer Interaction, Interaction Design

Abstract

This research explores the development of a novel method and apparatus for creating spherical panoramas enhanced with high dynamic range (HDR) for high fidelity Virtual Reality 360 degree (VR360) user experiences. The original contribution to knowledge which this study seeks to make, is a new application of human computer interaction techniques, applied in order to gauge and understand how user experience of interactive panorama images can be virtually operated with the aim of increasing fidelity, or high definition visual similarity and clarity, closest to the original scene depicted. In this context, the term ‘high fidelity’ refers to the aim of producing detailed and accurate HDR spherical panorama images which resemble the original scenes captured sufficiently to afford users a satisfactory and compelling VR360 user experience. A VR360 interactive panorama presentation using spherical panoramas can provide virtual interactivity and wider viewing coverage; with three degrees of freedom, users can look around in multiple directions within the VR360 experiences, gaining the sense of being in control of their own engagement. This degree of freedom is facilitated by the use of mobile displays or head-mount-devices. However, in terms of image reproduction, the exposure range can be a major difficulty in reproducing a high contrast real-world scene. Imaging variables caused by difficulties and obstacles can occur during the production process of spherical panorama facilitated with HDR. This may result in inaccurate image reproduction for location-based subjects, which will in turn result in a poor VR360 user experience. Such problems may include but are not limited to: parallax error, nadir angle difficulty, HDR ghosting effect, insufficient dynamic range and luminance preservation. In contrast, this study presents an HDR spherical panorama reproduction approach which can shorten the production process, reduce imaging variables, and keep technical issues to a minimum, leading to improved photographic image reproduction with fewer visual abnormalities for VR360 experiences. A user study has been conducted; this shows that the novel approach creates images which viewers prefer, on the whole, to those created using more complicated HDR methods, or to those created without the use of HDR at all. In an ideal situation for VR360 reproduction, the proposed solution and imaging workflow would allow multi-angle acquisition to be accomplished in less than a minute. The thesis is comprised of this critical exegesis of the use case study and practice-based research project as outline, with a creative component comprised of a unique set of VR360s presented using the proposed method and apparatus. I hope that the thesis will be of use to future scholars and practitioners, and to the general viewer as well.