Virtual reality is a powerful interaction mechanism that holds the promise of engaging users, not only for entertainment, but also for social and environmental purposes. In this paper we present PeakLensVR, a virtual reality mobile application that enables users to capture panoramic mountain images with their mobile devices and later visualize such images, enriched with metadata about the peaks visible from the capture point, with a low-end VR device. The application exploits a multi-stage data processing pipeline, which comprises the following steps: (1) the acquisition of a sequence of frames with the mobile phone camera and their annotation with sensor readings captured during the shooting session; (2) the creation of a panoramic image from the acquired frames, with state-of-the art stitching algorithms; (3) the registration of the panoramic image to the mountain skyline in view, by comparing the image skyline with a virtual profile extracted from the NASA SRTM Digital Elevation Model of the Earth; (4) the enrichment of the registered panoramic image with markers and metadata (name, altitude, etc.) of the peaks in view, by querying the OpenStreetMap GIS.

A virtual reality application for augmented panoramic mountain images

La Salandra A.;Frajberg D.;Fraternali P.
2019-01-01

Abstract

Virtual reality is a powerful interaction mechanism that holds the promise of engaging users, not only for entertainment, but also for social and environmental purposes. In this paper we present PeakLensVR, a virtual reality mobile application that enables users to capture panoramic mountain images with their mobile devices and later visualize such images, enriched with metadata about the peaks visible from the capture point, with a low-end VR device. The application exploits a multi-stage data processing pipeline, which comprises the following steps: (1) the acquisition of a sequence of frames with the mobile phone camera and their annotation with sensor readings captured during the shooting session; (2) the creation of a panoramic image from the acquired frames, with state-of-the art stitching algorithms; (3) the registration of the panoramic image to the mountain skyline in view, by comparing the image skyline with a virtual profile extracted from the NASA SRTM Digital Elevation Model of the Earth; (4) the enrichment of the registered panoramic image with markers and metadata (name, altitude, etc.) of the peaks in view, by querying the OpenStreetMap GIS.
2019
Environmental monitoring; Location-based systems; Mobile applications; Mountain identification; Remote sensing; Virtual reality
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11311/1107572
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 8
  • ???jsp.display-item.citation.isi??? 3
social impact