New technologies for innovative interactive experience represent a powerful medium to deliver cultural heritage content to a wider range of users. Among them, Natural User Interfaces (NUI), i.e. non-intrusive technologies not requiring to the user to wear devices nor use external hardware (e.g. keys or trackballs), are considered a promising way to broader the audience of specific cultural heritage domains, like the navigation/interaction with digital artworks presented on wall-sized displays. Starting from a collaboration with a worldwide famous Italian designer, we defined a NUI to explore 360!panoramic artworks presented on wall-sized displays, like virtual reconstruction of ancient cultural sites, or rendering of imaginary places. Specifically, we let the user to "move the head" as way of natural interaction to explore and navigate through these large digital artworks. To this aim, we developed a system including a remote head pose estimator to catch movements of users standing in front of the wall-sized display: starting from a central comfort zone, as users move their head in any direction, the virtual camera rotates accordingly. With NUIs, it is difficult to get feedbacks from the users about the interest for the point of the artwork he/she is looking at. To solve this issue, we complemented the gaze estimator with a preliminary emotional analysis solution, able to implicitly infer the interest of the user for the shown content from his/her pupil size. A sample of 150 subjects was invited to experience the proposed interface at an International DesignWeek. Preliminary results show that the most of the subjects were able to properly interact with the system from the very first use, and that the emotional module is an interesting solution, even if further work must be devoted to address specific situations.

Navigating Wall-sized Displays with the Gaze: a Proposal for Cultural Heritage / Calandra, DAVIDE MARIA; DI MAURO, Dario; Cutugno, Francesco; DI MARTINO, Sergio. - 1621:(2016), pp. 36-43. (Intervento presentato al convegno 1st Workshop on Advanced Visual Interfaces for Cultural Heritage, AVI*CH tenutosi a Bari, Italy nel 07/07/2016).

Navigating Wall-sized Displays with the Gaze: a Proposal for Cultural Heritage

CALANDRA, DAVIDE MARIA;DI MAURO, DARIO;CUTUGNO, FRANCESCO;DI MARTINO, SERGIO
2016

Abstract

New technologies for innovative interactive experience represent a powerful medium to deliver cultural heritage content to a wider range of users. Among them, Natural User Interfaces (NUI), i.e. non-intrusive technologies not requiring to the user to wear devices nor use external hardware (e.g. keys or trackballs), are considered a promising way to broader the audience of specific cultural heritage domains, like the navigation/interaction with digital artworks presented on wall-sized displays. Starting from a collaboration with a worldwide famous Italian designer, we defined a NUI to explore 360!panoramic artworks presented on wall-sized displays, like virtual reconstruction of ancient cultural sites, or rendering of imaginary places. Specifically, we let the user to "move the head" as way of natural interaction to explore and navigate through these large digital artworks. To this aim, we developed a system including a remote head pose estimator to catch movements of users standing in front of the wall-sized display: starting from a central comfort zone, as users move their head in any direction, the virtual camera rotates accordingly. With NUIs, it is difficult to get feedbacks from the users about the interest for the point of the artwork he/she is looking at. To solve this issue, we complemented the gaze estimator with a preliminary emotional analysis solution, able to implicitly infer the interest of the user for the shown content from his/her pupil size. A sample of 150 subjects was invited to experience the proposed interface at an International DesignWeek. Preliminary results show that the most of the subjects were able to properly interact with the system from the very first use, and that the emotional module is an interesting solution, even if further work must be devoted to address specific situations.
2016
Navigating Wall-sized Displays with the Gaze: a Proposal for Cultural Heritage / Calandra, DAVIDE MARIA; DI MAURO, Dario; Cutugno, Francesco; DI MARTINO, Sergio. - 1621:(2016), pp. 36-43. (Intervento presentato al convegno 1st Workshop on Advanced Visual Interfaces for Cultural Heritage, AVI*CH tenutosi a Bari, Italy nel 07/07/2016).
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11588/669628
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 18
  • ???jsp.display-item.citation.isi??? ND
social impact