In this article we present an integrated multimedia system for passive and active profiling of visitors in the Donatello room of the Bargello Museum in Florence. The system is composed by two Computer Vision powered modules: 1) the first, MNEMOSYNE, based on passive observation of visitors through cameras, builds a list of the artworks of interest for each visitor. These preferred artworks are then used to deliver personalised content and targeted recommendation of other items of interest on an interactive table exploiting user re-identification; 2) the latter, SeeForMe, is a wearable embedded system featuring an application which augments the functions of the well-known museum audio guides. The embedded system provides real-time artwork recognition on data obtained through a micro-camera exploiting a Convolutional Neural Network; furthermore it is smart, understanding the context and user behaviours such as walking, talking or being distracted and reacting consequently.

User Profiling and Context Understanding for Adaptive and Personalised Museum Experiences / Claudio Baecchi, Andrea Ferracani, Alberto Del Bimbo. - In: @ DIGITCULT. - ISSN 2531-5994. - ELETTRONICO. - 4:(2019), pp. 15-28.

User Profiling and Context Understanding for Adaptive and Personalised Museum Experiences

Claudio Baecchi;Andrea Ferracani;Alberto Del Bimbo
2019

Abstract

In this article we present an integrated multimedia system for passive and active profiling of visitors in the Donatello room of the Bargello Museum in Florence. The system is composed by two Computer Vision powered modules: 1) the first, MNEMOSYNE, based on passive observation of visitors through cameras, builds a list of the artworks of interest for each visitor. These preferred artworks are then used to deliver personalised content and targeted recommendation of other items of interest on an interactive table exploiting user re-identification; 2) the latter, SeeForMe, is a wearable embedded system featuring an application which augments the functions of the well-known museum audio guides. The embedded system provides real-time artwork recognition on data obtained through a micro-camera exploiting a Convolutional Neural Network; furthermore it is smart, understanding the context and user behaviours such as walking, talking or being distracted and reacting consequently.
4
15
28
Claudio Baecchi, Andrea Ferracani, Alberto Del Bimbo
File in questo prodotto:
File Dimensione Formato  
130-1-752-2-10-20200102.pdf

accesso aperto

Tipologia: Pdf editoriale (Version of record)
Licenza: Open Access
Dimensione 3.34 MB
Formato Adobe PDF
3.34 MB Adobe PDF Visualizza/Apri

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2158/1195588
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact