In this paper we address the problem of creating a smart audio guide that adapts to the actions and interests of tourists. Our guide performs automatic recognition of artworks and allows the users instant or deferred fruition of multimedia content. We use a compact CNN as computer vision system to back the whole application to performs object classification, localization and recognition. Tracking is used to improve the recognition accuracy over sequences of detections. We also provide an automatic pipeline for dataset creation based on the same tracking algorithm. The system, deployed on an NVIDIA Jetson TK1 and an NVIDIA Shield Tablet, has been tested in a real world environment.

Object Recognition and Tracking for Smart Audio Guides / Seidenari, Lorenzo; Baecchi, Claudio; Uricchio, Tiberio; Ferracani, Andrea; Bertini, Marco; Del Bimbo, Alberto;. - STAMPA. - (2018), pp. 1-6. ((Intervento presentato al convegno Italian Research Conference on Digital Libraries (IRCDL 2018) [10.1007/978-3-319-73165-0_16].

Object Recognition and Tracking for Smart Audio Guides

Seidenari, Lorenzo;Baecchi, Claudio;Uricchio, Tiberio;Ferracani, Andrea;Bertini, Marco;Del Bimbo, Alberto
2018

Abstract

In this paper we address the problem of creating a smart audio guide that adapts to the actions and interests of tourists. Our guide performs automatic recognition of artworks and allows the users instant or deferred fruition of multimedia content. We use a compact CNN as computer vision system to back the whole application to performs object classification, localization and recognition. Tracking is used to improve the recognition accuracy over sequences of detections. We also provide an automatic pipeline for dataset creation based on the same tracking algorithm. The system, deployed on an NVIDIA Jetson TK1 and an NVIDIA Shield Tablet, has been tested in a real world environment.
Proceedings of the 14th Italian Research Conference on Digital Libraries
Italian Research Conference on Digital Libraries (IRCDL 2018)
Seidenari, Lorenzo; Baecchi, Claudio; Uricchio, Tiberio; Ferracani, Andrea; Bertini, Marco; Del Bimbo, Alberto;
File in questo prodotto:
File Dimensione Formato  
ircdl2018.pdf

Accesso chiuso

Tipologia: Pdf editoriale (Version of record)
Licenza: DRM non definito
Dimensione 6.99 MB
Formato Adobe PDF
6.99 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2158/1099230
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 2
social impact