In this paper, we propose a framework for analyzing and understanding human behavior from depth videos. The proposed solution first employs shape analysis of the human pose across time to decompose the full motion into short temporal segments representing elementary motions. Then, each segment is characterized by human motion and depth appearance around hand joints to describe the change in pose of the body and the interaction with objects. Finally, the sequence of temporal segments is modeled through a Dynamic Naive Bayes classifier, which captures the dynamics of elementary motions characterizing human behavior. Experiments on four challenging datasets evaluate the potential of the proposed approach in different contexts, including gesture or activity recognition and online activity detection. Competitive results in comparison with state-of-the-art methods are reported.

Motion Segment Decomposition of RGB-D Sequences for Human Behavior Understanding / Devanne, Maxime; Berretti, Stefano; Pala, Pietro; Wannous, Hazem; Daoudi, Mohamed; Del Bimbo, Alberto. - In: PATTERN RECOGNITION. - ISSN 0031-3203. - STAMPA. - 61:(2017), pp. 222-233. [10.1016/j.patcog.2016.07.041]

Motion Segment Decomposition of RGB-D Sequences for Human Behavior Understanding

BERRETTI, STEFANO;PALA, PIETRO;DEL BIMBO, ALBERTO
2017

Abstract

In this paper, we propose a framework for analyzing and understanding human behavior from depth videos. The proposed solution first employs shape analysis of the human pose across time to decompose the full motion into short temporal segments representing elementary motions. Then, each segment is characterized by human motion and depth appearance around hand joints to describe the change in pose of the body and the interaction with objects. Finally, the sequence of temporal segments is modeled through a Dynamic Naive Bayes classifier, which captures the dynamics of elementary motions characterizing human behavior. Experiments on four challenging datasets evaluate the potential of the proposed approach in different contexts, including gesture or activity recognition and online activity detection. Competitive results in comparison with state-of-the-art methods are reported.
2017
61
222
233
Devanne, Maxime; Berretti, Stefano; Pala, Pietro; Wannous, Hazem; Daoudi, Mohamed; Del Bimbo, Alberto
File in questo prodotto:
File Dimensione Formato  
pr17.pdf

Accesso chiuso

Descrizione: Articolo principale
Tipologia: Pdf editoriale (Version of record)
Licenza: Tutti i diritti riservati
Dimensione 870.15 kB
Formato Adobe PDF
870.15 kB Adobe PDF   Richiedi una copia
motion-segments-decomposition.pdf

accesso aperto

Tipologia: Preprint (Submitted version)
Licenza: Open Access
Dimensione 1.61 MB
Formato Adobe PDF
1.61 MB Adobe PDF

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1053997
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 49
  • ???jsp.display-item.citation.isi??? 40
social impact