Affective content analysis has gained great attention in recent years and is an important challenge of content-based multimedia information retrieval. In this paper, a hierarchical approach is proposed for affect recognition in movie datasets. This approach has been verified on the AFEW dataset, showing an improvement in classification results compared to the baseline. In order to use all the visual sentiment aspects contained in the movies excerpts of a realistic dataset such as FilmStim, deep learning features trained on a large set of emotional images are added to the standard audio and visual features. The proposed approach will be integrated in a system that communicates the emotions of a movie to impaired people and contribute to improve their television experience.
Affect recognition in a realistic movie dataset using a hierarchical approach / Dumoulin, Joël; Affi, Diana; Mugellini, Elena; Abou Khaled, Omar; Bertini, Marco; Del Bimbo, Alberto. - ELETTRONICO. - (2015), pp. 15-20. (Intervento presentato al convegno ACM multimedia 2015 tenutosi a Brisbane, Australia nel October 26-30, 2015) [10.1145/2813524.2813526].
Affect recognition in a realistic movie dataset using a hierarchical approach
DUMOULIN, JOEL;BERTINI, MARCO;DEL BIMBO, ALBERTO
2015
Abstract
Affective content analysis has gained great attention in recent years and is an important challenge of content-based multimedia information retrieval. In this paper, a hierarchical approach is proposed for affect recognition in movie datasets. This approach has been verified on the AFEW dataset, showing an improvement in classification results compared to the baseline. In order to use all the visual sentiment aspects contained in the movies excerpts of a realistic dataset such as FilmStim, deep learning features trained on a large set of emotional images are added to the standard audio and visual features. The proposed approach will be integrated in a system that communicates the emotions of a movie to impaired people and contribute to improve their television experience.I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.