The main disadvantages of the existing methods for studying speech articulators (such as electromagnetic and optoelectronic systems) are the high cost and the discomfort to participants or patients. The aim of this work is to introduce a completely markerless low-cost 3D tracking technique in the context of speech articulation, and then compare it with a wellestablished marker-based one to evaluate the performances. A Kinect-like device was used in conjunction with an existing face tracking algorithm to track lips movements in 3D without markers. The method was tested on two subjects uttering 200 words and 100 sentences. For most of points of the lips the RMSE ranged between 1 and 3 mm. Although the image resolution used in this experiment was low, these results are very promising. Nevertheless, further studies should consider higher video resolutions in order to obtain better results.

Accuracy of a markerless acquisition technique for studying speech articulators / Bandini A.; Ouni S.; Cosi P.; Orlandi S.; Manfredi C.. - ELETTRONICO. - 2015-:(2015), pp. 2162-2166. (Intervento presentato al convegno 16th Annual Conference of the International Speech Communication Association, INTERSPEECH 2015 tenutosi a International Congress Center, deu nel 2015).

Accuracy of a markerless acquisition technique for studying speech articulators

Bandini A.
;
Orlandi S.;Manfredi C.
2015

Abstract

The main disadvantages of the existing methods for studying speech articulators (such as electromagnetic and optoelectronic systems) are the high cost and the discomfort to participants or patients. The aim of this work is to introduce a completely markerless low-cost 3D tracking technique in the context of speech articulation, and then compare it with a wellestablished marker-based one to evaluate the performances. A Kinect-like device was used in conjunction with an existing face tracking algorithm to track lips movements in 3D without markers. The method was tested on two subjects uttering 200 words and 100 sentences. For most of points of the lips the RMSE ranged between 1 and 3 mm. Although the image resolution used in this experiment was low, these results are very promising. Nevertheless, further studies should consider higher video resolutions in order to obtain better results.
2015
Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
16th Annual Conference of the International Speech Communication Association, INTERSPEECH 2015
International Congress Center, deu
2015
Bandini A.; Ouni S.; Cosi P.; Orlandi S.; Manfredi C.
File in questo prodotto:
File Dimensione Formato  
2015_Bandini_INTERSPEECH.pdf

accesso aperto

Tipologia: Pdf editoriale (Version of record)
Licenza: Tutti i diritti riservati
Dimensione 206.52 kB
Formato Adobe PDF
206.52 kB Adobe PDF

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1219684
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 7
  • ???jsp.display-item.citation.isi??? 4
social impact