This paper explores content-based image registration as a means of dealing with and understanding better Electronic Image Stabilization (EIS) in the context of Photo Response Non-Uniformity (PRNU) alignment. A novel and robust solution to extrapolate the transformation relating the different image output formats for a given device model is proposed. This general approach can be adapted to specifically extract the scale factor (and, when appropriate, the translation) so as to align native resolution images to video frames, with or without EIS on, and proceed to compare PRNU patterns. Comparative evaluations show that the proposed approach outperforms those based on brute-force and particle swarm optimization in terms of reliability, accuracy and speed. Furthermore, a tracking system able to revert back EIS in controlled environments is designed. This allows one to investigate the differences between the existing EIS implementations. The additional knowledge thus acquired can be exploited and integrated in order to design and implement better future PRNU pattern alignment methods, aware of EIS and suitable for video source identification in multimedia forensics applications.

Experiencing with electronic image stabilization and PRNU through scene content image registration / Fabio Bellavia, Marco Fanfani, Carlo Colombo, Alessandro Piva. - In: PATTERN RECOGNITION LETTERS. - ISSN 0167-8655. - STAMPA. - 145:(2021), pp. 8-15. [10.1016/j.patrec.2021.01.014]

Experiencing with electronic image stabilization and PRNU through scene content image registration

Fabio Bellavia;Marco Fanfani;Carlo Colombo
;
Alessandro Piva
2021

Abstract

This paper explores content-based image registration as a means of dealing with and understanding better Electronic Image Stabilization (EIS) in the context of Photo Response Non-Uniformity (PRNU) alignment. A novel and robust solution to extrapolate the transformation relating the different image output formats for a given device model is proposed. This general approach can be adapted to specifically extract the scale factor (and, when appropriate, the translation) so as to align native resolution images to video frames, with or without EIS on, and proceed to compare PRNU patterns. Comparative evaluations show that the proposed approach outperforms those based on brute-force and particle swarm optimization in terms of reliability, accuracy and speed. Furthermore, a tracking system able to revert back EIS in controlled environments is designed. This allows one to investigate the differences between the existing EIS implementations. The additional knowledge thus acquired can be exploited and integrated in order to design and implement better future PRNU pattern alignment methods, aware of EIS and suitable for video source identification in multimedia forensics applications.
2021
145
8
15
Fabio Bellavia, Marco Fanfani, Carlo Colombo, Alessandro Piva
File in questo prodotto:
File Dimensione Formato  
Alvaro_PRL2021.pdf

accesso aperto

Tipologia: Versione finale referata (Postprint, Accepted manuscript)
Licenza: Tutti i diritti riservati
Dimensione 1.25 MB
Formato Adobe PDF
1.25 MB Adobe PDF

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1223559
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 14
  • ???jsp.display-item.citation.isi??? 12
social impact