The development of generative AI techniques such as Generative Adversarial Networks and Diffusion Models has made it accessible to create images, often extremely realistic, that do not represent reality. This capability has been exploited on multiple occasions by malicious actors to spread propaganda and fake news online. To trace the origin of generated content, the multimedia forensics community has developed techniques capable of identifying the specific model used to generate the content. However, these techniques often require access to the model in question or large quantities of images generated by it, two conditions that are frequently unattainable. In this paper, we show that tiny autoencoders can be effectively used as few-shot detectors capable of identifying a generative model using a small number of training images. Moreover, we show how this technique can be easily adapted in time to add new models to the attribution system, enabling its use in an incremental class scenario. Experiments demonstrate that the proposed technique is more effective than existing methods in all tested few-shot scenarios, proving its efficacy in situations where large training datasets are not available.

Tiny Autoencoders are Effective Few-Shot Generative Model Detectors / Bindini L.; Bertazzini G.; Baracchi D.; Shullani D.; Frasconi P.; Piva A.. - ELETTRONICO. - (2024), pp. 1-6. (Intervento presentato al convegno 16th IEEE International Workshop on Information Forensics and Security, WIFS 2024 tenutosi a ita nel 2024) [10.1109/WIFS61860.2024.10810686].

Tiny Autoencoders are Effective Few-Shot Generative Model Detectors

Bindini L.;Bertazzini G.;Baracchi D.;Shullani D.;Frasconi P.;Piva A.
2024

Abstract

The development of generative AI techniques such as Generative Adversarial Networks and Diffusion Models has made it accessible to create images, often extremely realistic, that do not represent reality. This capability has been exploited on multiple occasions by malicious actors to spread propaganda and fake news online. To trace the origin of generated content, the multimedia forensics community has developed techniques capable of identifying the specific model used to generate the content. However, these techniques often require access to the model in question or large quantities of images generated by it, two conditions that are frequently unattainable. In this paper, we show that tiny autoencoders can be effectively used as few-shot detectors capable of identifying a generative model using a small number of training images. Moreover, we show how this technique can be easily adapted in time to add new models to the attribution system, enabling its use in an incremental class scenario. Experiments demonstrate that the proposed technique is more effective than existing methods in all tested few-shot scenarios, proving its efficacy in situations where large training datasets are not available.
2024
Proceedings - 16th IEEE International Workshop on Information Forensics and Security, WIFS 2024
16th IEEE International Workshop on Information Forensics and Security, WIFS 2024
ita
2024
Bindini L.; Bertazzini G.; Baracchi D.; Shullani D.; Frasconi P.; Piva A.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1412673
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact