Mandal, Abhishek
ORCID: 0000-0002-5275-4192, Leavy, Susan
ORCID: 0000-0002-3679-2279 and Little, Suzanne
ORCID: 0000-0003-3281-3471
(2024)
Generated Bias: Auditing Internal Bias Dynamics
of Text-To-Image Generative Models.
In: 1st ECCV Workshop on Critical Evaluation of Generative Models and their Impact on Society, 29 September 2024, Milan, Italy.
ISBN 978-3-031-92089-9
Abstract
Text-To-Image (TTI) Diffusion Models such as DALL-E and
Stable Diffusion are capable of generating images from text prompts.
However, they have been shown to perpetuate gender stereotypes. These models process data internally in multiple stages and employ several constituent models, often trained separately. In this paper, we propose two novel metrics to measure bias internally in these multistage multimodal models. Diffusion Bias was developed to detect and measures bias introduced by the diffusion stage of the models. Bias Amplification measures amplification of bias during the text-to-image conversion process. Our experiments reveal that TTI models amplify gender bias, the diffusion process itself contributes to bias and that Stable Diffusion v2 is more prone to gender bias than DALL-E 2.
Metadata
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Event Type: | Workshop |
| Refereed: | Yes |
| Subjects: | Computer Science > Artificial intelligence Computer Science > Machine learning Social Sciences > Gender |
| DCU Faculties and Centres: | Research Institutes and Centres > INSIGHT Centre for Data Analytics |
| Published in: | Del Bue, A., Canton, C., Pont-Tuset, J. and Tommasi, T., (eds.) Generated Bias: Auditing Internal Bias Dynamics of Text-to-Image Generative Models. Lecture Notes in Computer Science (LNCS) 15644. Springer Nature. ISBN 978-3-031-92089-9 |
| Publisher: | Springer Nature |
| Official URL: | https://link.springer.com/chapter/10.1007/978-3-03... |
| Copyright Information: | Authors |
| Funders: | Science Foundation Ireland |
| ID Code: | 30362 |
| Deposited On: | 02 Sep 2025 11:31 by Abhishek Mandal . Last Modified 02 Sep 2025 11:31 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0 3MB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record