Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Generated Bias: Auditing Internal Bias Dynamics of Text-To-Image Generative Models

Mandal, Abhishek orcid logoORCID: 0000-0002-5275-4192, Leavy, Susan orcid logoORCID: 0000-0002-3679-2279 and Little, Suzanne orcid logoORCID: 0000-0003-3281-3471 (2024) Generated Bias: Auditing Internal Bias Dynamics of Text-To-Image Generative Models. In: 1st ECCV Workshop on Critical Evaluation of Generative Models and their Impact on Society, 29 September 2024, Milan, Italy. ISBN 978-3-031-92089-9

Abstract
Text-To-Image (TTI) Diffusion Models such as DALL-E and Stable Diffusion are capable of generating images from text prompts. However, they have been shown to perpetuate gender stereotypes. These models process data internally in multiple stages and employ several constituent models, often trained separately. In this paper, we propose two novel metrics to measure bias internally in these multistage multimodal models. Diffusion Bias was developed to detect and measures bias introduced by the diffusion stage of the models. Bias Amplification measures amplification of bias during the text-to-image conversion process. Our experiments reveal that TTI models amplify gender bias, the diffusion process itself contributes to bias and that Stable Diffusion v2 is more prone to gender bias than DALL-E 2.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Refereed:Yes
Subjects:Computer Science > Artificial intelligence
Computer Science > Machine learning
Social Sciences > Gender
DCU Faculties and Centres:Research Institutes and Centres > INSIGHT Centre for Data Analytics
Published in: Del Bue, A., Canton, C., Pont-Tuset, J. and Tommasi, T., (eds.) Generated Bias: Auditing Internal Bias Dynamics of Text-to-Image Generative Models. Lecture Notes in Computer Science (LNCS) 15644. Springer Nature. ISBN 978-3-031-92089-9
Publisher:Springer Nature
Official URL:https://link.springer.com/chapter/10.1007/978-3-03...
Copyright Information:Authors
Funders:Science Foundation Ireland
ID Code:30362
Deposited On:02 Sep 2025 11:31 by Abhishek Mandal . Last Modified 02 Sep 2025 11:31
Documents

Full text available as:

[thumbnail of Abhishek_ECCV_2024_CEGIS_Workshop__SL_Copy_ (1).pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0
3MB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record