提出检测并移除数据集中儿童图像的流程,守护未成年人隐私安全
Neglected Risks: The Disturbing Reality of Children's Images in Datasets and the Urgent Call for Accountability
- 构建视觉语言模型驱动的儿童图像检测与清除流水线
- 在10万张Open Images V7图像中验证有效识别率,提升数据伦理安全性
- 呼吁研究社区重视儿童数据风险,推动负责任的数据集建设
将儿童图像纳入数据集引发隐私、同意、数据保护和责任归属等伦理问题。这些数据常通过网络爬取公开图片构建,可能使儿童面临剥削、画像和追踪风险。尽管问题日益凸显,应对措施仍有限。本文探讨儿童图像在人工智能数据集中的伦理影响,并提出一个检测与移除图像的流程。以视觉问答任务为例,基于视觉语言模型在#PraCegoVer数据集上进行测试,并在Open Images V7数据集的10万张图像子集中评估其有效性。该流程可作为未来研究的基准,为更全面的工具与方法提供起点。虽使用了潜在存在问题的预训练模型,但目的旨在揭示并解决此问题。我们不支持此类模型的训练或部署,而是呼吁学术界深入反思与行动,以保护儿童等弱势群体的基本权利。最终目标是促使研究者在构建新数据集时更加审慎,并推动开发保护未成年人权益的工具。
原文摘要 · Abstract (English)
Including children's images in datasets has raised ethical concerns, particularly regarding privacy, consent, data protection, and accountability. These datasets, often built by scraping publicly available images from the Internet, can expose children to risks such as exploitation, profiling, and tracking. Despite the growing recognition of these issues, approaches for addressing them remain limited. We explore the ethical implications of using children's images in AI datasets and propose a pipeline to detect and remove such images. As a use case, we built the pipeline on a Vision-Language Model under the Visual Question Answering task and tested it on the #PraCegoVer dataset. We also evaluate the pipeline on a subset of 100,000 images from the Open Images V7 dataset to assess its effectiveness in detecting and removing images of children. The pipeline serves as a baseline for future research, providing a starting point for more comprehensive tools and methodologies. While we leverage existing models trained on potentially problematic data, our goal is to expose and address this issue. We do not advocate for training or deploying such models, but instead call for urgent community reflection and action to protect children's rights. Ultimately, we aim to encourage the research community to exercise - more than an additional - care in creating new datasets and to inspire the development of tools to protect the fundamental rights of vulnerable groups, particularly children.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。