用AI自动为EPUB图文生成可读的替代文本,提升无障碍阅读体验。
AltGen: AI-Driven Alt Text Generation for Enhancing EPUB Accessibility
- 融合视觉与上下文信息,用AI生成语义连贯的图片描述。
- 降低97.5%的可访问性错误,模型输出在相似度和语言质量上表现优异。
- 适合出版机构、内容平台及无障碍技术开发者使用。
数字无障碍是包容性内容传播的基础,但许多EPUB文件缺乏图像的描述性替代文本,影响视障用户通过辅助技术理解内容。生成高质量替代文本需大量人力,难以规模化。本文提出AltGen,一种基于AI的自动化管道,用于为EPUB中的图像生成上下文相关的替代文本。该流程包括数据预处理、使用CLIP和ViT进行视觉分析,结合周围文本信息,由微调的语言模型生成准确描述。通过余弦相似度、BLEU分数等定量指标及视障用户定性反馈验证,实验表明,AltGen在多个数据集上实现97.5%的可访问性错误减少,且在语义一致性和语言流畅性方面得分高。用户研究显示其显著提升文档可用性与理解度,相较现有方法在准确性、相关性和可扩展性上均有优势。
原文摘要 · Abstract (English)
Digital accessibility is a cornerstone of inclusive content delivery, yet many EPUB files fail to meet fundamental accessibility standards, particularly in providing descriptive alt text for images. Alt text plays a critical role in enabling visually impaired users to understand visual content through assistive technologies. However, generating high-quality alt text at scale is a resource-intensive process, creating significant challenges for organizations aiming to ensure accessibility compliance. This paper introduces AltGen, a novel AI-driven pipeline designed to automate the generation of alt text for images in EPUB files. By integrating state-of-the-art generative models, including advanced transformer-based architectures, AltGen achieves contextually relevant and linguistically coherent alt text descriptions. The pipeline encompasses multiple stages, starting with data preprocessing to extract and prepare relevant content, followed by visual analysis using computer vision models such as CLIP and ViT. The extracted visual features are enriched with contextual information from surrounding text, enabling the fine-tuned language models to generate descriptive and accurate alt text. Validation of the generated output employs both quantitative metrics, such as cosine similarity and BLEU scores, and qualitative feedback from visually impaired users. Experimental results demonstrate the efficacy of AltGen across diverse datasets, achieving a 97.5% reduction in accessibility errors and high scores in similarity and linguistic fidelity metrics. User studies highlight the practical impact of AltGen, with participants reporting significant improvements in document usability and comprehension. Furthermore, comparative analyses reveal that AltGen outperforms existing approaches in terms of accuracy, relevance, and scalability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。