用自然语言生成可3D打印的触觉图形,让视障者能触摸读图。
Text-based Tactile Graphics Generation for the Visually Impaired

- 输入文字指令,自动生成带纹理和盲文的2.5D触觉图
- 支持高分辨率可重复纹理与可打印基底,保证触感清晰
- 适合视障用户、无障碍设计研究者及通用生成模型开发者
触觉图形是视障和低视力(BLV)人群获取非文本信息的主要方式,但难以规模化或个性化。尽管生成模型已革新视觉内容创作,但其优化目标为屏幕可视性,无法满足触觉感知与物理打印需求。本文提出首个集成生成系统,直接从自然语言提示生成可3D打印的2.5D触觉图形,统一生成全局基底结构、精细触觉纹理及符合标准的盲文。方法包括模板引导的浮雕生成、基于快速扩散的文本到纹理模块以生成高分辨率可重复法向图,以及严格的基底平整化处理,确保触觉可读性与打印可行性,同时支持自动生成与交互式纹理控制。大量评估结合实地视障用户与蒙眼正常视力者对实物3D打印输出的测试表明,参与者普遍偏好本方法生成结果。该工作将生成式图形拓展至可触摸实体,为视障群体及更广泛人群拓宽了生成式AI的应用边界。
原文摘要 · Abstract (English)
Tactile graphics are a primary medium for blind and low-vision (BLV) individuals to access non-textual information. However, they are difficult to scale or personalize. While recent generative models have revolutionized visual content creation, they are optimized for screen-based visual realism and fail to satisfy the haptic perceptual and physical fabrication constraints required for touch. We present the first integrated generative system that produces fabrication-ready 2.5D tactile graphics directly from natural language prompts, jointly generating global base geometry, fine-grained tactile surface textures, and standard-compliant braille within a unified 3D-printable representation. Our approach introduces fabrication-aware techniques, including template-guided relief generation, a fast diffusion-based text-to-texture module for high-resolution tileable normal maps, and strict base flattening to ensure tactile readability and printability, while supporting both automatic generation and interactive texture control. Extensive evaluations, together with in-person user studies with BLV participants and blindfolded sighted participants using physically 3D-printed outputs, show that participants consistently prefer our results over baselines. By extending generative graphics beyond screens to touchable reliefs, our work broadens access to generative AI for the BLV community and beyond.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。