用一张图生成带真实触感的3D纹理，让设计既好看又可触摸。
TactStyle: Generating Tactile Textures with Generative AI for Digital Fabrication
- 基于图像生成高度图，融合触觉信息实现风格化3D建模
- 单张图片输入即可生成多种触感特征，实测效果接近真实纹理
- 适合需要触觉反馈的数字制造与交互设计场景
当前生成式AI可基于图像提示对3D模型进行风格化，但缺乏触觉信息，导致设计缺少预期的触感。我们提出TactStyle，一个支持图像驱动且融入预期触觉特性的3D建模系统。该系统通过微调图像生成模型，生成目标表面纹理的高度图，并优化3D模型表面以呈现生成纹理，从而实现视觉与触觉双重匹配。我们使用大规模纹理数据集训练纹理生成模型。在心理物理学实验中，我们对比了3D打印的原始纹理与TactStyle生成纹理的触觉表现。结果表明，TactStyle仅凭单张图像输入即可成功生成多种触觉特征，为触觉设计提供了新范式。
原文摘要 · Abstract (English)
Recent work in Generative AI enables the stylization of 3D models based on image prompts. However, these methods do not incorporate tactile information, leading to designs that lack the expected tactile properties. We present TactStyle, a system that allows creators to stylize 3D models with images while incorporating the expected tactile properties. TactStyle accomplishes this using a modified image-generation model fine-tuned to generate heightfields for given surface textures. By optimizing 3D model surfaces to embody a generated texture, TactStyle creates models that match the desired style and replicate the tactile experience. We utilize a large-scale dataset of textures to train our texture generation model. In a psychophysical experiment, we evaluate the tactile qualities of a set of 3D-printed original textures and TactStyle's generated textures. Our results show that TactStyle successfully generates a wide range of tactile features from a single image input, enabling a novel approach to haptic design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。