用视频生成材料的感知特征指纹,实现跨平台材料识别。
Material Fingerprinting: Identifying and Predicting Perceptual Attributes of Material Appearance
- 通过动态视频提取16个关键感知属性,构建材料感知指纹。
- 20+参与者对347种材料进行评分,建立可预测的属性数据集。
- 模型能根据图像特征预测感知属性,适合材质检索与筛选场景。
世界充满多样材料,其表面外观在日常感知和属性理解中至关重要。尽管技术已能捕捉和真实再现材料外观,但不同测量方式与软件平台间材料属性信息的互操作性仍是一大挑战。核心在于自动识别材料的感知特征,以直观区分存储于异构数据中的属性。我们提出:对多数应用而言,紧凑的感知表征比详尽的物理描述更有用。本文通过动态视觉刺激编码材料感知特征,开展心理物理学实验,从347种材料的视频中选取并验证了16个关键感知属性。超过20名参与者为每种材料打分,形成“材料指纹”以刻画其独特感知特性。随后训练多层感知机模型,预测统计与深度学习图像特征与其对应感知属性的关系。实验展示模型在按属性检索与过滤材料上的性能。该模型显著推动了在不同数字环境下材料属性的共享与理解,提升了识别的准确性和效率。
原文摘要 · Abstract (English)
The world is abundant with diverse materials, each possessing unique surface appearances that play a crucial role in our daily perception and understanding of their properties. Despite advancements in technology enabling the capture and realistic reproduction of material appearances for visualization and quality control, the interoperability of material property information across various measurement representations and software platforms remains a complex challenge. A key to overcoming this challenge lies in the automatic identification of materials' perceptual features, enabling intuitive differentiation of properties stored in disparate material data representations. We reasoned that for many practical purposes, a compact representation of the perceptual appearance is more useful than an exhaustive physical description.This paper introduces a novel approach to material identification by encoding perceptual features obtained from dynamic visual stimuli. We conducted a psychophysical experiment to select and validate 16 particularly significant perceptual attributes obtained from videos of 347 materials. We then gathered attribute ratings from over twenty participants for each material, creating a 'material fingerprint' that encodes the unique perceptual properties of each material. Finally, we trained a multi-layer perceptron model to predict the relationship between statistical and deep learning image features and their corresponding perceptual properties. We demonstrate the model's performance in material retrieval and filtering according to individual attributes. This model represents a significant step towards simplifying the sharing and understanding of material properties in diverse digital environments regardless of their digital representation, enhancing both the accuracy and efficiency of material identification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。