首个融合几何与纹理的彩色网格质量评估框架
HybridMQA: Exploring Geometry-Texture Interactions for Colored Mesh Quality Assessment
- 结合3D图学习与2D投影渲染,捕捉几何与纹理交互
- 跨注意力机制实现多模态信息融合,提升评估精度
- 适合需要精细网格质量分析的研究与工业应用
网格质量评估(MQA)模型在多种应用场景中对网格设计、优化与评估至关重要。现有方法或依赖拓扑感知特征的模型,或基于渲染的2D投影,难以捕捉纹理与三维几何间的复杂交互。本文提出 HybridMQA,首个融合模型与投影方法的全参考彩色网格质量评估框架,通过图学习提取精细3D表示,并采用新型特征渲染过程将其精确投影至2D,实现与彩色投影对齐。借助交叉注意力机制探索几何-纹理交互,生成全面的网格质量表征。大量实验表明,HybridMQA 在多个数据集上表现优异,充分验证其对几何-纹理交互的有效利用。代码将公开。
原文摘要 · Abstract (English)
Mesh quality assessment (MQA) models play a critical role in the design, optimization, and evaluation of mesh operation systems in a wide variety of applications. Current MQA models, whether model-based methods using topology-aware features or projection-based approaches working on rendered 2D projections, often fail to capture the intricate interactions between texture and 3D geometry. We introduce HybridMQA, a first-of-its-kind hybrid full-reference colored MQA framework that integrates model-based and projection-based approaches, capturing complex interactions between textural information and 3D structures for enriched quality representations. Our method employs graph learning to extract detailed 3D representations, which are then projected to 2D using a novel feature rendering process that precisely aligns them with colored projections. This enables the exploration of geometry-texture interactions via cross-attention, producing comprehensive mesh quality representations. Extensive experiments demonstrate HybridMQA's superior performance across diverse datasets, highlighting its ability to effectively leverage geometry-texture interactions for a thorough understanding of mesh quality. Our implementation will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。