用单张照片生成3D人头，虚拟试戴眼镜，降低网购退货率。
Virtual Trial Room with Computer Vision and Machine Learning
- 单张2D图像生成3D人头模型，结合真实测量的3D眼镜模型。
- 通过纹理、光影与平滑处理还原真实试戴效果。
- 全栈开发应用，支持网页端沉浸式交互体验。
在线购物虽带来便利，但用户在购买手表、珠宝、眼镜、鞋履和服装等穿戴品时常因无法确定合身与适配而犹豫，导致退货率高企，对商家与顾客均造成困扰。为此，本文设计并实现了一款基于计算机视觉与机器学习的虚拟试戴平台。该平台利用DECA模型从单张2D图像生成3D人头模型，并将基于真实测量数据定制的3D眼镜模型精准叠加于其上。为增强真实感，模型经过纹理贴图、光照调整与表面平滑处理。同时，采用前后端技术构建全栈应用，支持用户在网页端实时查看3D生成结果，实现沉浸式、交互式的虚拟试戴体验。
原文摘要 · Abstract (English)
Online shopping has revolutionized the retail industry, providing customers with convenience and accessibility. However, customers often hesitate to purchase wearable products such as watches, jewelry, glasses, shoes, and clothes due to the lack of certainty regarding fit and suitability. This leads to significant return rates, causing problems for both customers and vendors. To address this issue, a platform called the Virtual Trial Room with Computer Vision and Machine Learning is designed which enables customers to easily check whether a product will fit and suit them or not. To achieve this, an AI-generated 3D model of the human head was created from a single 2D image using the DECA model. This 3D model was then superimposed with a custom-made 3D model of glass which is based on real-world measurements and fitted over the human head. To replicate the real-world look and feel, the model was retouched with textures, lightness, and smoothness. Furthermore, a full-stack application was developed utilizing various fornt-end and back-end technologies. This application enables users to view 3D-generated results on the website, providing an immersive and interactive experience.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。