用户上传手部图像，虚拟试戴戒指，效果逼真。
Virtual Ring Try-On
- 结合MediaPipe与YOLO-V8实现手部关键点与戒指定位。
- 通过向量计算调整戒指角度，按手指粗细缩放保持真实感。
- 适合电商试戴、移动应用开发，无需复杂建模。
本文提出一种创新方法，让用户通过移动端应用拍摄手部图像并虚拟试戴戒指。用户使用基于React Native的GUI上传手部图像，选择目标戒指后，系统将生成带有该戒指的手部图像。该方法结合MediaPipe手部关键点检测与YOLO-V8自定义对象检测：先通过MediaPipe获取手部关键点及戒指放置区域掩码；再用YOLO-V8检测戒指关键点并去除背景。随后利用向量代数计算手指参考轴与戒指主轴间的夹角偏差，并根据手指厚度按比例缩放戒指尺寸，保持长宽比以确保视觉真实感。最后将处理后的戒指图像合成至原手部图像，输出结果实时显示在用户屏幕上。
原文摘要 · Abstract (English)
This paper presents an innovative approach that enables the users to capture their hand and try the jewel ring on their hand. The user captures the image of the hand using the React Native base GUI of the mobile application and selects the ring that the user wants to try, and the output image will have the user's hand with the ring image. This approach is implemented using a combination of MediaPipe hand point detection and YOLO-V8 custom object detection. The hand image uploaded by the user first undergoes mediapipe hand point detection. It will give the hand points and a Region of Interest mask where the ring is going to be placed. Then the ring is passed through YOLO object detection, in which ring points are detected, and background is removed. After that, using vector algebra, the angular discrepancy between the finger's reference axis and the ring's principal axis is computed. Also, ring size is rescaled according to finger thickness, preserving the aspect ratio to maintain perceptual realism. Then the ring is placed on the hand image and the output image is generated and shown on the user screen.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。