根据用户选择的面部特征生成匹配人脸,实现个性化伴侣筛选。
Find Matching Faces Based On Face Parameters
- 用户通过界面选择面部参数,转为文本提示生成真人级人脸图像。
- 通过512维向量嵌入比对,从网站下载图像中找出最相似的五张脸。
- 适合婚恋应用、个性化形象设计,可快速构建匹配推荐系统。
本文提出一种创新方法,让用户基于自选面部特征寻找匹配人脸。通过基于Gradio的交互界面,用户可选择期望的面部特征,这些参数被转化为文本提示,输入文生图模型生成逼真人脸图像。随后,将生成图像与从Jeevansathi.com下载的图像,经由人脸检测与特征提取模型处理,生成512维高维向量嵌入。已下载图像的嵌入向量存入向量数据库,再与生成图像的嵌入向量进行相似性搜索,最终返回最相似的前五张人脸。该方法具有转化为高质量个性化人脸匹配工具的巨大潜力。
原文摘要 · Abstract (English)
This paper presents an innovative approach that enables the user to find matching faces based on the user-selected face parameters. Through gradio-based user interface, the users can interactively select the face parameters they want in their desired partner. These user-selected face parameters are transformed into a text prompt which is used by the Text-To-Image generation model to generate a realistic face image. Further, the generated image along with the images downloaded from the Jeevansathi.com are processed through face detection and feature extraction model, which results in high dimensional vector embedding of 512 dimensions. The vector embeddings generated from the downloaded images are stored into vector database. Now, the similarity search is carried out between the vector embedding of generated image and the stored vector embeddings. As a result, it displays the top five similar faces based on the user-selected face parameters. This contribution holds a significant potential to turn into a high-quality personalized face matching tool.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。