一键生成高表达力2D卡通数字人,50秒内完成建模。
CartoonAlive: Towards Expressive Live2D Modeling from Single Portraits
- 用3D人脸混合形状思想构建适合Live2D的面部变形模型。
- 仅需一张人脸图,50秒内生成可实时互动的高保真卡通角色。
- 适合快速制作虚拟偶像、游戏角色等需要个性化的场景。
随着大模型、AIGC、云渲染和实时动作捕捉技术的发展,数字人已能实现面部表情与肢体动作同步、基于自然语言的智能对话,并支持个性化角色快速创建。尽管当前主流数字人多聚焦于3D模型与2D视频表示,交互式2D卡通风格的Live2D数字人仍较少受到关注。相比需复杂建模与高渲染成本的3D数字人,以及灵活性差、难以实时交互的2D视频方案,Live2D通过分层分割实现类3D动态效果,无需传统3D建模,具备更高效率与表现力。本文提出CartoonAlive,一种从单张肖像图生成高质量Live2D数字人的新方法。该方法借鉴3D人脸中常用的形状基(shape basis)概念,构建适用于Live2D的面部混合形状(blendshapes),并基于输入图像检测到的面部关键点推断对应的混合形状权重。该流程可在不到半分钟内生成高度逼真且富有表现力的Live2D模型,忠实还原输入肖像特征。本工作为创建交互式2D卡通角色提供了实用且可扩展的解决方案,拓展了数字内容创作与虚拟角色动画的新可能。项目主页:https://human3daigc.github.io/CartoonAlive_webpage/
原文摘要 · Abstract (English)
With the rapid advancement of large foundation models, AIGC, cloud rendering, and real-time motion capture technologies, digital humans are now capable of achieving synchronized facial expressions and body movements, engaging in intelligent dialogues driven by natural language, and enabling the fast creation of personalized avatars. While current mainstream approaches to digital humans primarily focus on 3D models and 2D video-based representations, interactive 2D cartoon-style digital humans have received relatively less attention. Compared to 3D digital humans that require complex modeling and high rendering costs, and 2D video-based solutions that lack flexibility and real-time interactivity, 2D cartoon-style Live2D models offer a more efficient and expressive alternative. By simulating 3D-like motion through layered segmentation without the need for traditional 3D modeling, Live2D enables dynamic and real-time manipulation. In this technical report, we present CartoonAlive, an innovative method for generating high-quality Live2D digital humans from a single input portrait image. CartoonAlive leverages the shape basis concept commonly used in 3D face modeling to construct facial blendshapes suitable for Live2D. It then infers the corresponding blendshape weights based on facial keypoints detected from the input image. This approach allows for the rapid generation of a highly expressive and visually accurate Live2D model that closely resembles the input portrait, within less than half a minute. Our work provides a practical and scalable solution for creating interactive 2D cartoon characters, opening new possibilities in digital content creation and virtual character animation. The project homepage is https://human3daigc.github.io/CartoonAlive_webpage/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。