arXiv:2606.19195cs.CV2026-06

0.2B参数模型实现10B级图像修复质量,推理快15倍

Moebius: 0.2B Lightweight Image Inpainting Framework with 10B-Level Performance

论文配图:Moebius: 0.2B Lightweight Image Inpainting Framework with 10B-Level Performance
图 1 · 摘自论文原文
  • 用局部-λ混合交互块压缩结构,保留复杂特征关系
  • 0.22B参数达11.9B模型的修复质量,推理提速超15倍
  • 适合资源受限场景,如移动端或实时应用

尽管100亿级工业级基础模型推动了图像修复的边界,但其高昂的计算成本严重阻碍实际部署。构建高度优化的任务专用模型是可行方案,但极端结构压缩会引发严重的表征瓶颈。为此,我们提出Moebius,一种高效轻量的图像修复框架。通过引入局部-λ混合交互(LλMI)模块系统重构扩散主干网络,该模块由局部-λ和交互-λ组件构成,将空间上下文与全局语义先验精炼为固定尺寸的线性矩阵,在大幅减少参数的同时保持复杂的潜在交互。为进一步释放该紧凑架构的表征能力,我们结合自适应多粒度蒸馏策略,严格在潜在空间操作以避免昂贵的像素空间解码,动态平衡多种基于梯度的损失,实现高保真对齐。在自然图像与人像基准上的大量实验表明,这种最优协同使Moebius在生成质量上可媲美甚至超越100亿级通用模型FLUX.1-Fill-Dev。值得注意的是,Moebius仅使用不足2%的参数(0.22B vs. 11.9B),同时总推理时间加速超过15倍,树立了高质量图像修复的新效率标杆。

原文摘要 · Abstract (English)

While 10B-level industrial foundation models have pushed the boundaries of image inpainting, their prohibitive computational costs severely hinder practical deployment. Constructing a highly optimized task-specific specialist offers a promising solution; however, extreme structural compression inevitably triggers a severe representation bottleneck. To conquer this, we propose Moebius, a highly efficient lightweight inpainting framework. We systematically reconstruct the diffusion backbone by introducing the Local-$λ$ Mix Interaction ($LλMI$) block. Comprising Local-$λ$ and Interactive-$λ$ modules, it elegantly summarizes spatial contexts and global semantic priors into fixed-size linear matrices, preserving complex latent interactions while drastically shedding parameters. Furthermore, to unlock the full representational capacity of this highly compact architecture, we synergistically pair it with an adaptive multi-granularity distillation strategy. Operating strictly within the latent space to avoid expensive pixel-space decoding, this strategy dynamically balances multiple gradient-based losses to achieve high-fidelity alignment. Extensive experiments across natural and portrait benchmarks demonstrate that this optimal synergy enables Moebius to rival or even surpass the generation quality of the 10B-level industrial generalist FLUX.1-Fill-Dev. Remarkably, Moebius achieves this using less than 2\% of the parameters (0.22B vs. 11.9B) while delivering a $>15\times$ acceleration in total inference time, setting a new efficiency standard for high-fidelity inpainting. Project page at https://hustvl.github.io/Moebius.

图像修复轻量化扩散模型高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。