arXiv:2511.18838cs.CV2025-11被引 5

用聚焦预测替代缩放预测,让图像生成更清晰无锯齿。

FVAR: Visual Autoregressive Modeling via Next Focus Prediction

  • 通过模拟相机对焦过程,逐步去模糊而非简单下采样。
  • 构建无混叠的多尺度表示,显著减少细节丢失和摩尔纹。
  • 适合追求高质量图像生成的开发者,兼容现有自回归框架。

视觉自回归模型通过多尺度标记金字塔中的下一尺度预测实现卓越生成质量。然而,传统方法采用均匀下采样构建金字塔,导致混叠伪影,损害细节并引入不 desired 的锯齿与摩尔纹。为此,我们提出FVAR,将范式从「下一尺度预测」重构为「下一焦点预测」,模拟从模糊到清晰的自然对焦过程。核心创新包括:1)下一焦点预测范式,通过逐步去模糊而非简单下采样实现多尺度自回归;2)渐进式重聚焦金字塔构建,使用物理一致的离焦点扩散函数(PSF)核构建无混叠的多尺度表示;3)高频残差学习,引入专用残差教师网络,在训练中有效融合混叠信息,同时保持部署简洁。具体地,我们利用半径递减的离焦PSF核构造光学低通视图,实现平滑的模糊到清晰过渡,从源头消除混叠。为进一步增强细节生成,设计高频残差教师网络,学习清洁结构与混叠残差,将知识蒸馏至标准自回归部署网络,实现无缝推理。ImageNet上的大量实验表明,FVAR显著减少混叠伪影,提升细节保留与文本可读性,性能优于现有方法,且完全兼容现有自回归框架。

原文摘要 · Abstract (English)

Visual autoregressive models achieve remarkable generation quality through next-scale predictions across multi-scale token pyramids. However, the conventional method uses uniform scale downsampling to build these pyramids, leading to aliasing artifacts that compromise fine details and introduce unwanted jaggies and moiré patterns. To tackle this issue, we present \textbf{FVAR}, which reframes the paradigm from \emph{next-scale prediction} to \emph{next-focus prediction}, mimicking the natural process of camera focusing from blur to clarity. Our approach introduces three key innovations: \textbf{1) Next-Focus Prediction Paradigm} that transforms multi-scale autoregression by progressively reducing blur rather than simply downsampling; \textbf{2) Progressive Refocusing Pyramid Construction} that uses physics-consistent defocus kernels to build clean, alias-free multi-scale representations; and \textbf{3) High-Frequency Residual Learning} that employs a specialized residual teacher network to effectively incorporate alias information during training while maintaining deployment simplicity. Specifically, we construct optical low-pass views using defocus point spread function (PSF) kernels with decreasing radius, creating smooth blur-to-clarity transitions that eliminate aliasing at its source. To further enhance detail generation, we introduce a High-Frequency Residual Teacher that learns from both clean structure and alias residuals, distilling this knowledge to a vanilla VAR deployment network for seamless inference. Extensive experiments on ImageNet demonstrate that FVAR substantially reduces aliasing artifacts, improves fine detail preservation, and enhances text readability, achieving superior performance with perfect compatibility to existing VAR frameworks.

图像生成自回归模型去模糊细节增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。