arXiv:2510.27236cs.CV2025-10被引 1

用网格变形+物体一致性,实现无标注的图像自适应缩放。

Object-IR: Leveraging Object Consistency and Mesh Deformation for Self-Supervised Image Retargeting

  • 将图像缩放转为基于网格的变形优化问题,由物体外观一致性引导。
  • 在RetargetMe上超越现有方法,0.009秒处理1024x683图像。
  • 无需人工标注数据,适合实时应用与任意分辨率输入。

图像缩放中保持语义重要区域的几何不变性仍是难题。本文提出Object-IR,一种自监督架构,将图像缩放重构为基于网格变形的学习优化问题,通过物体外观一致性和几何保真约束引导网格变形。给定输入图像和目标长宽比,先在输出分辨率初始化均匀刚性网格,再用卷积神经网络预测每个网格点的运动,得到形变网格。通过输入图像的刚性网格与输出端形变网格进行图像映射生成结果。为缓解几何失真,设计综合目标函数:(a) 物体一致性损失,保证重要语义物体外观不变;(b) 几何保真损失,约束重要网格的简单缩放变换;(c) 边界损失,确保输出为清晰矩形。其自监督范式通过输入图像的几何与语义属性直接获取监督信号,无需人工标注数据。在RetargetMe基准上的大量实验表明,Object-IR在定量指标与主观视觉质量上均达到领先水平。框架可高效处理任意输入分辨率(1024x683平均推理时间0.009秒),并在消费级GPU上保持实时性能。代码即将开源于https://github.com/tlliao/Object-IR。

原文摘要 · Abstract (English)

Eliminating geometric distortion in semantically important regions remains an intractable challenge in image retargeting. This paper presents Object-IR, a self-supervised architecture that reformulates image retargeting as a learning-based mesh warping optimization problem, where the mesh deformation is guided by object appearance consistency and geometric-preserving constraints. Given an input image and a target aspect ratio, we initialize a uniform rigid mesh at the output resolution and use a convolutional neural network to predict the motion of each mesh grid and obtain the deformed mesh. The retargeted result is generated by warping the input image according to the rigid mesh in the input image and the deformed mesh in the output resolution. To mitigate geometric distortion, we design a comprehensive objective function incorporating a) object-consistent loss to ensure that the important semantic objects retain their appearance, b) geometric-preserving loss to constrain simple scale transform of the important meshes, and c) boundary loss to enforce a clean rectangular output. Notably, our self-supervised paradigm eliminates the need for manually annotated retargeting datasets by deriving supervision directly from the input's geometric and semantic properties. Extensive evaluations on the RetargetMe benchmark demonstrate that our Object-IR achieves state-of-the-art performance, outperforming existing methods in quantitative metrics and subjective visual quality assessments. The framework efficiently processes arbitrary input resolutions (average inference time: 0.009s for 1024x683 resolution) while maintaining real-time performance on consumer-grade GPUs. The source code will soon be available at https://github.com/tlliao/Object-IR.

图像缩放自监督网格变形实时处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。