提出新方法,让图片自适应任意比例且不丢关键内容
Prune and Repaint: Content-Aware Image Retargeting for any Ratio
- 根据像素语义重要性判断该删还是留
- 自适应重绘区域,避免拼接痕迹和失真
- 在多种比例下都保持内容完整与视觉美观
图像重定形旨在调整图像宽高比以适配不同显示设备或展示环境。现有方法难以平衡关键语义保留与图像质量,常导致关键对象变形或丢失,或引入局部伪影(如像素不连续、内容不一致)。为此,我们提出一种名为 PruneRepaint 的内容感知重定形方法。该方法基于每个像素的语义重要性,指导识别需裁剪或保留的区域以维持关键语义。同时引入自适应重绘模块,根据裁剪像素分布及前景尺寸与目标宽高比的比例关系,选择重绘区域,实现裁剪后的局部平滑。通过聚焦前景内容与结构,该方法可自适应避免关键内容丢失与形变,有效缓解局部伪影。我们在公开数据集 RetargetMe 上进行实验,客观指标与主观用户评估均表明,本方法在语义保留、美学质量以及跨多种宽高比的泛化能力上优于已有方法。
原文摘要 · Abstract (English)
Image retargeting is the task of adjusting the aspect ratio of images to suit different display devices or presentation environments. However, existing retargeting methods often struggle to balance the preservation of key semantics and image quality, resulting in either deformation or loss of important objects, or the introduction of local artifacts such as discontinuous pixels and inconsistent regenerated content. To address these issues, we propose a content-aware retargeting method called PruneRepaint. It incorporates semantic importance for each pixel to guide the identification of regions that need to be pruned or preserved in order to maintain key semantics. Additionally, we introduce an adaptive repainting module that selects image regions for repainting based on the distribution of pruned pixels and the proportion between foreground size and target aspect ratio, thus achieving local smoothness after pruning. By focusing on the content and structure of the foreground, our PruneRepaint approach adaptively avoids key content loss and deformation, while effectively mitigating artifacts with local repainting. We conduct experiments on the public RetargetMe benchmark and demonstrate through objective experimental results and subjective user studies that our method outperforms previous approaches in terms of preserving semantics and aesthetics, as well as better generalization across diverse aspect ratios. Codes will be available at https://github.com/fhshen2022/PruneRepaint.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。