arXiv:2606.01022cs.CVcs.AI2026-06KDD被引 1

评测多模态模型生成电商网页的能力,提出新基准和两种评估流程。

ProductWebGen: Benchmarking Multimodal Product Webpage Generation

论文配图:ProductWebGen: Benchmarking Multimodal Product Webpage Generation
图 1 · 摘自论文原文
  • 设计双流程评估:分步使用LLM+图像编辑模型,或统一模型端到端生成。
  • 分步流程在指令遵循和内容吸引力上更优,统一模型更擅长视觉内容一致。
  • 构建1000组真实商品图与自动生成的HTML数据集,支持开源模型训练。

从源商品图像及布局与视觉内容指令出发,生成符合要求的产品展示网页,在营销、广告和电商领域具有重要应用价值。该任务需保证产品展示的视觉一致性与高保真指令遵循,以生成可渲染的HTML代码。这与先进多模态生成模型(如图像编辑模型、统一模型)的核心能力高度契合。本文提出ProductWebGen基准,包含500个测试样本,覆盖13类商品,每条样本包含源图像、视觉内容指令和网页指令。目标是生成多个与源图一致且符合指令的展示图像构成的网页。针对混合模态输入输出特性,设计并系统比较两种评估流程:一种结合大语言模型与图像编辑模型分别生成HTML与图像(editing-based),另一种由单一统一模型生成,图像生成基于前序多模态上下文(UM-based)。实验表明,editing-based方法在网页指令遵循和内容吸引力上表现更优,而UM-based方法在满足视觉内容指令方面更具优势。此外,构建了监督微调数据集ProductWebGen-1k,包含1000组真实商品图与LLM生成的HTML代码,并在开源统一模型BAGEL上验证其有效性。数据与代码已公开于https://github.com/SJTU-DENG-Lab/ProductWebGen。

原文摘要 · Abstract (English)

Crafting a product display webpage from a source product image, along with layout and visual content instructions, holds significant practical value for domains such as marketing, advertising, and E-commerce. Intuitively, this task demands strict visual consistency across product displays and high-fidelity instruction following to jointly generate renderable HTML code. These requirements on controllability and instruction-following are closely aligned with the core features of advanced multimodal generative models, such as image editing models and unified models. To this end, this paper introduces ProductWebGen to systematically benchmark the product webpage generation capacities of these models. We organize ProductWebGen with 500 test samples covering 13 product categories; each sample consists of a source image, a visual content instruction, and a webpage instruction. The task is to generate a product showcase webpage including multiple consistent images in accordance with the source image and instructions. Given the mixed-modality input-output nature of the task, we design and systematically compare two workflows for evaluation -- one uses large language models and image editing models to separately generate HTML code and images (editing-based), while the other relies on a single UM to generate both, with image generation conditioned on the preceding multimodal context (UM-based). Empirical results show that editing-based approaches achieve leading results in webpage instruction following and content appeal, while UM-based ones may display more advantages in fulfilling visual content instructions. We also construct a supervised fine-tuning dataset, ProductWebGen-1k, with 1,000 groups of real product images and LLM-generated HTML code. We verify its effectiveness on the open-source UM BAGEL. The data and code are available at https://github.com/SJTU-DENG-Lab/ProductWebGen.

多模态生成电商网页评估基准统一模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。