让扩散模型更真实地生成汽车损伤图像,防欺诈更可信。
HERS: Hidden-Pattern Expert Learning for Risk-Specific Vehicle Damage Adaptation in Diffusion Models
- 用自监督数据训练多个损伤专家模型,再融合成统一生成器。
- 文本一致性和人类偏好评分分别提升5.5%和2.3%。
- 适合保险、安全等高风险领域中需要可信生成的场景。
文本到图像扩散模型在生成车辆损伤图像方面取得进展,但其高度逼真的合成能力可能被滥用于保险欺诈或索赔操纵。为应对这一风险,我们提出HERS(隐模式专家学习框架),通过领域特异性专家适配,在无需人工标注的情况下提升扩散模型生成损伤图像的保真度、可控性与领域一致性。HERS利用大语言模型与扩散生成流水线自动生成图像-文本对,将凹陷、划痕、破损灯、开裂漆面等损伤类型建模为独立专家,并融合为统一多损伤生成模型,兼顾专精与泛化。我们在四种扩散基线模型上验证,结果均显示:文本一致性提升5.5%,人类偏好评分提升2.3%。研究还探讨了该技术对反欺诈、可审计性及高风险领域安全部署的意义。结果表明,领域特异性扩散模型兼具机遇与风险,可信生成对自动驾驶保险等关键应用至关重要。
原文摘要 · Abstract (English)
Recent advances in text-to-image (T2I) diffusion models have enabled increasingly realistic synthesis of vehicle damage, raising concerns about their reliability in automated insurance workflows. The ability to generate crash-like imagery challenges the boundary between authentic and synthetic data, introducing new risks of misuse in fraud or claim manipulation. To address these issues, we propose HERS (Hidden-Pattern Expert Learning for Risk-Specific Damage Adaptation), a framework designed to improve fidelity, controllability, and domain alignment of diffusion-generated damage images. HERS fine-tunes a base diffusion model via domain-specific expert adaptation without requiring manual annotation. Using self-supervised image-text pairs automatically generated by a large language model and T2I pipeline, HERS models each damage category, such as dents, scratches, broken lights, or cracked paint, as a separate expert. These experts are later integrated into a unified multi-damage model that balances specialization with generalization. We evaluate HERS across four diffusion backbones and observe consistent improvements: plus 5.5 percent in text faithfulness and plus 2.3 percent in human preference ratings compared to baselines. Beyond image fidelity, we discuss implications for fraud detection, auditability, and safe deployment of generative models in high-stakes domains. Our findings highlight both the opportunities and risks of domain-specific diffusion, underscoring the importance of trustworthy generation in safety-critical applications such as auto insurance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。