用自增强反馈机制生成高质量稀有关系数据,提升不平衡分类效果
Self-Reinforcing Controllable Synthesis of Rare Relational Data via Bayesian Calibration

- 基于核心集选择与动态思维链,生成符合属性关联的结构化数据
- 在多个真实和合成数据集上,生成数据保真度与下游分类性能均领先
- 适合需要高质量小样本结构数据的科研与工业场景
现实应用中普遍存在数据不平衡问题。虽然数据合成可缓解罕见类别的数据稀缺,且大语言模型(LLM)已革新文本生成,但将LLM用于关系型/结构化表格数据合成仍研究不足。现有方法缺乏有效反馈机制,无法持续优化生成数据质量。本文提出RDDG——一种统一的上下文学习框架,采用渐进式思维链(CoT)步骤生成表格数据,以提升下游不平衡分类表现。首先通过核心集选择识别原始数据中的代表性样本,再利用上下文学习发现核心集中属性间的内在模式与相关性,随后生成保持上述约束的表格数据。更重要的是,该框架引入自增强反馈机制,自动评估生成数据质量,实现全过程持续优化。多组真实与合成数据集实验表明,RDDG在数据保真度和下游不平衡分类性能上均优于现有方法。代码已开源:https://github.com/cszhangLMU/RDDG。
原文摘要 · Abstract (English)
Imbalanced data are commonly present in real-world applications. While data synthesis can effectively mitigate data scarcity for rare classes, and LLMs have revolutionized text generation, the application of LLMs to the synthesis of relational/structured tabular data remains underexplored. Moreover, existing approaches lack an effective feedback mechanism to guide LLMs in continuously optimizing the quality of the generated data throughout the synthesis process. In this work, we propose RDDG, Relational Data generator with Dynamic Guidance, which is a unified in-context learning framework that employs progressive chain-of-thought (CoT) steps to generate tabular data for enhancing downstream imbalanced classification performance. RDDG first uses core set selection to identify representative samples from the original data, then utilizes in-context learning to discover the inherent patterns and correlations among attributes within the core set, and subsequently generates tabular data while preserving the aforementioned constraints. More importantly, it incorporates a self-reinforcing feedback mechanism that provides automatic assessments of the quality of the generated data, enabling continuous quality optimization throughout the generation process. Experimental results on multiple real and synthetic datasets demonstrate that RDDG outperforms existing approaches in both data fidelity and downstream imbalanced classification performance. We make our code available at https://github.com/cszhangLMU/RDDG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。