用大模型自动处理数据,提升微调效果并保护隐私。
LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning
- 让大模型充当智能代理,自动生成并优化数据清洗策略。
- 处理后模型胜率超80%,比传统方法高65%以上。
- 适合医疗等敏感领域,无需人工看原始数据。
大型语言模型可通过领域特定数据微调以提升专业表现,但此类数据常含大量低质量样本,需有效数据处理(DP)。当前策略多依赖人工反复分析与试错,成本高昂,且在医疗等高隐私领域易引发数据泄露风险。为此,本文提出LLM-AutoDP框架,利用大模型作为智能代理,自动生成并迭代优化数据处理策略。该方法通过反馈信号与对比评估,不断改进候选策略,实现无需人工干预或直接访问原始数据的高质量数据管道构建。为加速策略搜索,引入三项关键技术:分布保持采样(减少数据量同时保留分布特征)、处理目标选择(使用二分类器定位低质样本)、缓存复用机制(避免重复计算)。实验表明,经本框架处理的数据训练的模型,在对抗未处理数据模型时胜率超过80%;相较基于大模型代理的AutoML基线,胜率提升约65%。加速技术使总搜索时间最多降低10倍,兼具高效性与有效性。
原文摘要 · Abstract (English)
Large Language Models (LLMs) can be fine-tuned on domain-specific data to enhance their performance in specialized fields. However, such data often contains numerous low-quality samples, necessitating effective data processing (DP). In practice, DP strategies are typically developed through iterative manual analysis and trial-and-error adjustment. These processes inevitably incur high labor costs and may lead to privacy issues in high-privacy domains like healthcare due to direct human access to sensitive data. Thus, achieving automated data processing without exposing the raw data has become a critical challenge. To address this challenge, we propose LLM-AutoDP, a novel framework that leverages LLMs as agents to automatically generate and optimize data processing strategies. Our method generates multiple candidate strategies and iteratively refines them using feedback signals and comparative evaluations. This iterative in-context learning mechanism enables the agent to converge toward high-quality processing pipelines without requiring direct human intervention or access to the underlying data. To further accelerate strategy search, we introduce three key techniques: Distribution Preserving Sampling, which reduces data volume while maintaining distributional integrity; Processing Target Selection, which uses a binary classifier to identify low-quality samples for focused processing; Cache-and-Reuse Mechanism}, which minimizes redundant computations by reusing prior processing results. Results show that models trained on data processed by our framework achieve over 80% win rates against models trained on unprocessed data. Compared to AutoML baselines based on LLM agents, LLM-AutoDP achieves approximately a 65% win rate. Moreover, our acceleration techniques reduce the total searching time by up to 10 times, demonstrating both effectiveness and efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。