用大模型统一生成与判别任务的自动化机器学习,让普通人也能参与控制训练过程。
UniAutoML: A Human-Centered Framework for Unified Discriminative and Generative AutoML with Large Language Models
- 用大语言模型构建对话式界面,实现自然语言交互和实时反馈
- 在8个数据集上验证,提升用户对模型训练的掌控感和信任度
- 支持分类、回归、扩散模型等多类任务,适合非专业用户使用
自动化机器学习(AutoML)简化了数据预处理、模型选择和超参数搜索等复杂流程。然而,传统框架仅关注判别任务,难以应对生成模型的自动化;且缺乏可解释性与用户参与,导致决策不透明、控制力弱,降低信任与采纳率。为此,我们提出UniAutoML,一个以人为本的AutoML框架,利用大语言模型(LLMs)统一支持判别任务(如Transformer、CNN用于分类/回归)与生成任务(如微调扩散模型或LLM)。其创新的对话式用户界面(CUI)通过自然语言交互提供实时指导、反馈与进度更新,增强训练过程中的透明度与用户控制力,支持用户随时中断或修改模型。为防范大模型生成风险,框架内置安全过滤机制,对输入进行校验并屏蔽不当输出。我们在8个不同数据集上进行实验,并组织25名参与者开展用户研究,结果表明UniAutoML不仅提升性能,还显著增强用户控制感与信任度。该设计弥合了AutoML能力与用户理解之间的鸿沟,使机器学习更易被广泛人群所用。
原文摘要 · Abstract (English)
Automated Machine Learning (AutoML) has simplified complex ML processes such as data pre-processing, model selection, and hyper-parameter searching. However, traditional AutoML frameworks focus solely on discriminative tasks, often falling short in tackling AutoML for generative models. Additionally, these frameworks lack interpretability and user engagement during the training process, primarily due to the absence of human-centered design. It leads to a lack of transparency in final decision-making and limited user control, potentially reducing trust and adoption of AutoML methods. To address these limitations, we introduce UniAutoML, a human-centered AutoML framework that leverages Large Language Models (LLMs) to unify AutoML for both discriminative (e.g., Transformers and CNNs for classification or regression tasks) and generative tasks (e.g., fine-tuning diffusion models or LLMs). The human-centered design of UniAutoML innovatively features a conversational user interface (CUI) that facilitates natural language interactions, providing users with real-time guidance, feedback, and progress updates for better interpretability. This design enhances transparency and user control throughout the AutoML training process, allowing users to seamlessly break down or modify the model being trained. To mitigate potential risks associated with LLM generated content, UniAutoML incorporates a safety guardline that filters inputs and censors outputs. We evaluated UniAutoML's performance and usability through experiments on eight diverse datasets and user studies involving 25 participants, demonstrating that UniAutoML not only enhances performance but also improves user control and trust. Our human-centered design bridges the gap between AutoML capabilities and user understanding, making ML more accessible to a broader audience.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。