用多角色AI辩论实现可解释的特征选择,提速近半且效果不降。
LLM-FS-Agent: A Deliberative Role-based Large Language Model Architecture for Transparent Feature Selection
- 多个AI角色分工辩论,集体判断特征重要性
- 在物联网安全数据集上使训练时间平均减少46%
- 适合需要透明决策的工业级机器学习应用
高维数据仍是机器学习中的普遍挑战,常损害模型可解释性与计算效率。尽管大语言模型(LLM)在通过特征选择实现降维方面展现出潜力,但现有基于LLM的方法往往缺乏结构化推理和决策透明性。本文提出LLM-FS-Agent,一种新型多智能体架构,用于可解释且稳健的特征选择。该系统协调多个分配了特定角色的LLM智能体进行“辩论”,实现对特征相关性的集体评估并生成详细理由。我们在网络安全领域使用CIC-DIAD 2024 IoT入侵检测数据集进行评估,并与强基线方法(包括LLM-Select和传统方法如PCA)对比。实验结果表明,LLM-FS-Agent在分类性能上持续优于或相当,同时使下游训练时间平均减少46%(对XGBoost,p = 0.028,统计显著)。这些发现表明,所提出的辩论式架构在提升决策透明度和计算效率方面具有优势,确立了其在实际应用中的实用性和可靠性。
原文摘要 · Abstract (English)
High-dimensional data remains a pervasive challenge in machine learning, often undermining model interpretability and computational efficiency. While Large Language Models (LLMs) have shown promise for dimensionality reduction through feature selection, existing LLM-based approaches frequently lack structured reasoning and transparent justification for their decisions. This paper introduces LLM-FS-Agent, a novel multi-agent architecture designed for interpretable and robust feature selection. The system orchestrates a deliberative "debate" among multiple LLM agents, each assigned a specific role, enabling collective evaluation of feature relevance and generation of detailed justifications. We evaluate LLM-FS-Agent in the cybersecurity domain using the CIC-DIAD 2024 IoT intrusion detection dataset and compare its performance against strong baselines, including LLM-Select and traditional methods such as PCA. Experimental results demonstrate that LLM-FS-Agent consistently achieves superior or comparable classification performance while reducing downstream training time by an average of 46% (statistically significant improvement, p = 0.028 for XGBoost). These findings highlight that the proposed deliberative architecture enhances both decision transparency and computational efficiency, establishing LLM-FS-Agent as a practical and reliable solution for real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。