用自然语言指令自动完成科学数据分析,结果可解释且可复现。
Spec-Driven AI for Science: The ARIA Framework for Automated and Reproducible Data Analysis
- 通过自然语言描述分析目标,自动生成代码并执行
- 在波士顿房价数据中找到25个关键特征,模型准确率达R²=0.93
- 适合需要高效、可复现分析的科研人员使用
科学数据的快速膨胀加剧了分析能力与研究意图之间的差距。现有基于AI的分析工具,从AutoML框架到智能研究助手,或过度追求自动化而牺牲透明性,或依赖人工编写脚本,难以规模化和复现。我们提出ARIA(Automated Research Intelligence Assistant),一个以规范驱动、人机协同的自动化可解释数据分析框架。ARIA整合命令、上下文、代码、数据、编排和AI模块六大互操作层,构建文档为中心的工作流,统一人类推理与机器执行。研究人员通过自然语言定义分析目标,ARIA自主生成可执行代码、验证计算过程并生成透明文档。除高预测精度外,还能快速识别最优特征集与合适模型,减少冗余调参与重复实验。在波士顿房价案例中,ARIA发现25个关键特征,确定XGBoost为最优模型(R² = 0.93),且过拟合极小。跨异构领域评估表明,ARIA在性能、可解释性和效率方面均优于现有系统。通过融合AI for research与AI for science理念,ARIA建立了一种透明、协作、可复现的科学发现新范式。
原文摘要 · Abstract (English)
The rapid expansion of scientific data has widened the gap between analytical capability and research intent. Existing AI-based analysis tools, ranging from AutoML frameworks to agentic research assistants, either favor automation over transparency or depend on manual scripting that hinders scalability and reproducibility. We present ARIA (Automated Research Intelligence Assistant), a spec-driven, human-in-the-loop framework for automated and interpretable data analysis. ARIA integrates six interoperable layers, namely Command, Context, Code, Data, Orchestration, and AI Module, within a document-centric workflow that unifies human reasoning and machine execution. Through natural-language specifications, researchers define analytical goals while ARIA autonomously generates executable code, validates computations, and produces transparent documentation. Beyond achieving high predictive accuracy, ARIA can rapidly identify optimal feature sets and select suitable models, minimizing redundant tuning and repetitive experimentation. In the Boston Housing case, ARIA discovered 25 key features and determined XGBoost as the best performing model (R square = 0.93) with minimal overfitting. Evaluations across heterogeneous domains demonstrate ARIA's strong performance, interpretability, and efficiency compared with state-of-the-art systems. By combining AI for research and AI for science principles within a spec-driven architecture, ARIA establishes a new paradigm for transparent, collaborative, and reproducible scientific discovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。