构建自动推荐系统研究实验室,实现科研全流程自动化。
From AutoRecSys to AutoRecLab: A Call to Build, Evaluate, and Govern Autonomous Recommender-Systems Research Labs
- 用大模型驱动选题与报告,结合自动化实验完成端到端科研
- 提出五大推进方向,包括基准测试与可复现性评估
- 适合关注科研效率、自动化和伦理治理的研究者
推荐系统研究虽在模型与评估上快速进展,但忽视了科研过程本身的自动化。本文主张从聚焦算法选择与超参调优的AutoRecSys工具,转向整合全链条自动化(问题构想、文献分析、实验设计与执行、结果解读、论文撰写、溯源记录)的自主推荐系统研究实验室(AutoRecLab)。基于多智能体AI科学家等最新进展,提出五大倡议:(1) 开发开源原型,融合大模型生成与自动化实验;(2) 建立评测基准与竞赛,评估代理在极低人工干预下产出可复现成果的能力;(3) 设立透明发布AI生成论文的评审渠道;(4) 制定通过详细日志与元数据保障溯源与归因的标准;(5) 推动跨学科对话,探讨自主科研中的伦理、治理、隐私与公平问题。推进该议程可提升研究产出速度,发现非显性洞见,并助力推荐系统参与新兴的人工科研智能发展。最后呼吁组织社区研讨,协同制定负责任的自动化科研系统集成指南。
原文摘要 · Abstract (English)
Recommender-systems research has accelerated model and evaluation advances, yet largely neglects automating the research process itself. We argue for a shift from narrow AutoRecSys tools -- focused on algorithm selection and hyper-parameter tuning -- to an Autonomous Recommender-Systems Research Lab (AutoRecLab) that integrates end-to-end automation: problem ideation, literature analysis, experimental design and execution, result interpretation, manuscript drafting, and provenance logging. Drawing on recent progress in automated science (e.g., multi-agent AI Scientist and AI Co-Scientist systems), we outline an agenda for the RecSys community: (1) build open AutoRecLab prototypes that combine LLM-driven ideation and reporting with automated experimentation; (2) establish benchmarks and competitions that evaluate agents on producing reproducible RecSys findings with minimal human input; (3) create review venues for transparently AI-generated submissions; (4) define standards for attribution and reproducibility via detailed research logs and metadata; and (5) foster interdisciplinary dialogue on ethics, governance, privacy, and fairness in autonomous research. Advancing this agenda can increase research throughput, surface non-obvious insights, and position RecSys to contribute to emerging Artificial Research Intelligence. We conclude with a call to organise a community retreat to coordinate next steps and co-author guidance for the responsible integration of automated research systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。