arXiv:2511.13825cs.AIcs.CL2025-11被引 1

AI科学家在辐射生物学中提出三个假设,仅一个被证实。

When AI Does Science: Evaluating the Autonomous AI Scientist KOSMOS in Radiation Biology

  • 用随机基因基准测试AI生成的科学假设
  • 仅一个12基因签名预测生存率有统计显著性
  • 结果需严格验证,凸显AI科研的局限性

自主人工智能科学家KOSMOS在辐射生物学领域评估三个假设:(1)细胞系基础DNA损伤反应(DDR)能力预测辐射后p53转录反应(GSE30240);(2)OGT与CDO1基础表达预测乳腺癌细胞辐射响应模块的抑制与激活强度(GSE59732);(3)12基因表达谱预测前列腺放疗联合去势治疗后的生化复发无进展生存(GSE116918)。结果显示:第一假设未被支持,DDR评分与p53反应呈弱负相关(Spearman rho = -0.40, p = 0.76),与随机五基因评分无异;OGT关联微弱(r = 0.23, p = 0.34),CDO1为明显异常值(r = 0.70, empirical p = 0.0039);第三假设达到一致性指数0.61(p = 0.017),但效应量不唯一。总体表明,AI可生成有用假设,但必须通过恰当零模型严格审计。

原文摘要 · Abstract (English)

Agentic AI "scientists" now use language models to search the literature, run analyses, and generate hypotheses. We evaluate KOSMOS, an autonomous AI scientist, on three problems in radiation biology using simple random-gene null benchmarks. Hypothesis 1: baseline DNA damage response (DDR) capacity across cell lines predicts the p53 transcriptional response after irradiation (GSE30240). Hypothesis 2: baseline expression of OGT and CDO1 predicts the strength of repressed and induced radiation-response modules in breast cancer cells (GSE59732). Hypothesis 3: a 12-gene expression signature predicts biochemical recurrence-free survival after prostate radiotherapy plus androgen deprivation therapy (GSE116918). The DDR-p53 hypothesis was not supported: DDR score and p53 response were weakly negatively correlated (Spearman rho = -0.40, p = 0.76), indistinguishable from random five-gene scores. OGT showed only a weak association (r = 0.23, p = 0.34), whereas CDO1 was a clear outlier (r = 0.70, empirical p = 0.0039). The 12-gene signature achieved a concordance index of 0.61 (p = 0.017) but a non-unique effect size. Overall, KOSMOS produced one well-supported discovery, one plausible but uncertain result, and one false hypothesis, illustrating that AI scientists can generate useful ideas but require rigorous auditing against appropriate null models.

AI科研基因预测辐射生物学零模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。