用AI辅助生成有创意、符合背景的科研点子,提升创新效率。
SCI-IDEA: Context-Aware Scientific Ideation Using Token and Sentence Embeddings
- 结合文本与句子嵌入,通过提示工程迭代优化科研想法。
- 在新颖性、可行性等维度平均得分达6.8以上(满分10分)。
- 适合科研人员探索跨领域创新,兼顾伦理与人类创造力。
每一次科学发现都始于对已有研究、跨学科概念和新兴挑战的灵感。尽管基于科学语料训练的大语言模型推动了人工智能支持的创意生成,但生成具有上下文感知、高质量且富有创新性的想法仍具挑战。本文提出SCI-IDEA框架,融合大模型提示策略与‘顿悟时刻’检测,实现想法的迭代优化。该框架从科研论文中提取关键要素,评估生成想法在新颖性、兴奋度、可行性与有效性上的表现。全面实验表明,SCI-IDEA在多种模型(GPT-4o、GPT-4.5、DeepSeek-32B、DeepSeek-70B)下,使用不同提示策略(2-shot至5-shot),平均得分分别为6.84、6.86、6.89和6.84(1-10分制)。使用句子级嵌入时,得分可达6.87、6.86、6.83、6.87。同时探讨了知识产权归属、滥用风险及人机创造力平衡等伦理问题。结果表明,SCI-IDEA可有效支持上下文感知的科研创意探索,促进创新并遵守伦理规范。
原文摘要 · Abstract (English)
Every scientific discovery starts with an idea inspired by prior work, interdisciplinary concepts, and emerging challenges. Recent advancements in large language models (LLMs) trained on scientific corpora have driven interest in AI-supported idea generation. However, generating context-aware, high-quality, and innovative ideas remains challenging. We introduce SCI-IDEA, a framework that uses LLM prompting strategies and Aha Moment detection for iterative idea refinement. SCI-IDEA extracts essential facets from research publications, assessing generated ideas on novelty, excitement, feasibility, and effectiveness. Comprehensive experiments validate SCI-IDEA's effectiveness, achieving average scores of 6.84, 6.86, 6.89, and 6.84 (on a 1-10 scale) across novelty, excitement, feasibility, and effectiveness, respectively. Evaluations employed GPT-4o, GPT-4.5, DeepSeek-32B (each under 2-shot prompting), and DeepSeek-70B (3-shot prompting), with token-level embeddings used for Aha Moment detection. Similarly, it achieves scores of 6.87, 6.86, 6.83, and 6.87 using GPT-4o under 5-shot prompting, GPT-4.5 under 3-shot prompting, DeepSeek-32B under zero-shot chain-of-thought prompting, and DeepSeek-70B under 5-shot prompting with sentence-level embeddings. We also address ethical considerations such as intellectual credit, potential misuse, and balancing human creativity with AI-driven ideation. Our results highlight SCI-IDEA's potential to facilitate the structured and flexible exploration of context-aware scientific ideas, supporting innovation while maintaining ethical standards.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。