用大模型+物理约束,让外行也能自动设计高性能镜头。
OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Design
- 用混合目标训练大模型,融合系统级合成与镜片补全。
- 在3个基准数据集上超越传统算法和普通大模型。
- 适合光学新手、自动化设计与跨领域科研人员使用。
光学设计是配置光学元件以精确操控光实现高保真成像的过程,本质上是一个高度非凸的优化问题,严重依赖人类经验与领域知识。尽管大语言模型(LLM)具备丰富的光学知识,但其在实际镜头系统设计中的应用能力仍受限。本文首次将大模型引入光学设计领域,通过构建包含经典镜头系统(来自标准光学教材)与算法生成新构型的综合数据集OptiDesignQA,实现模型训练与评估。我们采用全系统合成与镜片补全相结合的混合目标,注入领域专业知识;并通过基于光学词典奖励的分组相对策略优化(DrGRPO),结合结构格式奖励、物理可行性奖励、光操控精度及基于大模型的启发式奖励,实现物理驱动的策略对齐。最终模型集成专用光学优化流程,完成端到端微调与精度优化。在多个基准测试中,该方法显著优于传统优化算法与现有大模型方案。
原文摘要 · Abstract (English)
Optical design is the process of configuring optical elements to precisely manipulate light for high-fidelity imaging. It is inherently a highly non-convex optimization problem that relies heavily on human heuristic expertise and domain-specific knowledge. While Large Language Models (LLMs) possess extensive optical knowledge, their capabilities in leveraging the knowledge in designing lens system remain significantly constrained. This work represents the first attempt to employ LLMs in the field of optical design. We bridge the expertise gap by enabling users without formal optical training to successfully develop functional lens systems. Concretely, we curate a comprehensive dataset, named OptiDesignQA, which encompasses both classical lens systems sourced from standard optical textbooks and novel configurations generated by automated design algorithms for training and evaluation. Furthermore, we inject domain-specific optical expertise into the LLM through a hybrid objective of full-system synthesis and lens completion. To align the model with optical principles, we employ Group Relative Policy Optimization Done Right (DrGRPO) guided by Optical Lexicographic Reward for physics-driven policy alignment. This reward system incorporates structural format rewards, physical feasibility rewards, light-manipulation accuracy, and LLM-based heuristics. Finally, our model integrates with specialized optical optimization routines for end-to-end fine-tuning and precision refinement. We benchmark our proposed method against both traditional optimization-based automated design algorithms and LLM counterparts, and experimental results show the superiority of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。