arXiv:2605.27643cs.ROphysics.optics2026-05

用自然语言指令自动生成可执行的微粒组装目标,实现光控微制造的闭环编程。

Agentic Language-to-Objective Synthesis for Optofluidic Assembly

  • 通过大模型将口语或文字指令转为可微分的目标函数
  • 在微流控环境中成功实现光驱动微粒图案组装,支持扰动恢复
  • 适用于需要灵活重构的微制造场景,适合非专业用户操作

基于光的先进制造日益需要可编程、闭环的工具,将人类设计意图转化为小尺度上的可执行操作。然而,在机器人与制造领域普遍存在一个关键瓶颈:如何将用户意图转化为可靠可执行的机器目标。尽管微机器人可通过光学操控流体实现灵活操作,但目标描述仍依赖手动且难以复用。本文提出 Speak-to-Objective,一种模块化智能体流程,利用条件大语言模型(LLM)将语音或文本命令转化为可微分的目标函数,输入约束感知的逆向求解器(SLSQP)及实验性光流控平台。该流程采用“感知→构想→提议→执行→报告与学习”的紧凑循环,以目标为意图与执行之间的接口,分离了组装内容与执行方式,并能从用户反馈中学习。系统通过组合几何、间距、分配/拓扑等项生成鲁棒的描述性目标,可从部分轨迹出发完成组装并具备扰动后恢复能力,同时支持精确位置的显式目标,且与执行装置无关。实验中使用激光诱导热粘度流作为物理驱动方式,实现了自然语言可编程的光基微尺度粒子图案组装。本工作不仅推动可编程微装配发展,更展示了将自然语言、可微目标与激光驱动耦合的自驱动、AI辅助光学制造平台的可行性。

原文摘要 · Abstract (English)

Light-based advanced manufacturing increasingly requires programmable, closed-loop tools that translate human design intent into executable operations at small length scales. Yet a key bottleneck persists across robotic and manufacturing modalities: turning user intent into machine-readable objectives that are reliably executable. While micro-robotics offers versatile manipulation via optical actuation of fluids, mathematically tractable goal specification remains manual and hard to reuse. Here, we introduce Speak-to-Objective, a modular agentic pipeline that uses a conditioned Large Language Model (LLM) to translate spoken or written commands into fully differentiable objective functions for assembling microparticles in a constraint-aware inverse solver (SLSQP) and on an experimental optofluidic platform. The approach employs a compact loop - perceive -> compose -> propose -> act -> report & learn - that treats the objective as the interface between intent and actuation, separating what to assemble or pattern from how to actuate, while learning from user feedback. The pipeline composes geometry, spacing, and assignment/topology terms to generate robust descriptive objectives that assemble from partial traces and recover after perturbations, as well as explicit objectives for precise placement, all in an actuator-agnostic fashion. Using laser-induced thermoviscous flows as the physical actuation modality, we demonstrate natural-language-programmable, light-based microscale assembly of particle patterns in a microfluidic environment. Beyond its immediate impact on programmable microassembly, and using laser-induced optofluidic actuation as a reduced-complexity experimental platform, our work points toward self-driving, AI-assisted optical manufacturing platforms in which natural language, differentiable objectives, and laser-based actuation are coupled into a reusable digital workflow.

光流控自然语言编程微装配智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。