用视觉语言模型评估机器人进化,让可爱、奇怪等主观词指导形态与运动演化。
An evolutionary model of animats with VLM-based subjective evaluation
- 用VLM对虚拟机器人运动图像进行主观评分,作为遗传算法的选择压力。
- 相比随机选择,主观评估加速种群收敛,且生成对应关键词的独特形态与动作。
- 揭示VLM对主观词的内在判断机制,适合研究人工生命与情感化设计的人参考。
本研究提出一种将视觉语言模型(VLM)提供的主观评价融入遗传算法适应度评估与选择过程的框架。以具有柔性形态和运动能力的虚拟软体机器人为进化目标,向VLM展示代表两个个体运动的序列图像。通过‘可爱’‘奇怪’等主观评价术语进行成对比较,比较结果作为遗传算法中的选择压力,实现形态与运动的同步演化。实验表明,相较于随机选择,VLM主导的主观选择能加速种群收敛,并生成与各评价术语对应的独特形态与运动模式。辅助的人类实验显示,尽管个体成对选择与VLM结果部分一致,但其演化趋势在定性上相似,且人类重复评估易产生疲劳。此外,不同评价术语下均出现相似演化结果,表明VLM并非字面理解这些术语,而是将其分解为多个内部评价标准进行判断。该工作可视化了主观语言表达如何映射至具身表型,为分析VLM中主观判断结构提供了基础框架,有望推动基于主观评价的演化计算与人工生命研究发展。
原文摘要 · Abstract (English)
In this study, we propose a framework that incorporates subjective evaluations provided by a Vision-Language Model (VLM) into the fitness evaluation and selection processes of a genetic algorithm. As the target of evolution, we employ virtual soft robots with flexible morphologies and locomotion and present the VLM with sequence images representing the locomotion of two individuals. Selection is performed via pairwise comparisons based on subjective evaluation terms such as adorably and weirdly. The outcomes of these comparisons are used as selection pressure within the genetic algorithm, enabling the simultaneous evolution of morphology and locomotion. Experimental results demonstrate that subjective selection by the VLM accelerates population convergence compared to random selection, while also giving rise to distinctive morphologies and motions corresponding to each evaluation term. An auxiliary experiment with human participants further showed that, although individual pairwise choices only partly agreed with the VLM selections, the resulting morphological and locomotion tendencies were qualitatively similar and repeated human evaluations imposed noticeable fatigue. Moreover, the observation that similar evolutionary outcomes emerged across different evaluation terms suggests that the VLM does not apply these terms in a purely literal manner but instead decomposes them into multiple internal evaluation criteria when making judgments. This work visualizes the evolutionary process through which subjective linguistic expressions are mapped onto embodied phenotypes and provides a foundational framework for analyzing the structure of subjective judgment in VLMs. The proposed approach is expected to contribute to new developments in evolutionary computation and artificial life research based on subjective evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。