arXiv:2501.01827cs.CLcs.AI2025-01

让机器人像人一样理解食谱,靠叙事结构解析烹饪指令

The Proof is in the Almond Cookies

  • 用故事化结构整合语言、本体与心理模拟,理解食谱语义
  • 解决零指代、规划优化等实际问题,提升机器人厨房协作能力
  • 适合研究具身智能、人机协作或智能助老的开发者

本文以杏仁月牙饼干的英文食谱为例,探讨如何将烹饪步骤(及一般性操作说明)转化为机器人或人工智能助手可理解的形式。这类智能助手对社会意义重大,能帮助老年人或行动不便者保持独立生活能力,或减轻专业厨房的压力。我们提出一种新方法,模仿人类理解过程——基于叙事的推理方式,通过融合自然语言处理、本体论与心理模拟,将食谱建模为丰富的叙事结构。该模型可有效应对食谱语言中的零指代现象;优化机器人的任务规划;评估AI对当前任务的理解程度;并使食谱标注脱离特定语言限制。

原文摘要 · Abstract (English)

This paper presents a case study on how to process cooking recipes (and more generally, how-to instructions) in a way that makes it possible for a robot or artificial cooking assistant to support human chefs in the kitchen. Such AI assistants would be of great benefit to society, as they can help to sustain the autonomy of aging adults or people with a physical impairment, or they may reduce the stress in a professional kitchen. We propose a novel approach to computational recipe understanding that mimics the human sense-making process, which is narrative-based. Using an English recipe for almond crescent cookies as illustration, we show how recipes can be modelled as rich narrative structures by integrating various knowledge sources such as language processing, ontologies, and mental simulation. We show how such narrative structures can be used for (a) dealing with the challenges of recipe language, such as zero anaphora, (b) optimizing a robot's planning process, (c) measuring how well an AI system understands its current tasks, and (d) allowing recipe annotations to become language-independent.

食谱理解叙事推理人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。