用运行时验证确保聊天机器人安全,防止行为偏离预期。
RV4Chatbot: Are Chatbots Allowed to Dream of Electric Sheep?
- 将用户与聊天机器人的交互建模为协议,实时监控行为偏差。
- 在工厂自动化场景中验证,成功检测出多种异常对话模式。
- 支持Rasa和Dialogflow框架,适合高安全需求的工业应用。
聊天机器人已广泛应用于各类场景,包括安全性要求高的领域。为此,亟需确保其始终遵循预期的安全行为。本文提出RV4Chatbot,一种运行时验证框架,用于监控聊天机器人行为的偏差。我们将期望行为形式化为用户与聊天机器人之间的交互协议,并展示了该框架的设计及两种实现:针对Rasa框架的RV4Rasa,以及针对Dialogflow的RV4Dialogflow。此外,我们在工厂自动化场景中对两种实现进行了实验,验证了其有效性。
原文摘要 · Abstract (English)
Chatbots have become integral to various application domains, including those with safety-critical considerations. As a result, there is a pressing need for methods that ensure chatbots consistently adhere to expected, safe behaviours. In this paper, we introduce RV4Chatbot, a Runtime Verification framework designed to monitor deviations in chatbot behaviour. We formalise expected behaviours as interaction protocols between the user and the chatbot. We present the RV4Chatbot design and describe two implementations that instantiate it: RV4Rasa, for monitoring chatbots created with the Rasa framework, and RV4Dialogflow, for monitoring Dialogflow chatbots. Additionally, we detail experiments conducted in a factory automation scenario using both RV4Rasa and RV4Dialogflow.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。