基于业务对话系统对齐模型，系统化识别实用对话系统的评估指标。
A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models
- 用业务-对话系统对齐模型挖掘评估项，替代传统满意度指标。
- 提出通用模型，支持为每个对话系统构建对齐框架。
- 适合研发运营人员和对话系统评估研究者参考。
本文提出一种用于识别实用对话系统评估项的方法论。传统评估多依赖用户满意度与用户体验，但实际开发与运营中还存在诸多其他评估维度，这些维度有望催生新的研究方向。目前尚无系统性方法识别这些评估项。本文提出基于业务-对话系统对齐模型的方法，该模型源自实际IT系统开发与运营中的业务-信息技术对齐模型。同时，本文构建了一个通用模型，可辅助为各类对话系统建立相应的业务-对话系统对齐框架。
原文摘要 · Abstract (English)
This paper proposes a methodology for identifying evaluation items for practical dialogue systems. Traditionally, user satisfaction and user experiences have been the primary metrics for evaluating dialogue systems. However, there are various other evaluation items to consider when developing and operating practical dialogue systems, and such evaluation items are expected to lead to new research topics. So far, there has been no methodology for identifying these evaluation items. We propose identifying evaluation items based on business-dialogue system alignment models, which are applications of business-IT alignment models used in the development and operation of practical IT systems. We also present a generic model that facilitates the construction of a business-dialogue system alignment model for each dialogue system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。