用模块化AI对话系统提升调研效率与质量
Modular Conversational Agents for Surveys and Interviews
- 模块化设计结合提示工程与知识库,支持灵活定制对话逻辑
- 实测完成率与回答质量显著提升,多场景下表现稳定
- 适合政策调研、公众意见收集等需高隐私与多语言的场景
问卷调查和访谈广泛用于收集对新兴或假设情境的见解。传统人工方式常面临成本高、可扩展性差和一致性不足的问题。近年来,生成式AI驱动的对话代理(聊天机器人)在多个领域开始应用。然而,交通投资与政策决策涉及重大公共与环境影响,使得在调研中引入AI代理面临独特挑战,亟需一种严谨、高效且能保障参与度与隐私的方法。本文提出一种模块化方法及其参数化流程,用于设计AI代理。我们详细阐述了系统架构,整合了工程化提示、专用知识库以及可定制的目标导向对话逻辑。通过三个实证研究验证该方法的适应性、泛化性与有效性:(1) 旅行偏好调查,展示条件逻辑与多模态(语音、文本、图像生成)能力;(2) 新建基础设施项目的公众意见采集,体现问题定制化与多语言(英语与法语)支持;(3) 专家咨询未来交通技术影响,突出对开放式问题的实时澄清请求、应对异常输入的鲁棒性及高效转录后处理。结果表明,该AI代理提升了完成率与回答质量。此外,模块化方法在可控性、灵活性与鲁棒性方面表现优异,同时有效应对伦理、隐私、安全与令牌消耗等关键问题。
原文摘要 · Abstract (English)
Surveys and interviews are widely used for collecting insights on emerging or hypothetical scenarios. Traditional human-led methods often face challenges related to cost, scalability, and consistency. Recently, various domains have begun to explore the use of conversational agents (chatbots) powered by generative artificial intelligence (AI) technologies. However, considering decisions in transportation investments and policies often carry significant public and environmental stakes, surveys and interviews face unique challenges in integrating AI agents, underscoring the need for a rigorous, resource-efficient approach that enhances participant engagement and ensures privacy. This paper addresses this gap by introducing a modular approach and its resulting parameterized process for designing AI agents. We detail the system architecture, integrating engineered prompts, specialized knowledge bases, and customizable, goal-oriented conversational logic. We demonstrate the adaptability, generalizability, and efficacy of our modular approach through three empirical studies: (1) travel preference surveys, highlighting conditional logic and multimodal (voice, text, and image generation) capabilities; (2) public opinion elicitation on a newly constructed, novel infrastructure project, showcasing question customization and multilingual (English and French) capabilities; and (3) expert consultation about the impact of technologies on future transportation systems, highlighting real-time, clarification request capabilities for open-ended questions, resilience in handling erratic inputs, and efficient transcript postprocessing. The results suggest that the AI agent increases completion rates and response quality. Furthermore, the modular approach demonstrates controllability, flexibility, and robustness while addressing key ethical, privacy, security, and token consumption concerns.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。