首次评估大模型在技术型虐待场景下的回应质量,为安全支持提供改进方向。
Assessing LLM Response Quality in the Context of Technology-Facilitated Abuse
- 用真实案例问题测试4个大模型,聚焦幸存者安全的响应设计
- 专家与幸存者双重视角发现:通用模型响应不准确,专用模型更可靠
- 适合关注数字暴力干预、大模型伦理与社会应用的研究者
技术型虐待(TFA)是亲密伴侣暴力(IPV)的一种常见形式,利用数字工具对受害者进行控制、监视或伤害。尽管科技诊所是支持幸存者的重要渠道,但受限于人力和后勤,许多幸存者转向在线资源求助。随着大语言模型(LLMs)的普及及亲密伴侣暴力组织的关注增加,幸存者可能在寻求专业帮助前先咨询基于LLM的聊天机器人。本文首次开展由专家主导的手动评估,对比评估了四个LLM——两个通用非推理模型和两个专用于亲密伴侣暴力情境的领域特定模型——在应对TFA相关问题时的表现。我们使用来自文献和在线论坛的真实问题,以幸存者安全为中心的提示词,评估零样本单轮响应的质量,评估标准针对TFA领域定制。此外,还通过用户研究评估了曾经历TFA个体对响应可操作性的感知。研究结果基于专家评估与用户反馈,揭示了当前大模型在TFA情境中的能力与局限,并为未来模型的设计、开发与微调提供依据。最后提出具体改进建议,提升大模型在幸存者支持中的表现。
原文摘要 · Abstract (English)
Technology-facilitated abuse (TFA) is a pervasive form of intimate partner violence (IPV) that leverages digital tools to control, surveil, or harm survivors. While tech clinics are one of the reliable sources of support for TFA survivors, they face limitations due to staffing constraints and logistical barriers. As a result, many survivors turn to online resources for assistance. With the growing accessibility and popularity of large language models (LLMs), and increasing interest from IPV organizations, survivors may begin to consult LLM-based chatbots before seeking help from tech clinics. In this work, we present the first expert-led manual evaluation of four LLMs - two widely used general-purpose non-reasoning models and two domain-specific models designed for IPV contexts - focused on their effectiveness in responding to TFA-related questions. Using real-world questions collected from literature and online forums, we assess the quality of zero-shot single-turn LLM responses generated with a survivor safety-centered prompt on criteria tailored to the TFA domain. Additionally, we conducted a user study to evaluate the perceived actionability of these responses from the perspective of individuals who have experienced TFA. Our findings, grounded in both expert assessment and user feedback, provide insights into the current capabilities and limitations of LLMs in the TFA context and may inform the design, development, and fine-tuning of future models for this domain. We conclude with concrete recommendations to improve LLM performance for survivor support.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。