arXiv:2503.04785cs.CLcs.CY2025-03被引 8

梳理大模型可信性研究脉络,揭示理论与实践脱节问题

Mapping Trustworthiness in Large Language Models: A Bibliometric Analysis Bridging Theory to Practice

  • 通过文献计量分析2019-2025年2006篇论文,识别可信性定义与策略
  • 发现透明、可解释、可靠是主流维度,微调与RAG是最常用增强手段
  • 指出术语碎片化风险,呼吁建立统一标准与更强监管

大型语言模型(LLMs)的快速普及引发了可信性与伦理关切。尽管其已在多个领域广泛应用,但对可信性的定义与实施仍无共识。本研究通过分析Web of Science数据库中2019至2025年的2,006篇文献(使用Bibliometrix工具),并人工审阅68篇论文,揭示了从传统AI伦理讨论向大模型可信性框架的转变。研究识别出18种不同的可信性定义,其中透明性、可解释性和可靠性最为常见。共归纳出20种提升可信性的策略,以微调和检索增强生成(RAG)最为突出。多数策略由开发者在后训练阶段主导实施。部分学者采用碎片化术语而非统一框架,存在‘伦理洗白’风险,即仅形式化采纳伦理话语而缺乏实质监管承诺。研究强调:理论分类与实际应用之间仍存显著鸿沟,开发者在可信性落地中起关键作用,并呼吁建立标准化框架与更强监管机制,以实现大模型的可信与伦理部署。

原文摘要 · Abstract (English)

The rapid proliferation of Large Language Models (LLMs) has raised significant trustworthiness and ethical concerns. Despite the widespread adoption of LLMs across domains, there is still no clear consensus on how to define and operationalise trustworthiness. This study aims to bridge the gap between theoretical discussion and practical implementation by analysing research trends, definitions of trustworthiness, and practical techniques. We conducted a bibliometric mapping analysis of 2,006 publications from Web of Science (2019-2025) using the Bibliometrix, and manually reviewed 68 papers. We found a shift from traditional AI ethics discussion to LLM trustworthiness frameworks. We identified 18 different definitions of trust/trustworthiness, with transparency, explainability and reliability emerging as the most common dimensions. We identified 20 strategies to enhance LLM trustworthiness, with fine-tuning and retrieval-augmented generation (RAG) being the most prominent. Most of the strategies are developer-driven and applied during the post-training phase. Several authors propose fragmented terminologies rather than unified frameworks, leading to the risks of "ethics washing," where ethical discourse is adopted without a genuine regulatory commitment. Our findings highlight: persistent gaps between theoretical taxonomies and practical implementation, the crucial role of the developer in operationalising trust, and call for standardised frameworks and stronger regulatory measures to enable trustworthy and ethical deployment of LLMs.

大模型可信性伦理综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。