arXiv:2603.12522cs.CLcs.AI2026-03Conference of the …被引 1

实时对比多个大模型输出,自动分析偏见分布。

LLM BiasScope: A Real-Time Bias Analysis Platform for Comparative LLM Evaluation

  • 双阶段检测:先定位有偏句子,再分类偏见类型。
  • 支持6个主流模型,实时展示偏见统计与可视化差异。
  • 适合研究人员和开发者快速评估模型公平性。

随着大语言模型广泛应用,检测其输出中的偏见至关重要。我们提出 LLM BiasScope,一个用于侧边对比多模型输出并实时分析偏见的网页应用。系统支持 Google Gemini、DeepSeek、MiniMax、Mistral、Meituan、Meta Llama 六个模型提供商,允许研究者和实践者在相同提示下比较模型表现并分析偏见模式。该平台采用两阶段偏见检测流程:先进行句级偏见检测,再对有偏句子进行偏见类型分类。分析自动运行于用户输入与模型响应,提供统计结果、可视化图表及偏见类型的详细拆解。界面支持双模型侧边对比,响应流式同步,每模型展示偏见摘要,并设有对比视图突出偏见分布差异。系统基于 Next.js 与 React 构建,集成 Hugging Face 推理端点实现偏见检测,使用 Vercel AI SDK 接入多提供商大模型。功能包括实时流式传输、导出为 JSON/PDF 以及交互式可视化(柱状图、雷达图)分析。LLM BiasScope 已开源,为大模型偏见评估与行为对比提供实用工具。

原文摘要 · Abstract (English)

As large language models (LLMs) are deployed widely, detecting and understanding bias in their outputs is critical. We present LLM BiasScope, a web application for side-by-side comparison of LLM outputs with real-time bias analysis. The system supports multiple providers (Google Gemini, DeepSeek, MiniMax, Mistral, Meituan, Meta Llama) and enables researchers and practitioners to compare models on the same prompts while analyzing bias patterns. LLM BiasScope uses a two-stage bias detection pipeline: sentence-level bias detection followed by bias type classification for biased sentences. The analysis runs automatically on both user prompts and model responses, providing statistics, visualizations, and detailed breakdowns of bias types. The interface displays two models side-by-side with synchronized streaming responses, per-model bias summaries, and a comparison view highlighting differences in bias distributions. The system is built on Next.js with React, integrates Hugging Face inference endpoints for bias detection, and uses the Vercel AI SDK for multi-provider LLM access. Features include real-time streaming, export to JSON/PDF, and interactive visualizations (bar charts, radar charts) for bias analysis. LLM BiasScope is available as an open-source web application, providing a practical tool for bias evaluation and comparative analysis of LLM behaviour.

大模型评测偏见检测实时分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。