arXiv:2607.23083cs.CL2026-07

用轻量级方法实现性别包容性文本生成与反偏见回应,无需修改模型权重。

LoRA for Gender-Inclusive Rewriting and Activation Steering for Counter-Narrative Generation

  • 采用LoRA微调实现性别包容性改写,准确率达80.00%
  • 通过PCA提取主引导方向,在推理时注入中间表示以生成反偏见回应
  • 适合需要快速部署可控生成系统的开发者,尤其关注社会对齐的场景

性别包容性语言生成旨在将带有偏见的文本转化为包容性表达,同时保持语义和上下文连贯性。本文针对LT-EDI 2026共享任务提出了IHLC系统,涵盖性别包容性改写与反偏见回应生成。在性别包容性改写中,采用参数高效低秩适配(LoRA)微调,取得官方得分80.00%。核心贡献在于一种计算高效的推理时表征工程方法:通过主成分分析(PCA)从对比隐藏状态激活中提取主引导方向,并在Gemma-3-4B-it推理过程中注入中间表示,实现行为导向的包容性响应生成,无需修改模型权重。结合约束提示,该方法生成礼貌且符合语境的反偏见回应,官方得分为78.12%。我们进一步进行了人工分析,识别出关键失败模式,包括语义漂移、残留偏见泄漏、层敏感性、过度引导及文本退化。研究揭示了激活引导作为轻量化替代方案在可控制与社会对齐生成中的潜力与局限。

原文摘要 · Abstract (English)

Gender-inclusive language generation seeks to transform biased text into inclusive alternatives while preserving semantic meaning and contextual coherence. This paper presents the IHLC system for the LT-EDI 2026 Shared Task, addressing both gender-inclusive rewriting and counter-narrative generation. For gender-inclusive rewriting, we employ parameter-efficient Low-Rank Adaptation (LoRA) fine-tuning, achieving an official score of 80.00%. Our primary contribution is a compute-efficient inference-time representation engineering approach for counter-narrative generation. We derive a principal steering direction from contrastive hidden-state activations using principal component analysis (PCA) and inject it into the intermediate representations of Gemma-3-4B-it during inference, enabling behavioral steering toward inclusive responses without modifying model weights. Combined with constrained prompting, this approach produces polite and contextually appropriate counter-narratives, achieving an official score of 78.12%. We further present a manual analysis of steering behavior, identifying key failure modes including semantic drift, residual bias leakage, layer sensitivity, over-steering, and text degeneration. Our findings highlight both the practical potential and current limitations of activation steering as a lightweight alternative to parameter updates for controllable and socially aligned language generation.

性别包容激活引导轻量微调反偏见

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。