arXiv:2512.18321cs.CL2025-12ACL被引 1

提出新框架,让模型在连续新领域中实时自适应,提升文本理解能力。

CTTA-T: Continual Test-Time Adaptation for Text Understanding via Teacher-Student with a Domain-aware and Generalized Teacher

  • 用师生架构动态积累跨域语义,跟踪领域变化
  • 通过丢弃率一致性校准预测,减少错误累积
  • 适合持续遇到新领域的实际应用,如多语言客服

文本理解常受领域偏移影响。传统领域自适应(DA)需在训练时知晓测试领域;而测试时自适应(TTA)虽可在测试阶段在线调整,但仅适用于固定测试领域。本文探索更贴近实际的持续测试时自适应(CTTA)场景:测试阶段面对一系列未见、连续出现的新领域。现有方法存在两难:噪声过滤可减少误差累积,但丢失有效信息;历史领域累积能增强泛化,却难以实现自适应累积。为此,本文提出 CTTA-T 框架,采用具备领域感知和泛化能力的教师模型。为提升教师预测质量,提出基于丢弃率一致性的“精炼-过滤”机制,校准输出并剔除不可靠指导。针对适应与泛化权衡,通过增量主成分分析(incremental PCA)动态累积跨域语义,持续追踪领域演变。实验表明,该方法显著优于基线。

原文摘要 · Abstract (English)

Text understanding often suffers from domain shifts. To handle testing domains, domain adaptation (DA) is trained to adapt to a fixed and observed testing domain; a more challenging paradigm, test-time adaptation (TTA), cannot access the testing domain during training and online adapts to the testing samples during testing, where the samples are from a fixed domain. We aim to explore a more practical and underexplored scenario, continual test-time adaptation (CTTA) for text understanding, which involves a sequence of testing (unobserved) domains in testing. Current CTTA methods struggle in reducing error accumulation over domains and enhancing generalization to handle unobserved domains: 1) Noise-filtering reduces accumulated errors but discards useful information, and 2) accumulating historical domains enhances generalization, but it is hard to achieve adaptive accumulation. In this paper, we propose a CTTA-T (continual test-time adaptation for text understanding) framework adaptable to evolving target domains: it adopts a teacher-student framework, where the teacher is domain-aware and generalized for evolving domains. To improve teacher predictions, we propose a refine-then-filter based on dropout-driven consistency, which calibrates predictions and removes unreliable guidance. For the adaptation-generalization trade-off, we construct a domain-aware teacher by dynamically accumulating cross-domain semantics via incremental PCA, which continuously tracks domain shifts. Experiments show CTTA-T excels baselines.

文本理解持续学习测试时适应师生模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。