arXiv:2603.08445cs.CV2026-03AAAI被引 1

用注意力机制重加权预训练滤波器,实现低资源下的精准眼动追踪个性化。

Alfa: Attentive Low-Rank Filter Adaptation for Structure-Aware Cross-Domain Personalized Gaze Estimation

论文配图:Alfa: Attentive Low-Rank Filter Adaptation for Structure-Aware Cross-Domain Personalized Gaze Estimation
图 1 · 摘自论文原文
  • 通过SVD提取跨用户共性特征,用注意力机制动态调整权重
  • 仅需少量无标签样本,在4个数据集上均达到最低平均误差
  • 适用于视觉外任务如扩散语言模型,可迁移性强

预训练眼动模型虽能识别跨用户通用模式,但细微的个体差异(如眼睑形状或面部结构)会降低性能。测试时个性化(TTP)通过少量无标签样本适配模型以应对用户特异域偏移。高效微调对资源受限场景至关重要,尤其在设备端定制时。尽管参数高效微调(PEFT)方法仅更新少量权重以降低开销,却未充分挖掘预训练滤波器中的结构信息。为此,我们提出将个性化重构为重加权已有特征而非学习新特征。本文提出注意力低秩滤波器适配(Alfa),通过重加权预训练滤波器中的语义模式实现适配。利用奇异值分解(SVD)提取主导空间成分,捕捉跨用户的瞳孔与面部特征;再通过注意力机制,仅需少量无标签样本即可调整并重新加权预训练结构,选择性增强目标用户相关特征。Alfa在四个跨数据集眼动基准上取得最低平均误差,优于现有TTP方法及基于LoRA的变体。此外,我们验证了Alfa的注意力低秩方法可扩展至视觉以外任务,如基于扩散的语言模型。

原文摘要 · Abstract (English)

Pre-trained gaze models learn to identify useful patterns commonly found across users, but subtle user-specific variations (i.e., eyelid shape or facial structure) can degrade model performance. Test-time personalization (TTP) adapts pre-trained models to these user-specific domain shifts using only a few unlabeled samples. Efficient fine-tuning is critical in performing this domain adaptation: data and computation resources can be limited-especially for on-device customization. While popular parameter-efficient fine-tuning (PEFT) methods address adaptation costs by updating only a small set of weights, they may not be taking full advantage of structures encoded in pre-trained filters. To more effectively leverage existing structures learned during pre-training, we reframe personalization as a process to reweight existing features rather than learning entirely new ones. We present Attentive Low-Rank Filter Adaptation (Alfa) to adapt gaze models by reweighting semantic patterns in pre-trained filters. With Alfa, singular value decomposition (SVD) extracts dominant spatial components that capture eye and facial characteristics across users. Via an attention mechanism, we need only a few unlabeled samples to adjust and reweight pre-trained structures, selectively amplifying those relevant to a target user. Alfa achieves the lowest average gaze errors across four cross-dataset gaze benchmarks, outperforming existing TTP methods and low-rank adaptation (LoRA)-based variants. We also show that Alfa's attentive low-rank methods can be applied to applications beyond vision, such as diffusion-based language models.

眼动追踪个性化低秩适配注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。