通过递归优化查询词,提升检索系统对少数群体的公平性。
FAIR-QR: Enhancing Fairness-aware Information Retrieval through Query Refinement
- 递归改写查询词,主动召回少数群体文档
- 在保持相关性的同时,显著提升群体公平性
- 每步可解释,适合需要透明性的场景
信息检索系统如开放网络搜索和推荐系统广泛存在,并深刻影响人们获取和消费在线信息的方式。已有研究指出,在信息检索中引入公平性有助于缓解回音室效应并抑制‘富者愈富’现象。因此,已提出多种公平性感知的信息检索方法。基于评分的公平性算法虽具可解释性,但可能存在数学不可行且泛化能力差的问题;而基于学习排序的公平性算法虽性能强,却缺乏可解释性。本文提出一种新颖且可解释的框架,通过递归地优化查询关键词,主动检索来自代表性不足群体的文档,实现群体公平性。使用优化后查询获取的文档将重新排序以保证相关性。该方法在相关性和公平性方面均表现优异,同时通过展示每轮迭代所用的优化关键词,保持了良好的可解释性。
原文摘要 · Abstract (English)
Information retrieval systems such as open web search and recommendation systems are ubiquitous and significantly impact how people receive and consume online information. Previous research has shown the importance of fairness in information retrieval systems to combat the issue of echo chambers and mitigate the rich-get-richer effect. Therefore, various fairness-aware information retrieval methods have been proposed. Score-based fairness-aware information retrieval algorithms, focusing on statistical parity, are interpretable but could be mathematically infeasible and lack generalizability. In contrast, learning-to-rank-based fairness-aware information retrieval algorithms using fairness-aware loss functions demonstrate strong performance but lack interpretability. In this study, we proposed a novel and interpretable framework that recursively refines query keywords to retrieve documents from underrepresented groups and achieve group fairness. Retrieved documents using refined queries will be re-ranked to ensure relevance. Our method not only shows promising retrieval results regarding relevance and fairness but also preserves interpretability by showing refined keywords used at each iteration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。