提出一种掩码输出层,让多级分类更一致公平。
Enforcing Consistency and Fairness in Multi-level Hierarchical Classification with a Mask-based Output Layer
- 用掩码层强制类别层级关系,修正预测不一致问题。
- 在公平性和准确率上优于大模型与无纠错模型。
- 适合电商、医疗等对预测可靠性要求高的场景。
传统多级层次分类器依赖具有 $n$ 个独立输出层的主干模型,忽略类别间的层级关系,导致违反分类体系的不一致预测。一旦选定主干架构,适应新任务(如引入公平性保护敏感属性)便十分困难,需复杂调整以维持层级结构并满足约束。本文提出一种公平、模型无关的掩码输出层,用于强化分类体系,并优化一致性、公平性和精确匹配等目标。实验表明,该方法不仅提升预测公平性,还确保分类一致性,性能优于采用内处理去偏技术的大语言模型及无偏差校正模型,在电商、医疗和教育等领域具有重要应用价值。
原文摘要 · Abstract (English)
Traditional Multi-level Hierarchical Classification (MLHC) classifiers often rely on backbone models with $n$ independent output layers. This structure tends to overlook the hierarchical relationships between classes, leading to inconsistent predictions that violate the underlying taxonomy. Additionally, once a backbone architecture for an MLHC classifier is selected, adapting the model to accommodate new tasks can be challenging. For example, incorporating fairness to protect sensitive attributes within a hierarchical classifier necessitates complex adjustments to maintain the class hierarchy while enforcing fairness constraints. In this paper, we extend this concept to hierarchical classification by introducing a fair, model-agnostic layer designed to enforce taxonomy and optimize specific objectives, including consistency, fairness, and exact match. Our evaluations demonstrate that the proposed layer not only improves the fairness of predictions but also enforces the taxonomy, resulting in consistent predictions and superior performance. Compared to Large Language Models (LLMs) employing in-processing de-biasing techniques and models without any bias correction, our approach achieves better outcomes in both fairness and accuracy, making it particularly valuable in sectors like e-commerce, healthcare, and education, where predictive reliability is crucial.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。