让向量空间更懂用户偏好,而非仅理解语义。
Embeddings for Preferences, Not Semantics
- 用合成数据打破语义与偏好的相关性,训练更精准的偏好嵌入
- 在11个在线讨论数据集上显著提升偏好预测效果
- 适合需要真实民意建模的集体决策系统
现代AI正推动以自由文本表达意见的集体决策模式。传统文本嵌入虽能衡量语义相似度,但无法准确反映用户对观点的偏好距离——偏好相似性应与向量距离成反比。现有嵌入模型依赖语义与偏好的偶然相关性,当该相关性失效时表现崩溃。本文将此问题形式化为不变性难题:嵌入同时包含偏好信号(立场、价值观)和语义干扰(风格、措辞),二者在观测上相关,导致基于干扰的几何看似有效实则失真。通过设计破坏相关性的合成训练数据,模型可摆脱对语义干扰的依赖,在11个在线讨论数据集上显著提升偏好预测性能。
原文摘要 · Abstract (English)
Modern AI is opening the door to collective decision-making in which participants express their views as free-form text rather than voting on a fixed set of candidates. A natural idea is to embed these opinions in a vector space so that the substantial literature on facility location problems and fair clustering can be brought to bear. But standard text embeddings measure semantic similarity, whereas distances in facility location problems and fair clustering require what we call \textit{preferential similarity}: a participant's agreement with a piece of text should be inversely related to their distance from it. Off-the-shelf embeddings inherit a coarse preference signal through a correlation between semantic and preferential similarity, but fail to capture preferences when the correlation breaks. We formalize this as an invariance problem: text embedding models encode both a preference-relevant signal (stance and values) and semantic nuisance (style and wording), and the two are observationally correlated, so a geometry that relies on nuisance can appear preference-correct even when it is not. We show that synthetic training data designed to break this correlation provably shifts the optimal scorer away from nuisance-dominated cosine and significantly improves preference prediction across 11 online deliberation datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。