让词向量更好当科学仪器,而非仅做预测工具。
The Prediction-Measurement Gap: Toward Meaning Representations as Scientific Instruments
- 以科学可用性为标准重构词向量设计,强调可解释性与几何清晰性。
- 静态词向量更透明易测,上下文模型虽语义丰富但混杂噪声难解释。
- 提出几何优先、可逆转换和意义地图等新方向,适合社科与心理研究者。
词向量已成为计算社会科学与心理学中测量意义的核心工具,支持大规模意义分析与混合方法推断。然而,当前表示学习主要优化预测与检索性能,导致预测-测量鸿沟:表现良好的特征可能不适合作为科学仪器。本文主张科学意义分析需独立的目标——科学可用性,强调几何可读性、可解释性、语言证据可追溯性、对非语义混淆因子的鲁棒性,以及与语义方向回归推断的兼容性。基于认知与神经心理学对意义的理解,论文评估了静态词向量与上下文变换器表示在这些要求下的表现:静态空间在透明测量上仍具优势,而上下文空间虽语义更丰富,却混杂其他信号,存在几何与解释性问题,阻碍推断。随后提出三项纲领性方向:(i) 几何优先设计梯度与抽象层次,包括受心理特权层级约束的层次感知空间;(ii) 可逆后处理变换,重调嵌入几何并减少干扰影响;(iii) 意义地图与面向测量的评估协议,实现可靠且可追溯的语义推断。面对规模主导进展的争议,具备测量能力的表示正开启一条原则性的新前沿。
原文摘要 · Abstract (English)
Text embeddings have become central to computational social science and psychology, enabling scalable measurement of meaning and mixed-method inference. Yet most representation learning is optimized and evaluated for prediction and retrieval, yielding a prediction-measurement gap: representations that perform well as features may be poorly suited as scientific instruments. The paper argues that scientific meaning analysis motivates a distinct family of objectives - scientific usability - emphasizing geometric legibility, interpretability and traceability to linguistic evidence, robustness to non-semantic confounds, and compatibility with regression-style inference over semantic directions. Grounded in cognitive and neuro-psychological views of meaning, the paper assesses static word embeddings and contextual transformer representations against these requirements: static spaces remain attractive for transparent measurement, whereas contextual spaces offer richer semantics but entangle meaning with other signals and exhibit geometric and interpretability issues that complicate inference. The paper then outlines a course-setting agenda around (i) geometry-first design for gradients and abstraction, including hierarchy-aware spaces constrained by psychologically privileged levels; (ii) invertible post-hoc transformations that recondition embedding geometry and reduce nuisance influence; and (iii) meaning atlases and measurement-oriented evaluation protocols for reliable and traceable semantic inference. As the field debates the limits of scale-first progress, measurement-ready representations offer a principled new frontier.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。