通过多源数据与可解释模型,间接测量难以观测的复杂系统状态。
Measurement for Opaque Systems: Multi-source Triangulation with Interpretable Machine Learning
- 融合多源间接数据与可解释机器学习进行交叉验证
- 在无真实标签情况下仍能识别出有意义的状态变化趋势
- 适合研究隐蔽组织或缺乏直接数据的高风险系统
针对科学与政策关注的高风险系统中难以直接观测、数据碎片化且真实状态不可得的问题,本文提出一种基于间接数据痕迹、可解释机器学习与理论引导三角验证的测量框架。传统统计推断与模型验证依赖单一权威数据流或标注结果,在此类场景下失效。本框架不追求对不可达理想数据的预测精度,转而强调多个部分信息模型间的一致性。通过跨信号一致性或偏离预期状态,用户可得出关于现实状况的可信结论。该方法适用于数据不足以支持常规统计或因果推断的定量分析场景。我们在一个隐秘武装组织的内部压力与组织扩张动态研究中进行了实证分析,利用多个提供局部且有偏视角的观测信号,展示了三角化可解释机器学习如何恢复具有实质性意义的变化模式。
原文摘要 · Abstract (English)
We propose a measurement framework for difficult-to-access contexts that uses indirect data traces, interpretable machine-learning models, and theory-guided triangulation to fill inaccessible measurement spaces. Many high-stakes systems of scientific and policy interest are difficult, if not impossible, to reach directly: dynamics of interest are unobservable, data are indirect and fragmented across sources, and ground truth is absent or concealed. In these settings, available data often do not support conventional strategies for analysis, such as statistical inference on a single authoritative data stream or model validation against labeled outcomes. To address this problem, we introduce a general framework for measurement in data regimes characterized by structurally missing or adversarial data. We propose combining multi-source triangulation with interpretable machine learning models. Rather than relying on accuracy against unobservable, unattainable ideal data, our framework seeks consistency across separate, partially informative models. This allows users to draw defensible conclusions about the state of the world based on cross-signal consistency or divergence from an expected state. Our framework provides an analytical workflow tailored to quantitative characterization in the absence of data sufficient for conventional statistical or causal inference. We demonstrate our approach and explicitly surface inferential limits through an empirical analysis of organizational growth and internal pressure dynamics in a clandestine militant organization, drawing on multiple observational signals that individually provide incomplete and biased views of the underlying process. The results show how triangulated, interpretable ML can recover substantively meaningful variation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。