用自适应密度场实现可扩展的空间注意力,提升地理计算的可解释性。
Attention in Geometry: Scalable Spatial Modeling via Adaptive Density Fields and FAISS-Accelerated Kernels
- 基于查询位置的局部自适应高斯核混合,动态调节影响范围。
- 引入近似最近邻搜索,在保持局部性的同时支持大规模数据。
- 适用于需几何可解释性的地理信息与空间机器学习任务。
地理系统中的空间计算日益需要在度量约束下进行查询相关的局部聚合,且要求可解释性。传统方法多依赖全局求和,将近似视为实现问题,限制了大尺度下的可解释性与可扩展性。本文提出自适应密度场(ADF),一种将空间聚合建模为连续空间中查询相关的度量诱导注意力算子的几何注意力框架。给定一组带标量得分的标注空间点,ADF 在空间上定义连续强度场。对于特定查询位置,场值通过以查询最近邻为中心的局部自适应高斯核混合获得,其中核带宽由点的得分调制,以评估局部聚合影响。同时引入近似最近邻搜索,实现可扩展执行并保留局部性。该框架融合自适应核方法、经典GIS方法与注意力机制,将空间影响重新诠释为嵌入几何的注意力,基于物理距离而非学习的潜在投影。其为形式层面的方法,支持灵活的核选择、得分到带宽的映射及近似参数。该方法提供统一的空间影响建模视角,强调结构、可扩展性与几何可解释性,对地理信息系统与空间机器学习具有重要价值。
原文摘要 · Abstract (English)
Spatial computation in geographic systems increasingly requires query-conditioned, local, interpretable aggregation under metric constraints. Many classical approaches rely on global summation and treat approximation as an implementation concern, limiting interpretability and scalability at large scales. We propose the Adaptive Density Field (ADF), a geometric attention framework that formulates spatial aggregation as a query-conditioned, metric-induced attention operator in continuous space. Given a set of labelled spatial points with associated scalar scores, ADF defines a continuous intensity field over space. For a given query location, the field value is obtained via a local adaptive Gaussian kernel mixture centered on the query's nearest neighbors, where kernel bandwidths are modulated by point-specific scores to evaluate local aggregated influence. Additionally, approximate nearest-neighbor search is introduced, enabling scalable execution while preserving locality. The proposed ADF bridges concepts from adaptive kernel methods, classical GIS methods, and attention mechanisms by reinterpreting spatial influence as geometry-embedded attention, grounded in physical distance rather than learned latent projections. The proposed framework is formulation-level rather than algorithm-specific, allowing flexible kernel choices, score-to-bandwidth mappings, and approximation parameters. This approach provides a unifying perspective on spatial influence modeling that emphasizes structure, scalability, and geometric interpretability, with relevance to geographic information systems and spatial machine learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。