用记忆检索提升房产估值精度,让模型学会找相似房源。
RowNet: A Memory Transformer for Tabular Regression
- 通过查询与记忆库中历史房源的相似度匹配来预测房价
- 分两阶段检索:先用特征相似度粗估,再结合目标一致性精调
- 适合需要精准回归的结构化数据场景,如房地产定价
房产估值是结构化回归问题,受异构特征类型、稀疏区域效应、非线性交互及可比房源逻辑影响。传统MLP将每行视为孤立向量,需从监督信号中自行学习局部性、尺度敏感性和类别匹配;梯度提升树虽表现良好,但其以特征为中心的分裂机制未显式建模相似历史样本的检索。本文提出RowNet,一种基于检索的神经架构,用于房价(每平方米)预测。该模型通过查询房源与记忆库中带标签房源的成对相似度特征进行表示。第一阶段检索层仅基于特征相似度估算粗略目标值。第二阶段引入目标一致性特征,使用多个可学习注意力头检索互补的可比房源集合。最终通过混合专家模块,结合学习门控、残差修正、熵正则化与头多样性正则化生成预测结果。
原文摘要 · Abstract (English)
Real estate valuation is a structured regression problem in which prices are governed by heterogeneous feature types, sparse regional effects, nonlinear interactions, and the practical logic of comparable properties. Standard multilayer perceptrons treat each row as an isolated vector and must learn locality, scale sensitivity, and categorical matching from supervision alone. Gradient-boosted decision trees provide strong tabular baselines, but their feature-centric splitting mechanism does not explicitly model the retrieval of similar historical observations. This paper presents RowNet, a retrieval-based neural architecture for real estate price-per-square-meter prediction. RowNet represents a query property through pairwise similarity features against a memory bank of labeled properties. A first retrieval layer estimates a coarse target from feature-only similarities. A second layer augments the memory comparison with target-consistency features and uses multiple learned attention heads to retrieve complementary comparable sets. A final mixture-of-experts module combines learned gating, residual correction, entropy regularization, and head-diversity regularization to produce the prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。