SmallML让小企业用几十条数据也能做高精度预测。
SmallML: Bayesian Transfer Learning for Small-Data Predictive Analytics
- 用贝叶斯迁移学习，从海量公开数据中提取先验知识
- 50个中小企业共享信息，提升小样本预测准确率24.2个百分点
- 适合数据少但需可靠预测的中小企业和创业者
小中型企业（SMEs）占美国企业总数的99.9%，却因数据量不足而被排除在人工智能之外。本文提出SmallML，一种贝叶斯迁移学习框架，在仅50-200条观测数据下即可实现企业级预测精度。其三层次架构包括：第一层利用基于SHAP的方法，从22,673条公开记录中提取梯度提升树到逻辑回归的知识转移先验；第二层在J=5-50家SME间实施分层池化与自适应收缩，平衡群体规律与个体特征；第三层采用共形预测，提供有限样本覆盖保证，实现分布无关的不确定性量化（P(y ∈ C(x)) ≥ 1−α）。在客户流失数据上的验证显示，每家企业仅100条数据时AUC达96.7% ± 4.2%，较独立逻辑回归提升24.2个百分点（72.5% ± 8.1%），p < 0.000001；共形预测在90%目标下实现92%实际覆盖率。模型在标准CPU上33分钟完成训练。SmallML为此前无法参与机器学习的3300万美国中小企业提供了可落地的企业级预测能力，推动了人工智能普惠化。
原文摘要 · Abstract (English)
Small and medium-sized enterprises (SMEs) represent 99.9% of U.S. businesses yet remain systematically excluded from AI due to a mismatch between their operational scale and modern machine learning's data requirements. This paper introduces SmallML, a Bayesian transfer learning framework achieving enterprise-level prediction accuracy with datasets as small as 50-200 observations. We develop a three-layer architecture integrating transfer learning, hierarchical Bayesian modeling, and conformal prediction. Layer 1 extracts informative priors from 22,673 public records using a SHAP-based procedure transferring knowledge from gradient boosting to logistic regression. Layer 2 implements hierarchical pooling across J=5-50 SMEs with adaptive shrinkage, balancing population patterns with entity-specific characteristics. Layer 3 provides conformal sets with finite-sample coverage guarantees P(y in C(x)) >= 1-alpha for distribution-free uncertainty quantification. Validation on customer churn data demonstrates 96.7% +/- 4.2% AUC with 100 observations per business -- a +24.2 point improvement over independent logistic regression (72.5% +/- 8.1%), with p < 0.000001. Conformal prediction achieves 92% empirical coverage at 90% target. Training completes in 33 minutes on standard CPU hardware. By enabling enterprise-grade predictions for 33 million U.S. SMEs previously excluded from machine learning, SmallML addresses a critical gap in AI democratization. Keywords: Bayesian transfer learning, hierarchical models, conformal prediction, small-data analytics, SME machine learning
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。