在重尾噪声下实现鲁棒线性系统识别,首次逼近高斯噪声的样本效率。
Outlier-Robust Linear System Identification Under Heavy-tailed Noise
- 通过构造弱集中估计器并结合高维鲁棒统计工具,设计新算法。
- 仅需四阶矩存在,即可达到接近高斯噪声下的样本复杂度。
- 可处理少量数据被恶意篡改场景,适合真实噪声环境下的控制系统学习。
我们研究在多个独立轨迹观测下,估计线性时不变(LTI)系统的状态转移矩阵问题。近期工作多依赖过程噪声为高斯或次高斯(轻尾)的假设,而本文在更弱的噪声模型下开展分析,仅假设噪声分布存在四阶矩。针对此设定,我们首次证明:可通过新算法获得近乎与次高斯噪声下同阶的样本复杂度界。核心方法是构建多个弱集中估计器,并利用高维鲁棒统计工具提升性能。分析揭示噪声峰度(衡量重尾程度)直接影响所需轨迹数量。此外,该方法可自然扩展至应对小部分轨迹被任意篡改的对抗场景。本工作为控制领域的非理想数据生成假设下建立鲁棒统计学习理论迈出关键一步。
原文摘要 · Abstract (English)
We consider the problem of estimating the state transition matrix of a linear time-invariant (LTI) system, given access to multiple independent trajectories sampled from the system. Several recent papers have conducted a non-asymptotic analysis of this problem, relying crucially on the assumption that the process noise is either Gaussian or sub-Gaussian, i.e., "light-tailed". In sharp contrast, we work under a significantly weaker noise model, assuming nothing more than the existence of the fourth moment of the noise distribution. For this setting, we provide the first set of results demonstrating that one can obtain sample-complexity bounds for linear system identification that are nearly of the same order as under sub-Gaussian noise. To achieve such results, we develop a novel robust system identification algorithm that relies on constructing multiple weakly-concentrated estimators, and then boosting their performance using suitable tools from high-dimensional robust statistics. Interestingly, our analysis reveals how the kurtosis of the noise distribution, a measure of heavy-tailedness, affects the number of trajectories needed to achieve desired estimation error bounds. Finally, we show that our algorithm and analysis technique can be easily extended to account for scenarios where an adversary can arbitrarily corrupt a small fraction of the collected trajectory data. Our work takes the first steps towards building a robust statistical learning theory for control under non-ideal assumptions on the data-generating process.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。