揭示动态非线性系统中静态与动态失真的不可同时最小化本质
Information-Theoretic Bounds and Task-Centric Learning Complexity for Real-World Dynamic Nonlinear Systems
- 基于结构分解与信息论,建立任务导向的复杂度边界
- 发现系统行为不确定性原理:静态与动态失真无法共优
- 提出可解释学习复杂度指标,适配实际建模与工程优化
动态非线性系统因静态与动态效应耦合产生畸变,其交织特性给数据驱动建模带来重大挑战。本文提出一个理论框架,融合结构分解、方差分析与任务导向复杂度边界。该框架引入可测量系统组件间相互作用的方向性下界,将内积空间正交性推广至结构非对称场景,支持分解系统的方差不等式。引入关键行为指标与记忆有限性指数,通过严格的功率条件建立可实现系统中有限记忆与热力学第一定律的可测关联,提供比传统基于第二定律更基础的视角。在此基础上,提出“行为不确定性原理”,证明静态与动态畸变无法同时最小化。实证表明,现实系统因静态与动态效应纠缠而难以完全确定性分解。此外,提出两个通用定理,将函数方差与均方Lipschitz连续性及学习复杂度关联,导出一种模型无关、任务感知的复杂度度量,表明低方差分量天然更易学习。这些洞察解释了结构残差学习的实证优势,包括更好泛化、更少参数、更低训练成本,此前已在功放线性化实验中观察到。该框架具广泛适用性,为复杂动态非线性系统建模提供可扩展、理论坚实的方法。
原文摘要 · Abstract (English)
Dynamic nonlinear systems exhibit distortions arising from coupled static and dynamic effects. Their intertwined nature poses major challenges for data-driven modeling. This paper presents a theoretical framework grounded in structured decomposition, variance analysis, and task-centric complexity bounds. The framework employs a directional lower bound on interactions between measurable system components, extending orthogonality in inner product spaces to structurally asymmetric settings. This bound supports variance inequalities for decomposed systems. Key behavioral indicators are introduced along with a memory finiteness index. A rigorous power-based condition establishes a measurable link between finite memory in realizable systems and the First Law of Thermodynamics. This offers a more foundational perspective than classical bounds based on the Second Law. Building on this foundation, we formulate a `Behavioral Uncertainty Principle,' demonstrating that static and dynamic distortions cannot be minimized simultaneously. We identify that real-world systems seem to resist complete deterministic decomposition due to entangled static and dynamic effects. We also present two general-purpose theorems linking function variance to mean-squared Lipschitz continuity and learning complexity. This yields a model-agnostic, task-aware complexity metric, showing that lower-variance components are inherently easier to learn. These insights explain the empirical benefits of structured residual learning, including improved generalization, reduced parameter count, and lower training cost, as previously observed in power amplifier linearization experiments. The framework is broadly applicable and offers a scalable, theoretically grounded approach to modeling complex dynamic nonlinear systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。