用无服务器架构实现工业级机器学习落地,精准预测海关商品编码
Operationalization of Machine Learning with Serverless Architecture: An Industrial Operationalization of Machine Learning with Serverless Architecture: An Industrial Implementation for Harmonized System Code Prediction
- 构建事件驱动的无服务器流水线,全程自动化管理模型生命周期
- 文本CNN达98%准确率,支持自动A/B测试与动态上线
- 兼顾成本与可解释性,适合高合规要求的工业场景
本文提出一种无服务器MLOps框架,全流程支持从数据接入、训练、部署、监控到重训练的机器学习生命周期,采用事件驱动管道和托管服务。该架构与模型无关,通过标准化接口支持多种推理模式,实现快速适配且无需基础设施投入。以海关商品编码(HS code)预测为例,针对产品描述短且非结构化、更新频繁、歧义性强的挑战,使用自定义文本嵌入编码器与多个深度学习模型,其中Text-CNN在真实数据上达到98%准确率。系统保障可复现性、可审计性及负载变化下的SLA达标,通过自动扩缩容实现高可用。关键特性为自动化A/B测试,支持生产环境中的动态模型选择与安全发布。虽变压器模型精度相近,但长期运维成本更高;本方案优先确保确定性分类、可预测延迟与可解释性,同时保留扩展至变压器与大模型推理的能力。论文先展示模型仿真与对比,再阐述基于无服务器架构的工业化落地,实现HS编码的自动化重训练、预测与验证。该工作提供可复现的工业级机器学习部署范式,助力企业规模化同时优化性能与经济性。
原文摘要 · Abstract (English)
This paper presents a serverless MLOps framework orchestrating the complete ML lifecycle from data ingestion, training, deployment, monitoring, and retraining to using event-driven pipelines and managed services. The architecture is model-agnostic, supporting diverse inference patterns through standardized interfaces, enabling rapid adaptation without infrastructure overhead. We demonstrate practical applicability through an industrial implementation for Harmonized System (HS) code prediction, a compliance-critical task where short, unstructured product descriptions are mapped to standardized codes used by customs authorities in global trade. Frequent updates and ambiguous descriptions make classification challenging, with errors causing shipment delays and financial losses. Our solution uses a custom text embedding encoder and multiple deep learning architectures, with Text-CNN achieving 98 percent accuracy on ground truth data. Beyond accuracy, the pipeline ensures reproducibility, auditability, and SLA adherence under variable loads via auto-scaling. A key feature is automated A/B testing, enabling dynamic model selection and safe promotion in production. Cost-efficiency drives model choice; while transformers may achieve similar accuracy, their long-term operational costs are significantly higher. Deterministic classification with predictable latency and explainability is prioritized, though the architecture remains extensible to transformer variants and LLM-based inference. The paper first introduces the deep learning architectures with simulations and model comparisons, then discusses industrialization through serverless architecture, demonstrating automated retraining, prediction, and validation of HS codes. This work provides a replicable blueprint for operationalizing ML using serverless architecture, enabling enterprises to scale while optimizing performance and economics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。