arXiv:2609.08659cs.CVcs.AI2026-09

提出可部署于卫星的三段式目标检测模型,兼顾精度与硬件效率。

TriCCOT: Tri-part Convolutional Conformal Transformer for Onboard Space Object Detection

论文配图:TriCCOT: Tri-part Convolutional Conformal Transformer for Onboard Space Object Detection
图 1 · 摘自论文原文
  • 分三段:卷积候选框生成 + 置信度校准 + 硬件友好注意力分类
  • 在DIOR和VDVRaw数据集上优于同类FPGA兼容模型,抗模糊和噪声更强
  • 首次实现全栈部署于Xilinx Versal VCK190 FPGA,支持混合CNN-Transformer推理

星载目标检测受限于计算资源有限及缺乏完全校正图像。虽卷积检测器硬件高效,但难以从原始噪声数据中提取鲁棒特征;而基于Transformer的模型虽具强全局推理能力,却因二次复杂度注意力与不兼容操作难部署于FPGA加速器。本文提出TriCCOT,一种三段式架构,兼顾鲁棒性与可部署性。该模型包含卷积区域提议网络、置信度校准阶段与Aper-GATES——一种硬件友好的基于注意力的分类器。区域提议网络生成候选框,经置信度校准后扩大,提供无分布假设的概率覆盖保证。所得图像块由Aper-GATES处理,通过卷积投影、全局通道统计与硬件友好的门控操作重构自注意力机制,避免传统Transformer中不适合CNN加速器的操作。在DIOR与VDVRaw数据集上的实验表明,其检测性能具有竞争力,且对空间模糊与信号相关噪声更具鲁棒性。最终,模型成功部署于Xilinx Versal VCK190 FPGA,无需修改底层DPU架构,实现星载嵌入式应用中的统一CNN-Transformer推理。

原文摘要 · Abstract (English)

Onboard object detection in Earth observation is constrained by limited computational resources and the absence of fully corrected imagery. While convolutional detectors are hardware-efficient, they often struggle to extract robust representations from raw and noisy data. Conversely, transformer-based models provide stronger global reasoning capabilities but remain difficult to deploy on FPGA accelerators due to quadratic attention complexity and non-compatible operations. We introduce TriCCOT, a tri-part architecture for robust and deployable onboard object detection. TriCCOT combines a convolutional region proposal network, a conformal prediction stage, and Aper-GATES, our hardware-friendly attention-based classifier. The region proposal network generates candidate bounding boxes, which are subsequently enlarged via conformal prediction, providing a distribution-free probabilistic coverage guarantee. The resulting crops are processed by Aper-GATES, which reformulates self-attention through convolutional projections, global channel statistics, and hardware-friendly gating operations, avoiding standard transformer operations that are poorly suited to CNN-oriented accelerators. Experiments on the DIOR and VDVRaw datasets demonstrate competitive detection performance and improved robustness to spatial blur and signal-dependent noise when compared to FPGA-compatible architectures. Finally, we report full deployment on a Xilinx Versal VCK190 FPGA without modifying the underlying DPU architecture, enabling unified CNN-Transformer inference for spaceborne embedded applications.

目标检测星载系统FPGA部署Transformer优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。