arXiv:2608.04423cs.CV2026-08

用AI补全化石叶子缺失部分,还原完整形态与脉络。

Foreseeing the Invisible: Amodal Reconstruction of Leaf Fossil Images

论文配图:Foreseeing the Invisible: Amodal Reconstruction of Leaf Fossil Images
图 1 · 摘自论文原文
  • 基于DINOv3构建多头模型,直接从图像预测可见与完整叶形。
  • 合成数据训练下,真实化石复原达95%骰子系数,迁移性能好。
  • 轻量化部署到浏览器,支持面积估算与活体叶片生成。

化石叶子通常不完整——岩石掩埋、破碎和侵蚀导致叶身缺失,但古植物学依赖完整的叶形与轮廓。本文将缺失组织恢复问题定义为无模态重建,提出AmodalDINO,一种多头密集预测模型,可从单张RGB图像同时预测四个掩码:可见叶区、无模态完整叶、主脉及细脉。不同于以往工作需提供可见掩码,AmodalDINO联合预测可见与无模态区域,无需运行时实例分割器。通过微调DINOv3 ViT-L/16(小学习率)并添加辅助脉络分支,模型学会叶片结构先验。仅在合成化石图像上训练,于验证集达到95.0% Dice / 90.5% IoU,对真实化石具有良好泛化能力。精简为双头模型后,在KINS和COCOA-cls两个基准数据集上分别取得85.05%全类别mIoU / 66.65%遮挡mIoU,以及80.90% / 38.15%的指标。模型还具备实用性:4比特量化后可在浏览器离线运行,保持0.910的IoU;加入尺标校准可估算表面积,并实现在本地设备生成活体叶片可视化。

原文摘要 · Abstract (English)

Fossil leaves are rarely preserved whole -- sedimentary rock hides, breaks, and erodes the lamina, yet paleobotany depends on the complete shape and outline of the leaf. We cast the recovery of the missing tissue as amodal reconstruction and present AmodalDINO, a multi-head dense-prediction model that predicts four masks from a single RGB image: visible leaf, amodal complete leaf, amodal main vein, and fine veins. Unlike essentially all prior amodal work, AmodalDINO is given no visible mask. It predicts the visible and amodal regions jointly, so it needs no upstream instance segmenter at runtime. Two simple but effective changes adapt the model to the amodal segmentation task: fully fine-tune a DINOv3 ViT-L/16 at a small learning rate instead of freezing it, and attach auxiliary venation heads alongside the leaf heads. These two changes enable the model to learn the structural shape prior of leaves. Trained only on synthetic leaf fossil images, AmodalDINO reaches 95.0% Dice / 90.5% IoU on the validation set and transfers well to real fossil specimens. Stripped to two heads, the same recipe can run on two benchmark datasets, reaching 85.05 full mIoU / 66.65 occluded mIoU on KINS and 80.90 / 38.15 on COCOA-cls. The model is also practical: by quantizing to 4-bit weights, it runs entirely offline in a browser, matching the original model with an IoU of 0.910. We also add ruler-based calibration to estimate surface area, and a generative visualization of living leaves on local devices.

无模态重建化石修复视觉模型轻量化部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。