用AI实时将桌面画面转为3D光场，支持网页、视频等多源输入。
A Real-time 3D Desktop Display
- 通过MiDaS CNN从单张2D图提取深度图，生成多视角光场
- 支持实时处理桌面区域，输出至Looking Glass等3D设备
- 跨平台界面简化操作，适合开发者与3D内容创作者
本文介绍altiro3D C++库的升级版本，该库最初用于从2D图像生成无眼镜全息显示。新版本可实时处理来自2D网络摄像头或普通视频文件的3D视频流，将其转换为原生格式的光场，实现逼真的3D体验。核心功能依赖MiDaS卷积神经网络（CNN）从单张2D图像中提取深度图，以重建多视角图像。人工智能计算技术被用于提升整体性能。系统现可处理标准图像、视频流或桌面运行中的任意屏幕区域（如浏览器、视频通话等），并直接输出至光场3D设备（如Looking Glass Portrait）。为简化用户选取屏幕区域的操作，已开发跨平台图形用户界面。代码开源：https://github.com/canessae/altiro3D/releases/tag/2.0.0
原文摘要 · Abstract (English)
A new extended version of the altiro3D C++ Library -- initially developed to get glass-free holographic displays starting from 2D images -- is here introduced aiming to deal with 3D video streams from either 2D webcam images or flat video files. These streams are processed in real-time to synthesize light-fields (in Native format) and feed realistic 3D experiences. The core function needed to recreate multiviews consists on the use of MiDaS Convolutional Neural Network (CNN), which allows to extract a depth map from a single 2D image. Artificial Intelligence (AI) computing techniques are applied to improve the overall performance of the extended altiro3D Library. Thus, altiro3D can now treat standard images, video streams or screen portions of a Desktop where other apps may be also running (like web browsers, video chats, etc) and render them into 3D. To achieve the latter, a screen region need to be selected in order to feed the output directly into a light-field 3D device such as Looking Glass (LG) Portrait. In order to simplify the acquisition of a Desktop screen area by the user, a multi-platform Graphical User Interface has been also implemented. Sources available at: https://github.com/canessae/altiro3D/releases/tag/2.0.0
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。