arXiv:2503.11677cs.HCcs.CV2025-03被引 1

用新算法模拟假体视觉,提升植入者识脸能力。

Simulation of prosthetic vision with PRIMA system and enhancement of face representation

  • 开发非像素化仿真算法,融合分辨率与对比度限制。
  • 模拟结果匹配临床视力水平,提升面部特征识别率。
  • 结合机器学习和对比度调整,改善情绪识别速度。

患者植入PRIMA光伏式视网膜假体后,平均视力对应100μm像素尺寸,虽能阅读书写,但识脸困难。尽管刺激呈现为像素点,患者却感知为平滑图案。本文提出新仿真算法ProViSim,整合基于像素间距的空间分辨率滤波器和对比度敏感度下降的对比度滤波器。使用该算法生成的Landolt C符号与人脸图像,与实际PRIMA使用者报告一致。为恢复因分辨率或对比度限制丢失的面部特征,采用机器学习面部关键点模型,并在图像投射前应用对比度增强调色曲线。结果表明,反向对比度滤波与面部特征强化可有效保留假体视觉中的对比度,提升情绪识别准确率并缩短反应时间。空间与对比度限制会削弱图像可分辨特征。基于机器学习的方法及投射前的对比度调整可缓解部分局限,显著改善面部表征。

原文摘要 · Abstract (English)

Objective. Patients implanted with the PRIMA photovoltaic subretinal prosthesis in geographic atrophy report form vision with the average acuity matching the 100um pixel size. Although this remarkable outcome enables them to read and write, they report difficulty with perceiving faces. Despite the pixelated stimulation, patients see smooth patterns rather than dots. We present a novel, non-pixelated algorithm for simulating prosthetic vision, compare its predictions to clinical outcomes, and describe computer vision and machine learning (ML) methods to improve face representation. Approach. Our simulation algorithm (ProViSim) integrates a spatial resolution filter based on sampling density limited by the pixel pitch and a contrast filter representing reduced contrast sensitivity of prosthetic vision. Patterns of Landolt C and human faces created using this simulator are compared to reports from actual PRIMA users. To recover the facial features lost in prosthetic vision due to limited resolution or contrast, we apply an ML facial landmarking model, as well as contrast-adjusting tone curves to the image prior to its projection onto the photovoltaic retinal implant. Main results. Prosthetic vision simulated using the above algorithm matches the letter acuity observed in clinical studies, as well as the patients' descriptions of perceived facial features. Applying the inversed contrast filter to images prior to projection onto the implant and accentuating the facial features using an ML facial landmarking model helps preserve the contrast in prosthetic vision, improves emotion recognition and reduces the response time. Significance. Spatial and contrast constraints of prosthetic vision limit the resolvable features and degrade natural images. ML based methods and contrast adjustments prior to image projection onto the implant mitigate some limitations and improve face representation.

假体视觉面部识别机器学习视觉仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。