Computer Vision in Retinal Interfaces via Deep Learning

 

Motivation

Neuroprosthetics is an emerging field in biomedical research and medical technology development. The loss of sensory or motor function has a significant negative impact on the quality of life and human well-being. Although significant progress has been made in ophthalmology in the past, conditions leading to untreatable blindness in a large number of people still exist. Restoration of vision can be achieved under these conditions by repairing cells with gene therapy, optogenetics, replacing cells with stem cells, or by bridging sensoric function with neuroprosthetic devices. All these concepts do have their advantages and disadvantages. In this RTG we are focussing on the neuroprosthetic approach.

RTG 2610 – Innovative Retinal Interfaces for Optimized Artificial Vision – InnoRetVision is a DFG funded Research Training Group dedicated to train graduate students with a background and interest in electrical engineering, neuroengineering, biophysics, sensory or neurophysiology, and or vision restoration. Our aim is to explore innovative methods for the stimulation of the visual system to improve current techniques for vision restoration in blind humans.

Scientific Questions

As a subproject of RTG InnoRetVision, we are focusing on the computer vision tasks in the retinal implants. The image signals taken from the camera(s) should be first downsampled to a drastically lower resolution, which are then sent to the electrode array to stimulate the neurons. The approaches to achieve this transformation effectively include image enhancement techniques, salient object detection and instance segmentation. In the case of stereo cameras or the combination of an RGB camera and e.g. an infrared camera or a depth camera (ToF), calibration techniques and information fusion algorithms are also of our interest.

Theses

New theses are regularly advertised in the area of Computer Vision in Retinal Interfaces via Deep Learning. In addition to the general overview, there are also numerous topics that have not yet been advertised, which will be gladly presented in a personal conversation.

External Funding

  • DFG GRK 2610, “Innovative Retinal interfaces for optimized Artificial Vision – InnoRetVision”, Project nr. 424556709

Partner

Contact

M.Sc.

Publications

2022

Yuli Wu, Peter Walter and Dorit Merhof
Multiscale Softmax Cross Entropy for Fovea Localization on Color Fundus Photography
In: Bildverarbeitung fuer die Medizin (BVM)