Binocular stereo vision relies on imaging disparity between two hemispherical retinas, which is essential to acquire image information in three dimensional environment. Therefore, retinomorphic electronics with structural and functional similarities to biological eyes are always highly desired to develop stereo vision perception system. In this work, a hemispherical optoelectronic memristor array based on Ag-TiO2 nanoclusters/sodium alginate film is developed to realize binocular stereo vision. All-optical modulation induced by plasmonic thermal effect and optical excitation in Ag-TiO2 nanoclusters is exploited to realize in-pixel image sensing and storage. Wide field of view (FOV) and spatial angle detection are experimentally demonstrated owing to the device arrangement and incident-angle-dependent characteristics in hemispherical geometry. Furthermore, depth perception and motion detection based on binocular disparity have been realized by constructing two retinomorphic memristive arrays. The results demonstrated in this work provide a promising strategy to develop all-optically controlled memristor and promote the future development of binocular vision system with in-sensor architecture.

Hemispherical Retina Emulated by Plasmonic Optoelectronic Memristors with All‐Optical Modulation for Neuromorphic Stereo Vision

Ielmini, Daniele;
2024-01-01

Abstract

Binocular stereo vision relies on imaging disparity between two hemispherical retinas, which is essential to acquire image information in three dimensional environment. Therefore, retinomorphic electronics with structural and functional similarities to biological eyes are always highly desired to develop stereo vision perception system. In this work, a hemispherical optoelectronic memristor array based on Ag-TiO2 nanoclusters/sodium alginate film is developed to realize binocular stereo vision. All-optical modulation induced by plasmonic thermal effect and optical excitation in Ag-TiO2 nanoclusters is exploited to realize in-pixel image sensing and storage. Wide field of view (FOV) and spatial angle detection are experimentally demonstrated owing to the device arrangement and incident-angle-dependent characteristics in hemispherical geometry. Furthermore, depth perception and motion detection based on binocular disparity have been realized by constructing two retinomorphic memristive arrays. The results demonstrated in this work provide a promising strategy to develop all-optically controlled memristor and promote the future development of binocular vision system with in-sensor architecture.
2024
Ag‐TiO2 nanocluster
all‐optical modulation
hemispherical array
neuromorphic stereo vision
plasmonic optoelectronic memristor
File in questo prodotto:
File Dimensione Formato  
2024_adv_sci.pdf

accesso aperto

: Publisher’s version
Dimensione 3.03 MB
Formato Adobe PDF
3.03 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11311/1273843
Citazioni
  • ???jsp.display-item.citation.pmc??? 1
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact