Optical neural network

An optical neural network (ONN) is a physical implementation of an artificial neural network with optical components.

Volume hologram
Early ONNs used a photorefractive volume hologram to interconnect arrays of input neurons to arrays of output with synaptic weights in proportion to the multiplexed hologram's strength. Volume holograms were further multiplexed using spectral hole burning to add one dimension of wavelength to space to achieve four dimensional interconnects of two dimensional arrays of neural inputs and outputs. This led to research on alternative methods using the strength of the optical interconnect to implement neuronal communications.

Silicon photonics
Silicon photonics offers superior speed, but lacks the massive parallelism that free-space optics can deliver.

Free-space optics
Free-space optics offers substantial parallelism. One implementation used phase masks for a handwritten digit classifier. Light passing through stacked 3D-printed phase masks can be read by a photodetector array of ten detectors, each representing a digit class (0 through 9). Although this network can achieve terahertz-speeds, it lacks flexibility, as the phase masks are fabricated for a specific task and cannot be trained.

An alternative method employs a 4F convolutional system. This system uses two lenses to execute the convolution Fourier transforms, enabling passive conversion into the Fourier domain without power consumption or latency. The convolution kernels are task-specific fixed phase masks.

Another technique used kernel tiling to access the parallelism of the 4F system while using a digital micromirror device (DMD) instead of a phase mask. Kernels can be entered into the 4F system and conduct inference.

Typical neural networks are not designed for the 4F systems, using a lower resolution and more channels in their feature maps.

Programmable Optical Array/Analogic Computer
The Programmable Optical Array/Analogic Computer (POAC) was implemented in 2000 based on a modified joint Fourier transform correlator (JTC) and bacteriorhodopsin (BR) as a holographic optical memory. The system offered full parallelism, large array size and the speed of light in an optical convolutional neural network. POAC is a general purpose and programmable array computer that has a wide range of applications including: image processing, pattern recognition, target tracking, real-time video processing, document security, and optical switching.

Hybrid
Taichi is a hybrid ONN that combines the power efficiency and parallelism of optical diffraction and the configurability of optical interference. Taichi offers 13.96 million parameters. Taichi avoids the high error rates that afflict deep (multi-layer) networks by combining clusters of fewer-layer diffractive units with arrays of interferometers for reconfigurable computation. Its encoding protocol divides large network models into sub-models that can be distributed across multiple chiplets in parallel.

Taichi achieved 91.89% accuracy in tests with the Omniglot database. It was also used to generate music Bach and generate images the styles of Van Gogh and Munch.

The developers claimed energy efficiency of up to 160 trillion operations second-1 watt-1 and an area efficiency of 880 trillion multiply-accumulate operations mm-2 or 103 more energy efficient than the NVIDIA H100, and 102 times more energy efficient and 10 times more area efficient than previous ONNs.

Other
ONNs include the Hopfield neural network and the Kohonen self-organizing map with liquid crystal spatial light modulators. Neuromorphic engineering can be used to create neuromorphic photonic systems. Typically, these systems encode information in the networks using spikes, mimicking the functionality of spiking neural networks in optical and photonic hardware.

Other photonic devices have demonstrated neuromorphic functionalities, including vertical-cavity surface-emitting lasers, integrated photonic modulators, optoelectronic systems based on superconducting Josephson junctions or systems based on resonant tunnelling diodes.

Comparison to biology
Biological neural networks are electrochemical, while optical neural networks use electromagnetic waves. Optical interfaces to biological neural networks can be created with optogenetics. Biological neural networks use multiple mechanisms to change the state of the neurons. These include short-term and long-term synaptic plasticity. Synaptic plasticity is among the electrophysiological phenomena used to control the efficiency of synaptic transmission, long-term for learning and memory, and short-term for transient changes in synaptic transmission efficiency. Implementing this ideally requires advanced photonic materials.

Desirable properties in photonic materials for optical neural networks include the ability to change their efficiency of transmitting light, based on the intensity of incoming light.