New ‘holography’ processor converts 2D video into real-time 3D ‘holograms’

New ‘holography’ processor converts 2D video into real-time 3D ‘holograms’
Researchers at the Electronics and Telecommunications Research Institute (ETRI) has developed a programmable, semiconductor-based digital ‘holographic’ media processor, converting 2D videos into 3D holograms in real time.

The processor uses field programmable gate array (FPGA) technology, utilising high-bandwidth memory to generate real-time, 3D holograms in full colour from 2D videos.

All of the hardware required for the ‘hologram’ generation is integrated into a single system-on-chip design, extracting red, green, and blue colours as well as depth information from 2D video before reconstructing ‘holographic’ video information at 4K resolution with a latency of 30 milliseconds.

The researchers claim that that the ‘holograms’ are processed at a speed of up to 30 FPS, performing numerical calculations for wave propagation to convert 2D information into 3D holograms.

By using HBM memory instead of DDR memory, the processor can reportedly enable processing of large-scale, complex number holographic computations.

The researchers claim that any video displayed on a computer screen, such as video calls or streaming content, could be converted into 3D holographic video without delay.

The researchers plan to improve the technology by integrating direct acquisition of light-based ‘holograms’ and HD ‘hologram’ rendering techniques.

Kwon Won Ok, principal researcher, digital holography research section, ETRI, commented: “Our goal is to develop a dedicated holographic media processor chip (ASIC) for general-purpose holographic displays by incorporating hardware-based holographic image enhancement technology in the future.”

Photo credit: ETRI