(Peer-Reviewed) Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging
Wenwu Chen ¹ ³ ⁴, Yifan Liu ¹ ³ ⁴, Shijie Feng ¹ ³ ⁴ ⁵, Wei Yin ¹ ³ ⁴ ⁵, Jiaming Qian ¹ ³ ⁴ ⁵, Yixuan Li ¹ ³ ⁴ ⁵, Hang Zhang ², Maciej Trusiak ⁶, Malgorzata Kujawinska ⁶, Qian Chen ⁴ ⁵, Chao Zuo ¹ ³ ⁴ ⁵
¹ Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
中国 南京 南京理工大学电子工程与光电技术学院 智能计算成像实验室
² Key Laboratory of Shock Wave Physics and Detonation Physics, Institute of Fluid Physics, China Academy of Engineering Physics, Mianyang 621900, China
中国 绵阳 中国工程物理研究院流体物理研究所 冲击波物理与爆轰物理国家级重点实验室
³ Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, Nanjing 210019, China
中国 南京 南京理工大学智能计算成像研究所
⁴ Jiangsu Key Laboratory of Visual Sensing & Intelligent Perception, Nanjing 210094, China
中国 南京 江苏省视觉传感与智能感知重点实验室
⁵ State key Laboratory of Extreme Environment Optoelectronic Dynamic Measurement Technology and Instrument, Taiyuan 030051, China
中国 太原 极限环境光电动态测试技术与仪器全国重点实验室
⁶ Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., Warsaw 02-525, Poland
Opto-Electronic Advances, 2025-09-25
Abstract
Recent advancements in artificial intelligence have transformed three-dimensional (3D) optical imaging and metrology, enabling high-resolution and high-precision 3D surface geometry measurements from one single fringe pattern projection. However, the imaging speed of conventional fringe projection profilometry (FPP) remains limited by the native sensor refresh rates due to the inherent "one-to-one" synchronization mechanism between pattern projection and image acquisition in standard structured light techniques.
Here, we present dual-frequency angular-multiplexed fringe projection profilometry (DFAMFPP), a deep learning-enabled 3D imaging technique that achieves high-speed, high-precision, and large-depth-range absolute 3D surface measurements at speeds 16 times faster than the sensor's native frame rate. By encoding multi-timeframe 3D information into a single multiplexed image using multiple pairs of dual-frequency fringes, high-accuracy absolute phase maps are reconstructed using specially trained two-stage number-theoretical-based deep neural networks.
We validate the effectiveness of DFAMFPP through dynamic scene measurements, achieving 10,000 Hz 3D imaging of a running turbofan engine prototype with only a 625 Hz camera. By overcoming the sensor hardware bottleneck, DFAMFPP significantly advances high-speed and ultra-high-speed 3D imaging, opening new avenues for exploring dynamic processes across diverse scientific disciplines.
Multiphoton intravital microscopy in small animals of long-term mitochondrial dynamics based on super‐resolution radial fluctuations
Saeed Bohlooli Darian, Jeongmin Oh, Bjorn Paulson, Minju Cho, Globinna Kim, Eunyoung Tak, Inki Kim, Chan-Gi Pack, Jung-Man Namgoong, In-Jeoung Baek, Jun Ki Kim
Opto-Electronic Advances
2025-07-17
Non-volatile tunable multispectral compatible infrared camouflage based on the infrared radiation characteristics of Rosaceae plants
Xin Li, Xinye Liao, Junxiang Zeng, Zao Yi, Xin He, Jiagui Wu, Huan Chen, Zhaojian Zhang, Yang Yu, Zhengfu Zhang, Sha Huang, Junbo Yang
Opto-Electronic Advances
2025-07-09
CW laser damage of ceramics induced by air filament
Chuan Guo, Kai Li, Zelin Liu, Yuyang Chen, Junyang Xu, Zhou Li, Wenda Cui, Changqing Song, Cong Wang, Xianshi Jia, Ji'an Duan, Kai Han
Opto-Electronic Advances
2025-06-27
Operando monitoring of state of health for lithium battery via fiber optic ultrasound imaging system
Chen Geng, Wang Anqi, Zhang Yi, Zhang Fujun, Xu Dongchen, Liu Yueqi, Zhang Zhi, Yan Zhijun, Li Zhen, Li Hao, Sun Qizhen
Opto-Electronic Science
2025-06-25
Observation of polaronic state assisted sub-bandgap saturable absorption
Li Zhou, Yiduo Wang, Jianlong Kang, Xin Li, Quan Long, Xianming Zhong, Zhihui Chen, Chuanjia Tong, Keqiang Chen, Zi-Lan Deng, Zhengwei Zhang, Chuan-Cun Shu, Yongbo Yuan, Xiang Ni, Si Xiao, Xiangping Li, Yingwei Wang, Jun He
Opto-Electronic Advances
2025-06-19