Year
Month
(Peer-Reviewed) Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging
Wenwu Chen 陈文武 ¹ ³ ⁴, Yifan Liu 刘苡帆 ¹ ³ ⁴, Shijie Feng 冯世杰 ¹ ³ ⁴ ⁵, Wei Yin 尹维 ¹ ³ ⁴ ⁵, Jiaming Qian 钱佳铭 ¹ ³ ⁴ ⁵, Yixuan Li 李艺璇 ¹ ³ ⁴ ⁵, Hang Zhang 张航 ², Maciej Trusiak ⁶, Malgorzata Kujawinska ⁶, Qian Chen 陈钱 ⁴ ⁵, Chao Zuo 左超 ¹ ³ ⁴ ⁵
¹ Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
中国 南京 南京理工大学电子工程与光电技术学院 智能计算成像实验室
² Key Laboratory of Shock Wave Physics and Detonation Physics, Institute of Fluid Physics, China Academy of Engineering Physics, Mianyang 621900, China
中国 绵阳 中国工程物理研究院流体物理研究所 冲击波物理与爆轰物理全国重点实验室
³ Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, Nanjing 210019, China
中国 南京 南京理工大学智能计算成像研究院
⁴ Jiangsu Key Laboratory of Visual Sensing & Intelligent Perception, Nanjing 210094, China
中国 南京 江苏省光谱成像与智能感知重点实验室
⁵ State key Laboratory of Extreme Environment Optoelectronic Dynamic Measurement Technology and Instrument, Taiyuan 030051, China
中国 太原 极限环境光电动态测试技术与仪器全国重点实验室
⁶ Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., Warsaw 02-525, Poland
Opto-Electronic Advances, 2025-09-25
Abstract

Recent advancements in artificial intelligence have transformed three-dimensional (3D) optical imaging and metrology, enabling high-resolution and high-precision 3D surface geometry measurements from one single fringe pattern projection. However, the imaging speed of conventional fringe projection profilometry (FPP) remains limited by the native sensor refresh rates due to the inherent "one-to-one" synchronization mechanism between pattern projection and image acquisition in standard structured light techniques.

Here, we present dual-frequency angular-multiplexed fringe projection profilometry (DFAMFPP), a deep learning-enabled 3D imaging technique that achieves high-speed, high-precision, and large-depth-range absolute 3D surface measurements at speeds 16 times faster than the sensor's native frame rate. By encoding multi-timeframe 3D information into a single multiplexed image using multiple pairs of dual-frequency fringes, high-accuracy absolute phase maps are reconstructed using specially trained two-stage number-theoretical-based deep neural networks.

We validate the effectiveness of DFAMFPP through dynamic scene measurements, achieving 10,000 Hz 3D imaging of a running turbofan engine prototype with only a 625 Hz camera. By overcoming the sensor hardware bottleneck, DFAMFPP significantly advances high-speed and ultra-high-speed 3D imaging, opening new avenues for exploring dynamic processes across diverse scientific disciplines.
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_1
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_2
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_3
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_4
  • Cavity-assisted nonlocal metasurfaces for momentum-space broadband-operational optical vortice generation with maximum efficiency approaching 80%
  • Keren Wang, Kaili Sun, Jing Du, Peijuan Dai, Hao Zhou, Lujun Huang, Zhanghua Han, Wei Wang
  • Opto-Electronic Advances
  • 2026-07-10
  • Instantaneous UAV tracking using single-photon LiDAR via photon-event-driven suppression of temporal-averaging bias
  • Dongfang Guo, Jianfeng Sun, Xin Zhou, Chen Shen, Sheng Chen, Sining Li, Yanchen Qu
  • Opto-Electronic Technology
  • 2026-06-28
  • Biological testing with terahertz focal-plane imaging based on a slot metamaterial sensor
  • Chen Zhang, Xinke Wang, Zehao He, Shuanglin Yue, Baogang Quan, Huan Zhao, Yan Zhang
  • Opto-Electronic Technology
  • 2026-06-28
  • Scattering media as random micro-phase-pinhole arrays for incoherent information transmission
  • Xuyu Zhang, Haoran Li, Tianting Zhong, Dawei Zhang, Songlin Zhuang, Shensheng Han, Puxiang Lai, Honglin Liu
  • Opto-Electronic Technology
  • 2026-06-28
  • Entropy-loaded digital subcarrier multiplexing transmission adaptive to the loss-spectrum ripples of hollow-core fiber
  • Hailin Yang, Meng Xiang, Cong Zhang, Lipeng Feng, Peng Li, Lei Zhang, Jie Luo, Jianping Li, Songnian Fu, Yuwen Qin
  • Opto-Electronic Technology
  • 2026-06-28
  • Integrated optical transceivers: architectures, key technologies, and applications
  • Peng Yan, Yunhao Zhang, Yuansheng Tao, Lei Wang, Haowen Shu, Xingjun Wang
  • Opto-Electronic Technology
  • 2026-06-28
  • AI-enabled electromagnetic metasurfaces for wireless communication and invisibility cloak
  • Fan Zhang, Jiwei Zhao, Huan Lu, Guixi Mei, Ruikai Hu, Bin Zheng, Hongsheng Chen
  • Opto-Electronic Technology
  • 2026-06-28
  • Breaking the speed-resolution trade-off in 3.3-km non-line-of-sight imaging using scanning-free laser reflective tomography
  • Zewei Wang, Xiaoyin Li, Yinghui Guo, Hengshuo Guo, Peng Yang, Fei Zhang, Mingbo Pu, Mingfeng Xu, Xiangang Luo
  • Opto-Electronic Science
  • 2026-06-17
  • Highly sensitive DUV-SWIR photodetectors by natural flavonoid-derivative isomers through a multisite chelation strategy
  • Nan Ding, Donggang Li, Mingyu Yao, Yanqi Liu, Hailong Liu, Guoqiang Fang, Ge Zhu, Xiaodong Li, Wen Xu, Bin Dong
  • Opto-Electronic Science
  • 2026-06-17
  • Triplet exciton harvesting via TADF in hafnium chlorides array scintillator screen enables ultrahigh-resolution X-ray imaging
  • Jun'an Lai, Yi Ye, Xu Liu, Sijun Cao, Shiji Zhou, Wenxia Zhang, Kang An, Peng He, Tingming Jiang, Xiaosheng Tang, Rui Zhou, Dong Zhang
  • Opto-Electronic Advances
  • 2026-06-08
  • Vacancy oscillating mode in amorphous binary oxide film by terahertz time domain spectroscopy
  • Huan Liu, Haiyun Huang, Heng Yu, Zhi Gong, Fei Yu, Zheng Zhang, Zhiyong Tan, Juncheng Cao, Haiyun Liu, Kan-Hao Xue, Xiangshui Miao, Yan Liu, Yue Hao, Genquan Han, Qihua Xiong
  • Opto-Electronic Advances
  • 2026-06-08



  • Flicker minimization in power-saving displays enabled by measurement of difference in flexoelectric coefficients and displacement-current in positive dielectric anisotropy liquid crystals                                High fiber-to-fiber net gain in erbium-doped thin film lithium niobate waveguide amplifier as an external gain chip
    About
    |
    Contact
    |
    Copyright © PubCard