Year
Month
(Peer-Reviewed) Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging
Wenwu Chen 陈文武 ¹ ³ ⁴, Yifan Liu 刘苡帆 ¹ ³ ⁴, Shijie Feng 冯世杰 ¹ ³ ⁴ ⁵, Wei Yin 尹维 ¹ ³ ⁴ ⁵, Jiaming Qian 钱佳铭 ¹ ³ ⁴ ⁵, Yixuan Li 李艺璇 ¹ ³ ⁴ ⁵, Hang Zhang 张航 ², Maciej Trusiak ⁶, Malgorzata Kujawinska ⁶, Qian Chen 陈钱 ⁴ ⁵, Chao Zuo 左超 ¹ ³ ⁴ ⁵
¹ Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
中国 南京 南京理工大学电子工程与光电技术学院 智能计算成像实验室
² Key Laboratory of Shock Wave Physics and Detonation Physics, Institute of Fluid Physics, China Academy of Engineering Physics, Mianyang 621900, China
中国 绵阳 中国工程物理研究院流体物理研究所 冲击波物理与爆轰物理全国重点实验室
³ Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, Nanjing 210019, China
中国 南京 南京理工大学智能计算成像研究院
⁴ Jiangsu Key Laboratory of Visual Sensing & Intelligent Perception, Nanjing 210094, China
中国 南京 江苏省光谱成像与智能感知重点实验室
⁵ State key Laboratory of Extreme Environment Optoelectronic Dynamic Measurement Technology and Instrument, Taiyuan 030051, China
中国 太原 极限环境光电动态测试技术与仪器全国重点实验室
⁶ Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., Warsaw 02-525, Poland
Opto-Electronic Advances, 2025-09-25
Abstract

Recent advancements in artificial intelligence have transformed three-dimensional (3D) optical imaging and metrology, enabling high-resolution and high-precision 3D surface geometry measurements from one single fringe pattern projection. However, the imaging speed of conventional fringe projection profilometry (FPP) remains limited by the native sensor refresh rates due to the inherent "one-to-one" synchronization mechanism between pattern projection and image acquisition in standard structured light techniques.

Here, we present dual-frequency angular-multiplexed fringe projection profilometry (DFAMFPP), a deep learning-enabled 3D imaging technique that achieves high-speed, high-precision, and large-depth-range absolute 3D surface measurements at speeds 16 times faster than the sensor's native frame rate. By encoding multi-timeframe 3D information into a single multiplexed image using multiple pairs of dual-frequency fringes, high-accuracy absolute phase maps are reconstructed using specially trained two-stage number-theoretical-based deep neural networks.

We validate the effectiveness of DFAMFPP through dynamic scene measurements, achieving 10,000 Hz 3D imaging of a running turbofan engine prototype with only a 625 Hz camera. By overcoming the sensor hardware bottleneck, DFAMFPP significantly advances high-speed and ultra-high-speed 3D imaging, opening new avenues for exploring dynamic processes across diverse scientific disciplines.
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_1
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_2
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_3
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_4
  • Programmable directional photonic spiking neuron based on a non-Hermitian silicon microresonator
  • Stefano Biasi, Bülent Aslan, Stefano Gretter, Davide Olivieri, Alessandro Foradori, Riccardo Franchi, Lorenzo Pavesi
  • Opto-Electronic Science
  • 2026-08-26
  • Mutual empowerment of artificial intelligence and metasurfaces: intelligent nanophotonics and optical intelligence
  • Yu Zhao, Zile Li, Yongquan Zeng, Shaohua Yu, Guoxing Zheng
  • Opto-Electronic Science
  • 2026-08-26
  • Heterogeneously integrated micro-ring with SnS₂ for dual-functional optical modulation and photodetection
  • Jinyi Du, Lidan Lu, Xu Zhang, Bofei Zhu, Wenbo Bo, Yingjie Xu, Guang Chen, Yanlin He, Guanghui Ren, Xiaoping Lou, Zheng You, Lianqing Zhu
  • Opto-Electronic Advances
  • 2026-08-25
  • Hardware-aware lightweight photonic spiking neural network for pattern classification
  • Shuiying Xiang, Yahui Zhang, Shangxuan Shi, Haowen Zhao, Dianzhuang Zheng, Xingxing Guo, Yanan Han, Ye Tian, Liyue Zhang, Yuechun Shi, Yue Hao
  • Opto-Electronic Advances
  • 2026-08-25
  • PhyspeNet: An empirical physics-aware network for adaptive speckle reconstructive spectrometry
  • Junrui Liang, Min Jiang, Jun Li, Zhongming Huang, Junhong He, Yanting Guo, Yanzhao Ke, Jun Ye, Jiangming Xu, Jinyong Leng, Pu Zhou
  • Opto-Electronic Advances
  • 2026-08-25
  • Video-rate wavefront capture and replay via single-shot reference-free measurement: toward holographic telepresence
  • Minwook Kim, Chansuk Park, Chulmin Oh, KyeoReh Lee, Herve Hugonnet, YongKeun Park
  • Opto-Electronic Advances
  • 2026-08-25
  • Luminescent YAG:Ce³⁺ 3D micro-structures via multi-photon laser lithography
  • Robertas Virkėtis, Greta Merkininkaitė, Artūr Harnik, Ugnė Ūsaitė, Dominykas Dapšys, Arturo Susarrey-Arce, Simas Šakirzanovas, Mangirdas Malinauskas
  • Opto-Electronic Advances
  • 2026-08-25
  • A 36 × 240 Gbps hybrid mode/wavelength division multiplexing transmitter using lithium niobate on insulator
  • Mingyu Zhu, Weihan Wang, Ruitao Ma, Aoyun Gao, Chun Gao, Zexu Wang, Fei Huang, Zhenyuan Bao, Dajian Liu, Jiaxuan Gan, Zejie Yu, Huan Li, Weike Zhao, Daoxin Dai
  • Opto-Electronic Advances
  • 2026-08-25
  • Scalable spatiotemporal interleaving network for high-density integrated photonic convolution
  • Hudi Liu, Jingchi Li, Hua Zhong, Yu He, Yikai Su
  • Opto-Electronic Science
  • 2026-07-24
  • From non-resonant to resonant meta-devices: imaging, color routing, displaying, and beyond
  • Weihan Liu, Yao Liang, Borui Leng, Shufan Chen, Peng-Yi Feng, Din Ping Tsai
  • Opto-Electronic Science
  • 2026-07-24
  • Light-perception-based interactive control of an underwater digital twin hand
  • Jinlong Lu, Chao Zhang, Hengchang Nong, Dongying Wang, Hongyu Zhou, Junjie Weng, Yuehua Deng, Yang Yu, Qiang Bian, Jianfa Zhang, Chaofan Zhang, Zhenrong Zhang, Junbo Yang
  • Opto-Electronic Advances
  • 2026-07-10
  • Digital twin optical computing system
  • Run Sun, Yuemin Li, Tingzhao Fu, Wencan Liu, Sigang Yang, Hongwei Chen
  • Opto-Electronic Advances
  • 2026-07-10



  • Flicker minimization in power-saving displays enabled by measurement of difference in flexoelectric coefficients and displacement-current in positive dielectric anisotropy liquid crystals                                High fiber-to-fiber net gain in erbium-doped thin film lithium niobate waveguide amplifier as an external gain chip
    About
    |
    Contact
    |
    Copyright © PubCard