Year
Month

(Peer-Reviewed) Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging
Wenwu Chen 陈文武 ¹ ³ ⁴, Yifan Liu 刘苡帆 ¹ ³ ⁴, Shijie Feng 冯世杰 ¹ ³ ⁴ ⁵, Wei Yin 尹维 ¹ ³ ⁴ ⁵, Jiaming Qian 钱佳铭 ¹ ³ ⁴ ⁵, Yixuan Li 李艺璇 ¹ ³ ⁴ ⁵, Hang Zhang 张航 ², Maciej Trusiak ⁶, Malgorzata Kujawinska ⁶, Qian Chen 陈钱 ⁴ ⁵, Chao Zuo 左超 ¹ ³ ⁴ ⁵
¹ Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
中国 南京 南京理工大学电子工程与光电技术学院 智能计算成像实验室
² Key Laboratory of Shock Wave Physics and Detonation Physics, Institute of Fluid Physics, China Academy of Engineering Physics, Mianyang 621900, China
中国 绵阳 中国工程物理研究院流体物理研究所 冲击波物理与爆轰物理全国重点实验室
³ Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, Nanjing 210019, China
中国 南京 南京理工大学智能计算成像研究院
⁴ Jiangsu Key Laboratory of Visual Sensing & Intelligent Perception, Nanjing 210094, China
中国 南京 江苏省光谱成像与智能感知重点实验室
⁵ State key Laboratory of Extreme Environment Optoelectronic Dynamic Measurement Technology and Instrument, Taiyuan 030051, China
中国 太原 极限环境光电动态测试技术与仪器全国重点实验室
⁶ Institute of Micromechanics and Photonics, Warsaw University of Technology, 8 Sw. A. Boboli St., Warsaw 02-525, Poland
Opto-Electronic Advances , 2025-09-25
Abstract

Recent advancements in artificial intelligence have transformed three-dimensional (3D) optical imaging and metrology, enabling high-resolution and high-precision 3D surface geometry measurements from one single fringe pattern projection. However, the imaging speed of conventional fringe projection profilometry (FPP) remains limited by the native sensor refresh rates due to the inherent "one-to-one" synchronization mechanism between pattern projection and image acquisition in standard structured light techniques.

Here, we present dual-frequency angular-multiplexed fringe projection profilometry (DFAMFPP), a deep learning-enabled 3D imaging technique that achieves high-speed, high-precision, and large-depth-range absolute 3D surface measurements at speeds 16 times faster than the sensor's native frame rate. By encoding multi-timeframe 3D information into a single multiplexed image using multiple pairs of dual-frequency fringes, high-accuracy absolute phase maps are reconstructed using specially trained two-stage number-theoretical-based deep neural networks.

We validate the effectiveness of DFAMFPP through dynamic scene measurements, achieving 10,000 Hz 3D imaging of a running turbofan engine prototype with only a 625 Hz camera. By overcoming the sensor hardware bottleneck, DFAMFPP significantly advances high-speed and ultra-high-speed 3D imaging, opening new avenues for exploring dynamic processes across diverse scientific disciplines.
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_1
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_2
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_3
Dual-frequency angular-multiplexed fringe projection profilometry with deep learning: breaking hardware limits for ultra-high-speed 3D imaging_4
  • High-speed and large-capacity visible light communication for 6G: advances and perspectives
  • Nan Chi, Zhilan Lu, Fujie Li, Haoyu Zhang, Yunkai Wang, Xinyi Liu, Zhiwu Chen, Zhe Feng, Zhuoran Hu, Zhixue He, Ziwei Li, Chao Shen, Junwen Zhang
  • Opto-Electronic Technology
  • 2026-03-20
  • Multi-dimensional photodetection: from material intrinsic properties and metasurface engineering to silicon photonic integration
  • Wenqi Liu, Zilan Tang, Qingzhao Hua, Liang Liu, Xiaoxia Wang, Anlian Pan
  • Opto-Electronic Technology
  • 2026-03-20
  • Holotomography-driven learning unlocks in-silico staining of single cells in flow cytometry by avoiding fluorescence co-registration
  • Daniele Pirone, Giusy Giugliano, Michela Schiavo, Annalaura Montella, Martina Mugnano, Vincenza Cerbone, Maddalena Raia, Giulia Scalia Ivana Kurelac, Diego Luis Medina, Lisa Miccio Mario Capasso, Achille Iolascon, Pasquale Memmolo, Pietro Ferraro
  • Opto-Electronic Science
  • 2026-02-25
  • Narrow beam and low-sidelobe electro-optic beam steering on thin-film lithium niobate optical phased array
  • Yang Li, Shiyao Deng, Xiao Ma, Ziliang Fang, Shufeng Li Weikang Xu, Fangheng Fu, Xu Ouyang, Yuming Wei, Tiefeng Yang Heyuan Guan, Huihui Lu
  • Opto-Electronic Science
  • 2026-02-25
  • Scene-level passive polarization 3D imaging
  • Xin Wang, Pingli Han, Xiyuan Luo, Qianqian Liu, Tong Zhang, Xue Dong, Meng Xiang, Jinpeng Liu, Yanyan Liu, Fei Liu
  • Opto-Electronic Advances
  • 2026-02-12
  • Modelling-guided inverse design strategy for semitransparent perovskite photovoltaics with customized colors
  • Seok-Beom Seo, Rira Kang, Eun-Joo Lee, So-Yeon Ju, Min Jae Lee, Byunghong Lee, Sun-Kyung Kim
  • Opto-Electronic Advances
  • 2026-02-12
  • A hybrid integrated high-precision tunable semiconductor laser
  • Yiran Zhu, Botao Fu, Zhiwei Fang, Qiyue Hu, Jianping Yu, Yunpeng Song, Yu Ma, Min Wang, Kunpeng Jia, Zhenda Xie, Ya Cheng
  • Opto-Electronic Advances
  • 2026-02-12
  • Soft chiral superstructure enabled dynamic polychromatic holography
  • Chun-Ting Xu, Lu Li, Quan-Ming Chen, Guang-Yao Wang, Wei Hu
  • Opto-Electronic Advances
  • 2026-02-12
  • Millisecond-level electrically switchable metalens for adaptive rotational depth mapping and diffraction-limited imaging
  • Yeseul Kim, Jihae Lee, Won-Sik Kim, Hyeonsu Heo, Dongmin Jeon, Beomha Yang, Xiaotong Li, Harit Keawmuang, Shiqi Hu, Young-Ki Kim, Trevon Badloe, Junsuk Rho
  • Opto-Electronic Advances
  • 2026-02-12
  • Ambient-energy-driven space-time-coding metasurface for space-frequency-division multiplexing wireless communications
  • Han Wei Tian, Chao Song, Dong Jie Wang, Qian Zhu, Tie Jun Cui, Wei Xiang Jiang
  • Opto-Electronic Advances
  • 2026-02-12
  • Ultra-sensitive multi-band infrared polarization photodetector based on 1T'-MoTe₂/2H-MoTe₂ van der Waals heterostructure
  • Yuting Pan, Lidan Lu, Bofei Zhu, Chunhua An, Jing Yu, Guanghui Ren, Jian Zhen Ou, Mingli Dong, Zheng You, Lianqing Zhu
  • Opto-Electronic Advances
  • 2026-02-09
  • Tunable compound eyes with coaxial lens-on-lens ommatidia for cooperative bi-focal imaging
  • Zhi-Juan Sun, Wei-Jian Zhong, Qing Cai, Yi-Fan Lu, Chang-Xu Li, Dong-Dong Han, Yong-Lai Zhang
  • Opto-Electronic Advances
  • 2026-02-09



  • Flicker minimization in power-saving displays enabled by measurement of difference in flexoelectric coefficients and displacement-current in positive dielectric anisotropy liquid crystals        High fiber-to-fiber net gain in erbium-doped thin film lithium niobate waveguide amplifier as an external gain chip
    About
    |
    Contact
    |
    Copyright © PubCard