Year
Month
(Peer-Reviewed) Physics-informed deep learning for fringe pattern analysis
Wei Yin 尹维 ¹ ² ³, Yuxuan Che 车宇轩 ¹ ² ³, Xinsheng Li 李鑫胜 ¹ ² ³, Mingyu Li 李明雨 ¹ ² ³, Yan Hu 胡岩 ¹ ² ³, Shijie Feng 冯世杰 ¹ ² ³, Edmund Y. Lam 林彥民 ⁴, Qian Chen 陈钱 ³, Chao Zuo 左超 ¹ ² ³
¹ Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
中国 南京 南京理工大学光电信息科学与工程学院 智能计算成像实验室
² Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, Nanjing 210019, China
中国 南京 南京理工大学智能计算成像研究院
³ Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing 210094, China
中国 南京 江苏省光谱成像与智能感知重点实验室
⁴ Department of Electrical and Electronic Engineering, The University of Hong Kong, Pokfulam, Hong Kong SAR 999077, China
中国 香港 薄扶林 香港大学电气电子工程系
Opto-Electronic Advances, 2024-01-25
Abstract

Recently, deep learning has yielded transformative success across optics and photonics, especially in optical metrology. Deep neural networks (DNNs) with a fully convolutional architecture (e.g., U-Net and its derivatives) have been widely implemented in an end-to-end manner to accomplish various optical metrology tasks, such as fringe denoising, phase unwrapping, and fringe analysis.

However, the task of training a DNN to accurately identify an image-to-image transform from massive input and output data pairs seems at best naïve, as the physical laws governing the image formation or other domain expertise pertaining to the measurement have not yet been fully exploited in current deep learning practice.

To this end, we introduce a physics-informed deep learning method for fringe pattern analysis (PI-FPA) to overcome this limit by integrating a lightweight DNN with a learning-enhanced Fourier transform profilometry (LeFTP) module. By parameterizing conventional phase retrieval methods, the LeFTP module embeds the prior knowledge in the network structure and the loss function to directly provide reliable phase results for new types of samples, while circumventing the requirement of collecting a large amount of high-quality data in supervised learning methods. Guided by the initial phase from LeFTP, the phase recovery ability of the lightweight DNN is enhanced to further improve the phase accuracy at a low computational cost compared with existing end-to-end networks. Experimental results demonstrate that PI-FPA enables more accurate and computationally efficient single-shot phase retrieval, exhibiting its excellent generalization to various unseen objects during training.

The proposed PI-FPA presents that challenging issues in optical metrology can be potentially overcome through the synergy of physics-priors-based traditional tools and data-driven learning approaches, opening new avenues to achieve fast and accurate single-shot 3D imaging.
Physics-informed deep learning for fringe pattern analysis_1
Physics-informed deep learning for fringe pattern analysis_2
Physics-informed deep learning for fringe pattern analysis_3
Physics-informed deep learning for fringe pattern analysis_4
  • Pixel-controlled programmable metasurface as phase-type spatial terahertz modulator
  • Guibin Li, Guanyi Li, Zehao He, Xinke Wang, Peter J. Klar, He Ma, Yan Zhang
  • Opto-Electronic Advances
  • 2026-09-15
  • Spatiotemporal beam stirring in a multicore fiber
  • Alena Y. Kolesnikova, Mikhail D. Gervaziev, Nikita V. Bochkarev, Denis S. Kharenko, Evgeniy V. Podivilov, Sergey A. Babin
  • Opto-Electronic Advances
  • 2026-09-15
  • Ultrafast all-optical modulation of wide-bandwidth pulses enabled by silicon-metasurfaces
  • Kaloyan Georgiev, Khosro Zangeneh Kamali, Anton A. Trifonov, Giulia Crotti, Lyuben Petrov, Stefan Georgiev, Hristo Iliev, Lei Xu, Unai Arregui Leon, Mohsen Rahmani, Giuseppe Della Valle, Ivan Buchvarov, Dragomir Neshev
  • Opto-Electronic Advances
  • 2026-09-15
  • Physics-informed neural fields enable blind aberration correction for partially coherent quantitative phase imaging
  • Shun Zhou, Xingyu Huang, Linpeng Lu, Habib Ullah, Kaiyu Du, Maciej Trusiak, Malgorzata Kujawinska, Yuzhen Zhang, Yao Fan, Qian Chen, Qinrong Zhang, Chao Zuo
  • Opto-Electronic Science
  • 2026-08-26
  • Programmable directional photonic spiking neuron based on a non-Hermitian silicon microresonator
  • Stefano Biasi, Bülent Aslan, Stefano Gretter, Davide Olivieri, Alessandro Foradori, Riccardo Franchi, Lorenzo Pavesi
  • Opto-Electronic Science
  • 2026-08-26
  • Mutual empowerment of artificial intelligence and metasurfaces: intelligent nanophotonics and optical intelligence
  • Yu Zhao, Zile Li, Yongquan Zeng, Shaohua Yu, Guoxing Zheng
  • Opto-Electronic Science
  • 2026-08-26
  • Heterogeneously integrated micro-ring with SnS₂ for dual-functional optical modulation and photodetection
  • Jinyi Du, Lidan Lu, Xu Zhang, Bofei Zhu, Wenbo Bo, Yingjie Xu, Guang Chen, Yanlin He, Guanghui Ren, Xiaoping Lou, Zheng You, Lianqing Zhu
  • Opto-Electronic Advances
  • 2026-08-25
  • Hardware-aware lightweight photonic spiking neural network for pattern classification
  • Shuiying Xiang, Yahui Zhang, Shangxuan Shi, Haowen Zhao, Dianzhuang Zheng, Xingxing Guo, Yanan Han, Ye Tian, Liyue Zhang, Yuechun Shi, Yue Hao
  • Opto-Electronic Advances
  • 2026-08-25
  • PhyspeNet: An empirical physics-aware network for adaptive speckle reconstructive spectrometry
  • Junrui Liang, Min Jiang, Jun Li, Zhongming Huang, Junhong He, Yanting Guo, Yanzhao Ke, Jun Ye, Jiangming Xu, Jinyong Leng, Pu Zhou
  • Opto-Electronic Advances
  • 2026-08-25
  • Video-rate wavefront capture and replay via single-shot reference-free measurement: toward holographic telepresence
  • Minwook Kim, Chansuk Park, Chulmin Oh, KyeoReh Lee, Herve Hugonnet, YongKeun Park
  • Opto-Electronic Advances
  • 2026-08-25
  • Luminescent YAG:Ce³⁺ 3D micro-structures via multi-photon laser lithography
  • Robertas Virkėtis, Greta Merkininkaitė, Artūr Harnik, Ugnė Ūsaitė, Dominykas Dapšys, Arturo Susarrey-Arce, Simas Šakirzanovas, Mangirdas Malinauskas
  • Opto-Electronic Advances
  • 2026-08-25
  • A 36 × 240 Gbps hybrid mode/wavelength division multiplexing transmitter using lithium niobate on insulator
  • Mingyu Zhu, Weihan Wang, Ruitao Ma, Aoyun Gao, Chun Gao, Zexu Wang, Fei Huang, Zhenyuan Bao, Dajian Liu, Jiaxuan Gan, Zejie Yu, Huan Li, Weike Zhao, Daoxin Dai
  • Opto-Electronic Advances
  • 2026-08-25



  • Multi-dimensional multiplexing optical secret sharing framework with cascaded liquid crystal holograms                                Smart palm-size optofluidic hematology analyzer for automated imaging-based leukocyte concentration detection
    About
    |
    Contact
    |
    Copyright © PubCard