(Peer-Reviewed) Light-perception-based interactive control of an underwater digital twin hand
Jinlong Lu 陆进龙 ¹ ², Chao Zhang 张超 ¹ ³, Hengchang Nong 农恒昌 ¹ ², Dongying Wang 王冬迎 ⁴, Hongyu Zhou 周泓宇 ¹ ⁵, Junjie Weng 翁俊杰 ⁶, Yuehua Deng 邓越华 ¹ ⁷, Yang Yu 于洋 ¹, Qiang Bian 卞强 ⁴, Jianfa Zhang 张检发 ⁸, Chaofan Zhang 张超凡 ⁹, Zhenrong Zhang 张振荣 ², Junbo Yang 杨俊波 ¹
¹ College of Science, National University of Defense Technology, Changsha 410073, China
中国 长沙 国防科技大学理学院
² Key Laboratory of Multimedia Communication and Network Technology in Guangxi, School of Computer, Electronics and Information, Guangxi University, Nanning 530004, China
中国 南宁 广西大学计算机与电子信息学院 广西多媒体通信与网络技术重点实验室
³ School of Automation, Central South University, Changsha 410075, China
中国 长沙 中南大学自动化学院
⁴ College of Meteorology and Oceanography, National University of Defense Technology, Changsha 410073, China
中国 长沙 国防科技大学气象海洋学院
⁵ School of Optical and Electronic Information, National Engineering Research Center of Next Generation Internet Access-system, Huazhong University of Science and Technology, Wuhan 430074, China
中国 武汉 华中科技大学光学与电子信息学院 下一代互联网接入系统国家工程研究中心
⁶ College of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, China
中国 长沙 国防科技大学智能科学学院
⁷ School of Physics, Central South University, Changsha 410083, China
中国 长沙 中南大学物理学院
⁸ Hunan Provincial Key Laboratory of Novel Nano-Optoelectronic, Information Materials and Devices, National University of Defense Technology, Changsha 410073, China
中国 长沙 国防科技大学新型纳米光电信息材料与器件湖南省重点实验室
⁹ College of Advanced Interdisciplinary Studies, National University of Defense Technology, Changsha 410073, China
中国 长沙 国防科技大学 前沿交叉学科学院
Opto-Electronic Advances, 2026-07-10
Abstract
With increasing demand for ocean exploration, underwater tasks become more complex. While soft robotic hands offer superior flexibility and biomimetic advantages over rigid robotic hands, their development has been hindered by low sensing accuracy and poor interactive control. Here, we propose a light-perception-based underwater digital twin hand interactive control system that integrates a multi-degree-of-freedom biomimetic pneumatic soft robotic hand with a wearable data glove based on fiber Bragg grating (FBG) sensors.
By fusing data from FBGs, RGB cameras, and inertial measurement units, and optimizing control strategies through reinforcement learning, we established a light-dominated perception-control-feedback closed-loop system that significantly enhances the control performance of the system in complex and dynamic underwater environments. With light as the information carrier, the system integrates a data glove with high strain sensitivity (1.148 pm/µε, linearity = 0.9996) and high bending sensitivity (26.667 pm/°, linearity = 0.9791). It achieves four-dimensional collaborative interactive control between the human operator, machine, virtual space, and environment.
The system achieves posture monitoring and precise grasping in various underwater environments, offering advantages like low cost, high precision, rapid response, and strong interference resistance. This establishes a new paradigm for underwater intelligent equipment by integrating light sensing with digital twin technology, offering broad prospects for future underwater operations.
A flexible wireless system for prospective photodynamic therapy applications
Rolan Mansour, Bhavani Yalagala, Vikas Vikas, Nikolas Bruce, Fawziye Tarhini, Georgios N. Arvanitakis, Mohammed Mughal, Jamie Blanche, Ahmad Taha, Jonathan Copper, Muhammad Imran, Karin Williams, Karin Oien, Mahmoud Wagih, Hadi Heidari, Robert Hadfield, David Flynn
Opto-Electronic Advances
2026-07-10
Parallel bright-field and multi-order edge imaging via wide field-of-view trichannel metalens
Xiaotong Li, Yeseul Kim, Youngsun Jeon, Junhwa Seong, Jaekyung Kim, Peng Tang, Shiqi Hu, Harit Keawmuang, Beomha Yang, Dongmin Jeon, Le Dai, Weiyan Li, Xiaodong Cai, Jinhui Shi, Yong-Sang Ryu, Trevon Badloe, Junsuk Rho
Opto-Electronic Advances
2026-07-10
