(Peer-Reviewed) DRVI: Dual Refinement for Video Interpolation
Xuanyi Wu ¹, Zhenkun Zhou 周振坤 ², Anup Basu ¹
¹ Department of Computing Science, University of Alberta, Edmonton, AB T6G 2R3, Canada
² Huawei Fields Laboratory, Hangzhou, Zhejiang 310000, China
IEEE Access, 2021-08-13
Abstract
The quality of a video clip is considered to be poor if the resolution or the frame rate is low. Video interpolation is thus introduced to enhance video quality and provide a better viewing experience to users. However, there are still some challenges, like the blur caused by motion changes.
In this paper, we introduce a dual refinement technique for video interpolation (DRVI). It has three main steps, namely flow refinement, frame synthesis, and Haar refinement. The flow refinement can generate accurate bi-directional flows, which are more suitable for frame interpolation tasks. The Haar refinement uses the Discrete Wavelet Transform (DWT). It can preserve information in different frequency domains and also speed up the learning process. We also add an arbitrary time approximation module to allow multi-frame generation.
The number of learnable parameters in our model is much less than existing methods; still, it has excellent performance. Our method is trained on Vimeo90K (Xue et al. , 2019) and tested on three well-known datasets to demonstrate its effectiveness.
Multiplexed stimulated emission depletion nanoscopy (mSTED) for 5-color live-cell long-term imaging of organelle interactome
Yuran Huang, Zhimin Zhang, Wenli Tao, Yunfei Wei, Liang Xu, Wenwen Gong, Jiaqiang Zhou, Liangcai Cao, Yong Liu, Yubing Han, Cuifang Kuang, Xu Liu
Opto-Electronic Advances
2024-07-05
Photonics-assisted THz wireless communication enabled by wide-bandwidth packaged back-illuminated modified uni-traveling-carrier photodiode
Yuxin Tian, Boyu Dong, Yaxuan Li, Bing Xiong, Junwen Zhang, Changzheng Sun, Zhibiao Hao, Jian Wang, Lai Wang, Yanjun Han, Hongtao Li, Lin Gan, Nan Chi, Yi Luo
Opto-Electronic Science
2024-07-01
NIR-triggered on-site NO/ROS/RNS nanoreactor: Cascade-amplified photodynamic/photothermal therapy with local and systemic immune responses activation
Ziqing Xu, Yakun Kang, Jie Zhang, Jiajia Tang, Hanyao Sun, Yang Li, Doudou He, Xuan Sha, Yuxia Tang, Ziyi Fu, Feiyun Wu, Shouju Wang
Opto-Electronic Advances
2024-06-05