Year
Month
(Preprint) Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain
Guangyao Chen 陈光耀 ¹, Peixi Peng 彭佩玺 ¹ ³, Li Ma 马力 ¹ ³, Jia Li 李甲 ² ³, Lin Du ⁴, Yonghong Tian 田永鸿 ¹ ³
¹ Department of Computer Science and Technology, Peking University
北京大学计算机科学技术系
² State Key Laboratory of Virtual Reality Technology and Systems, SCSE, Beihang University
北京航空航天大学 虚拟现实技术与系统国家重点实验室
³ Peng Cheng Laborotory
鹏城实验室
⁴ AI Application Research Center, Huawei
华为AI应用研究中心
arXiv, 2021-08-19
Abstract

Recently, the generalization behavior of Convolutional Neural Networks (CNN) is gradually transparent through explanation techniques with the frequency components decomposition. However, the importance of the phase spectrum of the image for a robust vision system is still ignored. In this paper, we notice that the CNN tends to converge at the local optimum which is closely related to the high-frequency components of the training images, while the amplitude spectrum is easily disturbed such as noises or common corruptions.

In contrast, more empirical studies found that humans rely on more phase components to achieve robust recognition. This observation leads to more explanations of the CNN's generalization behaviors in both robustness to common perturbations and out-of-distribution detection, and motivates a new perspective on data augmentation designed by re-combing the phase spectrum of the current image and the amplitude spectrum of the distracter image. That is, the generated samples force the CNN to pay more attention to the structured information from phase components and keep robust to the variation of the amplitude.

Experiments on several image datasets indicate that the proposed method achieves state-of-the-art performances on multiple generalizations and calibration tasks, including adaptability for common corruptions and surface variations, out-of-distribution detection, and adversarial attack.
Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain_1
Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain_2
Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain_3
Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain_4
  • Power grid fault diagnosis based on a deep pyramid convolutional neural network
  • Xu Zhang 张旭, Huiting Zhang, Dongying Zhang, Yixian Wang, Ruiting Ding, Yuchuan Zheng, Yongxu Zhang
  • CSEE Journal of Power and Energy Systems
  • 2022-05-06
  • China's factor reallocation effect considering energy
  • Guangqing Xu, Xiaoyu Chen
  • Chinese Journal of Population, Resources and Environment
  • 2022-05-02
  • Cannabidiol prevents depressive-like behaviors through the modulation of neural stem cell differentiation
  • Ming Hou, Suji Wang, Dandan Yu, Xinyi Lu, Xiansen Zhao, Zhangpeng Chen, Chao Yan
  • Frontiers of Medicine
  • 2022-04-26
  • Cultivation of gut microorganisms of the marine ascidian Halocynthia roretzi reveals their potential roles in the environmental adaptation of their host
  • Yang Yang, Yuting Zhu, Haiming Liu, Jiankai Wei, Haiyan Yu, Bo Dong
  • Marine Life Science & Technology
  • 2022-04-26
  • Data network traffic analysis and optimization strategy of real-time power grid dynamic monitoring system for wide-frequency measurements
  • Jinsong Li, Hao Liu, Wenzhuo Li, Tianshu Bi, Mingyang Zhao
  • Global Energy Interconnection
  • 2022-04-25
  • Field distribution of the Z₂ topological edge state revealed by cathodoluminescence nanoscopy
  • Xiao He, Donglin Liu, Hongfei Wang, Liheng Zheng, Bo Xu, Biye Xie, Meiling Jiang, Zhixin Liu, Jin Zhang, Minghui Lu, Zheyu Fang
  • Opto-Electronic Advances
  • 2022-04-25
  • Advances in femtosecond laser direct writing of fiber Bragg gratings in multicore fibers: technology, sensor and laser applications
  • Alexey Wolf, Alexander Dostovalov, Kirill Bronnikov, Mikhail Skvortsov, Stefan Wabnitz, Sergey Babin
  • Opto-Electronic Advances
  • 2022-04-25
  • Graphene-empowered dynamic metasurfaces and metadevices
  • Chao Zeng, Hua Lu, Dong Mao, Yueqing Du, He Hua, Wei Zhao, Jianlin Zhao
  • Opto-Electronic Advances
  • 2022-04-25
  • Charge carrier dynamics in different crystal phases of CH₃NH₃PbI₃ perovskite
  • Efthymis Serpetzoglou, Ioannis Konidakis, George Kourmoulakis, Ioanna Demeridou, Konstantinos Chatzimanolis, Christos Zervos, George Kioseoglou, Emmanuel Kymakis, Emmanuel Stratakis
  • Opto-Electronic Science
  • 2022-04-21
  • Applications of optically and electrically driven nanoscale bowtie antennas
  • Zhongjun Jiang, Yingjian Liu, Liang Wang
  • Opto-Electronic Science
  • 2022-04-20
  • Validation of the bodily expressive action stimulus test among Chinese adults and children
  • Yunmei Yang, Wenwen Hou, Jing Li
  • PsyCh Journal
  • 2022-04-17



  • Blind Estimation of Sparse Simo Channels: Quadratic Vs. Linear Constraints                                A Non-Stationary Channel Model with Correlated NLoS/LoS States for ELAA-mMIMO
    About
    |
    Contact
    |
    Copyright © PubCard