Year
Month
(Preprint) Boosting the Generalization Capability in Cross-Domain Few-shot Learning via Noise-enhanced Supervised Autoencoder
Hanwen Liang ¹, Qiong Zhang 张琼 ², Peng Dai ¹, Juwei Lu ¹
¹ Huawei Noah’s Ark Lab, Canada
加拿大 华为诺亚方舟实验室
² Department of Statistics, University of British Columbia, Vancouver, Canada
arXiv, 2021-08-11
Abstract

State of the art (SOTA) few-shot learning (FSL) methods suffer significant performance drop in the presence of domain differences between source and target datasets. The strong discrimination ability on the source dataset does not necessarily translate to high classification accuracy on the target dataset.

In this work, we address this cross-domain few-shot learning (CDFSL) problem by boosting the generalization capability of the model. Specifically, we teach the model to capture broader variations of the feature distributions with a novel noise-enhanced supervised autoencoder (NSAE).

NSAE trains the model by jointly reconstructing inputs and predicting the labels of inputs as well as their reconstructed pairs. Theoretical analysis based on intra-class correlation (ICC) shows that the feature embeddings learned from NSAE have stronger discrimination and generalization abilities in the target domain. We also take advantage of NSAE structure and propose a two-step fine-tuning procedure that achieves better adaption and improves classification performance in the target domain.

Extensive experiments and ablation studies are conducted to demonstrate the effectiveness of the proposed method. Experimental results show that our proposed method consistently outperforms SOTA methods under various conditions.
Boosting the Generalization Capability in Cross-Domain Few-shot Learning via Noise-enhanced Supervised Autoencoder_1
Boosting the Generalization Capability in Cross-Domain Few-shot Learning via Noise-enhanced Supervised Autoencoder_2
Boosting the Generalization Capability in Cross-Domain Few-shot Learning via Noise-enhanced Supervised Autoencoder_3
Boosting the Generalization Capability in Cross-Domain Few-shot Learning via Noise-enhanced Supervised Autoencoder_4
  • Dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates
  • Yuncheng Liu, Ke Xu, Xuhao Fan, Xinger Wang, Xuan Yu, Wei Xiong, Hui Gao
  • Opto-Electronic Advances
  • 2024-01-25
  • Multi-dimensional multiplexing optical secret sharing framework with cascaded liquid crystal holograms
  • Keyao Li, Yiming Wang, Dapu Pi, Baoli Li, Haitao Luan, Xinyuan Fang, Peng Chen, Yanqing Lu, Min Gu
  • Opto-Electronic Advances
  • 2024-01-25
  • Physics-informed deep learning for fringe pattern analysis
  • Wei Yin, Yuxuan Che, Xinsheng Li, Mingyu Li, Yan Hu, Shijie Feng, Edmund Y. Lam, Qian Chen, Chao Zuo
  • Opto-Electronic Advances
  • 2024-01-25
  • Advancing computer-generated holographic display thanks to diffraction model-driven deep nets
  • Vittorio Bianco, Pietro Ferraro
  • Opto-Electronic Advances
  • 2024-01-16
  • Inverse design for material anisotropy and its application for a compact X-cut TFLN on-chip wavelength demultiplexer
  • Jiangbo Lyu, Tao Zhu, Yan Zhou, Zhenmin Chen, Yazhi Pi, Zhengtong Liu, Xiaochuan Xu, Ke Xu, Xu Ma, Lei Wang, Zizheng Cao, Shaohua Yu
  • Opto-Electronic Science
  • 2024-01-09
  • Improved spatiotemporal resolution of anti-scattering super-resolution label-free microscopy via synthetic wave 3D metalens imaging
  • Yuting Xiao, Lianwei Chen, Mingbo Pu, Mingfeng Xu, Qi Zhang, Yinghui Guo, Tianqu Chen, Xiangang Luo
  • Opto-Electronic Science
  • 2024-01-05
  • Wide-spectrum optical synthetic aperture imaging via spatial intensity interferometry
  • Chunyan Chu, Zhentao Liu, Mingliang Chen, Xuehui Shao, Guohai Situ, Yuejin Zhao, Shensheng Han
  • Opto-Electronic Advances
  • 2023-3-10
  • Flat soliton microcomb source
  • Xinyu Wang, Xuke Qiu, Mulong Liu, Feng Liu, Mengmeng Li, Linpei Xue, Bohan Chen, Mingran Zhang, Peng Xie
  • Opto-Electronic Science
  • 2023-12-29
  • Smart palm-size optofluidic hematology analyzer for automated imaging-based leukocyte concentration detection
  • Deer Su, Xiangyu Li, Weida Gao, Qiuhua Wei, Haoyu Li, Changliang Guo, Weisong Zhao
  • Opto-Electronic Science
  • 2023-12-28
  • Exceptional-point-enhanced sensing in an all-fiber bending sensor
  • Zheng Li, Jingxu Chen, Lingzhi Li, Jiejun Zhang, Jianping Yao
  • Opto-Electronic Advances
  • 2023-12-12
  • All-optical object identification and three-dimensional reconstruction based on optical computing metasurface
  • Dingyu Xu, Wenhao Xu, Qiang Yang, Wenshuai Zhang, Shuangchun Wen, Hailu Luo,
  • Opto-Electronic Advances
  • 2023-12-12



  • Retrieval & Interaction Machine for Tabular Data Prediction                                All-climate aqueous Na-ion batteries using “Water-in-Salt” electrolyte
    About
    |
    Contact
    |
    Copyright © PubCard