Year
Month
(Conference Paper) A Proactive Failure Tolerant Mechanism for SSDs Storage Systems based on Unsupervised Learning
Hao Zhou 周浩 ¹, Zhiheng Niu ², Gang Wang 王刚 ², XiaoGuang Liu 刘晓光 ², Dongshi Liu ³, Bingnan Kang ³, Hu Zheng ³, Yong Zhang ³
¹ College of Cyber Science TJ Key Lab of NDST, Nankai University, Tianjin, China
中国 天津 南开大学网络空间安全学院 天津市网络与数据安全技术重点实验室
² College of Computer Science TJ Key Lab of NDST, Nankai University, Tianjin, China
中国 天津 南开大学计算机学院 天津市网络与数据安全技术重点实验室
³ Huawei
华为
2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS), 2021-08-26
Abstract

As a proactive failure tolerant mechanism in large scale cloud storage systems, drive failure prediction can be used to protect data by early warning before real failures of drives, and therefore improve system dependability and cloud storage service quality. At present, solid state drives (SSDs) are generally widely used in cloud storage systems due to their high performance. SSD failures seriously affect the dependability of the system and the quality of service. Existing proactive failure tolerant mechanisms for storage systems are basically aimed at HDD failure detection and use classification technology (Supervised learning), which relies on enough failure data to establish a classification model.

However, the low failure rate of SSDs leads to a serious imbalance in the ratio of positive and negative samples, which brings a big challenge for establishing a proactive failure tolerance mechanism for SSDs storage systems by using classification technology.In this paper, we propose a proactive failure tolerance mechanism for SSDs storage systems based on unsupervised technology. It only uses data of normal SSDs to train the failure prediction model, which means that our method is not limited by the imbalance in SSDs data.

At the core of our method is the idea to use VAE-LSTM to learn the pattern of normal SSDs, in which case faulty SSDs can be alerted when their patterns are very different from normal ones. Our method can provide early warning of failures, thereby effectively protecting data and improving the quality of cloud storage service. We also propose a drive failure cause location mechanism, which can help operators analyze the modes of failure by providing guiding suggestions. In order to evaluate the effectiveness of our method, we use cross-validation and online testing methods on SSDs data from a technology company. The results show that the FDR and FAR of our method outperform the baselines by 17.25% and 2.39% on average.
A Proactive Failure Tolerant Mechanism for SSDs Storage Systems based on Unsupervised Learning_1
A Proactive Failure Tolerant Mechanism for SSDs Storage Systems based on Unsupervised Learning_2
A Proactive Failure Tolerant Mechanism for SSDs Storage Systems based on Unsupervised Learning_3
  • Dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates
  • Yuncheng Liu, Ke Xu, Xuhao Fan, Xinger Wang, Xuan Yu, Wei Xiong, Hui Gao
  • Opto-Electronic Advances
  • 2024-01-25
  • Multi-dimensional multiplexing optical secret sharing framework with cascaded liquid crystal holograms
  • Keyao Li, Yiming Wang, Dapu Pi, Baoli Li, Haitao Luan, Xinyuan Fang, Peng Chen, Yanqing Lu, Min Gu
  • Opto-Electronic Advances
  • 2024-01-25
  • Physics-informed deep learning for fringe pattern analysis
  • Wei Yin, Yuxuan Che, Xinsheng Li, Mingyu Li, Yan Hu, Shijie Feng, Edmund Y. Lam, Qian Chen, Chao Zuo
  • Opto-Electronic Advances
  • 2024-01-25
  • Advancing computer-generated holographic display thanks to diffraction model-driven deep nets
  • Vittorio Bianco, Pietro Ferraro
  • Opto-Electronic Advances
  • 2024-01-16
  • Inverse design for material anisotropy and its application for a compact X-cut TFLN on-chip wavelength demultiplexer
  • Jiangbo Lyu, Tao Zhu, Yan Zhou, Zhenmin Chen, Yazhi Pi, Zhengtong Liu, Xiaochuan Xu, Ke Xu, Xu Ma, Lei Wang, Zizheng Cao, Shaohua Yu
  • Opto-Electronic Science
  • 2024-01-09
  • Improved spatiotemporal resolution of anti-scattering super-resolution label-free microscopy via synthetic wave 3D metalens imaging
  • Yuting Xiao, Lianwei Chen, Mingbo Pu, Mingfeng Xu, Qi Zhang, Yinghui Guo, Tianqu Chen, Xiangang Luo
  • Opto-Electronic Science
  • 2024-01-05
  • Wide-spectrum optical synthetic aperture imaging via spatial intensity interferometry
  • Chunyan Chu, Zhentao Liu, Mingliang Chen, Xuehui Shao, Guohai Situ, Yuejin Zhao, Shensheng Han
  • Opto-Electronic Advances
  • 2023-3-10
  • Flat soliton microcomb source
  • Xinyu Wang, Xuke Qiu, Mulong Liu, Feng Liu, Mengmeng Li, Linpei Xue, Bohan Chen, Mingran Zhang, Peng Xie
  • Opto-Electronic Science
  • 2023-12-29
  • Smart palm-size optofluidic hematology analyzer for automated imaging-based leukocyte concentration detection
  • Deer Su, Xiangyu Li, Weida Gao, Qiuhua Wei, Haoyu Li, Changliang Guo, Weisong Zhao
  • Opto-Electronic Science
  • 2023-12-28
  • Exceptional-point-enhanced sensing in an all-fiber bending sensor
  • Zheng Li, Jingxu Chen, Lingzhi Li, Jiejun Zhang, Jianping Yao
  • Opto-Electronic Advances
  • 2023-12-12
  • All-optical object identification and three-dimensional reconstruction based on optical computing metasurface
  • Dingyu Xu, Wenhao Xu, Qiang Yang, Wenshuai Zhang, Shuangchun Wen, Hailu Luo,
  • Opto-Electronic Advances
  • 2023-12-12



  • Designing Approximate and Deployable SRPT Scheduler: A Unified Framework                                Context-aware Telco Outdoor Localization
    About
    |
    Contact
    |
    Copyright © PubCard