Year
Month
(Conference Paper) A Proactive Failure Tolerant Mechanism for SSDs Storage Systems based on Unsupervised Learning
Hao Zhou 周浩 ¹, Zhiheng Niu ², Gang Wang 王刚 ², XiaoGuang Liu 刘晓光 ², Dongshi Liu ³, Bingnan Kang ³, Hu Zheng ³, Yong Zhang ³
¹ College of Cyber Science TJ Key Lab of NDST, Nankai University, Tianjin, China
中国 天津 南开大学网络空间安全学院 天津市网络与数据安全技术重点实验室
² College of Computer Science TJ Key Lab of NDST, Nankai University, Tianjin, China
中国 天津 南开大学计算机学院 天津市网络与数据安全技术重点实验室
³ Huawei
华为
2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS), 2021-08-26
Abstract

As a proactive failure tolerant mechanism in large scale cloud storage systems, drive failure prediction can be used to protect data by early warning before real failures of drives, and therefore improve system dependability and cloud storage service quality. At present, solid state drives (SSDs) are generally widely used in cloud storage systems due to their high performance. SSD failures seriously affect the dependability of the system and the quality of service. Existing proactive failure tolerant mechanisms for storage systems are basically aimed at HDD failure detection and use classification technology (Supervised learning), which relies on enough failure data to establish a classification model.

However, the low failure rate of SSDs leads to a serious imbalance in the ratio of positive and negative samples, which brings a big challenge for establishing a proactive failure tolerance mechanism for SSDs storage systems by using classification technology.In this paper, we propose a proactive failure tolerance mechanism for SSDs storage systems based on unsupervised technology. It only uses data of normal SSDs to train the failure prediction model, which means that our method is not limited by the imbalance in SSDs data.

At the core of our method is the idea to use VAE-LSTM to learn the pattern of normal SSDs, in which case faulty SSDs can be alerted when their patterns are very different from normal ones. Our method can provide early warning of failures, thereby effectively protecting data and improving the quality of cloud storage service. We also propose a drive failure cause location mechanism, which can help operators analyze the modes of failure by providing guiding suggestions. In order to evaluate the effectiveness of our method, we use cross-validation and online testing methods on SSDs data from a technology company. The results show that the FDR and FAR of our method outperform the baselines by 17.25% and 2.39% on average.
A Proactive Failure Tolerant Mechanism for SSDs Storage Systems based on Unsupervised Learning_1
A Proactive Failure Tolerant Mechanism for SSDs Storage Systems based on Unsupervised Learning_2
A Proactive Failure Tolerant Mechanism for SSDs Storage Systems based on Unsupervised Learning_3
  • Power grid fault diagnosis based on a deep pyramid convolutional neural network
  • Xu Zhang 张旭, Huiting Zhang, Dongying Zhang, Yixian Wang, Ruiting Ding, Yuchuan Zheng, Yongxu Zhang
  • CSEE Journal of Power and Energy Systems
  • 2022-05-06
  • China's factor reallocation effect considering energy
  • Guangqing Xu, Xiaoyu Chen
  • Chinese Journal of Population, Resources and Environment
  • 2022-05-02
  • Cannabidiol prevents depressive-like behaviors through the modulation of neural stem cell differentiation
  • Ming Hou, Suji Wang, Dandan Yu, Xinyi Lu, Xiansen Zhao, Zhangpeng Chen, Chao Yan
  • Frontiers of Medicine
  • 2022-04-26
  • Cultivation of gut microorganisms of the marine ascidian Halocynthia roretzi reveals their potential roles in the environmental adaptation of their host
  • Yang Yang, Yuting Zhu, Haiming Liu, Jiankai Wei, Haiyan Yu, Bo Dong
  • Marine Life Science & Technology
  • 2022-04-26
  • Data network traffic analysis and optimization strategy of real-time power grid dynamic monitoring system for wide-frequency measurements
  • Jinsong Li, Hao Liu, Wenzhuo Li, Tianshu Bi, Mingyang Zhao
  • Global Energy Interconnection
  • 2022-04-25
  • Field distribution of the Z₂ topological edge state revealed by cathodoluminescence nanoscopy
  • Xiao He, Donglin Liu, Hongfei Wang, Liheng Zheng, Bo Xu, Biye Xie, Meiling Jiang, Zhixin Liu, Jin Zhang, Minghui Lu, Zheyu Fang
  • Opto-Electronic Advances
  • 2022-04-25
  • Advances in femtosecond laser direct writing of fiber Bragg gratings in multicore fibers: technology, sensor and laser applications
  • Alexey Wolf, Alexander Dostovalov, Kirill Bronnikov, Mikhail Skvortsov, Stefan Wabnitz, Sergey Babin
  • Opto-Electronic Advances
  • 2022-04-25
  • Graphene-empowered dynamic metasurfaces and metadevices
  • Chao Zeng, Hua Lu, Dong Mao, Yueqing Du, He Hua, Wei Zhao, Jianlin Zhao
  • Opto-Electronic Advances
  • 2022-04-25
  • Charge carrier dynamics in different crystal phases of CH₃NH₃PbI₃ perovskite
  • Efthymis Serpetzoglou, Ioannis Konidakis, George Kourmoulakis, Ioanna Demeridou, Konstantinos Chatzimanolis, Christos Zervos, George Kioseoglou, Emmanuel Kymakis, Emmanuel Stratakis
  • Opto-Electronic Science
  • 2022-04-21
  • Applications of optically and electrically driven nanoscale bowtie antennas
  • Zhongjun Jiang, Yingjian Liu, Liang Wang
  • Opto-Electronic Science
  • 2022-04-20
  • Validation of the bodily expressive action stimulus test among Chinese adults and children
  • Yunmei Yang, Wenwen Hou, Jing Li
  • PsyCh Journal
  • 2022-04-17



  • Designing Approximate and Deployable SRPT Scheduler: A Unified Framework                                Context-aware Telco Outdoor Localization
    About
    |
    Contact
    |
    Copyright © PubCard