An automated monitoring system for large-scale supercomputers

Computer Engineering & Science ›› 2020, Vol. 42 ›› Issue (10高性能专刊): 1801-1806.

Previous Articles Next Articles

An automated monitoring system for large-scale supercomputers

YANG Jie,ZENG Ling-bo,PENG Yun-yong,JIANG Qian-qian,DU Liang

(National Supercomputing Center in Guangzhou，Sun Yat-Sen University,Guangzhou 510000,China)

Received:2020-06-09 Revised:2020-07-15 Online:2020-10-25 Published:2020-10-23

Abstract

Abstract: he number of large-scale cluster system nodes is increasing, the internal structure is becoming more and more complex, and the pressure on cluster availability and stability is also increasing. In order to solve the problems of the availability and stability of large-scale clusters and the difficulty of system management, operation and maintenance, an automated monitoring system for large-scale clusters is realized. The automated monitoring system is deployed on a large-scale cluster system. By collecting monitoring data of each cluster component and using microservices to process the monitoring data, the real-time monitoring of the cluster components are realized.

Key words: large-scale, cluster, monitor, microservices

YANG Jie, ZENG Ling-bo, PENG Yun-yong, JIANG Qian-qian, DU Liang. An automated monitoring system for large-scale supercomputers[J]. Computer Engineering & Science, 2020, 42(10高性能专刊): 1801-1806.

[1]	CHEN Haoran, WANG Xiaopeng, WANG Haizhou. A semi-supervised fuzzy clustering algorithm for image segmentation based on multiple clustering and adaptive parameter selection [J]. Computer Engineering & Science, 2026, 48(5): 888-897.
[2]	ZHANG Yanju, WU Yixuan, CHEN Zerong. A collaborative filtering recommendation algorithm fusing ROUSTIDA and improved probabilistic intuitionistic fuzzy clustering [J]. Computer Engineering & Science, 2026, 48(4): 731-742.
[3]	FENG Dandan, WANG Xiaopeng. Forest areas remote sensing image extraction algorithm with superpixel-based fuzzy C-means [J]. Computer Engineering & Science, 2026, 48(4): 659-666.
[4]	WEN Hao, LI Zhensong. A single-layer rectilinear obstacle-avoiding Steiner minimal tree generation algorithm based on net partitioning [J]. Computer Engineering & Science, 2026, 48(3): 411-421.
[5]	ZHAO Jinyue, GOU Zhinan, GAO Kai. ICBV:A semi-supervised intent clustering method based on BERT variational autoencoder [J]. Computer Engineering & Science, 2026, 48(2): 277-285.
[6]	ZHANG Hang, WU Jun. A two-stage text summarization method based on an improved PEGASUS model and adaptive error correction mechanism [J]. Computer Engineering & Science, 2026, 48(2): 309-318.
[7]	YANG Hongzhen, CHENG Wei, DU Liang, HUANG Dan, ZENG Chuxuan, XIAO Nong. Characteristics analysis and runtime prediction of jobs in supercomputer [J]. Computer Engineering & Science, 2026, 48(1): 28-39.
[8]	LI Junzhe, FU Zhenxin, YANG Honghui, MA Yinping, LI Ruomiao, FAN Chun, . Design and implementation of a cross-cluster data migration system for computational networks [J]. Computer Engineering & Science, 2025, 47(5): 775-786.
[9]	XIE Bin, LI Yanwei, YANG Shumin, XU Yan, WANG Guanchao. Emotional color transfer combining image decomposition and self-sparse fuzzy clustering [J]. Computer Engineering & Science, 2025, 47(3): 513-523.
[10]	LU Jianyun, SHAO Junming. A clustering algorithm based on the multi-level density center graph [J]. Computer Engineering & Science, 2025, 47(2): 327-335.
[11]	CAI Fapeng, FENG Ji, YANG Degang, CHEN Zhongshang. A hierarchical clustering algorithm based on partitioning natural neighborhood graph [J]. Computer Engineering & Science, 2025, 47(2): 370-380.
[12]	XIA Tong, YUAN Lingyun, XIE Tianyu. Evaluation of attribute access control policy integrating clustering and structural optimization [J]. Computer Engineering & Science, 2025, 47(12): 2169-2180.
[13]	DENG Mingliang, ZHANG Zhao, ZHOU Hongyan, CHEN Xuebo. Short-term power load forecasting based on PCA-PSO_KFCM clustering and BiLSTM-Attention [J]. Computer Engineering & Science, 2025, 47(11): 2067-2081.
[14]	XIE Qiuyuan, LI Qiuyao, CHAI Bianfang. Graph prompting for few-shot node classification based on maintaining node cluster distribution [J]. Computer Engineering & Science, 2025, 47(11): 2029-2037.
[15]	DENG Quan, LIN Rongzhen, LUO Li, LU Jianzhuang, WANG Yongwen. Configurable CPU performance analysis method for specific applications [J]. Computer Engineering & Science, 2025, 47(11): 1901-1911.

An automated monitoring system for large-scale supercomputers

PDF

Knowledge

Abstract

Cite this article

share this article

Related Articles 15

Recommended Articles

Metrics

Comments