The overhead of monitoring that increases with the increasing monitoring tasks is crucial to the effective management and efficient utilization of the cluster computers and to the performance of the monitoring system. Researches are made to reduce the overhead of monitoring by identifying the main characteristics of the application. Main factors of the application are dynamically identified by performing principal component analysis(PCA)on the fly of application execution. The set of the main characteristics is identified through matching up with the comparison characteristic set that is created by 4 categories resource intensive benchmark so that the monitoring workload is reduced. A prototype monitoring system adopting the proposed strategy is implemented. Experimental results show that the monitoring workload is decreased by 20% to 60% in hybrid applications or some resource intensive applications. Large collected data can be effectively refined and processed before inputting it to a monitoring system.
WANG Yinfeng, DONG Xiaoshe, HE Xiuqiang, et al. Grid testing engine: an infrastructure for constructing grid testing environment [J]. Journal of Xi'an Jiaotong University, 2007, 41(8), 884-888.
ZHANG Xuehai, FRESCHL J L, SCHOPF J M. A performance study of monitoring and information services for distributed systems [C]∥12th IEEE International Symposium on High Performance Distributed Computing. Los Alamitos, CA, USA: IEEE Computer Society,2003:270.
LIU Wei, LUO Tiejian, SONG Jinliang, et al. Improving grid monitoring with data quality assessment [C]∥International Symposium on Communications and Information Technologies. Los Alamitos, CA, USA:IEEE Computer Society,2007:1534-1539.
YOSHIKAZU K, KENJIRO T. Scalable data gathering for real-time monitoring systems on distributed computing[C]∥8th IEEE International Symposium on Cluster Computing and the Grid. Piscataway, NJ, USA: IEEE, 2008: 425-432.
YANG Lingyun, SCHOPF J M, DUMITRESCU C L, et al. Statistical data reduction for efficient application performance monitoring [C]∥Proceedings of the Grid Workshop. Los Alamitos, CA, USA: IEEE Computer Society,2006:327-334.
DUESTERWALD E, CASCAVAL C, DWARKADAS S. Characterizing and predicting program behavior and its variability [C]∥Proceedings of the 12th International Conference on Parallel Architectures and Compilation Techniques. Los Alamitos, CA, USA: IEEE Computer Society, 2003:220.
PHANSALKAR A, JOSHI A, EECKHOUT L, et al. Measuring program similarity: experiments with SPEC CPU benchmark suites [C]∥IEEE International Symposium on Performance Analysis of Systems and Software. Los Alamitos, CA, USA: IEEE Computer Society, 2005:10-20.