towards a framework for monitoring and analyzing qos metrics of grid services
DESCRIPTION
QoS (Quality of Service) parameters play a key role inselecting Grid resources and optimizing resources usageefficiently. Although many works have focused on usingQoS metrics, surprisingly few tools support the monitoringand analysis of QoS metrics of Grid services. This paperpresents a novel framework which supports the monitoringand analysis of QoS metrics in the Grid. Our approach isthat, firstly, we develop a classification of important QoSmetrics for Grid services that should be monitored and analyzed.Secondly, sensors are developed to monitor QoS ofdisparate Grid services by using a peer-to-peer Grid monitoringmiddleware. The dependencies among Grid servicesare modeled. Based on that, several techniques are used toanalyze QoS metrics of dependent Grid services.TRANSCRIPT
Hong-Linh Truong, Robert Samborski, Thomas Fahringer
Distributed and Parallel Systems Group Institute of Computer Science, University of Innsbruck
Email: [email protected]://www.dps.uibk.ac.at/projects/scaleag
Hong-Linh Truong, 2nd
IEEE E-Science Conference, 4 December 2006, Amsterdam.
Towards a Framework for Monitoring and Analyzing QoS Metrics of Grid
Services
Hong-Linh Truong, 2nd IEEE E-Science 2006 Conference, 05 December 2005. 2
QoS Monitoring, Management, and Analysis for Grid QoS Monitoring, Management, and Analysis for Grid ServiceService
Many works discussed about how to utilize QoS metrics in the Grid
Yet how to monitor and provide QoS metrics is a challenging taskLack of generic/integrated QoS monitoring frameworksLack of analysis for interdependent Grid services
Our objective: Develop a scalable, generic framework that is able to monitor, provide and manage QoS metrics of Grid services
Hong-Linh Truong, 2nd IEEE E-Science 2006 Conference, 05 December 2005. 3
Our ApproachOur Approach
Select and classify measurable QoS metrics of Grid services
Develop sensors for monitoring and providing data that can be used to determine QoS metrics
Provide and manage QoS metrics of various types of monitored resources
Online modelling, monitoring, and analyzing interdependent Grid services
All implemented in an integrated framework
Hong-Linh Truong, 2nd IEEE E-Science 2006 Conference, 05 December 2005. 4
Measurable Measurable QoSQoS MetricsMetrics
Select and classify measurable QoS metrics of Grid services
Based on various existing QoSmetrics, performance metrics, and QoS, dependability and security taxonomies
Develop sensors for monitoring and providing relevant data that can be used to determine these QoSmetrics
Hong-Linh Truong, 2nd IEEE E-Science 2006 Conference, 05 December 2005. 5
Collecting monitoring data for determining Collecting monitoring data for determining QoSQoSmetricsmetrics
Diverse monitored resources:Include machines (computational services), network paths, Grid middleware and applications
• Focusing on Web services and WSRF, utilizing WSDM (Web Services Distributed Management)
No single measurement techniqueDifferent methods for different types of monitored resources
• Direct measurement, accessing data from existing monitoring data providers (Ganglia, Nagios, etc.), parsing log and configuration files
Focusing on remote monitoring of services in an non-intrusive way, using publicly accessible interfaces.
Trade-offs: accuracy versus perturbation, generic versus specific
Hong-Linh Truong, 2nd IEEE E-Science 2006 Conference, 05 December 2005. 6
P2PP2P--based Framework for Monitoring and based Framework for Monitoring and Providing Providing QoSQoS related datarelated data
Data is published in P2P-based Grid services
WSRF-based service providing QoS metrics
Hong-Linh Truong, 2nd IEEE E-Science 2006 Conference, 05 December 2005. 7
Online Modelling and Analyzing NonOnline Modelling and Analyzing Non--functional functional Metrics of Interdependent Grid servicesMetrics of Interdependent Grid services
Hong-Linh Truong, 2nd IEEE E-Science 2006 Conference, 05 December 2005. 8
Online Modelling and Analyzing NonOnline Modelling and Analyzing Non--functional functional Metrics of Interdependent Grid servicesMetrics of Interdependent Grid services
Hong-Linh Truong, 2nd IEEE E-Science 2006 Conference, 05 December 2005. 9
ConclusionConclusions and Future Works and Future WorkCurrent implementation
Based on Globus Toolkit 4.0
At this time not all metrics in the tree supportedMostly availability, reliability, performanceMachines and network paths (IP/ICMP, TCP, HTTP)Grid applications and middleware: • WSDM-based, Web Services, WSRF, GridFTP, GRAM, etc.
Support modeling, online monitoring and analysis of non-functional parameters of Grid services in a single tool
Functional and/or operational, local view or global view
Future worksWorking on obtaining data from log files, storing QoS metricsSelf-management based on QoS metrics and WSDM
http://www.dps.uibk.ac.at/projects/scaleag/