Khan, Mehran N. A. H (2015) Monitoring Service Level Workload of Highly Available Applications. Masters thesis, Concordia University.
Preview |
Text (application/pdf)
3MBKhan_MASc_S2016.pdf - Accepted Version |
Abstract
Elasticity is a key feature of cloud computation and is a major contributor to its popularity. Elasticity is defined as automatic provisioning/de-provisioning of resources to match workload changes over time. Service High Availability (HA) is among one of cloud computing’s big challenges. High Availability (HA) is defined as providing a minimum of 99.999% service availability. Maintaining service HA while scaling in/out is even more challenging. Recently, an architecture has been proposed for managing HA. Following the proposed architecture, an Elasticity Engine has been introduced that is capable of managing resources based on application level provisioning or de-provisioning alerts while preserving HA. In contrast to the prevailing monitoring solutions where Virtual Machine (VM) level workload is provided, the Elasticity Engine requires a monitoring solution that monitors service-level workload and triggers alerts accordingly. In this thesis, we propose an approach and an architecture for the monitoring of HA applications at the service level. Accordingly, the monitoring approach starts with monitoring the application components in traditional manner. Workload of the components are mapped to each component’s respective service assignment. The resource usages of all the components providing services is aggregated and mapped to the service level workload using a distributed client-server architecture. This approach allows for distinguishing between the different HA states, active or standby that a component can be assigned at runtime and it (the approach) adapts to the situations where switchovers happen under the control of the SA Forum middleware due to failures for example. The proposed monitoring architecture has been implemented and integrated with the Elasticity Engine to test its effectiveness and overhead. It has been shown that the implemented and integrated prototypes achieve elasticity in a cluster based on service level workload while keeping the monitoring overhead within 5% of its total resource.
| Divisions: | Concordia University > Gina Cody School of Engineering and Computer Science > Electrical and Computer Engineering |
|---|---|
| Item Type: | Thesis (Masters) |
| Authors: | Khan, Mehran N. A. H |
| Institution: | Concordia University |
| Degree Name: | M.A. Sc. |
| Program: | Electrical and Computer Engineering |
| Date: | 26 November 2015 |
| Thesis Supervisor(s): | Khendek, Ferhat and Liu, Yan |
| Keywords: | cloud, monitoring, service-workload, high-availability, elasticity |
| ID Code: | 980909 |
| Deposited By: | MEHRAN NOOR AL- KHAN |
| Deposited On: | 15 Jun 2016 16:09 |
| Last Modified: | 18 Jan 2018 17:52 |
References:
[1] M. Toeroe, F. Tam, D. Penkler, R. Hyerle, J. Jensen, M. Angelic, U. Kleber, A. Mishra, A. Kanso, M. Angelic and F. Khendek, Service Availability: Principles and Practice, M. Toeroe and F. Tam, Eds., Montreal, Quebec: John Wiley & Sons. Ltd., 2012.[2] Amazon Inorporated, "What is Cloud Computing? - Benefits of the Cloud," Amazon Inorporated, 2015. [Online]. Available: http://aws.amazon.com/what-is-cloud-computing/. [Accessed July 2015].
[3] M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica and M. Zaharia, "A View of Cloud Computing," Communications of the ACM (CACM), vol. 53, no. 4, pp. 50-58, April 2010.
[4] N. R. Herbst, S. Kounev and R. Reussner, "Elasticity in Cloud Computing: What It Is, and What It Is Not," in International Conference on Autonomic Computing (ICAC), San Jose, CA, June 26-28, 2013.
[5] M. Rak, S. Venticinque and T. Ma´hr, "Cloud Application Monitoring: the mOSAIC Approach," in 2011 Third IEEE International Conference on Cloud Computing Technology and Science (IEEE CloudCom), Athens, Greece, August 28, 2011.
[6] Amazon CloudWatch, "Amazon CloudWatch Developer Guide: Publish Custom Metrics," Amazon, 1 August 2010. [Online]. Available: http://docs.aws.amazon.com/AmazonCloudWatch/latest/DeveloperGuide/publishingMetrics.html. [Accessed August 2015].
[7] Service Availability Forum, "Service Availability Forum - Home," Service Availability Forum, 2015. [Online]. Available: http://www.saforum.org/. [Accessed July 2015].
[8] N. Pawar, ""Managing High-Availability and Elasticity in a Cluster Environment" Masters Thesis," Concordia University, Montreal, 2014.
[9] Service Availability Forum, "Service Availability Forum Availability Management Framework SAI-AIS-AMF-B.04.01," September 2011. [Online]. Available: http://www.saforum.org/hoa/assn16627/images/SAI-AIS-AMF-B.04.01.AL.pdf. [Accessed July 2015].
[10] M. Toeroe, N. Pawar and F. Khendek, "Managing Application Level Elasticity and Availability," in 10th Conference on Network and Service Management and Workshop (CNSM), Rio de Janeiro, 17-21 November, 2014.
[11] OpenSAF Foundation, "OpenSAF Foundation - About Us," OpenSAF, 2015. [Online]. Available: http://www.opensaf.org/page/14944~155299/About-Us. [Accessed July 2015].
[12] Service Availability Forum, "Service Availability Forum: Service Availability Forum - Open Specifications for Service Availability," Service Availability Forum, 2015. [Online]. Available: http://www.saforum.org/page/16627~214723/Service-Availability-Forum-Open-Specifications-for-Service-Availability. [Accessed 4 August 2015].
[13] Service Availability Forum, "Service Availability Forum Specification : Hardware Platform Interface," Service Availability Forum, 2015. [Online]. Available: http://www.saforum.org/Page/16627~217308/Service-Availability-Forum-Specification-Hardware-Platform-Interface-28HPI29. [Accessed 4 August 2015].
[14] Service Availability Forum, "Service Availability Forum - Tutorial Downloads," 2015. [Online]. Available: http://www.saforum.org/HOA/assn16627/images/SAIOverview.ppt. [Accessed 4 August 2015].
[15] Service Availability Forum, "Information Model Management Service SAI-AIS-IMM-A.03.01," September 2011. [Online]. Available: http://www.saforum.org/HOA/assn16627/images/SAI-AIS-IMM-A.03.01.AL.pdf. [Accessed July 2015].
[16] T. L. D. Project, "LDAP Linux HOWTO," August 2015. [Online]. Available: http://tldp.org/HOWTO/LDAP-HOWTO/whatisldap.html. [Accessed August 2015].
[17] A. C. C. S. James Warner, "top(1) - Linux man page," [Online]. Available: http://linux.die.net/man/1/top. [Accessed September 2015].
[18] F. F. Henry Ware, "vmstat," [Online]. Available: http://linuxcommand.org/man_pages/vmstat8.html. [Accessed September 2015].
[19] M. K. J. Larry Greenfield, "uptime(1) - Linux man page," [Online]. Available: http://linux.die.net/man/1/uptime. [Accessed September 2015].
[20] Python Software Foundation, "psutil 3.1.1 - Python Package Index," Python Software Foundation, 2014. [Online]. Available: https://pypi.python.org/pypi/psutil. [Accessed August 2015].
[21] Nixcraft, "Nixcraft," 27 June 2009. [Online]. Available: http://www.cyberciti.biz/tips/top-linux-monitoring-tools.html. [Accessed August 2015].
[22] OpenStack, "Home: OpenStack Open Source Cloud Computing Software," [Online]. Available: https://www.openstack.org/. [Accessed 22 November 2015].
[23] Red Hat, "Ceilometer Quick Start - RDO," 2015. [Online]. Available: https://www.rdoproject.org/install/ceilometerquickstart/. [Accessed 22 November 2015`].
[24] The LTTng Project, "The LTTng Documentation," 2015. [Online]. Available: http://lttng.org/docs/. [Accessed July 2015].
[25] Efficios Inc., "Babeltrace," Efficios Inc., 2015. [Online]. Available: http://www.efficios.com/babeltrace. [Accessed August 2015].
[26] A. Colangelo, "What is Cloud Computing? - Introduction to Cloud Computing," [Online]. Available: https://cloudacademy.com/cloud-computing/introduction-to-cloud-computing-course/. [Accessed November 2015].
[27] National Institute of Standard and Technology (NIST), "NIST Cloud Computing Program," 15 November 2010. [Online]. Available: http://www.nist.gov/itl/cloud/. [Accessed November 2015].
[28] Boundary, "Product- Boundary," 2014. [Online]. Available: http://www.boundary.com/product/. [Accessed July 2015].
[29] Rackspace, "Cloud Monitoring - Server, App & Website Monitoring by Rackspace," Rackspace, 2015. [Online]. Available: http://www.rackspace.com/cloud/monitoring/features/. [Accessed July 2015].
[30] Microsoft Corporation, "Enabling Diagnostics in Azure Cloud Services and Virtual Machines," Microsoft, [Online]. Available: http://azure.microsoft.com/en-gb/documentation/articles/cloud-services-dotnet-diagnostics/. [Accessed July 2015].
[31] AppDynamics, "Application Performance Management," AppDynamics, 2015. [Online]. Available: http://www.appdynamics.com/product/application-performance-management/. [Accessed July 2015].
[32] Aternity, "Aternity Workforce APM," Aternity, [Online]. Available: http://www.aternity.com/products/workforce-apm/. [Accessed July 2015].
[33] mOSAIC, "Towards a Cross Platform Cloud API Components for Cloud Federation," mOSAIC, [Online]. Available: http://mosaic-cloud.eu/dissemination/poster/1305227346_posterCLOSER11-1.pdf. [Accessed July 2015].
[34] K. Alhamazani, R. Ranjan, K. Mitra, P. P. Jayaraman, Z. (. Huang, L. Wang and F. Rabhi, "CLAMS: Cross-Layer Multi-Cloud Application Monitoring-as-a-Service Framework," in IEEE International Conference on Services Computing (IEEE SCC), Anchorage, Alaska, USA, June 27- July 2, 2014.
[35] D. L. Quoc, L. Yazdanov and C. Fetzer, "DoLen: User-side multi-cloud application monitoring," in International Conference on Future Internet of Things and Cloud (FiCloud), Barcelona, Spain, 27-29 August, 2014.
[36] Python Software Foundation, "psutil 2.2.1," Python Software Foundation, January 2015. [Online]. Available: https://pypi.python.org/pypi/psutil. [Accessed July 2015].
[37] Python Software Foundation, "About Python," Python Software Foundation, 2001-2015. [Online]. Available: https://www.python.org/about/. [Accessed August 2015].
[38] EfficiOS Inc., "Common Trace Format (CTF)," EfficiOS Inc., 2015. [Online]. Available: http://www.efficios.com/ctf. [Accessed July 2015].
[39] Python Software Foundation, "Data Structures," Python Software Foundation, 8 February 2015. [Online]. Available: https://docs.python.org/3/tutorial/datastructures.html. [Accessed July 2015].
[40] P. G. Emma, "Understanding some simple processor-performance limits," IBM Journal of Research and Development - Special issue: performance analysis and its impact on design, vol. 41, no. 3, pp. 215-232, May 1997.
[41] VMware Incorporated, "VMware Workstation," VMware Incorporated, 2015. [Online]. Available: https://www.vmware.com/products/workstation. [Accessed July 2015].
[42] Python Software Foundation, "BaseHTTPServer — Basic HTTP server," 23 May 2015. [Online]. Available: https://docs.python.org/2/library/basehttpserver.html. [Accessed July 2015].
[43] Apache Software Foundation, "Apache JMeter™," Apache Software Foundation, 2015. [Online]. Available: http://jmeter.apache.org/. [Accessed July 2015].
[44] VideoLAN non-profit organization, "VideoLAN," VideoLAN non-profit organization, [Online]. Available: http://www.videolan.org/. [Accessed July 2015].
[45] D. C. Johnson, "Kill Commands and Signals," Linux.org, 12 July 2015. [Online]. Available: http://www.linux.org/threads/kill-commands-and-signals.4423/. [Accessed July 2015].
[46] I. Bicking, "Virtualenv," The Open Planning Project, PyPA, 2014. [Online]. Available: https://virtualenv.pypa.io/en/latest/. [Accessed September 2015].
[47] Amazon Incorporated, "Amazon EC2 Instances," Amazon Incorporated, 2015. [Online]. Available: https://aws.amazon.com/ec2/instance-types/. [Accessed September 2015].
[48] OpenStack Foundation, "Flavors," OpenStack Foundation, 2015. [Online]. Available: http://docs.openstack.org/openstack-ops/content/flavors.html. [Accessed September 2015].
[49] Google Incorporated, "Google Cloud Platform: Linux Getting Started Guide," Google Incorporated, 2015. [Online]. Available: https://cloud.google.com/compute/docs/linux-quickstart. [Accessed September 2015].
[50] M. Desnoyers and M. R. Dagenais, "LTTng, Filling the Gap Between Kernel Instrumentation," [Online]. Available: http://events.linuxfoundation.org/slides/lfcs09_desnoyers_paper.pdf. [Accessed 21 Nivember 2013].
[51] "LTTng Project," [Online]. Available: http://lttng.org/viewers. [Accessed 21 November 2013].
[52] T. Willhalm, R. Dementiev and P. Fay, "Intel® Performance Counter Monitor - A better way to measure CPU utilization," 16 August 2012. [Online]. Available: https://software.intel.com/en-us/articles/intel-performance-counter-monitor. [Accessed July 2015].
[53] M. Desnoyers, J. Desfossez and D. Goulet, "LTTNG," 18 July 2013. [Online]. Available: http://lttng.org/files/doc/man-pages/man1/lttng.1.html. [Accessed July 2015].
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.
Repository Staff Only: item control page
Download Statistics
Download Statistics