DMFD: Non-Intrusive Dependency Inference and Flow Ratio Model for Performance Anomaly Detection in Multi-tier Cloud Applications

• Type: Article in International Conference Proceedings Book
• Date: 2019

Authors

Fu, SB (Author) Other; Rui Prior (Author) FCUP; Kim, H (Author) Other

Conference proceedings International

Title: 2019 IEEE 12TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (IEEE CLOUD 2019)

Pages: 164-173

12th IEEE International Conference on Cloud Computing (IEEE CLOUD) held as Part of IEEE World Congress on Services (IEEE SERVICES)

MIlan, ITALY, JUL 08-13, 2019

Indexing

ISI Web of Knowledge - 2 Citations

Scopus - 2 Citations

Other information

Authenticus ID: P-00R-37M

DOI: 10.1109/cloud.2019.00036

Abstract (EN): More and more complex applications are deployed in virtualized Cloud environments. Cloud applications usually consist of multiple virtual components and the data flow among these components tends to be highly complex and unpredictable. Cloud providers have no visibility into tenants' virtual components and rely on non-intrusive knowledge to infer the service performance. The scale, complexity, and heterogeneity make Cloud environments prone to different kinds of performance anomalies. An automatic anomaly detection mechanism is necessary to help avoid service failure at an early stage of anomalies. We propose DMFD, a decentralized and non-intrusive anomaly detection system for Cloud applications. DMFD considers each virtual component as a black box, and works without knowledge from underlying operating system or applications. DMFD infers the dependency model to characterize the complex interaction behavior among multiple components, and further builds an adaptive data flow ratio model for anomaly detection. The data flow model explores a simple and common relationship that the number of outgoing response data packets changes accordingly with the number of incoming request data packets at each component. We evaluate DMFD with several different kinds of Cloud applications in our data center. The results reveal that DMFD has high precision and low false positive/negative in detecting different kinds of performance anomalies under varying workload scenarios.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 10