Problem Determination In Message-Flow Internet Services Based On Statistical Analysis of Event Logs

dc.comment.hiddenThe test data in my thesis was collected from the BlackBerry Internet Services, so I have applied for the restrict circulation of my thesisen
dc.contributor.authorXu, Yu
dc.date.accessioned2009-05-23T00:44:52Z
dc.date.available2009-05-23T00:44:52Z
dc.date.issued2009-05-23T00:44:52Z
dc.date.submitted2009
dc.description.abstractIn a message-flow Internet service where messages travel through multiple nodes, event log analysis is one of the most important methods to identify the root causes of problems. Traditional approaches for event log analysis have been largely based on expert systems that build static dependency models on rules and patterns defined by human experts. However, the semantic complexity and the various formats of event logs make it difficult to be modeled. In addition, it is time consuming to maintain such static model for constantly evolving Internet services. Recent research has been focused on building statistical models. However, all of these models rely on the trace information provided by J2EE or .NET frameworks, which are not available to all Internet services. In this thesis, we propose a framework of problem determination based on statistical analysis of event logs. We assume a unique message ID will be logged in multiple log lines to trace the message flow in the system. A generic log adaptor is defined to extract valuable information from the log entries. We also develop an algorithm of log event clustering and log pattern clustering. Frequency analysis will be performed based on the log patterns in order to build a statistical model of the system behaviors. Once the system is modeled, we can determine problems by running a chi-square goodness of fit test using a sliding window approach. As event logs are available on all major operating systems, we believe our framework is a generic solution for problem determination in message-flow Internet services. Our solution has been validated by the log data collected from the Blackberry Internet Service (BIS) engine ‎[4] , a wireless email service that serves millions of users across the world. According to the test results, our solution shows high accuracy of problem determination.en
dc.identifier.urihttp://hdl.handle.net/10012/4462
dc.language.isoenen
dc.pendingfalseen
dc.publisherUniversity of Waterlooen
dc.subjectproblem determinationen
dc.subjectmessage-flow internet servicesen
dc.subjectlog analysisen
dc.subject.programElectrical and Computer Engineeringen
dc.titleProblem Determination In Message-Flow Internet Services Based On Statistical Analysis of Event Logsen
dc.typeMaster Thesisen
uws-etd.degreeMaster of Applied Scienceen
uws-etd.degree.departmentElectrical and Computer Engineeringen
uws.peerReviewStatusUnrevieweden
uws.scholarLevelGraduateen
uws.typeOfResourceTexten

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
YuXu_Master_Thesis_2009_05_22_revised.pdf
Size:
606.96 KB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
242 B
Format:
Item-specific license agreed upon to submission
Description: