CS721 : Network Performance Evaluation

Course Overview

Course Synopsis

This is a graduate level course. The purpose of this course is to present a comprehensive breadth-focused overview of empirical, analytical, and simulation techniques used for modeling and studying the performance of communication networks. In particular, following details will be covered: a. Empirical techniques: how to design valid experiments through which we systematically analyze communication networks through measurements? b. Analytical techniques: how to we make analytical models to analyze and model the performance of communication networks? In particular, we will gain an overview of queueing theory and its most important results. c. Simulation techniques: how do we make computational models to analyze and model the performance of communication networks?

Course Learning Outcomes

Upon successful completion of this course, students should be able to:

  • Apply simulation techniques to develop valid models of communication networks
  • Apply queueing-based models to characterize communication networks and to gain insights about their performance
  • Perform measurement-based empirical performance analysis of communication networks
  • Design a set of experiments to obtain the most information for a given level of effort
  • Understand the inherent trade-offs involved in using simulation, measurement, and analytical modeling
  • Avoid common simulation/ modeling/ measurement/ data presentation/ data analysis errors
  • Evaluate the relative merits of alternative system/algorithm design solutions
  • Present quantitative results visually in an effective manner
  • Engage in research in the field of performance analysis and evaluation


Course Calendar

1 Introduction to Network Performance Evaluation (NPE)
2 Science of NPE
3 Common NPE Errors
4 NPE Performance Metrics & Techniques
5 Introduction to Statistics
6 Summarizing Measured Data
7 Sampling a Population
8 Hypothesis testing
9 Confidence Intervals
10 Model fitting or Regression models
11 Art of Modeling and NPE
12 Lies, Damned Lies and Statistics
13 Visual Display of Quantitative Data
14 Empirical Methods and Measurements
15 Workload Modeling
16 Common Distributions (Mediocristan)
17 Common Distributions (Extremistan)
18 Introduction to Fractals
19 Self-similarity and LRD
20 Experimental Design
21 One-Factor Experiments
22 Full Factorial Designs
23 Fractional Factorial Designs
24 Network Management
25 Internet Measurement Issues and Tools
26 Internet Measurement Results
27 Introduction to Stochastic Processes
28 Common Stochastic Processes
29 Discrete-Time Markov Chains
30 Continuous-Time Markov Chains
31 Introduction to Queuing Theory
32 Fundamentals of Queueing Theory
33 Single-Server Queueing Systems
34 Multi-Server Queueing Systems
35 Queueing Networks
36 Operational Analysis
37 Analysis of Queueing Networks
38 Introduction to Simulation
39 Random Number Generation
40 Verification and Validation
41 Input Modeling
42 Output Analysis
43 Comparing Systems
44 NPE Tools
45 Course Summary