Exploiting Nonstationarity for Performance Prediction
Stewart, Christopher; Kelly, Terence; Zhang, Alex
HPL-2007-64
External - Copyright Consideration
Keyword(s): performance modeling; prediction; transaction processing; queueing
Abstract: Real production applications ranging from enterprise applications to large e-commerce sites share a crucial but seldom-noted characteristic: The relative frequencies of transaction types in their workloads are nonstationary, i.e., the transaction mix changes over time. Accurately predicting application-level performance in business-critical production applications is an increasingly important problem. However, transaction mix nonstationarity casts doubt on the practical usefulness of prediction methods that ignore this phenomenon. This paper demonstrates that transaction mix nonstationarity enables a new approach to predicting application-level performance as a function of transaction mix. We exploit nonstationarity to circumvent the need for invasive instrumentation and controlled benchmarking during model calibration; our approach relies solely on lightweight passive measurements that are routinely collected in today.s production environments. We evaluate predictive accuracy on two real business- critical production applications. The accuracy of our response time predictions rang es from 10% to 16% these applications, and our models generalize well to workloads very different from those used for calibration. We apply our technique to the challenging problem of predicting the impact of application consolidation on transaction response times. We calibrate models of two testbed applications running on dedicated machines, then use the models to predict their performance when they run together on a shared machine and serve very different workloads. Our pre dictions are accurate to within 4% to 14%. Existing approaches to consolidation decision support predict post-consolidation resource utilizations. Our method allows application-level performance to guide consolidation decisions. Publication Info: Copyright ACM. Published in EuroSys'07, 21-23 March 2007, Lisbon, Portugal
14 Pages
Back to Index
| 
Printable version
