Addressing Performance Testing Challenges in Agile

Outline
Traditional approach to Performance Engineering Performance Engineering in Agile Continuous performance management Case Studies

2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Introduction
Enterprises are moving towards Agile
Improved Quality Midcourse corrections Customer satisfaction Quicker time-to-market Competition

2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Traditional approach to Performance Engineering

Waterfall model Afterthought in SDLC Reactive approach Insufficient time testing, tuning, optimization and forecasting Adverse system performance Business losses
2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Testing Challenges in Agile

Time boxed sprints

Shorter time to test

H/w infrastructure Test Data

Test Environment

Customer expectations Frequent changes Delivery pressures Defining performance user stories
Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

2013 Impetus Technologies

Performance Engineering in Agile

Sprint 0 (Planning) Capture NFR Performance Test Planning

Sprint (1-n) Performance Unit testing Scripting and Execution Identify and Fix bottlenecks

Hardening Sprint Performance Certification End to end testing Production Monitoring

Release Lifecycle

2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Performance Planning
Define performance requirements
User System

Performance test strategy Workload analysis Tool selection Test data

2013 Impetus Technologies

Graph to find Peak Usage hour

Expected Trans per hour 3000 2500 2000 1500 1000 500 0 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Hours in a Day

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Sprint Execution
Performance centric development Scripting and Execution Performance unit testing Continuous Performance Management Bottleneck Identification
2013 Impetus Technologies

Scripting and Execution

Bottleneck Identification and Fixing

Profiling and Analysis

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Performance Centric Development

Technology evaluation Architecture and Design Review Prototyping Deployment and Production monitoring

2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Performance Unit Testing

Unit tests as performance tests Performance Evaluation
Code Level Single user performance

Automated unit testing

ANT, Maven

Tools
Junit, junitperf, TestNG, Solex, TPTP, p-unit
2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Performance Unit Testing

2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Continuous Performance Management

Integrate test execution & Continuous Integration Component level performance Automated result analysis
Alerts and Notifications
Dev Environment CI tool Test Execution Performance testing tool

Performance Scripts Automated Build Trigger Code Repository Test scripts and Scenarios

Generate Load

Results

Performance comparison Tools

Jenkins, SVN, ANT, Maven, JMeter, SandStorm, Profilers
2013 Impetus Technologies

Performance Environment

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Continuous Performance Management

2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Bottleneck Identification
Using Diagnostic tools Profiling
Code Database

System tuning
Thread pool Connection pool JVM Queries

Tools
Yourkit, Jprofiler, visualVM, jConsole, AWR, SQL profiler, GC Analyzer, Glassbox, jwebApp, Jamon
Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

2013 Impetus Technologies

Hardening Sprint
Dedicated sprint for performance testing End-to-end performance testing Stress and Volume testing Endurance, Reliability, Fail over testing Production monitoring
Nagios, Zabbix, Wily, Dynatrace, AppDynamics

Performance certification
2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Bill Payment Solutions

The Challenge
Scrum development cycle Identify performance bottlenecks during the development Identify hardware requirements for deployment of new release Define optimized set of parameters for JVM Benchmark and tune the individual web services

Impetus Contributions
Defined and established Performance engineering process in Scrum

Defined performance tasks in product backlog

Performance benchmarking for critical web services Defined optimal set of JVM parameters for maximum throughput Recommended optimum hardware based on expected user base Automated monitoring utilities to debug performance issues

Benefits Realized
In time release with zero performance issues Cost savings due to early identification and resolution of performance issues

2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Digital Mailbox Solution

The Challenge
Identify performance bottlenecks during the development H/w sizing for the production deployment Benchmark and tune the individual web services Monitoring performance of multiplesub-systems during test execution Performance testing via CI

Impetus Contributions
Automated tasks for performance test data, environment and execution

Performance test execution via Hudson

Performance benchmarking for critical web services Recommended optimum hardware based on expected user base Automated monitoring utilities to monitor sub-system performance

Benefits Realized
In time release with zero performance issues Significant cost savings due to use of open source tools

2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

CPM in Digital Mailbox Solution

2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Summary
Proactive performance engineering
Early detection and resolution

Performance unit testing and optimization High degree of automation Extensive collaboration between teams Certainty in Deployment

2013 Impetus Technologies

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

What Sets Us Apart

Over 20 years focus on technology Innovation is in our DNA Technology thought leaders Process engineering maturity World-class user experience designs

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Q&A
Please send in your questions

Recorded version available at http://www.impetus.com/archived_webinar?eventid=68

Legal
2013 Impetus Technologies. All rights reserved. You are prohibited from making a copy or modification of, or from redistributing, rebroadcasting, or re-encoding of this content without the prior written consent of Impetus Technologies. This presentation includes images from other products and services. These images are used for illustrative purposes only. There is no explicit or implied endorsement or sponsorship of these products by Impetus. All copyrights and trademarks are property of their respective owners.
2013 Impetus Technologies

Thank you
inquiry@impetus.com | www.impetus.com