Incorporating Performance Testing in Test-Driven Development

Our performance-testing approach required manually inspecting the performance logs. During the project's development, JUnit-based performance testing tools, such as JUnitPerf, weren't available. Such tools provide better visibility of performance problems than manual inspection of performa...

Full description

Saved in:
Bibliographic Details
Published in:IEEE software 2007-05, Vol.24 (3), p.67-73
Main Authors: Johnson, M.J., Maximilien, E.M., Chih-Wei Ho, Williams, L.
Format: Article
Language:English
Subjects:
Architects
Complement
Computer programs
Customer feedback
Delay
Design engineering
Guidelines
Inspection
Java
Logs
Objectives
performance measures
Printers
Process design
Product development
Product life cycle
Response time
Software
Software industry
Software performance
Software testing
Specifications
Switches
System software
System testing
Systems design
test execution
testing strategies
Throughput
Workloads
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Our performance-testing approach required manually inspecting the performance logs. During the project's development, JUnit-based performance testing tools, such as JUnitPerf, weren't available. Such tools provide better visibility of performance problems than manual inspection of performance logs. Although we believe manual inspection of performance trends is necessary, specifying the bottom-line performance in assert-based test cases can complement the use of performance log files, making the TFP testing results more visible to the developers. We're investigating the design of assert-based performance testing to improve the TFP process. Another direction of future work is automatic performance test generation. In this project, we relied on the performance architect's experience to identify the execution paths and measurement points for performance testing. We can derive this crucial information for performance testing from the performance requirements and system design. We plan to find guidelines for specifications of performance requirements and system design to make the automation possible
ISSN:0740-7459
1937-4194
DOI:10.1109/MS.2007.77