Industrial experiences with automated regression testing of a legacy database application

Erik Rogstad, Lionel Briand, Ronny Dalberg, Marianne Rynning, Erik Arisholm

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper presents a practical approach and tool (DART) for functional black-box regression testing of complex legacy database applications. Such applications are important to many organizations, but are often difficult to change and consequently prone to regression faults during maintenance. They also tend to be built without particular considerations for testability and can be hard to control and observe. We have therefore devised a practical solution for functional regression testing that captures the changes in database state (due to data manipulations) during the execution of a system under test. The differences in changed database states between consecutive executions of the system under test, on different system versions, can help identify potential regression faults. In order to make the regression test approach scalable for large, complex database applications, classification tree models are used to prioritize test cases. The test case prioritization can be applied to reduce test execution costs and analysis effort. We report on how DART was applied and evaluated on business critical batch jobs in a legacy database application in an industrial setting, namely the Norwegian Tax Accounting System (SOFIE) at the Norwegian Tax Department (NTD). DART has shown promising fault detection capabilities and cost-effectiveness and has contributed to identify many critical regression faults for the past eight releases of SOFIE.

Original languageEnglish
Title of host publicationProceedings of the 27th IEEE International Conference on Software Maintenance, ICSM 2011
Pages362-371
Number of pages10
DOIs
Publication statusPublished - 2011
Externally publishedYes
Event27th IEEE International Conference on Software Maintenance, ICSM 2011 - Williamsburg, VA, United States
Duration: 25 Sep 201130 Sep 2011

Publication series

NameIEEE International Conference on Software Maintenance, ICSM

Conference

Conference27th IEEE International Conference on Software Maintenance, ICSM 2011
Country/TerritoryUnited States
CityWilliamsburg, VA
Period25/09/1130/09/11

Keywords

  • industrial context
  • legacy database applications
  • regression testing

Fingerprint

Dive into the research topics of 'Industrial experiences with automated regression testing of a legacy database application'. Together they form a unique fingerprint.

Cite this