On the effectiveness of contracts as test oracles in the detection and diagnosis of functional faults in concurrent object-oriented software

Wladimir Araujo, Lionel C. Briand, Yvan Labiche

Research output: Contribution to journalArticlepeer-review

Abstract

Design by contract (DbC) is a software development methodology that focuses on clearly defining the interfaces between components to produce better quality object-oriented software. Though there exists ample support for DbC for sequential programs, applying DbC to concurrent programs presents several challenges. Using Java as the target programming language, we tackle such challenges by augmenting the Java Modelling Language (JML) and modifying the JML compiler (jmlc) to generate runtime assertion checking code to support DbC in concurrent programs. We applied our solution in a carefully designed case study on a highly concurrent industrial software system from the telecommunications domain to assess the effectiveness of contracts as test oracles in detecting and diagnosing functional faults in concurrent software. Based on these results, clear and objective requirements are defined for contracts to be effective test oracles for concurrent programs whilst balancing the effort to design them. Effort is measured indirectly through the contract complexity measure (CCM), a measure we define. Main results include that contracts of a realistic level of completeness and complexity can detect around 76 percent of faults and reduce the diagnosis effort for such faults tenfold. We, therefore, show that DbC can be applied to concurrent software and can be a valuable tool to improve the economics of software engineering.

Original languageEnglish
Article number6857355
Pages (from-to)971-992
Number of pages22
JournalIEEE Transactions on Software Engineering
Volume40
Issue number10
DOIs
Publication statusPublished - 1 Oct 2014
Externally publishedYes

Keywords

  • Concurrent programming
  • object-oriented programming
  • Software Quality/SQA-Measurement applied to SQA and V and V
  • Software/Program Verification-Programming by contract

Fingerprint

Dive into the research topics of 'On the effectiveness of contracts as test oracles in the detection and diagnosis of functional faults in concurrent object-oriented software'. Together they form a unique fingerprint.

Cite this