A systematic literature review on fault prediction performance in software engineering

Tracy Hall, Sarah Beecham, David Bowes, David Gray, Steve Counsell

Research output: Contribution to journalReview articlepeer-review

Abstract

Background: The accurate prediction of where faults are likely to occur in code can help direct test effort, reduce costs, and improve the quality of software. Objective: We investigate how the context of models, the independent variables used, and the modeling techniques applied influence the performance of fault prediction models. Method: We used a systematic literature review to identify 208 fault prediction studies published from January 2000 to December 2010. We synthesize the quantitative and qualitative results of 36 studies which report sufficient contextual and methodological information according to the criteria we develop and apply. Results: The models that perform well tend to be based on simple modeling techniques such as Naive Bayes or Logistic Regression. Combinations of independent variables have been used by models that perform well. Feature selection has been applied to these combinations when models are performing particularly well. Conclusion: The methodology used to build models seems to be influential to predictive performance. Although there are a set of fault prediction studies in which confidence is possible, more studies are needed that use a reliable methodology and which report their context, methodology, and performance comprehensively.

Original languageEnglish
Article number6035727
Pages (from-to)1276-1304
Number of pages29
JournalIEEE Transactions on Software Engineering
Volume38
Issue number6
DOIs
Publication statusPublished - 2012

Keywords

  • software fault prediction
  • Systematic literature review

Fingerprint

Dive into the research topics of 'A systematic literature review on fault prediction performance in software engineering'. Together they form a unique fingerprint.

Cite this