TY - GEN
T1 - Using Ensemble Inference to Improve Recall of Clone Detection
AU - Ahmed, Gul Aftab
AU - Patten, James Vincent
AU - Han, Yuanhua
AU - Lu, Guoxian
AU - Gregg, David
AU - Buckley, Jim
AU - Chochlov, Muslim
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Large-scale source-code clone detection is a challenging task. In our previous work, we proposed an approach (SSCD) that leverages artificial neural networks and approximates nearest neighbour search to effectively and efficiently locate clones in large-scale bodies of code, in a time-efficient manner. However, our literature review suggests that the relative efficacy of differing neural network models has not been assessed in the context of large-scale clone detection approaches. In this work, we aim to assess several such models individually, in terms of their potential to maximize recall, while preserving a high level of precision during clone detection. We investigate if ensemble inference (in this case, using the results of more than one of these neural network models in combination) can further assist in this task. To assess this, we employed four state-of-The-Art neural network models and evaluated them individually/in combination. The results, on an illustrative dataset of approximately 500K lines of C/C++ code, suggest that ensemble inference outperforms individual models in all trialled cases, when recall is concerned. Of individual models, the ADA model (belonging to the ChatGPT family of models) has the best performance. However commercial companies may not be prepared to hand their proprietary source code over to the cloud, as required by that approach. Consequently, they may be more interested in an ensemblecombination of CodeBERT-based and CodeT5 models, resulting in similar (if slightly lesser) recall and precision results.
AB - Large-scale source-code clone detection is a challenging task. In our previous work, we proposed an approach (SSCD) that leverages artificial neural networks and approximates nearest neighbour search to effectively and efficiently locate clones in large-scale bodies of code, in a time-efficient manner. However, our literature review suggests that the relative efficacy of differing neural network models has not been assessed in the context of large-scale clone detection approaches. In this work, we aim to assess several such models individually, in terms of their potential to maximize recall, while preserving a high level of precision during clone detection. We investigate if ensemble inference (in this case, using the results of more than one of these neural network models in combination) can further assist in this task. To assess this, we employed four state-of-The-Art neural network models and evaluated them individually/in combination. The results, on an illustrative dataset of approximately 500K lines of C/C++ code, suggest that ensemble inference outperforms individual models in all trialled cases, when recall is concerned. Of individual models, the ADA model (belonging to the ChatGPT family of models) has the best performance. However commercial companies may not be prepared to hand their proprietary source code over to the cloud, as required by that approach. Consequently, they may be more interested in an ensemblecombination of CodeBERT-based and CodeT5 models, resulting in similar (if slightly lesser) recall and precision results.
KW - artificial neural networks
KW - clone detection
KW - ensemble inference
UR - http://www.scopus.com/inward/record.url?scp=85190068792&partnerID=8YFLogxK
U2 - 10.1109/IWSC60764.2023.00010
DO - 10.1109/IWSC60764.2023.00010
M3 - Conference contribution
AN - SCOPUS:85190068792
T3 - Proceedings - 2023 IEEE 17th International Workshop on Software Clones, IWSC 2023
SP - 15
EP - 21
BT - Proceedings - 2023 IEEE 17th International Workshop on Software Clones, IWSC 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 17th IEEE International Workshop on Software Clones, IWSC 2023
Y2 - 1 October 2023
ER -