OpenRank Leaderboard: Motivating Open Source Collaborations Through Social Network Evaluation in Alibaba

Shengyu Zhao; Xiaoya Xia; Brian Fitzgerald; Xiaozhou Li; Valentina Lenarduzzi; Davide Taibi; Rong Wang; Wei Wang; Chunqi Tian

doi:10.1145/3639477.3639734

OpenRank Leaderboard: Motivating Open Source Collaborations Through Social Network Evaluation in Alibaba

Shengyu Zhao
, Xiaoya Xia
, Brian Fitzgerald
, Xiaozhou Li
, Valentina Lenarduzzi
, Davide Taibi
, Rong Wang
, Wei Wang
, Chunqi Tian

Tongji University
East China Normal University
University of Oulu
Alibaba Group Holding Ltd.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Open source has revolutionized how software development is carried out, with a growing number of individuals and organizations contributing to open source projects. As the importance of open source continues to grow, companies also expect to grow thriving and sustainable open source communities with continued contributions and better collaborations. In this study, we applied the contribution leaderboard to seven open source projects initiated by Alibaba. We conducted a case study to investigate the perceptions and facts regarding how to motivate collaboration through gamification. Specifically, we employed a social network algorithm, OpenRank, to evaluate and steer developers' contributions. We validated the effectiveness of OpenRank by comparing it with other evaluation metrics and surveying developers. Through semi-structured interviews and project metric analysis, we found that the OpenRank Leaderboard can promote transparent communication environments, a better community atmosphere, and improved collaboration behavior.

Original language	English
Title of host publication	Proceedings - 2024 ACM/IEEE 44th International Conference on Software Engineering
Subtitle of host publication	New Ideas and Emerging Results, ICSE-SEIP 2024
Publisher	Association for Computing Machinery
Pages	346-357
Number of pages	12
ISBN (Electronic)	9798400705007
DOIs	https://doi.org/10.1145/3639477.3639734
Publication status	Published - 31 May 2024
Event	2024 ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-SEIP 2024 - Lisbon, Portugal Duration: 14 Apr 2024 → 20 Apr 2024

Publication series

Name	ACM International Conference Proceeding Series

Conference

Conference	2024 ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-SEIP 2024
Country/Territory	Portugal
City	Lisbon
Period	14/04/24 → 20/04/24

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 9 Industry, Innovation, and Infrastructure

Keywords

gamification
leaderboard
open source contribution
social network

Access to Document

10.1145/3639477.3639734

Cite this

Zhao, S., Xia, X., Fitzgerald, B., Li, X., Lenarduzzi, V., Taibi, D., Wang, R., Wang, W., & Tian, C. (2024). OpenRank Leaderboard: Motivating Open Source Collaborations Through Social Network Evaluation in Alibaba. In Proceedings - 2024 ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-SEIP 2024 (pp. 346-357). (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3639477.3639734

Zhao, Shengyu ; Xia, Xiaoya ; Fitzgerald, Brian et al. / OpenRank Leaderboard : Motivating Open Source Collaborations Through Social Network Evaluation in Alibaba. Proceedings - 2024 ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-SEIP 2024. Association for Computing Machinery, 2024. pp. 346-357 (ACM International Conference Proceeding Series).

@inproceedings{9601c5df60984d87800f45e482fd8fd7,

title = "OpenRank Leaderboard: Motivating Open Source Collaborations Through Social Network Evaluation in Alibaba",

abstract = "Open source has revolutionized how software development is carried out, with a growing number of individuals and organizations contributing to open source projects. As the importance of open source continues to grow, companies also expect to grow thriving and sustainable open source communities with continued contributions and better collaborations. In this study, we applied the contribution leaderboard to seven open source projects initiated by Alibaba. We conducted a case study to investigate the perceptions and facts regarding how to motivate collaboration through gamification. Specifically, we employed a social network algorithm, OpenRank, to evaluate and steer developers' contributions. We validated the effectiveness of OpenRank by comparing it with other evaluation metrics and surveying developers. Through semi-structured interviews and project metric analysis, we found that the OpenRank Leaderboard can promote transparent communication environments, a better community atmosphere, and improved collaboration behavior.",

keywords = "gamification, leaderboard, open source contribution, social network",

author = "Shengyu Zhao and Xiaoya Xia and Brian Fitzgerald and Xiaozhou Li and Valentina Lenarduzzi and Davide Taibi and Rong Wang and Wei Wang and Chunqi Tian",

note = "Publisher Copyright: Copyright {\textcopyright} 2024 held by the owner/author(s).; 2024 ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-SEIP 2024 ; Conference date: 14-04-2024 Through 20-04-2024",

year = "2024",

month = may,

day = "31",

doi = "10.1145/3639477.3639734",

language = "English",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery",

pages = "346--357",

booktitle = "Proceedings - 2024 ACM/IEEE 44th International Conference on Software Engineering",

}

Zhao, S, Xia, X, Fitzgerald, B, Li, X, Lenarduzzi, V, Taibi, D, Wang, R, Wang, W & Tian, C 2024, OpenRank Leaderboard: Motivating Open Source Collaborations Through Social Network Evaluation in Alibaba. in Proceedings - 2024 ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-SEIP 2024. ACM International Conference Proceeding Series, Association for Computing Machinery, pp. 346-357, 2024 ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-SEIP 2024, Lisbon, Portugal, 14/04/24. https://doi.org/10.1145/3639477.3639734

OpenRank Leaderboard: Motivating Open Source Collaborations Through Social Network Evaluation in Alibaba. / Zhao, Shengyu; Xia, Xiaoya; Fitzgerald, Brian et al.
Proceedings - 2024 ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-SEIP 2024. Association for Computing Machinery, 2024. p. 346-357 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - OpenRank Leaderboard

T2 - 2024 ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-SEIP 2024

AU - Zhao, Shengyu

AU - Xia, Xiaoya

AU - Fitzgerald, Brian

AU - Li, Xiaozhou

AU - Lenarduzzi, Valentina

AU - Taibi, Davide

AU - Wang, Rong

AU - Wang, Wei

AU - Tian, Chunqi

PY - 2024/5/31

Y1 - 2024/5/31

N2 - Open source has revolutionized how software development is carried out, with a growing number of individuals and organizations contributing to open source projects. As the importance of open source continues to grow, companies also expect to grow thriving and sustainable open source communities with continued contributions and better collaborations. In this study, we applied the contribution leaderboard to seven open source projects initiated by Alibaba. We conducted a case study to investigate the perceptions and facts regarding how to motivate collaboration through gamification. Specifically, we employed a social network algorithm, OpenRank, to evaluate and steer developers' contributions. We validated the effectiveness of OpenRank by comparing it with other evaluation metrics and surveying developers. Through semi-structured interviews and project metric analysis, we found that the OpenRank Leaderboard can promote transparent communication environments, a better community atmosphere, and improved collaboration behavior.

AB - Open source has revolutionized how software development is carried out, with a growing number of individuals and organizations contributing to open source projects. As the importance of open source continues to grow, companies also expect to grow thriving and sustainable open source communities with continued contributions and better collaborations. In this study, we applied the contribution leaderboard to seven open source projects initiated by Alibaba. We conducted a case study to investigate the perceptions and facts regarding how to motivate collaboration through gamification. Specifically, we employed a social network algorithm, OpenRank, to evaluate and steer developers' contributions. We validated the effectiveness of OpenRank by comparing it with other evaluation metrics and surveying developers. Through semi-structured interviews and project metric analysis, we found that the OpenRank Leaderboard can promote transparent communication environments, a better community atmosphere, and improved collaboration behavior.

KW - gamification

KW - leaderboard

KW - open source contribution

KW - social network

UR - https://www.scopus.com/pages/publications/85195262946

U2 - 10.1145/3639477.3639734

DO - 10.1145/3639477.3639734

M3 - Conference contribution

AN - SCOPUS:85195262946

T3 - ACM International Conference Proceeding Series

SP - 346

EP - 357

BT - Proceedings - 2024 ACM/IEEE 44th International Conference on Software Engineering

PB - Association for Computing Machinery

Y2 - 14 April 2024 through 20 April 2024

ER -

Zhao S, Xia X, Fitzgerald B, Li X, Lenarduzzi V, Taibi D et al. OpenRank Leaderboard: Motivating Open Source Collaborations Through Social Network Evaluation in Alibaba. In Proceedings - 2024 ACM/IEEE 44th International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-SEIP 2024. Association for Computing Machinery. 2024. p. 346-357. (ACM International Conference Proceeding Series). doi: 10.1145/3639477.3639734

OpenRank Leaderboard: Motivating Open Source Collaborations Through Social Network Evaluation in Alibaba

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this