Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems

C. Estelle Smith; Bowen Yu; Anjali Srivastava; Aaron L Halfaker; Loren Terveen; Haiyi Zhu

doi:10.1145/3313831.3376783

Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems

C. Estelle Smith, Bowen Yu, Anjali Srivastava, Aaron L Halfaker, Loren Terveen, Haiyi Zhu

Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

43 Scopus citations

Abstract

On Wikipedia, sophisticated algorithmic tools are used to assess the quality of edits and take corrective actions. However, algorithms can fail to solve the problems they were designed for if they conflict with the values of communities who use them. In this study, we take a Value-Sensitive Algorithm Design approach to understanding a community-created and -maintained machine learning-based algorithm called the Objective Revision Evaluation System (ORES) - -A quality prediction system used in numerous Wikipedia applications and contexts. Five major values converged across stakeholder groups that ORES (and its dependent applications) should: (1) reduce the effort of community maintenance, (2) maintain human judgement as the final authority, (3) support differing peoples' differing workflows, (4) encourage positive engagement with diverse editor groups, and (5) establish trustworthiness of people and algorithms within the community. We reveal tensions between these values and discuss implications for future research to improve algorithms like ORES.

Original language	English (US)
Title of host publication	CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
Publisher	Association for Computing Machinery
ISBN (Electronic)	9781450367080
DOIs	https://doi.org/10.1145/3313831.3376783
State	Published - Apr 21 2020
Event	2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020 - Honolulu, United States Duration: Apr 25 2020 → Apr 30 2020

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020
Country/Territory	United States
City	Honolulu
Period	4/25/20 → 4/30/20

Bibliographical note

Funding Information:
We thank our anonymous reviewers, Zhiwei Steven Wu, colleagues at GroupLens Research at the University of Minnesota, and the HCI Institute at Carnegie Mellon University for their feedback. This work was supported by the National Science Foundation (NSF) under Award No. IIS-2001851 and IIS-2000782, and the NSF Program on Fairness in AI in collaboration with Amazon under Award No. IIS-1939606.

Publisher Copyright:
© 2020 Owner/Author.

Keywords

ORES
community values
machine learning
peer production
value sensitive algorithm design
wikipedia

Access

10.1145/3313831.3376783

OpenUrl availability

Full text

Cite this

Smith, C. E., Yu, B., Srivastava, A., Halfaker, A. L., Terveen, L., & Zhu, H. (2020). Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems. In CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems Article 3376783 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/3313831.3376783

Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems. / Smith, C. Estelle; Yu, Bowen; Srivastava, Anjali et al.
CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 2020. 3376783 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Smith, CE, Yu, B, Srivastava, A, Halfaker, AL, Terveen, L & Zhu, H 2020, Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems. in CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems., 3376783, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery, 2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020, Honolulu, United States, 4/25/20. https://doi.org/10.1145/3313831.3376783

Smith CE, Yu B, Srivastava A, Halfaker AL, Terveen L , Zhu H. Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems. In CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery. 2020. 3376783. (Conference on Human Factors in Computing Systems - Proceedings). doi: 10.1145/3313831.3376783

@inproceedings{591ad7e1b64a458e8a6a44d333139a4b,

title = "Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems",

abstract = "On Wikipedia, sophisticated algorithmic tools are used to assess the quality of edits and take corrective actions. However, algorithms can fail to solve the problems they were designed for if they conflict with the values of communities who use them. In this study, we take a Value-Sensitive Algorithm Design approach to understanding a community-created and -maintained machine learning-based algorithm called the Objective Revision Evaluation System (ORES) - -A quality prediction system used in numerous Wikipedia applications and contexts. Five major values converged across stakeholder groups that ORES (and its dependent applications) should: (1) reduce the effort of community maintenance, (2) maintain human judgement as the final authority, (3) support differing peoples' differing workflows, (4) encourage positive engagement with diverse editor groups, and (5) establish trustworthiness of people and algorithms within the community. We reveal tensions between these values and discuss implications for future research to improve algorithms like ORES.",

keywords = "ORES, community values, machine learning, peer production, value sensitive algorithm design, wikipedia",

author = "Smith, {C. Estelle} and Bowen Yu and Anjali Srivastava and Halfaker, {Aaron L} and Loren Terveen and Haiyi Zhu",

note = "Funding Information: We thank our anonymous reviewers, Zhiwei Steven Wu, colleagues at GroupLens Research at the University of Minnesota, and the HCI Institute at Carnegie Mellon University for their feedback. This work was supported by the National Science Foundation (NSF) under Award No. IIS-2001851 and IIS-2000782, and the NSF Program on Fairness in AI in collaboration with Amazon under Award No. IIS-1939606. Publisher Copyright: {\textcopyright} 2020 Owner/Author.; 2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020 ; Conference date: 25-04-2020 Through 30-04-2020",

year = "2020",

month = apr,

day = "21",

doi = "10.1145/3313831.3376783",

language = "English (US)",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery",

booktitle = "CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems",

}

TY - GEN

T1 - Keeping Community in the Loop

T2 - 2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020

AU - Smith, C. Estelle

AU - Yu, Bowen

AU - Srivastava, Anjali

AU - Halfaker, Aaron L

AU - Terveen, Loren

AU - Zhu, Haiyi

N1 - Funding Information: We thank our anonymous reviewers, Zhiwei Steven Wu, colleagues at GroupLens Research at the University of Minnesota, and the HCI Institute at Carnegie Mellon University for their feedback. This work was supported by the National Science Foundation (NSF) under Award No. IIS-2001851 and IIS-2000782, and the NSF Program on Fairness in AI in collaboration with Amazon under Award No. IIS-1939606. Publisher Copyright: © 2020 Owner/Author.

PY - 2020/4/21

Y1 - 2020/4/21

N2 - On Wikipedia, sophisticated algorithmic tools are used to assess the quality of edits and take corrective actions. However, algorithms can fail to solve the problems they were designed for if they conflict with the values of communities who use them. In this study, we take a Value-Sensitive Algorithm Design approach to understanding a community-created and -maintained machine learning-based algorithm called the Objective Revision Evaluation System (ORES) - -A quality prediction system used in numerous Wikipedia applications and contexts. Five major values converged across stakeholder groups that ORES (and its dependent applications) should: (1) reduce the effort of community maintenance, (2) maintain human judgement as the final authority, (3) support differing peoples' differing workflows, (4) encourage positive engagement with diverse editor groups, and (5) establish trustworthiness of people and algorithms within the community. We reveal tensions between these values and discuss implications for future research to improve algorithms like ORES.

AB - On Wikipedia, sophisticated algorithmic tools are used to assess the quality of edits and take corrective actions. However, algorithms can fail to solve the problems they were designed for if they conflict with the values of communities who use them. In this study, we take a Value-Sensitive Algorithm Design approach to understanding a community-created and -maintained machine learning-based algorithm called the Objective Revision Evaluation System (ORES) - -A quality prediction system used in numerous Wikipedia applications and contexts. Five major values converged across stakeholder groups that ORES (and its dependent applications) should: (1) reduce the effort of community maintenance, (2) maintain human judgement as the final authority, (3) support differing peoples' differing workflows, (4) encourage positive engagement with diverse editor groups, and (5) establish trustworthiness of people and algorithms within the community. We reveal tensions between these values and discuss implications for future research to improve algorithms like ORES.

KW - ORES

KW - community values

KW - machine learning

KW - peer production

KW - value sensitive algorithm design

KW - wikipedia

UR - http://www.scopus.com/inward/record.url?scp=85091269334&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85091269334&partnerID=8YFLogxK

U2 - 10.1145/3313831.3376783

DO - 10.1145/3313831.3376783

M3 - Conference contribution

AN - SCOPUS:85091269334

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

Y2 - 25 April 2020 through 30 April 2020

ER -

Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this