TY - JOUR
T1 - An investigation of unpaid crowdsourcing
AU - Borromeo, Ria Mae
AU - Toyama, Motomichi
N1 - Publisher Copyright:
© 2016, The Author(s).
PY - 2016/12/1
Y1 - 2016/12/1
N2 - The continual advancement of internet technologies has led to the evolution of how individuals and organizations operate. For example, through the internet, we can now tap a remote workforce to help us accomplish certain tasks, a phenomenon called crowdsourcing. Crowdsourcing is an approach that relies on people to perform activities that are costly or time-consuming using traditional methods. Depending on the incentive given to the crowd workers, crowdsourcing can be classified as paid or unpaid. In paid crowdsourcing, the workers are incentivized financially, enabling the formation of a robust workforce, which allows fast completion of tasks. Consequently, in unpaid crowdsourcing, the lack of financial incentive potentially leads to an unpredictable workforce and indeterminable task completion time. However, since payment to workers is not necessary, it can be an economical alternative for individuals and organizations who are more concerned about the budget than the task turnaround time. In this study, we explore unpaid crowdsourcing by reviewing crowdsourcing applications where the crowd comes from a pool of volunteers. We also evaluate its performance in sentiment analysis and data extraction projects. Our findings suggest that for such tasks, unpaid crowdsourcing completes slower but yields results of similar or higher quality compared to its paid counterpart.
AB - The continual advancement of internet technologies has led to the evolution of how individuals and organizations operate. For example, through the internet, we can now tap a remote workforce to help us accomplish certain tasks, a phenomenon called crowdsourcing. Crowdsourcing is an approach that relies on people to perform activities that are costly or time-consuming using traditional methods. Depending on the incentive given to the crowd workers, crowdsourcing can be classified as paid or unpaid. In paid crowdsourcing, the workers are incentivized financially, enabling the formation of a robust workforce, which allows fast completion of tasks. Consequently, in unpaid crowdsourcing, the lack of financial incentive potentially leads to an unpredictable workforce and indeterminable task completion time. However, since payment to workers is not necessary, it can be an economical alternative for individuals and organizations who are more concerned about the budget than the task turnaround time. In this study, we explore unpaid crowdsourcing by reviewing crowdsourcing applications where the crowd comes from a pool of volunteers. We also evaluate its performance in sentiment analysis and data extraction projects. Our findings suggest that for such tasks, unpaid crowdsourcing completes slower but yields results of similar or higher quality compared to its paid counterpart.
KW - Crowdsourcing
KW - Data extraction
KW - Platforms
KW - Sentiment analysis
UR - http://www.scopus.com/inward/record.url?scp=84982808397&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84982808397&partnerID=8YFLogxK
U2 - 10.1186/s13673-016-0068-z
DO - 10.1186/s13673-016-0068-z
M3 - Review article
AN - SCOPUS:84982808397
SN - 2192-1962
VL - 6
JO - Human-centric Computing and Information Sciences
JF - Human-centric Computing and Information Sciences
IS - 1
M1 - 11
ER -