TY - JOUR
T1 - Can observation skills of citizen scientists be estimated using species accumulation curves?
AU - Kelling, Steve
AU - Johnston, Alison
AU - Hochachka, Wesley M.
AU - Iliff, Marshall
AU - Fink, Daniel
AU - Gerbracht, Jeff
AU - Lagoze, Carl
AU - La Sorte, Frank A.
AU - Moore, Travis
AU - Wiggins, Andrea
AU - Wong, Weng Keen
AU - Wood, Chris
AU - Yu, Jun
N1 - Publisher Copyright:
© 2015 Kelling et al.This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
PY - 2015/10/9
Y1 - 2015/10/9
N2 - Volunteers are increasingly being recruited into citizen science projects to collect observations for scientific studies. An additional goal of these projects is to engage and educate these volunteers. Thus, there are few barriers to participation resulting in volunteer observers with varying ability to complete the project's tasks. To improve the quality of a citizen science project's outcomes it would be useful to account for inter-observer variation, and to assess the rarely tested presumption that participating in a citizen science projects results in volunteers becoming better observers. Here we present a method for indexing observer variability based on the data routinely submitted by observers participating in the citizen science project eBird, a broad-scale monitoring project in which observers collect and submit lists of the bird species observed while birding. Our method for indexing observer variability uses species accumulation curves, lines that describe how the total number of species reported increase with increasing time spent in collecting observations. We find that differences in species accumulation curves among observers equates to higher rates of species accumulation, particularly for harder-to-identify species, and reveals increased species accumulation rates with continued participation. We suggest that these properties of our analysis provide a measure of observer skill, and that the potential to derive post-hoc data-derived measurements of participant ability should be more widely explored by analysts of data from citizen science projects. We see the potential for inferential results from analyses of citizen science data to be improved by accounting for observer skill.
AB - Volunteers are increasingly being recruited into citizen science projects to collect observations for scientific studies. An additional goal of these projects is to engage and educate these volunteers. Thus, there are few barriers to participation resulting in volunteer observers with varying ability to complete the project's tasks. To improve the quality of a citizen science project's outcomes it would be useful to account for inter-observer variation, and to assess the rarely tested presumption that participating in a citizen science projects results in volunteers becoming better observers. Here we present a method for indexing observer variability based on the data routinely submitted by observers participating in the citizen science project eBird, a broad-scale monitoring project in which observers collect and submit lists of the bird species observed while birding. Our method for indexing observer variability uses species accumulation curves, lines that describe how the total number of species reported increase with increasing time spent in collecting observations. We find that differences in species accumulation curves among observers equates to higher rates of species accumulation, particularly for harder-to-identify species, and reveals increased species accumulation rates with continued participation. We suggest that these properties of our analysis provide a measure of observer skill, and that the potential to derive post-hoc data-derived measurements of participant ability should be more widely explored by analysts of data from citizen science projects. We see the potential for inferential results from analyses of citizen science data to be improved by accounting for observer skill.
UR - http://www.scopus.com/inward/record.url?scp=84949032880&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84949032880&partnerID=8YFLogxK
U2 - 10.1371/journal.pone.0139600
DO - 10.1371/journal.pone.0139600
M3 - Article
C2 - 26451728
AN - SCOPUS:84949032880
SN - 1932-6203
VL - 10
JO - PloS one
JF - PloS one
IS - 10
M1 - e0139600
ER -