Can observation skills of citizen scientists be estimated using species accumulation curves?

Steve Kelling, Alison Johnston, Wesley M. Hochachka, Marshall Iliff, Daniel Fink, Jeff Gerbracht, Carl Lagoze, Frank A. La Sorte, Travis Moore, Andrea Wiggins, Weng Keen Wong, Chris Wood, Jun Yu

Research output: Contribution to journalArticlepeer-review

107 Scopus citations


Volunteers are increasingly being recruited into citizen science projects to collect observations for scientific studies. An additional goal of these projects is to engage and educate these volunteers. Thus, there are few barriers to participation resulting in volunteer observers with varying ability to complete the project's tasks. To improve the quality of a citizen science project's outcomes it would be useful to account for inter-observer variation, and to assess the rarely tested presumption that participating in a citizen science projects results in volunteers becoming better observers. Here we present a method for indexing observer variability based on the data routinely submitted by observers participating in the citizen science project eBird, a broad-scale monitoring project in which observers collect and submit lists of the bird species observed while birding. Our method for indexing observer variability uses species accumulation curves, lines that describe how the total number of species reported increase with increasing time spent in collecting observations. We find that differences in species accumulation curves among observers equates to higher rates of species accumulation, particularly for harder-to-identify species, and reveals increased species accumulation rates with continued participation. We suggest that these properties of our analysis provide a measure of observer skill, and that the potential to derive post-hoc data-derived measurements of participant ability should be more widely explored by analysts of data from citizen science projects. We see the potential for inferential results from analyses of citizen science data to be improved by accounting for observer skill.

Original languageEnglish (US)
Article numbere0139600
JournalPloS one
Issue number10
StatePublished - Oct 9 2015
Externally publishedYes

ASJC Scopus subject areas

  • General


Dive into the research topics of 'Can observation skills of citizen scientists be estimated using species accumulation curves?'. Together they form a unique fingerprint.

Cite this