Environmental problems, such as climate change are global in scope and multivariate in complexity. Today, citizen scientists can make important contributions by providing observations to further understand environmental related issues and by playing an important role in data collection. Citizen scientists now have the ability to use EPA certified testing tools that increase their ability to collect accurate and precise environmental data. Smart phones allow citizens to efficiently submit timely data. Given that citizen scientists now have the capacity to be involved in scientifically meaningful data acquisition campaigns, it is important to evaluate the citizen scientists’ experience and engagement using technology to fully maximize their potential contribution. For this study we developed an interactive mobile app, called mWatershed, which enabled citizen scientists to be involved in all aspects of the campaign: environmental monitoring, information gathering, data collection and analysis, and reporting. Specifically, the citizen scientists were given EPA tools to test their drinking water or neighboring surface waters for: toxic metals, certain pesticides, nutrients and certain bacteria. Citizen scientists had the option to use the mWatershed app. At the end of the campaign they were invited to take a survey assessing their experience and engagement. The survey utilized the MUX instrument, which provides a holistic assessment of mobile software-device use. In addition, we included tailored engagement questions. We report on the results from our study and discuss implications for future citizen scientists’ efforts. We also examine the MUX instrument in the context of this research.