Chefs Know More than Just Recipes: Professional Vision in a Citizen Science Game

Marisa Ponti; Igor Stankovic; Wolmet Barendregt; Bruno Kestemont; Lyn Bain

doi:10.15346/hc.v5i1.1

Authors

Marisa Ponti University of Gothenburg http://orcid.org/0000-0003-4708-4048
Igor Stankovic University of Gothenburg http://orcid.org/0000-0001-7341-144X
Wolmet Barendregt University of Gothenburg
Bruno Kestemont Foldit Player - Go Science Team
Lyn Bain Foldit Player, Go Science Team

DOI:

https://doi.org/10.15346/hc.v5i1.1

Keywords:

Games with a Purpose, Citizen Science, Professional Vision, Scripts

Abstract

Some citizen science projects use “games with a purpose” (GWAPs) to integrate what humans and computers, respectively, can do well. One of these projects is Foldit, which invites talented players to predict three-dimensional (3D) models of proteins from their amino acid composition. This study investigated players’ professional vision and interpret their use of recipes, small scripts of computer code that automate some protein folding processes, to carry out their strategies more easily when solving game puzzles. Specifically, this study examined when, how and why the players ran recipes when solving the puzzles, and what actions those recipes performed in the gameplay.Autoethnographic accounts of players at different levels of experience (beginner, intermediate, and expert) with playing the game were analyzed using a grounded theory approach. The analysis of what these players observed and did visualized the professional vision necessary to use recipes sensibly and effectively. The findings highlight three key abilities: (a) seeing beauty; (b) repairing errors made by recipes, and (c) monitoring a large quantity of information to perform actions effectively. This study indicates that players indeed have to develop a professional vision independent of what the game itself can highlight. This is related to the nature of the game where it seems impossible for the game developers to show the affordances, because they are unknown. Players must learn to see the affordances and develop a professional vision, which means that they have to learn these skills through gaming.

Author Biographies

Marisa Ponti, University of Gothenburg

Marisa Ponti is an assistant professor at the Department of Applied IT at the University of Gothenburg, Sweden. She is interested in the use of technology to enhance new forms of scientific activities involving amateurs, such as hacker culture and citizen science. Contact information: marisa.ponti@ituniv.se

Wolmet Barendregt, University of Gothenburg

Wolmet Barendregt is an associate professor at the Department of Applied IT at the University of Gothenburg, Sweden. Her fields of interest are game based learning and interaction design and children. Contact information: wolmet.barendregt at ait.gu.se

Bruno Kestemont, Foldit Player - Go Science Team

Bruno Kestemont has been playing Foldit intensively during more than three years. He achieved the highest positions in the game ranking leagues, including an Overall Rank 2. Contact information: http://fold.it/portal/user/447652

Lyn Bain, Foldit Player, Go Science Team

Lyn Bain has an Australian Bachelor of Education Degree. Lyn was presented with Excellence in Science Teaching awarded by the Science Teachers Association for her work with training Teachers in Science and Technology for Children. Biological science has been a lifelong interest. Contact information: https://fold.it/portal/user/552390

References

Bravermann, H. (1974). Labor and Monopoly Capital: The Degradation of Work in the Twentieth Century. Monthly Review Press: London & New Work.

Brown, A. (2015). Awkward. In P. Lankoski and S. Björk (Eds.), Game Research Methods – An Overview. Retrieved from http://press.etc.cmu.edu/files/Game-Research-Methods_Lankoski-Bjork-etal-web.pdf

Carmeli, A., & Tishler, A. (2006). An empirical analysis of the relative importance of management team. International Journal of Manpower, 27, 9–36.

Charmaz, K. (2006). Constructing Grounded Theory: A Practical Guide through Qualitative Analysis. London: Sage.

Chi, T.H. M.(2006). Two approaches to the study of experts’ characteristics. In K. A. Ericsson, N. Charness, P. J. Feltovich, and R. R. Hoffman (Eds.), The Cambridge Handbook of Expertise and Expert Performance (pp. 21–30). Cambridge, UK: Cambridge University Press.

Collins, H. M., de Vries, G. H., & Bijker, W. E. (1997). Ways of going on: An analysis of skill applied to medical practice. Science, Technology, & Human Values, 22(3), 267-285.

Cooper, S. (2014). A Framework for Scientific Discovery Through Video Games. New York, NY: Association for Computing Machinery and Morgan & Claypool.

Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., … Foldit players (2010). Predicting protein structures with a multiplayer online game. Nature, 466, 756–760. DOI: 10.1038/nature09304

Cooper, S. Khatib, F., Makedon, I., Lu, H., Barbero, J., Baker, D., …Foldit Players. (2011). Analysis of social gameplay macros in the Foldit Cookbook. In FDG’11, Proceedings of the 6th International Conference on Foundations of Digital Games (pp. 9-14). ACM, New York, NY.

De Paoli, S. (2013). Automatic-play and player deskilling in MMORPGs. Game Studies: The International Journal of Computer Game Research, 13(1). Retrieved March 23, 2015 from http://gamestudies.org/1301/articles/depaoli_automatic_play

Good, B.M., & Su, A.I. (2013). Crowdsourcing for bioinformatics. Bioinformatics, 29(16), 1925-1933. doi: 10.1093/bioinformatics/btt333

Goodwin, C. (1994). Professional vision. American Anthropologist, 96(3), 606-633.

Gherardi, S. (2012). How to Conduct a Practice-Based Study. Cheltenham, UK: Edward Elgar Publishing.

Hand, E. (2010). Citizen science: People power. Nature, 466, 685-687. doi:10.1038/466685a

Khatib, F., Cooper, S., Tyka, M. D., Kefan, X., Makedon, I., Popovic, Z., … Foldit Players. (2011). Algorithm discovery by protein folding game players. PNAS, 108(47), 18949–18953. DOI: 10.1073/pnas.1115898108.

Lee, J., Kladwang, W., Lee, M., Cantu, D. et al. (2014). RNA design rules from a massive open laboratory. Proc. Natl. Acad. Sci. USA, 111, 2122-2127.

Lieberoth, A., Pedersen, M.K. Marin, A.C., Planke, T., & Sherson, J.F. (2014). Getting humans to do quantum optimization - User acquisition, engagement and early results from the citizen cyberscience game quantum moves. Human Computation, 1(2), 221-246.

Lintott, C. & Reed, J. (2013). Human computation in citizen science. In P. Michelucci, P. (Ed.), Handbook of Human Computation (pp. 153-162). New York: Springer.

Kawrykow, A., Roumanis, G., Kam, A. et al. (2012). Phylo: A citizen science approach for improving multiple sequence alignment. PloS One, 2(7):e31362.

Law, E. & von Ahn, L. (2011). Human computation. In R.J. Brachman, W.W. Cohen, & T. Dietterich (Eds.), Human computation (pp. 1-11). San Rafael, CA: Morgan & Claypool.

Linderoth, J. (2010). Why gamers don’t learn more: An ecological approach to games as learning environments. In Proceeding of DiGRA Nordic (Stockholm, 2010).

Ponti, M., & Stankovic, I. (2015). Scripts in a gamified crowdsourcing approach to do science. Short paper for the workshop on “Examining the Essence of the Crowds: Motivations, Roles and Identities” at the European Conference on Computer-Supported Cooperative Work – ECSCW, September 19-23, Oslo, Norway. Retrieved from https://marisaponti.files.wordpress.com/2015/03/ecscw_ws-mp_final.pdf

Poteete, A. R., Janssen, M. A., & Ostrom, E. (2010). Working Together:

Collective Action, the Commons, and Multiple Methods in Practice. Princeton, New Jersey: Princeton University Press.

Prestopnik, N., & Crowston, K. (2012). Purposeful gaming & socio-computational systems: A citizen science design case. In GROUP’12 Proceedings of the 17th ACM International Conference on Supporting Group Work (pp. 75-84), October 27-31, 2012, Sanibel Island, Florida. DOI: 10.1145/2389176.2389188.

Reeves, S, Brown B. & Laurier, E. (2009). Experts at play: understanding skilled expertise. Games and Culture, 4(3), 205-227.

Rouncefield, M. Slack, R., & Hartswood, M. (2011). Technology. In M. Rouncefield & P. Tolmie (Eds.), Ethnomethodology at Work (pp. 191-210), Ashgate Publishing Group: Farnham, UK.

Schell, J. (2008). The Art of Game Design: A Book of Lenses. Burlington, MA: Morgan Kaufmann Publishers.

Shamir, L., Yerby, C., Simpson, R., von Benda-Beckmann, A. M., Tyack, P., Samarra, F., et al. (2014). Classification of large acoustic datasets using machine learning and crowdsourcing: Application to whale calls. Acoustical Society of America, 135(2), 953–962.

Scott, K.S. (2004). Relating categories in grounded theory analysis: Using a conditional relationship guide and reflective coding matrix. The Qualitative Report, 9(1), 113-126.

Tedder, V. (2016). Digital stories and handmade skills: explorations in how digital methods can be used to study transmission of skills. In H. Snee, C. Hine, Y. Morey, S. Roberts & H. Watson (Eds.), Digital methods for Social Science (pp. 157-170). Palgrave Macmillan: Houndmills, UK.

von Ahn, L. (2005). Human Computation (Unpublished doctoral dissertation). Carnegie Mellon University, Pittsburgh, PA.

von Ahn, L. (2006). Games with a purpose. IEEE Computer Magazine, 96-98, June 2006.

von Ahn, L. & Dabbish, L. (2004). Labeling images with a computer game. In CHI’04, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 319–326), Vienna, Austria, April 24-29, 2004. DOI: 10.1145/985692.985733