Design and Evaluation of a "Gamified" System for Improving Career Knowledge in Computing Sciences
DOI:
https://doi.org/10.23962/10539/21322Keywords:
computing sciences (CS), gamification, Mechanics, Dynamics and Aesthetics (MDA) classification framework, usability;, user experience (UX), educational usabilityAbstract
"Gamification", or the use of game elements outside the gaming context, is a recent trend in learning approaches and has been used to digitally engage and motivate people to accomplish their learning objectives. The study described in this article investigated components of a gamification system and the impact of these components on user experience, usability and education usability. The Mechanics, Dynamics and Aesthetics (MDA) classification framework for gamification design was used to guide the authors' design of a gamification system intended to improve learners’ knowledge of careers in computing sciences (CS). Criteria for evaluating e-learning systems were derived from literature and used to extend the MDA framework via addition of criteria for evaluating usability, user experience (UX) and educational usability of a gamification system. The extended MDA framework was found to be successful in guiding the design, development and evaluation of the system prototype, and the results gathered from the summative usability evaluation indicated that positive UX and educational usability were achieved. The results suggest that gamification designed for UX and educational usability can potentially play an important role in equipping young people in South Africa with a knowledge of CS-related careers.
References
Amir, B., & Ralph, P. (2014). Proposing a theory of gamification effectiveness. Paper presented at the 36th International Conference on Software Engineering, New York. https://doi.org/10.1145/2591062.2591148
Ašeriškis, D., & Damaševičius, R. (2014). Gamification patterns for gamification applications. Procedia Computer Science, 39, 83-90. https://doi.org/10.1016/j.procs.2014.11.013
Barata, G., Gama, S., Jorge, J., & Gonçalves, D. (2013). Improving participation and learning with gamification. Paper presented at the First International Conference on Gameful Design, Research, and Applications, New York. https://doi.org/10.1145/2583008.2583010
Beier, L. (2014). Evaluating the use of gamification in higher education to improve students' engagement. Diploma thesis, Dresden University of Technology, Germany.
Browne, K., Anand, C., & Gosse, E. (2014). Gamification and serious game approaches for adult literacy tablet software. Entertainment Computing, 5(3), 135-146. https://doi.org/10.1016/j.entcom.2014.04.003
Burke, B. (2014). Gartner redefines gamification. Retrieved from http://blogs.gartner.com/brian_burke/2014/04/04/gartner-redefines-gamification
Calitz, A. (2010). Model for the alignment of ICT education with business ICT skills requirements. Doctoral dissertation, Business School, Nelson Mandela Metropolitan University, Port Elizabeth, South Africa.
Carcary, M., Sherry, M., McLaughlin, S., & O'Brien, C. (2012). Career development for ICT professionals: Driving transparency in educational attainment. Paper presented at the 8th European Conference on Management Leadership and Governance, Reading,UK.
Codish, D., & Ravid, G. (2014). Adaptive approach for gamification optimization. Paper presented at the 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing, New York. https://doi.org/10.1109/UCC.2014.94
Csikszentmihalyi, M. (1990). Flow: The psychology optimal experience. New York, NY: Harper Perennial.
Darejeh, A., & Salim, S. S. (2016). Gamification solutions to enhance software user engagement - A systematic review. International Journal of Human-Computer Interaction, 32(8). https://doi.org/10.1080/10447318.2016.1183330
Da Rocha Seixas, L., Gomes, A. S., & De Melo Filho, I. J. (2016). Effectiveness of gamification in the engagement of students. Journal Computers in Human Behavior, 58(C), 48-63. https://doi.org/10.1016/j.chb.2015.11.021
Deterding, S., Björk, S. L., Nacke, L. E., Dixon, D., & Lawley, E. (2013). Designing gamification: Creating gameful and playful experiences. Paper presented at CHI '13 Extended Abstracts on Human Factors in Computing Systems, New York. https://doi.org/10.1145/2468356.2479662
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011a). From game design elements to gamefulness: Defining "gamification". Paper presented at the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, New York. https://doi.org/10.1145/2181037.2181040
Deterding, S., Khaled, R., Nacke, L. E., & Dixon, D. (2011b). Gamification: Toward a definition. Paper presented at CHI 2011 Workshop Gamification: Using Game Design Elements in Non-Game Contexts, Vancouver. https://doi.org/10.1145/1979742.1979575
Domínguez, A., Saenz-de-Navarrete, J., de-Marcos, L., Fernández-Sanz, L., Pagés, C., & Martínez-Herráiz, J. J. (2013). Gamifying learning experiences: Practical implications and outcomes. Computers & Education, 63, 380-392. https://doi.org/10.1016/j.compedu.2012.12.020
El-Masri, M., & Tarhini, A. (2015). A design science approach to gamify education: From games to platforms. Paper presented at the Twenty-Third European Conference on Information Systems (ECIS), Münster, Germany.
Erenli, K. (2013). The impact of gamification: Recommending education scenarios. International Journal of Emerging Technologies in Learning, 8, 15-21. https://doi.org/10.3991/ijet.v8iS1.2320
Ernst, J. V., & Clark, A. C. (2012). Fundamental computer science conceptual understandings for high school students using original computer game design. Journal of STEM Education: Innovations and Research, 13(5), 40-45.
Gee, J. P. (2003). What video games have to teach us about learning and literacy. Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment, 1(1), 20.
https://doi.org/10.1145/950566.950595
Growth Engineering. (2015). Gartner's gamification predictions for 2020. Retrieved from http://www.growthengineering.co.uk/future-of-gamification-gartner
Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work? - A literature review of empirical studies on gamification. Paper presented at the 47th Hawaii International Conference on System Sciences.
https://doi.org/10.1109/HICSS.2014.377
Harman, K., Koohang, A., & Paliszkiewicz, J. (2014). Scholarly interest in gamification: A citation network analysis. Industrial Management & Data Systems, 114(9), 1438-1452. https://doi.org/10.1108/IMDS-07-2014-0208
Harpur, P. A., & De Villiers, M. R. (2015). MUUX-E, a framework of criteria for evaluating the usability, user experience and educational features of m-learning environments. South African Computer Journal, 56.
https://doi.org/10.18489/sacj.v56i1.240
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004). Design science in information systems research. MIS Quarterly, 28(1), 75-105. https://doi.org/10.2307/25148625
Hunicke, R., LeBlanc, M., & Zubek, R. (2004). MDA: A formal approach to game design and game research. Paper presented at the Association for the Advancement of Artificial Intelligence Workshop on Challenges in Game Artificial Intelligence, San Jose, CA.
Ibáñez, M. B., Di-Serio, A., & Delgado-Kloos, C. (2014). Gamification for engaging computer science students in learning activities: A case study. IEEE Transactions on Learning Technologies, 7(3), 291-301.
https://doi.org/10.1109/TLT.2014.2329293
Iosup, A., & Epema, D. (2014). An experience report on using gamification in technical higher education. Paper presented at the 45th ACM Technical Symposium on Computer Science Education, New York.
https://doi.org/10.1145/2538862.2538899
International Standards Organisation (ISO). (1997). ISO 9241-11: Ergonomic requirements for office work with visual display terminals (VDT's). Part 11: Guidelines for specifying and measuring usability.
ISO. (2009). ISO 9241-210: 2010: Ergonomics of human-system interaction. Part 210: Human-centred design for interactive systems.
Jacobs, C., & Sewry, D. A. (2009). Learner inclinations to study computer science or information systems at tertiary level. South African Computer Journal, 45, 85-91. https://doi.org/10.18489/sacj.v45i0.34
Kim, B. (2015). Game mechanics, dynamics and aesthetics. Library Technology Reports, 51(2), 17-20.
Knaving, K., & Björk, S. (2013). Designing for fun and play: Exploring possibilities in design for gamification. Paper presented at the First International Conference on Gameful Design, Research, and Applications, New York. https://doi.org/10.1145/2583008.2583032
Landers, R. N. (2014). Developing a theory of gamified learning: Linking serious games and gamification of learning. Simulation Gaming, 45(6), 752-768. https://doi.org/10.1177/1046878114563660
Leacock, T. L., & Nesbit, J. C. (2007). A framework for evaluating the quality of multimedia learning resources. Journal of Educational Technology & Society, 10(2), 44-59.
Lee, J. J., & Hammer, J. (2011). Gamification in education: What, how, why bother? Academic Exchange Quarterly, 15(2), 1-5. Retrieved from http://www.academia.edu/570970/Gamification_in_Education_What_How_Why_Bother
Levinson, D. J. (1994). A conception of adult development. In R. D. Gross (Ed.), Key studies in psychology (pp. 304-305). London: Hodder & Stoughton.
Meder, M., & Jain, B. J. (2014). The gamification design problem. Retrieved from http://arxiv.org/abs/1407.0843
Mekler, E. D., Brühlmann, F., Opwis, K., & Tuch, A. N. (2013). Do points, levels and leaderboards harm intrinsic motivation?: An empirical analysis of common gamification elements. Paper presented at the First International Conference on GamefulDesign, Research, and Applications, New York. https://doi.org/10.1145/2583008.2583017
Morrison, B. B., & Preston, J. A. (2009). Engagement: Gaming throughout the curriculum. Paper presented at the 40th ACM Technical Symposium on Computer Science Education, New York. https://doi.org/10.1145/1508865.1508990
Nelson Mandela Metropolitan University (NMMU) Computing Sciences. (n.d.). Department of Computing Sciences. Retrieved from http://cs.nmmu.ac.za
Petrović, V., & Ivetić, D. (2012). Gamifying education: A proposed taxonomy of satisfaction metrics. Paper presented at the 8th International Scientific Conference eLearning and Software for Education, Bucharest.
https://doi.org/10.12753/2066-026X-12-147
Plotr. (2016). Careers advice, discovery and exploration. Retrieved from http://www.plotr.co.uk
Raymer, R. (2011). Gamification: Using game mechanics to enhance e-learning. eLearn, 2011(9).
https://doi.org/10.1145/2025356.2031772
Rebolledo-Mendez, G., Avramides, K., De Freitas, S., & Memarzia, K. (2009). Societal impact of a serious game on raising public awareness: The case of FloodSim. Paper presented at the 2009 ACM SIGGRAPH Symposium on Video Games, New York. https://doi.org/10.1145/1581073.1581076
Reeve, A. (2014). Power up! Game-based learning design. Retrieved from http://www.brightwavegroup.com/our-thinking/game-based-learning-design/index.html
Reiners, T., & Wood, L. C. (2015). Gamification in education and business. Cham, Switzerland: Springer.
https://doi.org/10.1007/978-3-319-10208-5
Rodgers, Y., Sharp, H., & Preece, J. (2011). Interaction design: Beyond human-computer interaction. Chichester, UK: Wiley.
Schell, J. (2015). The art of game design: A book of lenses. Boca Raton, FL: CRC Press.
Schnabel, B., & White, J. (2014). Pathways to computing careers. Communications of the ACM, 57(12).
https://doi.org/10.1145/2684460
Schofield, A. (2014). 2014 JCSE ICT skills survey report. Retrieved from http://www.jcse.org.za/sites/default/files/%5Bfilename%5D_2.pdf
Scholtz, J. (2000). Common industry format for usability test reports. Paper presented at CHI '00 Extended Abstracts on Human Factors in Computing Systems, New York. https://doi.org/10.1145/633465.633470
Schonfeld, E. (2010). SCVNGR's secret game mechanics playdeck. Retrieved from http://techcrunch.com/2010/08/25/scvngr-game-mechanics
Squires, D., & Preece, J. (1999). Predicting quality in educational software: Evaluating for learning, usability and the synergy between them. Interacting with Computers, 11(5), 467-483 https://doi.org/10.1016/S0953-5438(98)00063-0
Ssemugabi, S., & De Villiers, M. R. (2010). Effectiveness of heuristic evaluation in usability evaluation of e-learning applications in higher education: Research article. South African Computer Journal, 45, 26-39.
https://doi.org/10.18489/sacj.v45i0.37
Thomas, J., & Harden, A. (2008). Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Medical Research Methodology, 8. https://doi.org/10.1186/1471-2288-8-45
Tullis, T., & Albert, B. (2013). Measuring the user experience: Collecting, analyzing, and presenting usability metrics. Waltham, MA: Morgan Kaufmann.
Urh, M., Vukovic, G., Jereb, E., & Pintar, R. (2015). The model for introduction of gamification into e-learning in higher education. Procedia - Social and Behavioral Sciences, 197, 388-397. https://doi.org/10.1016/j.sbspro.2015.07.154
US Bureau of Labor Statistics. (2015). Employment projections. Retrieved from http://www.bls.gov/emp
Werbach, K., & Hunter, D. (2012). For the win: How game thinking can revolutionize your business. Philadelphia, PA: Wharton Digital Press.
Western Cape Government. (2014). Financial services sector assessment report 2014: Growth, regulation, compliance, skills and recruitment in South Africa. Retrieved from http://www.westerncape.gov.za/assets/departments/economic-development-tourism/fssa_report_18march.pdf
Zichermann, G., & Cunningham, C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps. Sebastopol, CA: O'Reilly Media.
Zwang, J. (2010). Summit: US needs more computer science teachers. Retrieved from http://www.eschoolnews.com/2010/10/07/summit-u-s-needs-more-computer-science-teachers
Downloads
Published
Issue
Section
License
Copyright (c) 2016 https://creativecommons.org/licenses/by/4.0
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
- Abstract 273
- pdf 121
.png){kind=spacer}