Postgraduate Dissertation Assessment: Exploring Extant Use and Potential Efficacy of Visualisations

Authors

DOI:

https://doi.org/10.23962/10539/20328

Keywords:

visualisation, assessment, postgraduate, dissertation

Abstract

In the context of assessment, two specific challenges face South African academics. The first is that their universities have experienced an unprecedented increase in postgraduate students without a concomitant increase in supervision capacity. The second challenge is that many South African students are studying in a second or third language and struggle to express themselves in English. It is notoriously difficult to write text that is easy to read. Examiners are thus finding it challenging to maintain their own existing high standards of consistency, accuracy and fairness. This paper focuses on identifying a way of making the assessment of dissertations more efficient, while retaining rigour and fairness. In so doing, we want to provide students with a tool that will help them to communicate their research more effectively. In seeking an intervention, we noted the emerging use of visualisation as a communication facilitator in other areas of academia. Given the innate human ability to understand and remember visual representations, and the deep level of cognitive processing required to produce such visualisations, the considered inclusion of visualisations could be the means we are seeking. In this paper we report on an investigation into the extant use and potential usefulness of visualisation in a number of dissertations. We also explore supervisor expectations with respect to the use of visualisation in research reporting. Based on our findings, we propose that a discourse be opened into the deliberate use of visualisation in postgraduate research reporting.

References

Andriessen, D., Kliphuis, E., McKenzie, J., & van Winkelen, C. (2009). Pictures of knowledge management, Developing a method for analysing knowledge metaphors in visuals. Electronic Journal of Knowledge Management, 7(40), 405-415.

Armbruster, B. B., & Anderson, T. H. (1985). Producing 'considerate' expository text: Or easy reading is damned hard writing. Journal of Curriculum Studies, 17(3), 247-274. https://doi.org/10.1080/0022027850170303

Bauer, M. I., & Johnson-Laird, P. N. (1993). How diagrams can improve reasoning. Psychological Science, 4(6), 372-378. https://doi.org/10.1111/j.1467-9280.1993.tb00584.x

Bezuidenhout, A. (2015). Implications of distance educator's changing work roles for academic workload. Distance Education 1(1). Special issue: Distance education and time: Organizational models for managing time and workload in distance education, 1-17.

Bitzer, E. (2010). Postgraduate research supervision: More at stake than research training. Acta Academica: Postgraduate supervision: research and practice: Supplementum 1, 23-56. https://doi.org/10.38140/aa.v0i1.1276

Bresciani, S., & Eppler, M. J. (2009). The risks of visualization. In Schulz, P., Hartung, U. & Keller, S. (Eds.). Identität und vielfalt der kommunikations-wissenschaft, (pp. 165-178). Konstanz: UVK Verlagsgesellschaft.

Brits, H., Bezuidenhout, J., Steinberg, W. J., & Joubert, G. (2014). An evaluation of the assessment tool used for extensive mini-dissertations in the Master's Degree in Family Medicine, University of the Free State. South African Family Practice, 56(2), 125-133. https://doi.org/10.1080/20786204.2014.10855350

Brown, G., & Atkins, M. (1988). Effective teaching in higher education. London and New York: Methuen.

Burkhard, R. A. (2005). Towards a framework and a model for knowledge visualization: Synergies between information and knowledge visualization. In Keller, T., & Tergan, S. O. (Eds.), Knowledge and information visualization, (pp. 238-255). Berlin Heidelberg: Springer. https://doi.org/10.1007/11510154_13

Card, S. K., Mackinlay, J. D., & Shneiderman, B. (1999). Readings in information visualization: Using vision to think. San Diego, USA: Morgan Kaufmann.

Chen, M., Ebert, D., Hagen, H., Laramee, R. S., Van Liere, R., Ma, K. L., Ribarsky, W., Scheuermann, G. & Silver, D. (2009). Data, information, and knowledge in visualization. Computer Graphics and Applications, IEEE, 29(1), 12-19. https://doi.org/10.1109/MCG.2009.6

Ellis, W. D. (1938). A source book of Gestalt psychology. New York: Harcourt, Brace, & Co. https://doi.org/10.1037/11496-000

Eppler, M. J., & Burkhard, R. A. (2007). Visual representations in knowledge management: Framework and cases. Journal of Knowledge Management, 11(4), 112-122. https://doi.org/10.1108/13673270710762756

Fisk, A. D., Scerbo, M. W., & Kobylak, R. F. (1986). Relative value of pictures and text in conveying information: Performance and memory evaluations. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting 30(13), (pp. 1269-1272). SAGE Publications. https://doi.org/10.1177/154193128603001306

Fleming, N. D. (1995). I’m different; not dumb. Modes of presentation (VARK) in the tertiary classroom. In Research and Development in Higher Education, Proceedings of the 1995 Annual Conference of the Higher Education and Research Development Society of Australasia (HERDSA), HERDSA 18, (pp. 308-313). https://doi.org/10.3817/0695104051

Flower, L., & Hayes, J. R. (1980). The cognition of discovery: Defining a rhetorical problem. College Composition and Communication, 31(1), 21-32. https://doi.org/10.58680/ccc198015963

Frankel, F. (2005). Translating science into pictures: A powerful learning tool. Invention and impact: Building excellence in undergraduate science, technology, engineering, and mathematics (STEM) education, Washington DC, USA: AAAS Press, (pp. 155-158).

Guillemin, M. (2004). Understanding illness: Using drawings as a research method. Qualitative Health Research, 14(2), 272-289. https://doi.org/10.1177/1049732303260445

Herminingsih, D. I. (2013). Teaching writing narrative text using pictures to the first semester students of faculty of social and politics University Of Tulungagung. Journal Universitas Tulungagung, Bonorowo 1(1), 16-29.

Kelleher, C., & Wagener, T. (2011). Ten guidelines for effective data visualization in scientific publications. Environmental Modelling & Software, 26(6), 822-827. https://doi.org/10.1016/j.envsoft.2010.12.006

Kiley, M., & Wisker, G. (2009). Threshold concepts in research education and evidence of threshold crossing. Higher Education Research & Development, 28(4), 431-441. https://doi.org/10.1080/07294360903067930

Kind, V. (2004). Beyond appearances: Students' misconceptions about basic chemical ideas. 2nd Edition. Available at http://www.rsc.org/images/Misconceptions_update_tcm18-188603.pdf

Kosslyn, S. M. (1980). Image and mind. Cambridge, USA: Harvard University Press.

Kruss, G. (2006). Creating knowledge networks: Higher education, industry and innovation in South Africa. Science Technology & Society, 11(2), 319-349. https://doi.org/10.1177/097172180601100203

I'Anson, R. A., & Smith, K. A. (2004). Undergraduate research projects and dissertations: Issues of topic selection, access and data collection amongst tourism management students. Journal of Hospitality, Leisure, Sport and Tourism Education, 3(1), 19-32. https://doi.org/10.3794/johlste.31.54

Laseau, P. (2000). Graphic thinking for architects and designers. New York: John Wiley & Sons.

Leshem, S., & Trafford, V. (2007). Overlooking the conceptual framework. Innovations in Education and Teaching International, 44(1), 93-105. https://doi.org/10.1080/14703290601081407

Machanick, P. (2014). Teaching without technology. Proceedings of the Southern African Computer Lecturers' Association Conference, 25-26 June, Port Elizabeth, South Africa, (pp. 20-23).

Mayer, R. E. (1989). Systematic thinking fostered by illustrations in scientific text. Journal of Educational Psychology, 81(2), 240. https://doi.org/10.1037/0022-0663.81.2.240

Muller, H., van Biljon, J. A., & Renaud, K. (2012). Information visualisation in research reporting: Guidelines for representing quantitative data. Proceedings of the Southern African Computer Lecturers' Association Conference, 1-3 July, Thaba 'Nchu, South Africa, (pp. 13-19).

O'Donovan, B., Price, M., & Rust, C. (2004). Know what I mean? Enhancing student understanding of assessment standards and criteria. Teaching in Higher Education, 9(3), 325-335. https://doi.org/10.1080/1356251042000216642

Pounder, J. (1999) Institutional performance in higher education: Is quality a relevant concept? Quality Assurance in Education, 7(3), 156-165. https://doi.org/10.1108/09684889910281719

Pretorius, E. J. (2002). Reading ability and academic performance in South Africa: Are we fiddling while Rome is burning? Language Matters: Studies in the Languages of Africa, 33(1), 169-196.

https://doi.org/10.1080/10228190208566183

Rowe, A. L., & Cooke, N. J. (1995). Measuring mental models: Choosing the right tools for the job. Human Resource Development Quarterly, 6(3), 243-255. https://doi.org/10.1002/hrdq.3920060303

Rowntree, D. (1987). Assessing students: How shall we know them? London: Kogan Page.

Sanders, I. D. & Pilkington, C. L. (2014). Increasing personal research output by utilising Honours students. Proceedings of the Southern African Computer Lecturers' Association Conference, 24-26 June, Port Elizabeth, South Africa, (pp. 146-152).

Saunders, M. N. K., & Davis, S. M. (1998). The use of assessment criteria to ensure consistency of marking: some implications for good practice, Quality Assurance in Education, 6(3), 162-171. https://doi.org/10.1108/09684889810220465

Simmonds, S. & du Preez, P. (2014). The centrality of the research question for locating PhD studies in the global knowledge society. South African Journal of Higher Education, 28(5), 1607-1624.

https://doi.org/10.20853/28-5-419

Taylor, J. (2002). Changes in teaching and learning in the period to 2005: The case of postgraduate higher education in the UK. Journal of Higher Education Policy and Management, 24(1), 53-73.

https://doi.org/10.1080/13600800220130761

Ungerleider, L. G., & Haxby, J. V. (1994). 'What' and 'where' in the human brain. Current Opinion in Neurobiology, 4(2), 157-165. https://doi.org/10.1016/0959-4388(94)90066-3

Van Biljon, J., Van Dyk, T., & Naidoo, L. (2014). Towards increasing supervision capacity: The pyramid cohort supervision model. Proceedings of the Southern African Computer Lecturers' Association Conference, 24-26 June, Port Elizabeth, South Africa, (pp. 166-174).

Van Biljon, J. A. & de Villiers, M. R. (2013). Multiplicity in supervision models: the supervisor's perspective. South African Journal of Higher Education (SAJHE), 27(6), 1443-1463. https://doi.org/10.20853/27-6-307

Van Biljon, J. A. & Renaud, K. V. (2015). Do visualizations ease dissertation assessment? Proceedings of the Southern African Computer Lecturers Association Conference. 1-3 July, Johannesburg, South Africa, (pp. 177-185).

Webb, V. (2002). English as a second language in South Africa's tertiary institutions: A case study at the University of Pretoria. World Englishes, 21(1), 49-61. https://doi.org/10.1111/1467-971X.00231

Weber, R. (2012). Evaluating and developing theories in the information systems discipline. Journal of the Association for Information Systems, 13(1), 1-30. https://doi.org/10.17705/1jais.00284

Webster, F., Pepper, D., & Jenkins, A. (2000). Assessing the undergraduate dissertation. Assessment & Evaluation in Higher Education, 25(1), 71-80. https://doi.org/10.1080/02602930050025042

Downloads

Published

15-12-2015

Issue

Section

Thematic Section: Issues in Educational Informatics

How to Cite

Van Biljon, J. and Renaud, K. (2015) “Postgraduate Dissertation Assessment: Exploring Extant Use and Potential Efficacy of Visualisations”, The African Journal of Information and Communication (AJIC) [Preprint], (15). doi:10.23962/10539/20328.
Views
  • Abstract 158
  • pdf 89