A Comparative Study to Evaluate the Impact of Using the SOLO Taxonomy in Preparing Exam Questions

Abstract

Evaluation is a complex task that requires clear and transparent criteria, ensuring all involved understand it as credible, with educational and social responsibility. However, as evaluation is not an exact science, it is naturally subjective. Do teachers prepare questions covering all levels of complexity? Do they reflect on the knowledge and complexity required for each question? What methods and tools do they use?

In higher education, studies on evaluation are few, and in mathematics subjects, they are almost nonexistent. Greater reflection on this topic in higher education institutions is needed to deepen knowledge. The SOLO taxonomy, developed by John Biggs and Kevin Collis, in 1982, includes five levels of learning complexity: pre-structural, uni-structural, multi-structural, relational, and abstract. The authors have used this taxonomy to assess exam quality and identify cognitive complexity levels needed for assessments. The SOLO taxonomy should be used by teachers to formulate questions, classifying them according to cognitive complexity and assigning appropriate weights in student evaluations. This approach helps identify areas for student improvement, aiming for greater academic and professional success.
This paper presents a comparative study of results and discussions based on an evaluation of Linear Algebra program content common to subjects from three different undergraduate programs at different higher education institutions. In the study, students took an exam with questions structured according to an ascending process of cognitive complexity, based on the SOLO taxonomy.



Author Information
Cristina M. R. Caridade, Polytechnic University of Coimbra, Portugal
Verónica Pereira, Portuguese Catholic University, Portugal
Inês Borges, Polytechnic University of Coimbra, Portugal

Paper Information
Conference: BCE2024
Stream: Assessment Theories & Methodologies

This paper is part of the BCE2024 Conference Proceedings (View)
Full Paper
View / Download the full paper in a new tab/window


To cite this article:
Caridade C., Pereira V., & Borges I. (2025) A Comparative Study to Evaluate the Impact of Using the SOLO Taxonomy in Preparing Exam Questions ISSN: 2435-9467 – The Barcelona Conference on Education 2024: Official Conference Proceedings (pp. 695-707) https://doi.org/10.22492/issn.2435-9467.2024.61
To link to this article: https://doi.org/10.22492/issn.2435-9467.2024.61


Comments & Feedback

Place a comment using your LinkedIn profile

Comments

Share on activity feed

Powered by WP LinkPress

Share this Research

Posted by James Alexander Gordon