Quantext: For rapid analysis of student responses to short answer questions
Status
Completed: 1 July 2020
Project Details
A two-year pilot study that was undertaken by McDonald and Moskal Ltd to implement and evaluate the new text analysis tool, Quantext, in real classroom settings.
Quantext supports the rapid analysis of short-form student writing, for example, responses to short-answer questions or mini essays.
Quantext allows teachers to aggregate and summarise trends or patterns in student writing, monitor writing development and potentially trace conceptual understanding back to source in teaching resources and lecture content.
Aims:
The main aims of this project were to:
- implement and evaluate the new text analysis tool (Quantext) in real classroom settings as a tool for:
- teacher development and reflection
- providing timely, formative feedback to students, especially in large-class settings.
- evaluate the utility of the mechanism employed to develop this software. That is, a public-private partnership between New Zealand tertiary institutions and a social enterprise dedicated to supporting educational software innovation and development.
Methodology:
This project used a mixed-method approach to data collection and analysis.
- Teachers and staff from a wide range of contexts across four New Zealand tertiary institutions were recruited to pilot Quantext in ways that are meaningful for them. Each of these contexts makes up an individual case-study.
- Introductory workshops were held with the teachers who then asked their students formative, open-ended questions, or used existing short-form student writing, to analyse with Quantext. Reflections from teachers, staff and in some cases students, who used Quantext, along with the analysed text data made up the dataset for each case-study.
- Throughout the pilot study, Quantext was updated and where possible, additional prototype tools were incorporated in response to feedback from pilot participants.
- Towards the end of each case-study there were individual or focus group sessions with all teacher participants to provide summaries of the key teaching and learning insights they had gained along with potential issues faced and opportunities for improvement.
Team
Dr Jenny McDonald
McDonald & Moskal LtdAdon Moskal
McDonald & Moskal LtdAssociate Professor Cathy Gunn
University of AucklandDr Irina Elgort
Victoria UniversityStatus
Funding
$114,252.00 (excl GST)
Key Findings
Key Recommendations
This report gives details of the project which aimed to develop and evaluate Quantext in authentic tertiary education contexts.
(PDF, 7.5 MB, 76-pages)
- 30 June 2020