Automated short-answer marking cannot 'guarantee' 100% agreement between the marks generated by a software system and the marks produced separately by a human. This problem has prevented automated marking systems from being used in high-stake short-answer marking. Given this limitation, can an automated short-answer marking system have any practical application? This thesis describes how an automated short-answer marking system, called IndusMarker, can be effectively used to improve learning and teaching.The design and evaluation of IndusMarker are also presented in the thesis. IndusMarker is designed for factual answers where there is a clear criterion for answers being right or wrong. The system is based on structure matching, i.e. matching a pre-specified structure, developed via a purpose-built structure editor, with the content of the student's answer text. An examiner specifies the required structure of an answer in a simple purpose-designed language called Question Answer Markup Language (QAML). The structure editor ensures that users construct correct required structures (with respect to QAML's syntax and informal semantics) in a form that is suitable for accurate automated marking.
| Identifer | oai:union.ndltd.org:bl.uk/oai:ethos.bl.uk:525183 |
| Date | January 2010 |
| Creators | Siddiqi, Raheel |
| Contributors | Harrison, Christopher |
| Publisher | University of Manchester |
| Source Sets | Ethos UK |
| Detected Language | English |
| Type | Electronic Thesis or Dissertation |
| Source | https://www.research.manchester.ac.uk/portal/en/theses/improving-learning-and-teaching-through-automated-shortanswer-marking(b3042248-401a-4187-9a92-b88ec0fad7b6).html |
Page generated in 0.0031 seconds