Institutional Repository of Vilnius University
Lietuviškų pasirenkamojo atsakymo klausimų generavimas ir vertinimas taikant didžiuosius kalbos modelius /
Abstract
dc:descriptionThis bachelor’s thesis presents and experimentally evaluates an automated method for generating Lithuanian multiple choice questions with four answer options from the New Testament Gospel texts using LLMs. The study compared two generation strategies: a baseline zero-shot approach and a structured few-shot approach, both utilizing the Gemini 3.1 Pro model. The quality of the generated questions was assessed on a custom five-point scale through the automated G-Eval methodology (using the GPT-5.4 model) alongside independent evaluations by two theology experts. The findings demonstrated that the few-shot method significantly outperformed the zero-shot generation, particularly regarding distractor quality and educational value, achieving an overall average score of 4.75 out of 5 compared to 4.59, a conclusion that was also supported by the expert evaluations.
Degree
thesis:*- Grantor dc:publisher
- Institutional Repository of Vilnius University
- Year dc:date
- 2026
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Žalneravičius, Balys,
Rights
dc:rights- Statement dc:rights
-
- info:eu-repo/semantics/openAccess
- Language dc:language
- lit
Identifiers
dc:identifier.*- Repository record dc:identifier
- https://repository.vu.lt/VU:ELABAETD308339321&prefLang=en_US