Back to search

Institutional Repository of Vilnius University

Lietuviškų pasirenkamojo atsakymo klausimų generavimas ir vertinimas taikant didžiuosius kalbos modelius /

Abstract

dc:description

This bachelor’s thesis presents and experimentally evaluates an automated method for generating Lithuanian multiple choice questions with four answer options from the New Testament Gospel texts using LLMs. The study compared two generation strategies: a baseline zero-shot approach and a structured few-shot approach, both utilizing the Gemini 3.1 Pro model. The quality of the generated questions was assessed on a custom five-point scale through the automated G-Eval methodology (using the GPT-5.4 model) alongside independent evaluations by two theology experts. The findings demonstrated that the few-shot method significantly outperformed the zero-shot generation, particularly regarding distractor quality and educational value, achieving an overall average score of 4.75 out of 5 compared to 4.59, a conclusion that was also supported by the expert evaluations.

Degree

thesis:*
Grantor dc:publisher
Institutional Repository of Vilnius University
Year dc:date
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Žalneravičius, Balys,

Rights

dc:rights
Statement dc:rights
  • info:eu-repo/semantics/openAccess
Language dc:language
lit

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
Vilnius University
Base URL
epublications.vu.lt/oai
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Žalneravičius, Balys,. Lietuviškų pasirenkamojo atsakymo klausimų generavimas ir vertinimas taikant didžiuosius kalbos modelius /. Institutional Repository of Vilnius University, 2026. https://repository.vu.lt/VU:ELABAETD308339321&prefLang=en_US