Institutional Repository of Vilnius University
Didžiųjų kalbos modelių loginio mąstymo gebėjimų tobulinimas lietuvių kalbai taikant sustiprinimo mokymą: metodologija, duomenų paruošimas ir palyginamoji analizė /
Abstract
dc:descriptionThis thesis investigates the possibilities of enhancing the logical and mathematical reasoning capabilities of smallscale Large Language Models (LLMs) using Reinforcement Learning (RL) methods. During the study, a Lithuanian ”Knights and Knaves” logical task dataset comprising 5000 unique examples was algorithmically synthesized and categorized by distinct difficulty levels. The baseline Qwen31.7B model was trained using three different algorithms: GRPO, DAPO, and LogicRL Reinforce++. The primary objective of the experiment was to incentivize the model to generate accurate, deep, and coherent reasoning chains to successfully solve complex logical tasks. The experimental results revealed that the 1.7 billion parameter model trained with the LogicRL Reinforce++ method achieved the highest performance. This model attained a 13.3% accuracy rate on Olympiadlevel AIME benchmarks, outperforming both its baseline model (4.4%) and the significantly larger Qwen34B (8.9%) and Qwen38B (6.7%) models. The model trained with the GRPO method also demonstrated superiority over the baseline version (6.7%) and secured an intermediate position among the investigated algorithms. Conversely, the application of the DAPO algorithm failed due to a reward hacking problem that restricted the generated reasoning chains. The conducted research proves that targeted reinforcement learning successfully enhances the logical reasoning capabilities of small models, and the developed sequential reasoning chain generation ensures model versatility across tasks of varying difficulty.
Degree
thesis:*- Grantor dc:publisher
- Institutional Repository of Vilnius University
- Year dc:date
- 2026
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Girdauskas, Žygimantas,
Rights
dc:rights- Statement dc:rights
-
- info:eu-repo/semantics/openAccess
- Language dc:language
- lit
Identifiers
dc:identifier.*- Repository record dc:identifier
- https://repository.vu.lt/VU:ELABAETD308334486&prefLang=en_US