Back to search

Institutional Repository of Vilnius University

Didžiųjų kalbos modelių loginio mąstymo gebėjimų tobulinimas lietuvių kalbai taikant sustiprinimo mokymą: metodologija, duomenų paruošimas ir palyginamoji analizė /

Abstract

dc:description

This thesis investigates the possibilities of enhancing the logical and mathematical reasoning capabilities of small­scale Large Language Models (LLMs) using Reinforcement Learning (RL) methods. During the study, a Lithuanian ”Knights and Knaves” logical task dataset comprising 5000 unique examples was algorithmically synthesized and categorized by distinct difficulty levels. The baseline Qwen3­1.7B model was trained using three different algorithms: GRPO, DAPO, and LogicRL Reinforce++. The primary objective of the experiment was to incentivize the model to generate accurate, deep, and coherent reasoning chains to successfully solve complex logical tasks. The experimental results revealed that the 1.7 billion parameter model trained with the Logic­RL Reinforce++ method achieved the highest performance. This model attained a 13.3% accuracy rate on Olympiadlevel AIME benchmarks, outperforming both its baseline model (4.4%) and the significantly larger Qwen3­4B (8.9%) and Qwen3­8B (6.7%) models. The model trained with the GRPO method also demonstrated superiority over the baseline version (6.7%) and secured an intermediate position among the investigated algorithms. Conversely, the application of the DAPO algorithm failed due to a reward hacking problem that restricted the generated reasoning chains. The conducted research proves that targeted reinforcement learning successfully enhances the logical reasoning capabilities of small models, and the developed sequential reasoning chain generation ensures model versatility across tasks of varying difficulty.

Degree

thesis:*
Grantor dc:publisher
Institutional Repository of Vilnius University
Year dc:date
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Girdauskas, Žygimantas,

Rights

dc:rights
Statement dc:rights
  • info:eu-repo/semantics/openAccess
Language dc:language
lit

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
Vilnius University
Base URL
epublications.vu.lt/oai
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Girdauskas, Žygimantas,. Didžiųjų kalbos modelių loginio mąstymo gebėjimų tobulinimas lietuvių kalbai taikant sustiprinimo mokymą: metodologija, duomenų paruošimas ir palyginamoji analizė /. Institutional Repository of Vilnius University, 2026. https://repository.vu.lt/VU:ELABAETD308334486&prefLang=en_US