{"id":{"repo_id":"vilnius","oai_identifier":"oai:vu.lt:elaba:308338032"},"canonical_url":"https://search.ndltd.org/etd/vilnius/oai:vu.lt:elaba:308338032","repository":{"repo_id":"vilnius","name":"Vilnius University","base_url":"https://epublications.vu.lt/oai"},"display":{"title":"Didelių kalbos modelių lietuvių kalbai tyrimas /","abstract":"In recent years, large language models have become one of the fastest-­developing areas of technology, yet their capabilities for low-­resource languages such as Lithuanian remain insufficient. This work investigates the effectiveness of LoRA adaptation for Lithuanian morphological analysis and accentuation tasks, using the Ministral 3 3B model as the base model. Training data was collected and prepared from three sources: LRT, Wikisources, and the General Corpus of the Lithuanian Language (BLKT). Four LoRA adapters were trained, differing in data volume, diversity, and LoRA rank. Results show that specialized LoRA adaptation significantly improves model performance in accentuation, whose accuracy increased from 8.0% to 80.0%, and overall morphological analysis, whose accuracy rose from 33.7% to 56.5%. Furthermore, the adapted three billion parameter model was able to substantially outperform GPT­5.5 and Gemini 3.1 models in both tasks. Error analysis revealed that the model’s accentuation accuracy reaches approximately 96% when it produces an output, with most errors stemming from word omission rather than incorrect accentuation. The study also found that data diversity has a greater impact on adaptation quality than data quantity, and that improper LoRA parameter selection, specifically an excessively high rank combined with a high learning rate, can cause overfitting even with large datasets.","abstract_html":"In recent years, large language models have become one of the fastest-­developing areas of technology, yet their capabilities for low-­resource languages such as Lithuanian remain insufficient. This work investigates the effectiveness of LoRA adaptation for Lithuanian morphological analysis and accentuation tasks, using the Ministral 3 3B model as the base model. Training data was collected and prepared from three sources: LRT, Wikisources, and the General Corpus of the Lithuanian Language (BLKT). Four LoRA adapters were trained, differing in data volume, diversity, and LoRA rank. Results show that specialized LoRA adaptation significantly improves model performance in accentuation, whose accuracy increased from 8.0% to 80.0%, and overall morphological analysis, whose accuracy rose from 33.7% to 56.5%. Furthermore, the adapted three billion parameter model was able to substantially outperform GPT­5.5 and Gemini 3.1 models in both tasks. Error analysis revealed that the model’s accentuation accuracy reaches approximately 96% when it produces an output, with most errors stemming from word omission rather than incorrect accentuation. The study also found that data diversity has a greater impact on adaptation quality than data quantity, and that improper LoRA parameter selection, specifically an excessively high rank combined with a high learning rate, can cause overfitting even with large datasets.","abstract_has_math":false,"creators":["Sazonik, Jekaterina,"],"institution":"Institutional Repository of Vilnius University","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2026,"date_issued":"2026","date_published":"2026","updated_at":"2026-11-19T10:12:59Z","subjects":[],"languages":["lit"],"rights":["info:eu-repo/semantics/openAccess"],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://repository.vu.lt/VU:ELABAETD308338032&prefLang=en_US","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://repository.vu.lt/VU:ELABAETD308338032&prefLang=en_US","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":"open","embargo_until":null,"access_note":null},"source_record":{"url":"https://epublications.vu.lt/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Avu.lt%3Aelaba%3A308338032","prefix":"oai_dc"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Sazonik, Jekaterina,"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2026"]},{"key":"dc:publisher","label":"Institution","values":["Institutional Repository of Vilnius University"]},{"key":"dc:relation","label":"Dc Relation","values":["https://epublications.vu.lt/object/elaba:308338032/308338032.pdf"]},{"key":"dc:type","label":"Dc Type","values":["info:eu-repo/semantics/bachelorThesis"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["lit"]},{"key":"dc:rights","label":"Dc Rights","values":["info:eu-repo/semantics/openAccess"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://repository.vu.lt/VU:ELABAETD308338032&prefLang=en_US"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["In recent years, large language models have become one of the fastest-­developing areas of technology, yet their capabilities for low-­resource languages such as Lithuanian remain insufficient. This work investigates the effectiveness of LoRA adaptation for Lithuanian morphological analysis and accentuation tasks, using the Ministral 3 3B model as the base model. Training data was collected and prepared from three sources: LRT, Wikisources, and the General Corpus of the Lithuanian Language (BLKT). Four LoRA adapters were trained, differing in data volume, diversity, and LoRA rank. Results show that specialized LoRA adaptation significantly improves model performance in accentuation, whose accuracy increased from 8.0% to 80.0%, and overall morphological analysis, whose accuracy rose from 33.7% to 56.5%. Furthermore, the adapted three billion parameter model was able to substantially outperform GPT­5.5 and Gemini 3.1 models in both tasks. Error analysis revealed that the model’s accentuation accuracy reaches approximately 96% when it produces an output, with most errors stemming from word omission rather than incorrect accentuation. The study also found that data diversity has a greater impact on adaptation quality than data quantity, and that improper LoRA parameter selection, specifically an excessively high rank combined with a high learning rate, can cause overfitting even with large datasets."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Didelių kalbos modelių lietuvių kalbai tyrimas /","Large language models for lithuanian language."]}]}],"canonical_facts":{"dc:creator":["Sazonik, Jekaterina,"],"dc:date":["2026"],"dc:description":["In recent years, large language models have become one of the fastest-­developing areas of technology, yet their capabilities for low-­resource languages such as Lithuanian remain insufficient. This work investigates the effectiveness of LoRA adaptation for Lithuanian morphological analysis and accentuation tasks, using the Ministral 3 3B model as the base model. Training data was collected and prepared from three sources: LRT, Wikisources, and the General Corpus of the Lithuanian Language (BLKT). Four LoRA adapters were trained, differing in data volume, diversity, and LoRA rank. Results show that specialized LoRA adaptation significantly improves model performance in accentuation, whose accuracy increased from 8.0% to 80.0%, and overall morphological analysis, whose accuracy rose from 33.7% to 56.5%. Furthermore, the adapted three billion parameter model was able to substantially outperform GPT­5.5 and Gemini 3.1 models in both tasks. Error analysis revealed that the model’s accentuation accuracy reaches approximately 96% when it produces an output, with most errors stemming from word omission rather than incorrect accentuation. The study also found that data diversity has a greater impact on adaptation quality than data quantity, and that improper LoRA parameter selection, specifically an excessively high rank combined with a high learning rate, can cause overfitting even with large datasets."],"dc:format":["application/pdf"],"dc:identifier":["https://repository.vu.lt/VU:ELABAETD308338032&prefLang=en_US"],"dc:language":["lit"],"dc:publisher":["Institutional Repository of Vilnius University"],"dc:relation":["https://epublications.vu.lt/object/elaba:308338032/308338032.pdf"],"dc:rights":["info:eu-repo/semantics/openAccess"],"dc:title":["Didelių kalbos modelių lietuvių kalbai tyrimas /","Large language models for lithuanian language."],"dc:type":["info:eu-repo/semantics/bachelorThesis"]},"updated_at":"2026-11-19T10:12:59Z"}