{"id":{"repo_id":"vilnius","oai_identifier":"oai:vu.lt:elaba:24251445"},"canonical_url":"https://search.ndltd.org/etd/vilnius/oai:vu.lt:elaba:24251445","repository":{"repo_id":"vilnius","name":"Vilnius University","base_url":"https://epublications.vu.lt/oai"},"display":{"title":"Investigation of multi-class classification methods for textual data /","abstract":"Today, a largely scalable computing environment provides a possibility of carrying out various data-intensive natural language processing and machine-learning tasks. One of them is a classification of textual data with some issues recently investigated by many data scientists. In this dissertation, big data-classification tasks will be completed by using the machine learning toolkit MLlib on the Apache Spark, the in-memory intensive data analytics framework. Such intensive in-memory computations open the door to classification methods that are effective in solving big-data multi-class text-classification tasks. In this thesis, a multi-class classification of Naïve Bayes, Random Forest, Decision Tree, Support Vector Machines, Logistic Regression and Multilayer perceptron classifiers are experimentally examined and compared with a focus on evaluating the classification accuracy, based on the size of training datasets, and the number of n-grams. The proposed data feature selection such as a combination of n-grams, term frequency, inverse document frequency, part of speech, noise reduction, and used classifiers, determines multi-class classification problem with a higher classification accuracy. Findings indicate the optimal data feature selection that can be used in a variety of short texts, such as product-review classification within sentiment analysis. Applied data analytics frameworks are horizontally scalable in the multi-node cloud computing environment and allow us to run the mostly known classification algorithms to understand and predict the textual data that support knowledge gathering and decision-making processes. In the experiments, short texts for product-review data from Amazon were analyzed.","abstract_html":"Today, a largely scalable computing environment provides a possibility of carrying out various data-intensive natural language processing and machine-learning tasks. One of them is a classification of textual data with some issues recently investigated by many data scientists. In this dissertation, big data-classification tasks will be completed by using the machine learning toolkit MLlib on the Apache Spark, the in-memory intensive data analytics framework. Such intensive in-memory computations open the door to classification methods that are effective in solving big-data multi-class text-classification tasks. In this thesis, a multi-class classification of Naïve Bayes, Random Forest, Decision Tree, Support Vector Machines, Logistic Regression and Multilayer perceptron classifiers are experimentally examined and compared with a focus on evaluating the classification accuracy, based on the size of training datasets, and the number of n-grams. The proposed data feature selection such as a combination of n-grams, term frequency, inverse document frequency, part of speech, noise reduction, and used classifiers, determines multi-class classification problem with a higher classification accuracy. Findings indicate the optimal data feature selection that can be used in a variety of short texts, such as product-review classification within sentiment analysis. Applied data analytics frameworks are horizontally scalable in the multi-node cloud computing environment and allow us to run the mostly known classification algorithms to understand and predict the textual data that support knowledge gathering and decision-making processes. In the experiments, short texts for product-review data from Amazon were analyzed.","abstract_has_math":false,"creators":["Pranckevičius, Tomas,"],"institution":"Institutional Repository of Vilnius University","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":["Marcinkevičius, Virginijus"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2017,"date_issued":"2017","date_published":"2017","updated_at":"2026-11-19T09:54:41Z","subjects":["Machine Learning ; Text Classification ; Natural Language Processing"],"languages":["eng"],"rights":["info:eu-repo/semantics/openAccess"],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://repository.vu.lt/VU:ELABAETD24251445&prefLang=en_US","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://repository.vu.lt/VU:ELABAETD24251445&prefLang=en_US","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":"open","embargo_until":null,"access_note":null},"source_record":{"url":"https://epublications.vu.lt/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3Avu.lt%3Aelaba%3A24251445","prefix":"oai_dc"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Marcinkevičius, Virginijus"]},{"key":"dc:creator","label":"Author","values":["Pranckevičius, Tomas,"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2017"]},{"key":"dc:publisher","label":"Institution","values":["Institutional Repository of Vilnius University"]},{"key":"dc:relation","label":"Dc Relation","values":["https://epublications.vu.lt/object/elaba:24251445/24251445.pdf"]},{"key":"dc:type","label":"Dc Type","values":["info:eu-repo/semantics/doctoralThesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Machine Learning ; Text Classification ; Natural Language Processing"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["info:eu-repo/semantics/openAccess"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://repository.vu.lt/VU:ELABAETD24251445&prefLang=en_US"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Today, a largely scalable computing environment provides a possibility of carrying out various data-intensive natural language processing and machine-learning tasks. One of them is a classification of textual data with some issues recently investigated by many data scientists. In this dissertation, big data-classification tasks will be completed by using the machine learning toolkit MLlib on the Apache Spark, the in-memory intensive data analytics framework. Such intensive in-memory computations open the door to classification methods that are effective in solving big-data multi-class text-classification tasks. In this thesis, a multi-class classification of Naïve Bayes, Random Forest, Decision Tree, Support Vector Machines, Logistic Regression and Multilayer perceptron classifiers are experimentally examined and compared with a focus on evaluating the classification accuracy, based on the size of training datasets, and the number of n-grams. The proposed data feature selection such as a combination of n-grams, term frequency, inverse document frequency, part of speech, noise reduction, and used classifiers, determines multi-class classification problem with a higher classification accuracy. Findings indicate the optimal data feature selection that can be used in a variety of short texts, such as product-review classification within sentiment analysis. Applied data analytics frameworks are horizontally scalable in the multi-node cloud computing environment and allow us to run the mostly known classification algorithms to understand and predict the textual data that support knowledge gathering and decision-making processes. In the experiments, short texts for product-review data from Amazon were analyzed."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Investigation of multi-class classification methods for textual data /","Daugiaklasių tekstinių duomenų klasifikavimo metodų tyrimas."]}]}],"canonical_facts":{"dc:contributor":["Marcinkevičius, Virginijus"],"dc:creator":["Pranckevičius, Tomas,"],"dc:date":["2017"],"dc:description":["Today, a largely scalable computing environment provides a possibility of carrying out various data-intensive natural language processing and machine-learning tasks. One of them is a classification of textual data with some issues recently investigated by many data scientists. In this dissertation, big data-classification tasks will be completed by using the machine learning toolkit MLlib on the Apache Spark, the in-memory intensive data analytics framework. Such intensive in-memory computations open the door to classification methods that are effective in solving big-data multi-class text-classification tasks. In this thesis, a multi-class classification of Naïve Bayes, Random Forest, Decision Tree, Support Vector Machines, Logistic Regression and Multilayer perceptron classifiers are experimentally examined and compared with a focus on evaluating the classification accuracy, based on the size of training datasets, and the number of n-grams. The proposed data feature selection such as a combination of n-grams, term frequency, inverse document frequency, part of speech, noise reduction, and used classifiers, determines multi-class classification problem with a higher classification accuracy. Findings indicate the optimal data feature selection that can be used in a variety of short texts, such as product-review classification within sentiment analysis. Applied data analytics frameworks are horizontally scalable in the multi-node cloud computing environment and allow us to run the mostly known classification algorithms to understand and predict the textual data that support knowledge gathering and decision-making processes. In the experiments, short texts for product-review data from Amazon were analyzed."],"dc:format":["application/pdf"],"dc:identifier":["https://repository.vu.lt/VU:ELABAETD24251445&prefLang=en_US"],"dc:language":["eng"],"dc:publisher":["Institutional Repository of Vilnius University"],"dc:relation":["https://epublications.vu.lt/object/elaba:24251445/24251445.pdf"],"dc:rights":["info:eu-repo/semantics/openAccess"],"dc:subject":["Machine Learning ; Text Classification ; Natural Language Processing"],"dc:title":["Investigation of multi-class classification methods for textual data /","Daugiaklasių tekstinių duomenų klasifikavimo metodų tyrimas."],"dc:type":["info:eu-repo/semantics/doctoralThesis"]},"updated_at":"2026-11-19T09:54:41Z"}