Rowan University
Back to the Future: A Case for the Resurgence of Approximation Theory for Enabling Data Driven “Intelligence”
Abstract
dc:description.abstractArtificial Intelligence (AI) has exploded into mainstream consciousness with commercial investments exceeding $90 billion in the last year alone. Inasmuch as consumer-facing applications such ChatGPT offer astounding access to algorithms that were hitherto restricted to academic research labs, public focus of attention on AI has created an avalanche of misinformation. The nexus of investor-driven hype, “surprising” inaccuracies in the answers provided by AI models – now anthropomorphically labeled as “hallucinations”, and impending legislation by well-meaning and concerned governments has resulted in a crisis of confidence in the science of AI. The primary driver for AI’s recent growth is the convergence of ubiquitous cloud computing technology and pivotal developments in artificial neural network (ANN) architectures and machine learning topologies, leading to the emergence and dominance of large language models. These models have cast aside the need for extensive data pre-processing and incorporate feature extraction into network training. In some cases, such as in the use of generative AI models for natural language processing, the results are astonishing, but also, in many ways, concerning. An overreliance on the network to perform multiple tasks, well beyond data interpolation, leads to output anomalies and errors. Also, increasing the size of datasets and number of network layers to ensure better performance is soon to hit a brick wall of incurred time and expense to train the network. But of greatest concern, despite the race to advance the technology, is that we are unable to adequately describe the operation of AI models mathematically, and, therefore, we do not completely understand how such systems develop the relationships within the training data to produce results. It is in this context that the research work presented in this dissertation comprehensively investigates the origins of ANNs based on approximation theory, in order to refocus efforts on data pre-processing, and away from the exclusive attention on the development of more and more complex architectures. In a sense, the science and mathematics of AI algorithms must provide a path for the robust, reliable, and rapid deployment of intelligent algorithms without an over-reliance of technological prowess – inexpensive bandwidth and computing power. An algorithm for shape recognition in image data is developed based on geometric transformations, which forms the input to data to any neural network architecture of choice. Results demonstrate that such intelligent pre-processing provides significantly more control to the network designer than brute-force methods of exponentially increasing network layers.
Degree
thesis:*- Name thesis:degree_name
- Doctor of Philosophy (Ph.D.)
- Level thesis:degree_level
- Dissertation
- Discipline thesis:degree_discipline
- Electrical and Computer Engineering
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Ciocco, Michael Dominic
- Contributors dc:contributor
-
- Shreekanth Mandayam, Ph.D.
- Nidhal Bouaynaya, Ph.D.
- Mira Lalovic-Hand, Ph.D.
Subjects
dc:subject × 6Identifiers
dc:identifier.*- Repository record dc:identifier
- https://rdw.rowan.edu/etd/3232