Being able to predict and recognize human activities is an essential element for us to effectively communicate with other humans during our day to day activities. A system that is able to do this has a number of appealing applications, from assistive robotics to health care and preventative medicine. Previous work in supervised video-based human activity prediction and detection fails to capture the richness of spatiotemporal data that these activities generate. Convolutional Long short-term memory (Convolutional LSTM) networks are a useful tool in analyzing this type of data, showing good results in many other areas. This thesis’ focus is on utilizing RGB-D Data to improve human activity prediction and recognition. A modified Convolutional LSTM network is introduced to do so. Experiments are performed on the network and are compared to other models in-use as well as the current state-of-the-art system. We show that our proposed model for human activity prediction and recognition outperforms the current state-of-the-art models in the CAD-120 dataset without giving bounding frames or ground-truths about objects.

No description available.

No description available.

Artificial neural networks have been gaining attention in recent years due to theirimpressive ability to map out complex nonlinear relations within data. In this report,an attempt is made to use a Long short-term memory neural network for detectinganomalies within electrocardiographic records. The hypothesis is that if a neuralnetwork is trained on records of normal ECGs to predict future ECG sequences, it isexpected to have trouble predicting abnormalities not previously seen in the trainingdata. Three different LSTM model configurations were trained using records fromthe MIT-BIH Arrhythmia database. Afterwards the models were evaluated for theirability to predict previously unseen normal and anomalous sections. This was doneby measuring the mean squared error of each prediction and the uncertainty of over-lapping predictions. The preliminary results of this study demonstrate that recurrentneural networks with the use of LSTM units are capable of detecting anomalies.

Several automatic methods exist for creating 3D point clouds extracted from 2D photos. In manycases, the result is a sparse point cloud, unevenly distributed over the scene.After determining the coordinates of the same point in two images of an object, the 3D positionof that point can be calculated using knowledge of camera data and relative orientation. A model created from a unevenly distributed point clouds may loss detail and precision in thesparse areas. The aim of this thesis is to study methods for densification of point clouds. This thesis contains a literature study over different methods for extracting matched point pairs,and an implementation of Least Square Template Matching (LSTM) with a set of improvementtechniques. The implementation is evaluated on a set of different scenes of various difficulty. LSTM is implemented by working on a dense grid of points in an image and Wallis filtering isused to enhance contrast. The matched point correspondences are evaluated with parameters fromthe optimization in order to keep good matches and discard bad ones. The purpose is to find detailsclose to a plane in the images, or on plane-like surfaces. A set of extensions to LSTM is implemented in the aim of improving the quality of the matchedpoints. The seed points are improved by Transformed Normalized Cross Correlation (TNCC) andMultiple Seed Points (MSP) for the same template, and then tested to see if they converge to thesame result. Wallis filtering is used to increase the contrast in the image. The quality of the extractedpoints are evaluated with respect to correlation with other optimization parameters and comparisonof standard deviation in x- and y- direction. If a point is rejected, the option to try again with a largertemplate size exists, called Adaptive Template Size (ATS).

Automatic processing of emotion information through deep neural networks (DNN) can have great benefits (e.g., for human-machine interaction). Vice versa, machine learning can profit from concepts known from human information processing (e.g., visual attention). We employed a recurrent DNN incorporating a spatial attention mechanism for facial emotion recognition (FER) and compared the output of the network with results from human experiments. The attention mechanism enabled the network to select relevant face regions to achieve state-of-the-art performance on a FER database containing images from realistic settings. A visual search strategy showing some similarities with human saccading behavior emerged when the model’s perceptive capabilities were restricted. However, the model then failed to form a useful scene representation.

京都大学 / 0048 / 新制・課程博士 / 博士(農学) / 甲第22077号 / 農博第2369号 / 新制||農||1072(附属図書館) / 学位論文||R1||N5231(農学部図書室) / 京都大学大学院農学研究科地域環境科学専攻 / (主査)教授 近藤 直, 教授 清水 浩, 教授 飯田 訓久 / 学位規則第4条第1項該当 / Doctor of Agricultural Science / Kyoto University / DGAM

No description available.

<div>Today, machine learning models and Deep Neural Networks (DNNs) are prevalent in various areas. Also, educational Artificial Intelligence (AI) is drawing increasing attention</div><div>with the rapid development of online learning platforms. Researchers explore different types of educational AI to improve students’ learning performance and experience in online classes. Educational AIs can be categorized into “interactive” and “predictive.” Interactive AIs answer simple course questions for students, such as the due day of homework and the final project’s minimum page requirement. Predictive educational AIs play a role in predicting students’ learning states. Instructors can adjust the learning content based on the students’ learning states. However, most AIs are not evaluated in an actual class setting. Therefore, we want to evaluate the effects of a state-of-the-art educational AI model, BKT (Bayesian Knowledge Tracing)-LSTM(Long Short-Term Memory), on students’ learning performance in an actual class setting. Data came from the course CNIT 25501, a large introductory Java program?ming class at Purdue University. Participants were randomly separated into the control and experimental groups (AI-group). Weekly quizzes measured participants’ learning performance. Pre-quiz and base quizzes estimated participants’ prior knowledge levels. Using BKT-LSTM, participants in the experimental group had questions from the knowledge that they were most lacking. However, participants in the control group had questions from randomly picked knowledge. The results suggested that both the experimental and control groups had lower scores in review quizzes than in base quizzes. However, the score difference between base quizzes and review quizzes for the experimental group was more often significantly different (three quizzes) compared to the control group (two quizzes), demonstrating the predictive capability of BKT-LSTM to some extent. Initially, we expected that BKT-LSTM would enhance students’ learning performance. However, in post-quiz, participants in the control group had significantly higher scores than those in the experimental group. The result suggested that continuous complex questions may negatively affect students’ learning initiatives. On the contrary, relatively easy questions may improve their learning initiatives.</div>

<div>With the advent of Machine Learning and Deep Learning models, many avenues of development have opened. Today, these technologies are being leveraged to perform a wide variety of tasks that were otherwise not possible with traditional systems. The power of Machine Learning and Artificial Intelligence makes it possible to compute very complicated tasks at near real-time speeds. To provide an example, Machine Learning models are used extensively in the retail industry to predict and analyze critical parameters such as sales, promotions, customer behavior, recommendations, and offers.</div><div><br></div><div><br></div><div>Today, it is increasingly common to observe AI being used across many of the biggest domains such as Health, Environment, Military, and Business. Artificial Intelligence being used in educational settings has thus been a growing field of focus and study. For example, conversational AI being deployed to act as virtual tutors to answer student questions and concerns. Additionally, there is a fill-the-hole type of AIs that will help students learn tasks such as coding by either showing them how to do it or by predicting where the student might go wrong and suggesting preemptive corrective steps. </div><div><br></div><div>As described, a great deal of literature exists about the use of Deep Learning and Machine Learning models in education. However, the existing tools and models act as external appendages that add to the course structure, thereby altering it. This proposed study introduces a Bayesian Knowledge Transfer model based on the Long Short Term Memory structure (BKT-LSTM) utilized in a live STEM (Science, Technology, Engineering, and Mathematics) classroom. The model discovers individual student learning profiles based on past quiz performance and customizes future quizzes based on the learned patterns. The BKT-LSTM model works in tandem with the existing course curriculum and only tests those knowledge items that have already been covered in the classroom. The model does not change the course structure but rather aims to improve the student’s learning experience by focusing on areas of the student's knowledge that require more practice in learning. </div><div><br></div><div><br></div><div>Within a live STEM classroom, the BKT-LSTM model acts as a herald of change in the way students interact with the curriculum, even though no major changes are observed in the course structure. Students interacting with the model are subjected to quizzes with questions that target the individual student’s lack of learning in particular knowledge areas. Thus, students can be expected to perceive the change as unwelcoming due to the increasing difficulty in subsequent quizzes. Regardless, the study focuses on measuring the learning performance of the students. Do the students learn more in the new system? Another focus of the study is the student’s perception of engagement while interacting with the BKT-LSTM model. The effectiveness of the new educational process is determined not only by increased student learning performance, but also by the student’s perception of engagement while interacting with the model. Are the students enjoying the new experience? Do the students feel like they are learning something? Another important factor was also studied, that is learning performance of students interacting with the BKT-LSTM. </div><div><br></div>