When firing a handheld weapon, the shooter tries to aim at the point where he wants the bullet to hit. However, due to imperfections in the human body, this can be quite hard. The weapon moves relative to the target and the shooter has to use precise timing to fire the shot exactly when the weapon points to the intended target position. This can be very hard, especially when shooting at long range using a magnifying rifle scope. In this thesis, a solution to this problem using image analysis is described and tested. Using a digital video camera and software, the system helps the shooter to fire at the appropriate time. The system is designed to operate in real-time conditions on a PC. The tests carried out have shown that the solution is promising and helps to achieve better accuracy. However it needs to be optimized to run smoothly on a smaller scale embedded system. / Då en skytt avfyrar ett handhållet vapen försöker skytten sikta mot den punkt där han vill att kulan ska träffa. Eftersom den mänskliga kroppen inte är helt stabil kommer vapnet att röra sig runt denna punkt och skytten måste försöka avfyra skottet precis vid den tidpunkt då vapnet pekar mot rätt punkt. Detta är särskilt svårt vid stora avstånd, då små vinkelskillnader i vapnets pipa ger större utslag med ökande avstånd till målet.  I denna uppsats beskrivs och utvärderas ett system konstruerat för att minimera inverkan av de ofrivilliga rörelserna. Systemet använder sig av en videokamera monterad i siktet och en dator med mjukvara som utför analys och behandling av videoströmmen för att avgöra när vapnet bör avfyras. Tanken är att i ett färdigt system implementera algoritmen i ett portabelt inbyggt system som kan monteras i kikarsiktet tillsammans med kameran. Mjukvaran kan sedan styra avfyrningen elektroniskt efter att skytten gett sitt godkännande genom att lägga tryck på avtryckaren. Testen som genomförts visar att angreppssättet är lovande. Systemet fick i samtliga fall bättre resultat än då skyttarna avfyrade skott manuellt.

When an object makes a motion of continuous variation, its projection on a plane brings a succession of image and the motion between the video camera and the object causes displacement of image pixels. The relative motion of the displacement is called optical flow. The advantage of using the optical flow approach is that it is not required to know characteristics of the object and the environment at that time. So this method is suitable for tracking problems in unknown environment. It has been indicated that the optical flow based on the whole image cannot always be correct enough for control purpose where motion or feature occur. This thesis first uses digital image technique to subtract two continuous images, and extract the region where the motion actually occurs. Then, optical flow is calculated based on image information in this area. In this way, it cannot only raise the tracking speed, but also reduce the effect of the incorrect optical flow value. As a result, both tracking accuracy and speed can be greatly improved.

The brightness variance, caused by relative velocity of the camera and environment in a sequence of images, is called optical flow. The advantage of the optical-flow-based visual servo method is that feature of the object dose not need to be known in advance. Therefore, it can be applied for positioning and tracking implement tasks. The purpose of this thesis is to implement the image servo technique and the sliding-mode control method to track an unknown image pattern in three dimensional motion. The goal of tracking is to maintain identical image captured by the camera based on the relative movement calculated from the optical flow.

The optical flow has been one of the common approaches for image tracking. Its advantage is that no prior knowledge for image features is required. Since movement information can be obtained based on brightness data only, this method is suitable for tracking tasks of unknown objects. Besides, insects are always masters in chasing and catching preys in the natural world due to their unique compound eye structure. If the edge of the compound eye can be applied to tracking of moving objects, it is highly expected that the tracking performance will be greatly improved. Conventional images are built on a Cartesian reference system, which is quite different from the hexagonal framework for the compound eye of insects. This thesis explores the distinction of the hexagonal image framework by incorporating the hexagonal concept into the optical flow technology. Consequently, the reason behind why the compound eye is good at tracking moving objects can be revealed. According to simulation results for test images with different features, the hexagonal optical flow method appears to be superior to the traditional optical flow method in the Cartesian reference system.

No description available.

<p>There has been a rapid progress of the graphics processor the last years, much because of the demands from computer games on speed and image quality. Because of the graphics processor’s special architecture it is much faster at solving parallel problems than the normal processor. Due to its increasing programmability it is possible to use it for other tasks than it was originally designed for.</p><p>Even though graphics processors have been programmable for some time, it has been quite difficult to learn how to use them. CUDA enables the programmer to use C-code, with a few extensions, to program NVIDIA’s graphics processor and completely skip the traditional programming models. This thesis investigates if the graphics processor can be used for calculations without knowledge of how the hardware mechanisms work. An image processing algorithm calculating the optical flow has been implemented. The result shows that it is rather easy to implement programs using CUDA, but some knowledge of how the graphics processor works is required to achieve high performance.</p>

In this work we develop optical flow templates. In doing so, we introduce a practical tool for inferring robot egomotion and semantic superpixel labeling using optical flow in imaging systems with arbitrary optics. In order to do this we develop valuable understanding of geometric relationships and mathematical methods that are useful in interpreting optical flow to the robotics and computer vision communities. This work is motivated by what we perceive as directions for advancing the current state of the art in obstacle detection and scene understanding for mobile robots. Specifically, many existing methods build 3D point clouds, which are not directly useful for autonomous navigation and require further processing. Both the step of building the point clouds and the later processing steps are challenging and computationally intensive. Additionally, many current methods require a calibrated camera, which introduces calibration challenges and places limitations on the types of camera optics that may be used. Wide-angle lenses, systems with mirrors, and multiple cameras all require different calibration models and can be difficult or impossible to calibrate at all. Finally, current pixel and superpixel obstacle labeling algorithms typically rely on image appearance. While image appearance is informative, image motion is a direct effect of the scene structure that determines whether a region of the environment is an obstacle. The egomotion estimation and obstacle labeling methods we develop here based on optical flow templates require very little computation per frame and do not require building point clouds. Additionally, they do not require any specific type of camera optics, nor a calibrated camera. Finally, they label obstacles using optical flow alone without image appearance. In this thesis we start with optical flow subspaces for egomotion estimation and detection of “motion anomalies”. We then extend this to multiple subspaces and develop mathematical reasoning to select between them, comprising optical flow templates. Using these we classify environment shapes and label superpixels. Finally, we show how performing all learning and inference directly from image spatio-temporal gradients greatly improves computation time and accuracy.

In this dissertation, novel variational optical-flow and active-contour methods are investigated to address challenging problems in computer vision and shape-based imaging. Starting from traditional applications of these methods in computer vision, such as object segmentation, tracking, and detection, this research subsequently applies similar active contour techniques to the realm of shape-based imaging, which is an image reconstruction technique estimating object shapes directly from physical wave measurements. In particular, the first and second part of this thesis deal with the following two physically inspired computer vision applications. Optical Flow for Vision-Based Flame Detection: Fire motion is estimated using optimal mass transport optical flow, whose motion model is inspired by the physical law of mass conservation, a governing equation for fire dynamics. The estimated motion fields are used to first detect candidate regions characterized by high motion activity, which are then tracked over time using active contours. To classify candidate regions, a neural net is trained on a set of novel motion features, which are extracted from optical flow fields of candidate regions. Coupled Photo-Geometric Object Features: Active contour models for segmentation in thermal videos are presented, which generalize the well-known Mumford-Shah functional. The diffusive nature of heat processes in thermal imagery motivates the use of Mumford-Shah-type smooth approximations for the image radiance. Mumford-Shah's isotropic smoothness constraint is generalized to anisotropic diffusion in this dissertation, where the image gradient is decomposed into components parallel and perpendicular to level set curves describing the object's boundary contour. In a limiting case, this anisotropic Mumford-Shah segmentation energy yields a one-dimensional ``photo-geometric'' representation of an object which is invariant to translation, rotation and scale. These properties allow the photo-geometric object representation to be efficiently used as a radiance feature; a recognition-segmentation active contour energy, whose shape and radiance follow a training model obtained by principal component analysis of a training set's shape and radiance features, is finally applied to tracking problems in thermal imagery. The third part of this thesis investigates a physics-driven active contour approach for shape-based imaging. Adjoint Active Contours for Shape-Based Imaging: The goal of this research is to estimate both location and shape of buried objects from surface measurements of waves scattered from the object. These objects' shapes are described by active contours: A misfit energy quantifying the discrepancy between measured and simulated wave amplitudes is minimized with respect to object shape using the adjoint state method. The minimizing active contour evolution requires numerical forward scattering solutions, which are obtained by way of the method of fundamental solutions, a meshfree collocation method. In combination with active contours being implemented as level sets, one obtains a completely meshfree algorithm; a considerable advantage over previous work in this field. With future applications in medical and geophysical imaging in mind, the method is formulated for acoustic and elastodynamic wave processes in the frequency domain.

Στο πλαίσιο της εργασίας αυτής προτείνεται μια τεχνική η οποία προσπαθεί να κάνει ταυτόχρονα εκτίμηση της οπτικής ροής καθώς επίσης και διαμέριση της σκηνής σε διαφορετικά κινούμενα σώματα. Συγκεκριμένα προτείνεται η λύση μιας ακολουθίας προβλημάτων ελαχιστοποίησης. Κάθε πρόβλημα ελαχιστοποίησης προσπαθεί να απομονώσει κάποιο κινούμενο σώμα από την σκηνή και εκτιμά για αυτό μία ταχύτητα. Τα αποτελέσματα που προέκυψαν από την εφαρμογή της τεχνικής σε προβλήματα εκτίμησης της οπτικής ροής διαφορετικής πολυπλοκότητας δείχνουν ότι η επίδοση της προτεινόμενης τεχνικής είναι ικανοποιητική. / In this thesis, a method, which tries to estimate the optical flow field, and segment the scene at the same time, is suggested. Specifically, a series of minimization problems are solved. Each of these minimization problems, tries to isolate a moving object from the scene, and estimate for it a velocity. The results from applying the suggested method in several optical flow estimation problems, with varying complexities, show that the performance of the method is very promising.

No description available.