This dissertation considers radar detection and tracking of weak fluctuating targets using dynamic programming (DP) based track-before-detect (TBD). TBD combines target detection and tracking by integrating data over consecutive scans before making a decision on the presence of a target. A novel algorithm is proposed which employs order statistics in dynamic programming based TBD (OS-DP-TBD) to detect weak fluctuating targets. The well-known Swerling type 0, 1 and 3 targets are considered with non-Gaussian distributed clutter and complex Gaussian noise. The clutter is modeled using the Weibull, K and G0 distributions. The proposed algorithm is shown to provide better performance than well-known techniques in the literature. In addition, a novel expanding window multiframe (EW-TBD) technique is presented to improve the detection performance with reasonable computational complexity compared to batch processing. It is shown that EW-TBD has lower complexity than existing multiframe processing techniques. Simulation results are presented which confirm the superiority of the proposed expanding window technique in detecting targets even when they are not present in every scan in the window. Further, the throughput of the proposed technique is higher than with batch processing. Depending on the range and azimuth resolution of the radar system, the target may appear as a point in some radar systems and there will be target energy spillover in other systems. This dissertation considers both extended targets with different energy spillover levels and point targets. Simulation results are presented which confirm the superiority of the proposed algorithm in both cases. / Graduate

The problem of object detection deals with determining whether an instance of a given class of object is present or not. There are robust, supervised learning based algorithms available for object detection in an image. These image object detectors (image-based object detectors) use characteristics learnt from the training samples to find object and non-object regions. The characteristics used are such that the detectors work under a variety of conditions and hence are very robust. Object detection in video can be performed by using such a detector on each frame of the video sequence. This approach checks for presence of an object around each pixel, at different scales. Such a frame-based approach completely ignores the temporal continuity inherent in the video. The detector declares presence of the object independent of what has happened in the past frames. Also, various visual cues such as motion and color, which give hints about the location of the object, are not used. The current work is aimed at building a generic framework for using a supervised learning based image object detector for video that exploits temporal continuity and the presence of various visual cues. We use temporal continuity and visual cues to speed up the detection and improve detection accuracy by considering past detection results. We propose a generic framework, based on Experiential Sampling [1], which considers temporal continuity and visual cues to focus on a relevant subset of each frame. We determine some key positions in each frame, called attention samples, and object detection is performed only at scales with these positions as centers. These key positions are statistical samples from a density function that is estimated based on various visual cues, past experience and temporal continuity. This density estimation is modeled as a Bayesian Filtering problem and is carried out using Sequential Monte Carlo methods (also known as Particle Filtering), where a density is represented by a weighted sample set. The experiential sampling framework is inspired by Neisser’s perceptual cycle [2] and Itti-Koch’s static visual attention model[3]. In this work, we first use Basic Experiential Sampling as presented in[1]for object detection in video and show its limitations. To overcome these limitations, we extend the framework to effectively combine top-down and bottom-up visual attention phenomena. We use learning based detector’s response, which is a top-down cue, along with visual cues to improve attention estimate. To effectively handle multiple objects, we maintain a minimum number of attention samples per object. We propose to use motion as an alert cue to reduce the delay in detecting new objects entering the field of view. We use an inhibition map to avoid revisiting already attended regions. Finally, we improve detection accuracy by using a particle filter based detection scheme [4], also known as Track Before Detect (TBD). In this scheme, we compute likelihood of presence of the object based on current and past frame data. This likelihood is shown to be approximately equal to the product of average sample weights over past frames. Our framework results in a significant reduction in overall computation required by the object detector, with an improvement in accuracy while retaining its robustness. This enables the use of learning based image object detectors in real time video applications which otherwise are computationally expensive. We demonstrate the usefulness of this framework for frontal face detection in video. We use Viola-Jones’ frontal face detector[5] and color and motion visual cues. We show results for various cases such as sequences with single object, multiple objects, distracting background, moving camera, changing illumination, objects entering/exiting the frame, crossing objects, objects with pose variation and sequences with scene change. The main contributions of the thesis are i) We give an experiential sampling formulation for object detection in video. Many concepts like attention point and attention density which are vague in[1] are precisely defined. ii) We combine detector’s response along with visual cues to estimate attention. This is inspired by a combination of top-down and bottom-up attention maps in visual attention models. To the best of our knowledge, this is used for the first time for object detection in video. iii) In case of multiple objects, we highlight the problem with sample based density representation and solve by maintaining a minimum number of attention samples per object. iv) For objects first detected by the learning based detector, we propose to use a TBD scheme for their subsequent detections along with the learning based detector. This improves accuracy compared to using the learning based detector alone. This thesis is organized as follows . Chapter 1: In this chapter we present a brief survey of related work and define our problem. . Chapter 2: We present an overview of biological models that have motivated our work. . Chapter 3: We give the experiential sampling formulation as in previous work [1], show results and discuss its limitations. . Chapter 4: In this chapter, which is on Enhanced Experiential Sampling, we suggest enhancements to overcome limitations of basic experiential sampling. We propose track-before-detect scheme to improve detection accuracy. . Chapter 5: We conclude the thesis and give possible directions for future work in this area. . Appendix A: A description of video database used in this thesis. . Appendix B: A list of commonly used abbreviations and notations.

Detection of an underwater target with active sonar in shallow waters such as the Baltic sea is a big challenge. This since the sound beams from the sonar will be reflected on the surfaces, sea surface and sea bottom, and the water volume itself which generates reverberation. Reverberation which will be reflected back to the receiver, is strong in intensity which give rise to many false targets in terms of classifying a target in a surveillance area. These false targets are unwanted and a real target might benefit from these miss-classifications in terms of remaining undetected. It is especially hard if the signal-to-noise ratio (SNR) is approaching zero, i.e. the target strength and the reverberation strength are equal in magnitude. The classical approach to a target detection problem is to assign a threshold value to the measurement, and the data point exceeding the threshold is classified as a target. This approach does not hold for low levels of SNR, since a threshold would not have a statistical significance and could lead to neglecting important data. Track-before-detect (TrBD) is a proposed method for low-SNR situations which tracks and detects a target based on unthresholded data. TrBD enables tracking and detecting of weak and/or stealthy targets. Due to the issues with target detection in shallow waters, the hypothesis of this thesis is to investigate the possibility to implement TrBD, and evaluate the performance of it, when applied on a low-SNR target. The TrBD is implemented with a particle filter which is a recursive Bayesian solution to the problem of integrated tracking and detection. The reverberation data was generated by filtering white noise with an Autoregressive filter of order 1. The target is assigned to propagate according to a constant velocity state space model. Two types of TrBD algorithms are implemented, one which is trained on the background and one which is not. The untrained TrBD is able to track and detect the target but only for levels of SNR down to 4dB. Lower SNR leads to the algorithm not being able to distinguish the target signal from the reverberation. The trained TrBD on the other hand, is able to perform very well for levels of SNR down to 0dB, it is able to track and detect the target and neglect the reverberation. For trajectories passing through areas with high reverberation, the target was lost for a short period of time until it could be retracked again. Overall, the TrBD was successfully implemented on the self-generated data and has a good performance for various target trajectories.