abstract With many visual speech animation techniques now available, there is a clear need for systematic perceptual evaluation schemes. We describe here our scheme and its application to a new video-realistic (potentially indistinguishable from real recorded video) visual-speech animation system, called Mary 101. Two types of experiments were performed: a) distinguishing visually between real and synthetic image- sequences of the same utterances, ("Turing tests") and b) gauging visual speech recognition by comparing lip-reading performance of the real and synthetic image-sequences of the same utterances ("Intelligibility tests"). Subjects that were presented randomly with either real or synthetic image-sequences could not tell the synthetic from the real sequences above chance level. The same subjects when asked to lip-read the utterances from the same image-sequences recognized speech from real image-sequences significantly better than from synthetic ones. However, performance for both, real and synthetic, were at levels suggested in the literature on lip-reading. We conclude from the two experiments that the animation of Mary 101 is adequate for providing a percept of a talking head. However, additional effort is required to improve the animation for lip-reading purposes like rehabilitation and language learning. In addition, these two tasks could be considered as explicit and implicit perceptual discrimination tasks. In the explicit task (a), each stimulus is classified directly as a synthetic or real image-sequence by detecting a possible difference between the synthetic and the real image-sequences. The implicit perceptual discrimination task (b) consists of a comparison between visual recognition of speech of real and synthetic image-sequences. Our results suggest that implicit perceptual discrimination is a more sensitive method for discrimination between synthetic and real image-sequences than explicit perceptual discrimination.

In this thesis, a novel and efficient numerical method is presented for the computation of the L² optimal mass transport mapping in two and three dimensions. The method uses a direct variational approach. A new projection to the constraint technique has been formulated that can yield a good starting point for the method as well as a second order accurate discretization to the problem. The numerical experiments demonstrate that the algorithm yields accurate results in a relatively small number of iterations that are mesh independent. In the first part of the thesis, the theory and implementation details of the proposed method are presented. These include the reformulation of the Monge-Kantorovich problem using a variational approach and then using a consistent discretization in conjunction with the "discretize-then-optimize" approach to solve the resulting discrete system of differential equations. Advanced numerical methods such as multigrid and adaptive mesh refinement have been employed to solve the linear systems in practical time for even 3D applications. In the second part, the methods efficacy is shown via application to various image processing tasks. These include image registration and morphing. Application of (OMT) to registration is presented in the context of medical imaging and in particular image guided therapy where registration is used to align multiple data sets with each other and with the patient. It is shown that an elastic warping methodology based on the notion of mass transport is quite natural for several medical imaging applications where density can be a key measure of similarity between different data sets e.g. proton density based imagery provided by MR. An application is also presented of the two dimensional optimal mass transport algorithm to compute diffeomorphic correspondence maps between curves for geometric interpolation in an active contour based visual tracking application.

Thesis (MSc (Mathematical Sciences. Applied Mathematics))--University of Stellenbosch, 2007. / Image morphing is a popular technique used to create spectacular visual effects, by gradually transforming one image into another. This thesis explains what exactly is meant by the terms “image morphing” / “warping”, where it is used and how it is done. A few existing morphing techniques are described and finally an implementation using Delaunay triangulation and texture mapping is presented.