National Technical University of Athens (NTUA)
Ανάλυση εικόνας και όραση υπολογιστών: θεωρία και εφαρμογές στην αποκατάσταση αρχαίων τοιχογραφιών
Abstract
dc:descriptionOur work lies in the area of image analysis and computer vision and is motivated by the problem of digitally restoring the wall paintings excavated at Akrotiri, Thera. Its subject makes it part of a broader recent trend to utilize modern digital technologies in order to facilitate capturing, restoring, studying, and disseminating our cultural heritage. The thesis tackles problems related both to the specific practical needs of the Akrotiri Thera application as well as broader theoretical basic research issues in the direction of developing mathematical models for describing natural images. In this framework, we start by describing the process we followed for the detailed photographic acquisition of a large number of Theran wall paintings. We have addressed the problem of digitally capturing a whole wall painting into a single ultra high resolution composition. Our approach consists of, first, capturing a large number of photographs, each depicting in detail parts of the composition, which we then stitch into a huge photographic mosaic. A web-based interface facilitates browsing through these high resolution panoramic mosaics. This approach, largely automated thanks to the use of modern computer vision techniques, has proven particularly successful and stands out as a practical and effective method for capturing high resolution photographs of artwork without the need for using highly specialized and expensive equipment. With application to the digital restoration of missing parts in the Theran wall paintings, our research has focused on image inpainting, the problem of filling-in missing image parts. In relation to image inpainting, we study two broad classes of image modeling methods. The first class consists of geometric image description methods inspired by physical diffusion processes and formulated as variational or partial differential equation models. Our main novel contribution in this area is the development of fast multigrid algorithms for the numerical solution of nonlinear anisotropic diffusion models, with application not only to image inpainting but also to image segmentation with geometric active contour models. We also propose statistically motivated algorithms for optimal scale selection in the context of image denoising with nonlinear scale-space methods. The thesis also studies a second statistical wavelet-based approach to image inpainting. In this framework, we discuss important statistical properties of natural images in the wavelet representation, captured to a good extent by the multiscale hidden Markov tree (HMT) model which we study in depth. Our main novel contribution in this area is the development of probabilistic image inpainting methods based on the HMT representation. We also propose new algorithms for learning the HMT model parameters from noisy data, with application to image denoising. Through a series of experiments involving the proposed models, we highlight their strengths and weaknesses and discuss possible future improvements. In the thesis Appendix we also discuss another aspect of our doctoral thesis research on audiovisual speech recognition. Our main research contribution in this area is the development of a theoretical framework for optimal adaptive fusion of multimodal data based on careful modeling of the individual feature measurement uncertainty (collaborative work), as well as the development of computer vision techniques for visual speech feature extraction from the speaker’s face.
Degree
thesis:*- Grantor dc:publisher
- National Technical University of Athens (NTUA)
- Year dc:date
- 2009
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Papandreou, Georgios
- Παπανδρέου, Γεώργιος
Subjects
dc:subject × 20- Όραση υπολογιστών
- Ψηφιακή επεξεργασία εικόνων
- Ψηφιακή ενδοσυμπλήρωση
- Τοιχογραφίες Ακρωτηρίου Θήρας
- Οπτική-ακουστική αναγνώριση ομιλίας
- Ψηφιακή πολιτιστική κληρονομιά
- Κυματίδια
- Πολυπλεγματικοί αλγόριθμοι
- Computer vision
- Digital image processing
- Digital inpainting
- Akrotiri Thera wall paintings
- Audio-visual speech recognition
- Digital cultural heritage
- Wavelets
- Multigrid algorithms
- Επιστήμες Μηχανικού και Τεχνολογία
- Επιστήμη Ηλεκτρολόγου Μηχανικού, Ηλεκτρονικού Μηχανικού, Μηχανικού Η/Υ
- Engineering and Technology
- Electrical Engineering, Electronic Engineering, Information Engineering
Rights
- Language dc:language
- gre
Identifiers
dc:identifier.*- Identifier
- 10.12681/eadd/18283