Return to search

Image motion estimation for 3D model based video conferencing.

Cheung Man-kin. / Thesis (M.Phil.)--Chinese University of Hong Kong, 2000. / Includes bibliographical references (leaves 116-120). / Abstracts in English and Chinese. / Chapter 1) --- Introduction --- p.1 / Chapter 1.1) --- Building of the 3D Wireframe and Facial Model --- p.2 / Chapter 1.2) --- Description of 3D Model Based Video Conferencing --- p.3 / Chapter 1.3) --- Wireframe Model Fitting or Conformation --- p.6 / Chapter 1.4) --- Pose Estimation --- p.8 / Chapter 1.5) --- Facial Motion Estimation and Synthesis --- p.9 / Chapter 1.6) --- Thesis Outline --- p.10 / Chapter 2) --- Wireframe model Fitting --- p.11 / Chapter 2.1) --- Algorithm of WFM Fitting --- p.12 / Chapter 2.1.1) --- Global Deformation --- p.14 / Chapter a) --- Scaling --- p.14 / Chapter b) --- Shifting --- p.15 / Chapter 2.1.2) --- Local Deformation --- p.15 / Chapter a) --- Shifting --- p.16 / Chapter b) --- Scaling --- p.17 / Chapter 2.1.3) --- Fine Updating --- p.17 / Chapter 2.2) --- Steps of Fitting --- p.18 / Chapter 2.3) --- Functions of Different Deformation --- p.18 / Chapter 2.4) --- Experimental Results --- p.19 / Chapter 2.4.1) --- Output wireframe in each step --- p.19 / Chapter 2.4.2) --- Examples of Mis-fitted wireframe with incoming image --- p.22 / Chapter 2.4.3) --- Fitted 3D facial wireframe --- p.23 / Chapter 2.4.4) --- Effect of mis-fitted wireframe after compensation of motion --- p.24 / Chapter 2.5) --- Summary --- p.26 / Chapter 3) --- Epipolar Geometry --- p.27 / Chapter 3.1) --- Pinhole Camera Model and Perspective Projection --- p.28 / Chapter 3.2) --- Concepts in Epipolar Geometry --- p.31 / Chapter 3.2.1) --- Working with normalized image coordinates --- p.33 / Chapter 3.2.2) --- Working with pixel image coordinates --- p.35 / Chapter 3.2.3) --- Summary --- p.37 / Chapter 3.3) --- 8-point Algorithm (Essential and Fundamental Matrix) --- p.38 / Chapter 3.3.1) --- Outline of the 8-point algorithm --- p.38 / Chapter 3.3.2) --- Modification on obtained Fundamental Matrix --- p.39 / Chapter 3.3.3) --- Transformation of Image Coordinates --- p.40 / Chapter a) --- Translation to mean of points --- p.40 / Chapter b) --- Normalizing transformation --- p.41 / Chapter 3.3.4) --- Summary of 8-point algorithm --- p.41 / Chapter 3.4) --- Estimation of Object Position by Decomposition of Essential Matrix --- p.43 / Chapter 3.4.1) --- Algorithm Derivation --- p.43 / Chapter 3.4.2) --- Algorithm Outline --- p.46 / Chapter 3.5) --- Noise Sensitivity --- p.48 / Chapter 3.5.1) --- Rotation vector of model --- p.48 / Chapter 3.5.2) --- The projection of rotated model --- p.49 / Chapter 3.5.3) --- Noisy image --- p.51 / Chapter 3.5.4) --- Summary --- p.51 / Chapter 4) --- Pose Estimation --- p.54 / Chapter 4.1) --- Linear Method --- p.55 / Chapter 4.1.1) --- Theory --- p.55 / Chapter 4.1.2) --- Normalization --- p.57 / Chapter 4.1.3) --- Experimental Results --- p.58 / Chapter a) --- Synthesized image by linear method without normalization --- p.58 / Chapter b) --- Performance between linear method with and without normalization --- p.60 / Chapter c) --- Performance of linear method under quantization noise with different transformation components --- p.62 / Chapter d) --- Performance of normalized case without transformation in z- component --- p.63 / Chapter 4.1.4) --- Summary --- p.64 / Chapter 4.2) --- Two Stage Algorithm --- p.66 / Chapter 4.2.1) --- Introduction --- p.66 / Chapter 4.2.2) --- The Two Stage Algorithm --- p.67 / Chapter a) --- Stage 1 (Iterative Method) --- p.68 / Chapter b) --- Stage 2 ( Non-linear Optimization) --- p.71 / Chapter 4.2.3) --- Summary of the Two Stage Algorithm --- p.72 / Chapter 4.2.4) --- Experimental Results --- p.72 / Chapter 4.2.5) --- Summary --- p.80 / Chapter 5) --- Facial Motion Estimation and Synthesis --- p.81 / Chapter 5.1) --- Facial Expression based on face muscles --- p.83 / Chapter 5.1.1) --- Review of Action Unit Approach --- p.83 / Chapter 5.1.2) --- Distribution of Motion Unit --- p.85 / Chapter 5.1.3) --- Algorithm --- p.89 / Chapter a) --- For Unidirectional Motion Unit --- p.89 / Chapter b) --- For Circular Motion Unit (eyes) --- p.90 / Chapter c) --- For Another Circular Motion Unit (mouth) --- p.90 / Chapter 5.1.4) --- Experimental Results --- p.91 / Chapter 5.1.5) --- Summary --- p.95 / Chapter 5.2) --- Detection of Facial Expression by Muscle-based Approach --- p.96 / Chapter 5.2.1) --- Theory --- p.96 / Chapter 5.2.2) --- Algorithm --- p.97 / Chapter a) --- For Sheet Muscle --- p.97 / Chapter b) --- For Circular Muscle --- p.98 / Chapter c) --- For Mouth Muscle --- p.99 / Chapter 5.2.3) --- Steps of Algorithm --- p.100 / Chapter 5.2.4) --- Experimental Results --- p.101 / Chapter 5.2.5) --- Summary --- p.103 / Chapter 6) --- Conclusion --- p.104 / Chapter 6.1) --- WFM fitting --- p.104 / Chapter 6.2) --- Pose Estimation --- p.105 / Chapter 6.3) --- Facial Estimation and Synthesis --- p.106 / Chapter 6.4) --- Discussion on Future Improvements --- p.107 / Chapter 6.4.1) --- WFM Fitting --- p.107 / Chapter 6.4.2) --- Pose Estimation --- p.109 / Chapter 6.4.3) --- Facial Motion Estimation and Synthesis --- p.110 / Chapter 7) --- Appendix --- p.111 / Chapter 7.1) --- Newton's Method or Newton-Raphson Method --- p.111 / Chapter 7.2) --- H.261 --- p.113 / Chapter 7.3) --- 3D Measurement --- p.114 / Bibliography --- p.116

Identiferoai:union.ndltd.org:cuhk.edu.hk/oai:cuhk-dr:cuhk_323177
Date January 2000
ContributorsCheung, Man-kin., Chinese University of Hong Kong Graduate School. Division of Electronic engineering.
Source SetsThe Chinese University of Hong Kong
LanguageEnglish, Chinese
Detected LanguageEnglish
TypeText, bibliography
Formatprint, xii, 121 leaves : ill. ; 30 cm.
RightsUse of this resource is governed by the terms and conditions of the Creative Commons “Attribution-NonCommercial-NoDerivatives 4.0 International” License (http://creativecommons.org/licenses/by-nc-nd/4.0/)

Page generated in 0.0021 seconds