File Download
Supplementary
-
Citations:
- Appears in Collections:
postgraduate thesis: Facial expression analysis with graphical models
Title | Facial expression analysis with graphical models |
---|---|
Authors | |
Advisors | Advisor(s):Chan, KP |
Issue Date | 2012 |
Publisher | The University of Hong Kong (Pokfulam, Hong Kong) |
Citation | Shang, L. [尚利峰]. (2012). Facial expression analysis with graphical models. (Thesis). University of Hong Kong, Pokfulam, Hong Kong SAR. Retrieved from http://dx.doi.org/10.5353/th_b4784948 |
Abstract | Facial expression recognition has become an active research topic in recent
years due to its applications in human computer interfaces and data-driven animation. In this thesis, we focus on the problem of how to e?ectively use domain,
temporal and categorical information of facial expressions to help computer understand human emotions. Over the past decades, many techniques (such as
neural networks, Gaussian processes, support vector machines, etc.) have been
applied to facial expression analysis. Recently graphical models have emerged as
a general framework for applying probabilistic models. They provide a natural
framework for describing the generative process of facial expressions. However,
these models often su?er from too many latent variables or too complex model
structures, which makes learning and inference di±cult. In this thesis, we will
try to analyze the deformation of facial expression by introducing some recently
developed graphical models (e.g. latent topic model) or improving the recognition
ability of some already widely used models (e.g. HMM).
In this thesis, we develop three di?erent graphical models with di?erent representational assumptions: categories being represented by prototypes, sets of
exemplars and topics in between. Our ¯rst model incorporates exemplar-based
representation into graphical models. To further improve computational e±-
ciency of the proposed model, we build it in a local linear subspace constructed
by principal component analysis. The second model is an extension of the recently
developed topic model by introducing temporal and categorical information into
Latent Dirichlet Allocation model. In our discriminative temporal topic model
(DTTM), temporal information is integrated by placing an asymmetric Dirichlet
prior over document-topic distributions. The discriminative ability is improved by
a supervised term weighting scheme. We describe the resulting DTTM in detail
and show how it can be applied to facial expression recognition. Our third model
is a nonparametric discriminative variation of HMM. HMM can be viewed as a
prototype model, and transition parameters act as the prototype for one category.
To increase the discrimination ability of HMM at both class level and state level,
we introduce linear interpolation with maximum entropy (LIME) and member-
ship coe±cients to HMM. Furthermore, we present a general formula for output
probability estimation, which provides a way to develop new HMM. Experimental
results show that the performance of some existing HMMs can be improved by
integrating the proposed nonparametric kernel method and parameters adaption
formula.
In conclusion, this thesis develops three di?erent graphical models by (i) combining exemplar-based model with graphical models, (ii) introducing temporal
and categorical information into Latent Dirichlet Allocation (LDA) topic model,
and (iii) increasing the discrimination ability of HMM at both hidden state level
and class level. |
Degree | Doctor of Philosophy |
Subject | Face perception - Data processing. Image processing - Digital techniques. Human-computer interaction. |
Dept/Program | Computer Science |
Persistent Identifier | http://hdl.handle.net/10722/174506 |
HKU Library Item ID | b4784948 |
DC Field | Value | Language |
---|---|---|
dc.contributor.advisor | Chan, KP | - |
dc.contributor.author | Shang, Lifeng. | - |
dc.contributor.author | 尚利峰. | - |
dc.date.issued | 2012 | - |
dc.identifier.citation | Shang, L. [尚利峰]. (2012). Facial expression analysis with graphical models. (Thesis). University of Hong Kong, Pokfulam, Hong Kong SAR. Retrieved from http://dx.doi.org/10.5353/th_b4784948 | - |
dc.identifier.uri | http://hdl.handle.net/10722/174506 | - |
dc.description.abstract | Facial expression recognition has become an active research topic in recent years due to its applications in human computer interfaces and data-driven animation. In this thesis, we focus on the problem of how to e?ectively use domain, temporal and categorical information of facial expressions to help computer understand human emotions. Over the past decades, many techniques (such as neural networks, Gaussian processes, support vector machines, etc.) have been applied to facial expression analysis. Recently graphical models have emerged as a general framework for applying probabilistic models. They provide a natural framework for describing the generative process of facial expressions. However, these models often su?er from too many latent variables or too complex model structures, which makes learning and inference di±cult. In this thesis, we will try to analyze the deformation of facial expression by introducing some recently developed graphical models (e.g. latent topic model) or improving the recognition ability of some already widely used models (e.g. HMM). In this thesis, we develop three di?erent graphical models with di?erent representational assumptions: categories being represented by prototypes, sets of exemplars and topics in between. Our ¯rst model incorporates exemplar-based representation into graphical models. To further improve computational e±- ciency of the proposed model, we build it in a local linear subspace constructed by principal component analysis. The second model is an extension of the recently developed topic model by introducing temporal and categorical information into Latent Dirichlet Allocation model. In our discriminative temporal topic model (DTTM), temporal information is integrated by placing an asymmetric Dirichlet prior over document-topic distributions. The discriminative ability is improved by a supervised term weighting scheme. We describe the resulting DTTM in detail and show how it can be applied to facial expression recognition. Our third model is a nonparametric discriminative variation of HMM. HMM can be viewed as a prototype model, and transition parameters act as the prototype for one category. To increase the discrimination ability of HMM at both class level and state level, we introduce linear interpolation with maximum entropy (LIME) and member- ship coe±cients to HMM. Furthermore, we present a general formula for output probability estimation, which provides a way to develop new HMM. Experimental results show that the performance of some existing HMMs can be improved by integrating the proposed nonparametric kernel method and parameters adaption formula. In conclusion, this thesis develops three di?erent graphical models by (i) combining exemplar-based model with graphical models, (ii) introducing temporal and categorical information into Latent Dirichlet Allocation (LDA) topic model, and (iii) increasing the discrimination ability of HMM at both hidden state level and class level. | - |
dc.language | eng | - |
dc.publisher | The University of Hong Kong (Pokfulam, Hong Kong) | - |
dc.relation.ispartof | HKU Theses Online (HKUTO) | - |
dc.rights | The author retains all proprietary rights, (such as patent rights) and the right to use in future works. | - |
dc.rights | This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. | - |
dc.source.uri | http://hub.hku.hk/bib/B47849484 | - |
dc.subject.lcsh | Face perception - Data processing. | - |
dc.subject.lcsh | Image processing - Digital techniques. | - |
dc.subject.lcsh | Human-computer interaction. | - |
dc.title | Facial expression analysis with graphical models | - |
dc.type | PG_Thesis | - |
dc.identifier.hkul | b4784948 | - |
dc.description.thesisname | Doctor of Philosophy | - |
dc.description.thesislevel | Doctoral | - |
dc.description.thesisdiscipline | Computer Science | - |
dc.description.nature | published_or_final_version | - |
dc.identifier.doi | 10.5353/th_b4784948 | - |
dc.date.hkucongregation | 2012 | - |
dc.identifier.mmsid | 991033485279703414 | - |