3D facial expression recognition using deep feature fusion CNN

Kun Tian, Liaoyuan Zeng, Sean McGrath, Qian Yin, Wenyi Wang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

As an important way of human communication, facial expression not only reflects our mental activities but also provides useful information for human behavior research. Recently, 3D technology becomes promising method to achieve robust facial expression analysis. 3D face scans are robust to lighting and pose variations. In this paper, a novel deep feature fusion convolution neural network (CNN) is designed for 3D facial expression recognition (FER). Each 3D face scan is firstly represented as 2D facial attribute maps (including depth, normal, and shape index values). Then, we combine different of facial attribute maps to learn facial representations by fine-tuning a pre-trained deep feature fusion CNN subnet trained from a large-scale image dataset for universal visual tasks. Moreover, Global Average Pooling is utilized to reduce the number of parameters to decrease the effect of overfitting. The experiments are conducted on the Bosphorus database and the results demonstrate the effectiveness of the proposed method.

Original languageEnglish
Title of host publication30th Irish Signals and Systems Conference, ISSC 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728128009
DOIs
Publication statusPublished - Jun 2019
Event30th Irish Signals and Systems Conference, ISSC 2019 - Maynooth, Ireland
Duration: 17 Jun 201918 Jun 2019

Publication series

Name30th Irish Signals and Systems Conference, ISSC 2019

Conference

Conference30th Irish Signals and Systems Conference, ISSC 2019
Country/TerritoryIreland
CityMaynooth
Period17/06/1918/06/19

Keywords

  • 3D facial expression recognition
  • Deep feature fusion CNN
  • Feature extraction
  • Point cloud

Fingerprint

Dive into the research topics of '3D facial expression recognition using deep feature fusion CNN'. Together they form a unique fingerprint.

Cite this