Person-Independent Facial Expression Recognition Based on Compound Local Binary Pattern (CLBP)

Faisal Ahmed1, Hossain Bari2, and Emam Hossain3
1Department of CSE, Islamic University of Technology, Bangladesh
2Samsung Bangladesh R & D Center Ltd, Bangladesh
3Department of CSE, Ahsanullah University of Science and Technology, Bangladesh

 

Abstract: Automatic recognition of facial expression is an active research topic in computer vision due to its importance in both human-computer and social interaction. One of the critical issues for a successful facial expression recognition system is to design a robust facial feature descriptor. Among the different existing methods, the Local Binary Pattern (LBP) has been proved to be a simple and effective one for facial expression representation. However, the LBP method thresholds P neighbors exactly at the value of the center pixel in a local neighborhood and encodes only the signs of the differences between the gray values. Thus, it loses some important texture information. In this paper, we present a robust facial feature descriptor constructed with the Compound Local Binary Pattern (CLBP) for person-independent facial expression recognition, which overcomes the limitations of LBP. The proposed CLBP operator combines extra P bits with the original LBP code in order to construct a robust feature descriptor that exploits both the sign and the magnitude information of the differences between the center and the neighbor gray values. The recognition performance of the proposed method is evaluated using the Cohn-Kanade (CK) and the Japanese Female Facial Expression (JAFFE) database with a support vector machine (SVM) classifier. Experimental results with prototypic expressions show the superiority of the CLBP feature descriptor against some well-known appearance-based feature representation methods.

Keywords: Facial expression recognition, feature descriptor, LBP, support vector machine, texture encoding.

 

Received April 26, 2012; accepted December 31, 2012