Face Detection Documentation
Face Detection Documentation
1 Introduction
The goal of this project is to detect and locate human faces in a color image. A set of seven
training images were provided for this purpose. The objective was to design and implement a face
detector in MATLAB that will detect human faces in an image similar to the training images.
The problem of face detection has been studied extensively. A wide spectrum of techniques have
been used including color analysis, template matching, neural networks, support vector machines
(SVM), maximal rejection classification and model based detection. However, it is difficult to
design algorithms that work for all illuminations, face colors, sizes and geometries, and image
backgrounds. As a result, face detection remains as much an art as science.
Our method uses rejection based classification. The face detector consists of a set of weak
classifiers that sequentially reject non-face regions. First, the non-skin color regions are rejected
using color segmentation. A set of morphological operations are then applied to filter the clutter
resulting from the previous step. The remaining connected regions are then classified based on
their geometry and the number of holes. Finally, template matching is used to detect zero or more
faces in each connected region. A block diagram of the detector is shown in Figure 1.
We chose the HSV (Hue, Saturation, Value) color space for segmentation since it decouples the
chrominance information from the luminance information. Thus we can only focus on the hue
and the saturation component. The faces in each training image were extracted using the ground
truth data and a histogram was plotted for their H and S color component (Figure 2). The
histograms reveal that the H and S color components for faces are nicely clustered. This
information was used to define appropriate thresholds for H and S space that correspond to faces.
The threshold values were embedded into the color segmentation routine.
1
EE368 Digital Image Processing
Figure 2. Histograms for the H and S components of all faces in training image1