Review Paper Final
Review Paper Final
Attendance System
Zain ul Abideen Qureshi
Department of Electrical Engineering Faculty of
Electronics and Electrical Engineering University of
Engineering & Technology Taxila, Pakistan
qzain06@gmail.com
Abstract
Providing accurate attendance marking system in real-time is challenging. It is tough to
mark the attendance of a student in the large classroom when there are many students
attending the class. Many attendance management systems have been implemented in
the recent research. However, the attendance management system based on facial
recognition still has issues. Thus many research have been conducted to improve
system. This paper reviewed the previous works on attendance management system
based on facial recognition. This article does not only provide the literature review on
the earlier work or related work, but it also provides the deep analysis of Principal
Component Analysis, discussion, suggestions for future work.
Keywords
Principal Component Analysis, Facial Recognition, Histogram Oriented Gradient,
Automatic System, AMS.
I. INTRODUCTION
Facial recognition development has received many interests in recent years. It is a
critical application in image analysis yet it is very challenging to create an automated
system based on facial recognition, a system with ability to recognize human face
accurately. One application of facial recognition is in the field of attendance
management system. The manual attendance system is time-consuming, thus many
research has been conducted with the automatic [1], [2], [3] or smart attendance
management [4] system to resolve this issue. One solution is the application of
biometric attendance management system. However, it is difficult to verify each student
in the classroom as there are many students who attend the class, and if the system
cannot detect or recognize one student, it will interrupt the learning process.
In addition, the biometric system needs much hardware that requires high cost and a lot
of interaction with the students that makes it a time-consuming system. The research on
applying real-time facial recognition in attendance management system has been a real
challenge. Automatic attendance marking can solve the main issues such as the error
when inputting the data from the sheet to the manual attendance system, especially
there is a concern that the data is not 100% accurate in the traditional attendance
marking method considering the extremely large number of students in a university.
The facial recognition process has many steps such as capture, extraction, comparison,
and matching [5]. The operation in each process is:
1. Step one
Capture is the way to snap the picture during the enrollment of the system.
2. Second step
Extraction is used for finding or extract the specific feature from the face.
3. Third step
Third step is comparison, where new input is used for comparison with the
database (sample data).
4. Fourth step
Fourth step is matching the system will try to find the matching of the new face
with the registered face based on extraction and comparison process. The
sequence of the processes is illustrated in Fig. 1.
There are several methods and algorithms that can be implemented in facial recognition
system. Study conducted by [6] implements LBP (local binary pattern) to recognize the
human face and SVM (support vector machine) to find the similarities of the images
stored in the database with the image acquired by camera inside the classroom. There
are a lot of limiting on the research done in the past. The detail of the limitations will be
introduced in next part of literature survey. The literature review gives a summaries of
information about the previous research and how each researcher implements the
attendance management system by using face recognition. In section five gives a
comparison of each paper based on the criteria by the author and provides the small
discussion about face recognition algorithm in attendance management system. At the
last section, will concludes all the discussion in this paper and gives some advice for
refinement of attendance management system.
A. Geometric Approach
This approach recognizes human based on geometry point on the face.
There are many features of geometric approach that has been explored: [7]
uses geometric approach to improve the accuracy of the system when the
images have complex background.
B. PCA Based
PCA is a statistical method used in facial recognition for feature extraction
and used to remove redundant information. PCA also used to decrease
dimensionality and conserve the information. When new image is input to the
system; facial recognition will process it to find the match between the new
image and the image inside the databases. Principal component or Eigen
face is a face image that contains feature and characteristic. The image with
the M ×M can be written to 1-dimensional M2 to reduce the dimensionality.
C. LDA Based
This method is used to maximize the scatter image in the same or different
class, which is enhanced from PCA. In PCA, a subspace is selected that
contains the most variation. Since 1997, Fisher faces [8] has been used in
the application of Fishers linear discriminant (FLD). The Fishers linear
discriminant chooses the linear subspace Φ that maximize the ratio.
T
Φ Sb Φ
T
Φ Sw Φ (1)
Where,
m
sb =∑ ¿ ( x i−x ) ( x i−x )
T
(2)
i=1
(3)
m
T
sw =∑ ∑ ( x i−x )(xi −x)
i=1 x ∈ Xi
Sb : between-class scatter
Sw : within-class scatter
m : number of subject in the database
In [8], this method was tested with a front-view of face images, and the result had less
error than Eigen faces-based method.
D. Local Binary Pattern
This approach is used in computer vision, which is first introduced in 1990 for
classification. In 1994, research papers [9] and [10] showed that combination
of LBP and HOG (histogram of oriented gradient) had a great performance in
texture classification and it improved the performance detection on some
relevant data sets.
Capturing and preparing image for training Suppose we have images X1,
X2, ..., X2 for training in face recognition system. The images must be the
same size.
All the face in Xi are transformed as a vector and put into a training set.
i=n
1 (5)
X= ∑x
N i=1 n
Φi = Γi − X (6)
n
(7)
∑ (Γ i−X )(Γ i −X )T
C= i=1
n
In [22], Priyanka Thakare proposes a method using Eigen face and principal component
analysis with architecture as follows. The camera is installed in the front, which is used
to capture entire face of the students inside the class. Then, the captured images are
transferred into the system as inputs. The images captured from the camera could be
too dark or too bright, thus enhancement is needed to convert them to gray images. In
the next step, histogram normalization is used to remove the contrast of the images,
thus it is easy to recognize the students who sit in the back row. The median filter is
used to remove noise from the images. Noise sometimes still occurs even when high
definition camera is used. The system also implements skin classification that changes
all pixels to black, except the pixels that are close to the skin.
V. COMPARISON OF FACE RECOGNITION TECHNIQUES
The aforementioned papers proposes several algorithms. Table I covers six papers that
are related to facial recognition area and an overview of all papers, including the
problems and cover the limitations of each paper used algorithms. We also give a
summary of every papers.
In Table II gives a brief pros and cons of each paper. All papers have conducted with
attendance management system should be improved based on each paper in Table III.
Which each paper has their own pros and cons on difference environment of the
implementation system. In the artificial intelligence-based method, artificial neural
network is able to classify face images successfully and it has the best system
performance compared to other artificial intelligence based or conventional algorithms.
Furthermore, integration of traditional and artificial intelligence-based algorithm such as
presented paper titled Face Recognition using Principal Component Analysis and
Neural Network also achieved better accuracy and performance than previous
attendance management based facial recognition system. The various algorithms
discussed in other papers are principal component analysis with AdaBoost [26], PCA
with error back-propagation [27] [28], and PCA with ANN and Wavelet [29]. Each paper
shows that the system accuracy is higher than the system with PCA that is not
incorporated with ANN.
TABLE I
SUMMARY PAPER
TABLE II
THE PROS AND CONS OF EACH PAPER
Feature Extraction
Feature extraction is used to extract the face features such as eyes, edge features, line
features, and center-surrounded features. Extraction of facial features for comparison
from the training set and test image for face detection. After the extraction of face
features the data is stored in the files that are classifier.it is created to store the
information. Student's images with Id are stored in the same folder.
Stage 1:
a) Data set
Generating Data for Training Initially the framework is prepared that is the edited
pictures are spared to the database and they experience location and acknowledgment.
Further, this information will be used to think about the distinguished pictures in all the
transferred records and imprint the participation.
Stage 2:
b) Capturing
In this the catching of the video or picture will be finished utilizing a gadget and the
caught record is transferred to the server utilizing web application.
Stage 3:
c) Face Detection
The record transferred to the server experiences face identification utilizing Viola what's
more, Jones calculation. The casings got are checked for the countenances and those
are trimmed for further acknowledgment.
Stage 4:
d) Face Recognition
The recognized pictures experience a relationship with the prepared pictures of the
databases. By this, the identified pictures are currently perceived.
Stage 5:
e) Attendance Marking
After the acknowledgment procedure the understudies perceived are looked in the
database and their participation is checked.
Database Design
This is the detail flow diagram of the project which involves the following steps.
1. Take images
Gathering data take pictures through the webcam or any other camera available. This is
all done through open cv.it is an open-source computer vision library used for image
recognition.
2.Training
After taking the image sample we have to click Train Image button. Now it takes a few
seconds to train the machine for the images that are taken by clicking the Take Image
button and creates a Trainner.yml file and store in the Training Image Label folder.
3. Track image
By clicking the Track Image button camera of the running machine is opened again. If
the face is recognized by system then Id and Name of person are shown on Image.
4. Attendance
Press Q(or q) for quit this window. After quitting it attendance of person will be stored in
the Attendance folder as CSV file with name, id, date and time and it is also available in
the window. The whole process is shown in the figure
Background Level
Students details are entered into automatic attendance management system and then
the process will start .first it will enable the camera and then capture the image and then
it will extract the face features and send to the known image file these are all stored in
the name of generated files when the features will extracted it will recognize the
students with the known matching data provided by the data set. Then further reports
are delivered to faculty after that, the reports are checked by the management and
further details are send to the authorized authority. Following are the flow diagram that
shows how the whole process will flow and managed the data.
People perform face acknowledgment naturally consistently and for all intents and
purposes with no exertion. There is different kind of face recognition algorithm. Every
technique has an alternate way to deal with concentrate the picture data and play out
the coordinating with the info picture. Today we going to discuss one of the most
established and increasingly prevalent face acknowledgment calculations: Local Binary
Patterns Histograms. (LBPH)
Utilizing the LBP joined with histograms we can speak to the face pictures with a basic
information vector. As LBP is a visual descriptor it can likewise be utilized for face
acknowledgment undertakings, as can be found in the accompanying bit by bit
clarification
Steps
Since we discover somewhat more about face acknowledgment and the LBPH, we
should go further and see the means of the calculation:
Parameters: the LBPH utilizes 4 parameters:
Radius: The radius is utilized to construct the round nearby double design and speaks
to the range around the focal pixel. It is normally set to 1.
Neighbors: The quantity of test focuses to manufacture the roundabout nearby parallel
example. Remember: the more example focuses you incorporate, the higher the
computational expense. It is normally set to 8.
Grid X: The number of cells in the flat course. The more cells, the better the framework,
the higher the dimensionality of the subsequent component vector. It is generally set to
8.
Grid Y: The number of cells in the vertical bearing. The more cells, the better the matrix,
the higher the dimensionality of the subsequent component vector. It is typically set to 8.
When we Run the program in pychram editor a window is open which contain the
following terms such as
1. Enter id
2. Enter Name
3. Notification
4. Take images
5. Train images
6. Track images
7. Quit
8. Attendance
Take images
After inter the details of the student id and name the first step is to take images from the
webcam or any other camera install in the classroom. This is all done through open cv.it
is an open-source computer vision library used for image recognition.
Train images
After taking the image sample we have to click the Train Image button. Now it takes a
few seconds to train the machine for the images that are taken by clicking the Take
Image button and creates a Trainner.yml file and store in the Training Image Label
folder. Harcascade classifier detects the desired portion of the image captured as in this
project the desired portion is our face. We are using a frontal face detection haar
cascade classifier. We are storing these images in a folder name training image.
Unknown images like glass appear in the video or any other thing if captured stored in
the unknown image folder.
Track images
By clicking the Track Image button camera of the running machine is opened again. If
the data is being in the folder which we take the images from the camera so when we
click on the track images it will start recognizing the data from the previous data in the
folder. If a face is recognized by the system then Id and Name of person are shown on
Image.
Attendance
Press Q(or q) for quit this window. After quitting it attendance of person will be stored in
the Attendance folder as CSV file with name, id, date and time and it is also available in
the window. The following images are the details of the whole process.
VII. CONCLUSION
This paper reviews several methods in terms of overall system capacity, throughput,
and accuracy. The result shows that the PCA algorithm is incredibly effective in
extensive database. PCA has better performance in the system of attendance
management based on facial recognition than manual attendance system that is time-
consuming. Convolutional neural network also contributes to attendance management
system based on facial recognition by providing strong classifier The focus in future
work is improving the accuracy of the system by incorporating principal component
analysis with convolutional neural network. The objective is to obtain good
generalization abilities. In [25], ANN and PCA has been integrated to solve a blocking
issue of attendance management system based on facial recognition. However, this
system still has issues with system performance and accuracy in recognizing human
face.
Future work will use fast PCA with back-propagation to resolve this problem.
Our project is recognizing marking the attendance of students whose data is stored
already .future work can be that like with the passage of time changes occur in the
human faces and body so the shape and size of face is change for this purpose we
need an intelligent algorithm that marks the attendance of students and as well as
stored the changing feature of face and stored it in the particular student record time to
time.
To avoid from terrorist activities in the institution it will help in a way that if an unknown
person comes in class an algorithm is made so efficient that when it detects the
unknown face a buzzer connected to the system start sounding.
REFERENCES
[1] A. Ahmedi and S. Nandyal, “An Automatic Attendance System Using Image
processing,” pp. 1–8, 2015.
[2] V. Shehu and A. Dika, “Using real time computer vision algorithms in automatic
attendance management systems,” Information Technology Interfaces (ITI),
2010 32nd International Conference, pp. 397–402, 2010.
[5] T. H. Le, “Applying Artificial Neural Networks for Face Recognition,” Advances in
Artificial Neural Systems, 2011.
[20] N. K. Jayant and S. Borra, “Attendance management system using hybrid face
recognition techniques,”Conference on Advances in Signal Processing (CASP),
vol. 2, no. 11. IEEE, pp. 412–417, jun 2016.
[27] J.-M. Kim and M.-A. Kang, “A Study of Face Recognition Using the PCA and
Error Back-Propagation,” in 2010 Second International Conference on Intelligent
Human-Machine Systems and Cybernetics, vol. 2, no. 1. IEEE, , pp. 241–244,
aug 2010.
[28] R. Toufiq and M. R. Islam, “Face recognition system using PCA-ANN technique
with feature fusion method,” Electrical Engineering and Information &
Communication Technology (ICEEICT), International Conference on, pp. 1–5,
2014.
[29] M. Mazloum and S. Ayat, “Combinational Method for Face Recognition: Wavelet,
PCA and ANN, “Digital Image Computing: Techniques and Applications. IEEE,
pp. 90–95,2008.