“Face Recognition Based Attendance System”

A
Third Year Design Engineering Project Report
UDP/IDP Project
Submitted in fulfillment for the award of VI Semester
B. E. ___I.T._________ Engineering

Submitted by

Sr. No. Name Enrollment No.

1 Patel Raxit Pankajbhai 190390116027
2 Prajapati Yash Ganeshbhai 190390116039
3 Pal Hiteshkumar Kamaleshkumar 190390116013
4 Patel Raj Arvindbhai 190390116025

Under the Guidance of

Prof. __Upasna Leela__

___IT_____ Engineering Department

December, 2021-2022

1|Page
 CERTIFICATE
(Online copy downloaded from GTU website)

2|Page
Table of Contents
List of Figures .............................................................................................................................5

1. Background .............................................................................................................................6

1.1 Domain Introduction .........................................................................................................6

1.2 Topic Introduction .............................................................................................................6

1.3 Literature Review ..............................................................................................................6

1.3.1 Resarch Papers............................................................................................................6

1.3.2 Patents ........................................................................ Error! Bookmark not defined.

1.4 Research Gap .................................................................... Error! Bookmark not defined.

2. Problem Definition ................................................................................................................ 11

3. Objectives ............................................................................................................................. 12

4. Methodology ......................................................................................................................... 13

5. Skills and Knowledge Required ............................................................................................. 16

5.1 Technical Skills ............................................................................................................... 16

5.2 Non-Technical Skills ....................................................................................................... 16

5.3 Knowledge Required ....................................................................................................... 16

6. Project Planning .................................................................................................................... 16

3|Page
7. Verification & Validation ........................................................ Error! Bookmark not defined.

7.1 Verification ....................................................................... Error! Bookmark not defined.

7.2 Validation.......................................................................... Error! Bookmark not defined.

8. Expected Outcome ................................................................................................................ 17

Appendix A: AEIOU Canvas .................................................................................................... 18

A.1 Activities ........................................................................................................................ 18

A.2 Environment ..................................................................... Error! Bookmark not defined.

A.3 Interactions ..................................................................................................................... 18

A.4 Objects ........................................................................................................................... 18

A.5 Users .............................................................................................................................. 18

A.6 AEIOU Sheet.................................................................................................................. 19

Appendix B: Empathy Canvas................................................................................................... 20

Appendix C: Mind Mapping...................................................................................................... 21

Appendix D: Ideation Canvas .................................................................................................... 22

Appendix E: Product Development Canvas .............................................................................. 24

Annexure F: Log Book ................................................................ Error! Bookmark not defined.

4|Page
List of Figures
Figure 1: Tap leaking on the 1st floor Water Room ................. 18Error! Bookmark not defined.

Figure 2: Dirty Environment due to recent function ................. 19Error! Bookmark not defined.

Figure 3: Interaction of User with Computer for using the website ........ 20Error! Bookmark not
defined.

Figure 4: Lathe Machine ......................................................... 21Error! Bookmark not defined.

Figure 5: Labourers & Engineers at the site ............................. 22Error! Bookmark not defined.

Figure 6: AEIOU Sheet ........................................................... 23Error! Bookmark not defined.

Figure 7: Empathy Canvas ...................................................... 24Error! Bookmark not defined.

Figure 8: Mind Mapping Canvas ............................................. 25Error! Bookmark not defined.

Figure 9: Ideation Canvas ........................................................ 26Error! Bookmark not defined.

Figure 10: Software model of the Product prepared in CREO .. 27Error! Bookmark not defined.

Figure 11: Sectional Elevation of the product .......................... 28Error! Bookmark not defined.

Figure 12: Plan of the product ................................................. 29Error! Bookmark not defined.

Figure 13: Cardboard prototype of the product ........................ 30Error! Bookmark not defined.

Figure 14: Various modules of our Website/Application ......... 31Error! Bookmark not defined.

5|Page
1. Background
1.1 Domain Introduction
Domain Introduction: -We have seen in colleges that faculty member are facing with manual
hand written document of attendance in online lecture during corona pandemic. To reduce their
work by using automated attendance application.

Domain Definition: - Face recognition is defined as biometric method in which identification of

individual is performed by comparing real time capture image with stored database of that
person.

1.2 Topic Introduction

Topic Introduction: - Face recognition based attendance system is a process of training the
students face and recognition for taking attendance by using face biometrics based on monitor
video technology.

Topic definition: - A facial recognition attendance system uses facial recognition technology to
identify and verify a person using the person’s face features and automatically mark attendance.

1.3 Literature Review

1.3.1 Research Papers

 Research paper review by all team members

 Reviewed by – Raid P. Patel

 Paper 1: Automatic Attendance System Using Face Recognition Technique

 Author: Mayur Surve, Priya Joshi, Sujata Jamadar, Minakshi Vharkate,MIT

academy,Pune

 Journal Name, Publishing Date: International Journal of Recent Technology and

Engineering (IJRTE) May 2020

 Citations:09

6|Page
  Key Words: face detection, face recognition, haar features, histogram of oriented
gradient

 Paper Summary: In this paper had focus to improve attendance system in colleges in
order to manual attendance system, Manual system has some disadvantage so this paper
represent the idea to save the time using face recognition technique. It is very useful.
Using haar cascade algorithm technique it will compare the face with capture images
which are stored in database. If it will match, attendance will be marked Present, date and
time, otherwise it will not mark.

Reviewed by – Raxit P. Patel

 Paper 2: Face Recognition Based Attendance System.

 Author: Nandhini R, Duraimurugan N, S.P.Chokkalingam

 Journal name, publishing Date: International Journal of Engineering and Advanced

Technology (IJEAT), February 2019.

 Citations: 14

 Keyword: Face recognition, Face detection, Deep Learning, Convolution Neural

Network (CNN).

 Paper summary: In this paper, the idea of two technologies namely Student Attendance
and Feedback system has been implemented with machine learning. This system
automatically detects the student performance and maintains the student's records like
attendance and their feedback on the subjects like Science, English, etc. Therefore the
attendance of the student can be made available by recognizing the face. On recognizing,
the attendance details and details about the marks of the student is obtained as feedback.

 Reviewed by – Yash G. Prajapati

 Paper 3: Face Time – Deep Learning Based Face Recognition Attendance System

 Author: Marko Arsenovic, Srdjan Sladojevic, Andras Anderla, Darko Stefanovic

University of Novi Sad, Faculty of Technical Sciences, Novi Sad, Serbia

 Journal Name, Publishing Date: 5th International Symposium on Intelligent Systems

and Informatics September 14-16, 2017
7|Page
  Citations: 06

 Key Words:Face recognition; deep learning, attendance system

 Paper summary: In this paper, a new deep learning based face recognition attendance
system is proposed. The entire procedure of developing a face recognition component by
advances in deep learning is described. It is determined that with the smaller number of
face images along with the proposed method of augmentation high accuracy can be
achieved, 95.02% in overall.

 Reviewed by – Yash G. Prajapati

 Paper 4: Face Recognition Based Attendance Management System Using Machine

Learning.

 Author: Anju V Das1, Anjana Shyju2, and T3homas Varghese3 and Nisha Mohan.
Mount Zion College of Engineering, Kadammanitta, Kerala, India,

 Journal Name, Publishing Date: Department of Computer Science and Engineering,

May 2019.

 Citations: 05

 Key Word: application, Biometric, Recognition system, Face Recognition, Deep

Learning, Portable Document Format

 Paper Summary: Attendance is a compulsory requirement of every class maintaining

Attendance muster daily is a difficult and time consuming task there are many other ways
like biometric REID, eye, voice etc. Here primary Identification is face the system uses
face recognized system library for Attendance and storing it.

 Reviewed by – Hiteshkumar K. Pal

 Paper 5: Study of Implementing Automated Attendance System Using Face Recognition

Technique

 Author:Nirmalya Kar, Mrinal Kanti Debbarma, Ashim Saha, and Dwijen Rudra Pal

 Journal Name, Publishing Date: International Journal of Computer and Communication

Engineering, 2, July 2012

8|Page
  Citations: 04

 Key Words: Face recognition system, attendance, authentication, bio-metric, PCA.

 Paper Summary: Authentication is a significant issue in system control in computer

based communication. For biometrics human face recognition is an important way and
has been widely used by many applications this paper shows a method for students face
recognition technology using personal component analysis (PCA) algorithms. It will
record Attendance Automatically and provide facility like login and logout time.

 Reviewed by – Hiteshkumar K. Pal

 Paper 6: Class Room Attendance System Using Facial Recognition System

 Author: Abhishek Jha ABES Engineering College, Ghaziabad

 Journal Name, Publishing Date: The International Journal of Mathematics, Science,

Technology and Management

 Citations: 05

 Key Words: Image Processing; Face Recognition; Pattern Recognition; Identification.

 Paper Summary: Automated attendance system that recognizes students using face
recognition technology through an image/video stream to record their attendance in
lectures or sections and evaluating their performance accordingly. The objective behind
this research is to thoroughly study the field of pattern recognition which is very
important and is used in various applications like identification and detection.

 Reviewed by – Raj A.Patel

 Paper 7: Attendance System Based on Face Recognition System Using CNN-PCA

Method

 Author:Edy Winarno, Imam Husni Al Amin, Herny Februariyanti, Prajanto Wahyu Adi ,
Wiwien Hadikurniawati , Muchamad Taufiq Anwar, Faculty of Information Technology
Universitas Stikubank Semarang, Indonesia

 Journal Name, Publishing Date: face recognition-based attendance system, hybrid

feature extraction, CNN-PCA, real-time camera

9|Page
  Citations: 04

 Key Words: International Seminar on Research of Information Technology and

Intelligent Systems (ISRITI)

 Paper Summary: One of the development in computer vision is the research of human
face reorganization one of the use of the human face system is as and attendance system
its use face its use face as object to to be identify persons detail and stored in database
this system using this camera is very effective and effectively for improve the accuracy of
users data.

 Reviewed by – Raj A. Patel

 Paper 8: Real-Time Smart Attendance System using Face Recognition Techniques

 Author: Shreyak Sawhney1, Karan Kacker2,Samyak Jain3, Shailendra Narayan Singh4,

Rakesh Garg5, Amity University Uttar Pradesh, Noida

 Journal Name, Publishing Date: International Conference on Cloud Computing, Data

Science & Engineering

 Citations: 04

 Key Words: facial recognition, attendance management system, Convolution Neural

Network, Principle Component Analysis.

 Paper Summary: The management of the attendance can be a great Durand the faculties
if it's done by hand to resolve problem, smart and auto attendance system is being
utilization. But authentication is an important issue in this system. Buy this system
problem for proxy and student mark present if they where present physically can be
easily solved.

10 | P a g e
2. Problem Definition
 Up to date, attendance system has been taken manually which causing time waste,
besides it is inaccurate during online platform. Face recognition technology can be
utilized to build an automated system that makes counting and identifying students much
easier and convenient.

What: - building an automated attendance system.

Why: - because manually attendance system causing more time.

How: - face recognition app done by python.

11 | P a g e
3. Objectives

Objective 1:-To design an effective and secure system for student detail, store sample photos in
database, and train image dataset and also evaluate the performance by comparing with the
difficulty in the manual as well as other traditional means of attendance systems.

What: - To design an effective and secure technique.

Why: - For effective technique and better performance.

How: - Python high level language and Opencv.

Outcome: - Store detail and photos in database.

Objective 2:- To offer system that simplify and automate the process of recording and tracking
student’s attendance through face recognition technology identifies or verifies a person from a
digital image or surveillance video.

What: - Simplify and automate the process of student’s attendance.

Why: - Tracking the student’s attendance.

How: - Through face recognition technology from verify a person from a digital image or
surveillance video.

Outcome: - Successfully verifies a person with recorded data.

Objective 3:- To create a feedback system for student expectations and feedback about
attendance system.

What: - Create feedback system

Why: - Student expectations and feedback about attendance system.

How: - Using python mysql database.

12 | P a g e
4. Methodology

Methodology for objective 1

Step 1: - our system dashboard in which we have to enter Id, name, gender, age, semester ,
mobile no, address, etc. of student.

Step 2:- After entering the student detail we have to click on Icon named as Take Images. Then it
will take images of student to train dataset.

Step 3: - Deep learning applies to generate images of student faces and store in folder.

Step 4: - By using haar cascade algorithm and we have train and classify images. Classifier
is a machine learning approach where a positive and negative images are used to train.
Positive images contain the images which we want our classifier to identify. After taking
image of student we have to click on Train Image which will directly get assign to ID and
NAME which we have entered.

13 | P a g e
Methodology for Objective 2

Step 1: - we have to track image during attendance time so we have to start Face recognition
process.

Step 2: - Face recognition process is done by Haar cascade algorithm. This algorithm is object
detection algorithm. Web cam of computer take real time face through live surveillance.

Step 3:- Haar cascade algorithm match this face with trained dataset.

Step 4: -If it matches the face with trained data successfully, it will show the name and Id of
student on his/her detected face .This process is done by Haar cascade algorithm.

Step 5: -It will generate an excel file which have been stored with student’s information who are
present in class if face matched.

Methodology for Objective 3

14 | P a g e
15 | P a g e
5. Skills and Knowledge Required
5.1 Technical Skills
 Machine Learning,

 Advanced python,

 Application Development Skill

5.2 Non-Technical Skills

 Management Skill,

 Leadership,

 Problem solving,

 Team Work.

5.3 Knowledge Required

 Advanced Python,
o Book by, Martin C. Brown,
o Python: The Complete Reference

 Mysql Workbench,
o Book by, Michael McLaughlin,
o MySQL Workbench: Data Modelling & Development

 Opens Machine learning tutorial.

o Book by, Joseph Howse, Joe Minichino
o Learning opencv computer vision with Python

16 | P a g e
8. Expected Outcome
There may be various types of lighting conditions, seating arrangements and environments in
various classrooms. Most of these conditions have been tested on the system and system has
shown 100% accuracy for most of the cases. There may also exist students portraying various
facial expressions, varying hair styles, beard, spectacles etc.

All of these cases are considered and tested to obtain a high level of accuracy and efficiency.
Thus, it can be concluded from the above discussion that a reliable, secure, fast and an efficient
system has been developed replacing a manual and unreliable system. The system will save time,
reduce the amount of work the administration has to do. Hence a system with expected results
has been developed but there is still some room for improvement

17 | P a g e
Appendix A: AEIOU Canvas
(Observation recorded under White Thinking Hat)

A.1 Activities
1 Activities

 Thinking of possibly design

 Collection of data from experts.
 Research Ideas.
 Construct prototypes
 Matching
 Taking photos

A.2 Environment
 Happy
 Sad
 Confused
 Surprised

A.3 Interactions
 Student-Student
 Admin-Student
 Faculty-Student

A.4 Objects
 Laptop
 Internet
 Software for programming
 Database Connectivity

18 | P a g e
A.5 Users
 Student

 Faculty

 Businessman

 Employee

 Manager

 Professors

19 | P a g e
A.6 AEIOU Sheet

Appendix B: Empathy Canvas

20 | P a g e
21 | P a g e
Appendix C: Mind Mapping

Appendix D: Ideation Canvas

22 | P a g e
23 | P a g e
Appendix E: Product Development Canvas

24 | P a g e
Appendix F: LNM Canvas

25 | P a g e