Project Report - I On Iot Based Home Automation System Using Augmented Reality
Project Report - I On Iot Based Home Automation System Using Augmented Reality
on
Bachelor of Engineering
In
Electronics and Telecommunication Engineering
BY
Miss. Saylee Surve (B-748)
Mr. Aaditya Auti (B-758)
Mr. Bharat Kolekar (B-759)
Mr. Tejas Lad (B-760)
CERTIFICATE
This is to certify that the project entitled " IOT BASED HOME AUTOMATION SYSTEM
USING AUGMENTED REALITY" is a bonafied work of Miss. Saylee Surve, Mr.
Aaditya Auti, Mr. Bharat Kolekar and Mr. Tejas Lad under the supervision of Prof.
Shrikrishna Patil, submitted to the University of Mumbai in partial fulfillment of the
requirement for the award of the Degree of Bachelor of Engineering in Electronics and
Telecommunication Engineering.
ii
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
This project report entitled " IOT BASED HOME AUTOMATION SYSTEM USING
AUGMENTED REALITY " by Miss. Saylee Surve, Mr. Aaditya Auti, Mr. Bharat
Kolekar and Mr. Tejas Lad is approved for the degree of Bachelor of Engineering in
Electronics and Telecommunication Engineering from University of Mumbai, in
academic year 2021-22.
Examiners:
1. Internal: _______________
2. External: ______________
Date: 13/11/2021
Place: Mumbai
iii
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
DECLARATION
We declare that this written submission for B.E project entitled " IOT BASED HOME
AUTOMATION SYSTEM USING AUGMENTED REALITY " presents our ideas in our
own words and where others ideas or words have been included; we have adequately cited
and referenced the original sources. We also declare that we have adhered to all principles of
academic honesty and integrity and have not misrepresented or fabricated or falsified any
idea/data/fact/source in our submission. We understand that any violation of the above will
be cause for disciplinary action by the Institute and can also evoke penal action from the
sources which have thus not been properly cited or from whom proper permission has not
been taken when needed.
Signature
Date: 13/11/2021
Place: Mumbai
iv
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
Abstract
This project presents a low cost and flexible home control and environment monitoring
system. The work is mainly concentrated on IOT based home automation using Augmented
Reality acting as GUI between different home appliances based on wireless home automation
system using IOT helps us to control basic home appliances automatically by using
smartphone.
Internet of Things (IoT) conceptualizes the idea of remotely connecting and monitoring real
world objects (things) through the Internet. When it comes to our house, this concept can be
aptly incorporated to make it smarter, safer and automated. This IoT project focuses on
building a smart wireless home security system which sends alerts to the owner by using
Internet in case of any trespass and raises an alarm optionally. Besides, the same can also be
utilized for home automation by making use of the same set of sensors. The leverage obtained
by preferring this system over the similar kinds of existing systems is that the alerts and the
status sent by the Wi-Fi connected microcontroller managed system can be received by the
user on his phone from any distance irrespective of whether his mobile phone is connected to
the internet. The microcontroller used in the current project is the ESP32 for accessing and
controlling devices and appliances remotely. Therefore, this system has been successfully
designed and implemented in real time.
Lastly, Augmented Reality implementation in this project brings user executing direct
interactions to manipulate all objects in the surrounding world. Thus, this project presents an
idea or a concept for home automation using ESP32 with Blynk App, Augmented Reality and
switch to control four Relays with and without internet.
Keywords- IOT, Wi-Fi, ESP32, Augmented Reality (AR), Blynk Application, Relay
v
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
Table of Content
Content Page no.
Abstract ………………………………………………………………………….…...…….…. v
1. Introduction ………………………………………………………………………….……... 1
3.2 Objectives
4.Work Done……………………………………………………………………………....…... 7
8. References …………………………………………………………………………………. 21
vi
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
List of Figure
Fig 4.1: Block Diagram of Home Automation System with AR…………………. 8
Fig 4.7: Output Screen for Fingerprint scanner shit and logged data…………….. 12
vii
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
List of Table
Table 6.1: Cost Estimation for project…………………………………………….. 19
viii
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
1. Introduction
Home automation is become more beneficial because of its safety and security. Nowadays,
home automation become more advance and precise to monitor all the home appliances.[1]
Home automation system become energy efficient and highly approachable smart home
technique. It involves basic feature to maintain the user satisfaction and comfort. Home
automation systems are quickly emerging and becoming popular nowadays in the world and
its end users are specifically the disabled and elderly but due to their complexity and cost it
is not always accepted.[2] Population ageing is taking place in nearly all the countries of the
world. Ageing results from decreasing mortality, and most importantly, declining fertility.
This process leads to a relative reduction in the proportion of children and to an increase in
the share of people in the main working ages and of older persons in the population.[3]
With rapid economic growth, living standard are also rising day by day. The modern society
wants safe, economic, comfortable and convenient life which is ideal for every family. Home
automation is a very promising area. Its main benefits range from increased comfort and
greater safety and security, to a more rational use of energy and other resources, allowing for
significant savings.[4] It also offers powerful means for helping and supporting the special
needs of people with disabilities and, in particular, the elderly. This application domain is
very important and will steadily increase in the future. Home automation is known as the
automation of the home, housework or household activity. It commonly defines a residence
that integrates technology and services through home networking to improve the quality of
living.[5] Home automation is not a new term for science society and has been around for a
significant time. Home automation include mainly centralized control of lighting,
temperature, appliances, and other systems, to provide improved comfort, convenience,
efficiency and security. For disabled and elderly person home automation can be the
substitute of institutional care.
There are certain issues involved in the design of a home automation system. The system
should be scalable, so that new device can easily be integrated into it.[6] It should provide a
user-friendly interface on the host side, so that the devices can be setup, monitored and
controlled. The interface should also provide some diagnostic services so those problems with
the system, if any, can be tracked down. The overall system should be fast enough to realize
the true power of wireless technology. It should also be cost effective in order to justify its
application in home automation.[7]
The alerts and the status of the IoT system can be accessed by the user from anywhere even
where Internet connectivity may not be readily available since it is not necessary for the
mobile phone to be connected to internet only board is required to have an access to Wi-Fi.
1
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
The existing infra-red (IR) or Blue-tooth remote controls present in the market are in general
appliance specific and the same cannot be used interchangeably.[8] Electrical appliances
connected through Bluetooth making use of Blue-tooth enabled smart phones cannot be
managed from a distant location. Thus, functions such as being able to turn on an air-
conditioner while returning home cannot be done with such systems. In contrast, this work
gives a cost effective and simple solution for wireless home automation and home security
systems. The difficulty faced by current home security/surveillance systems in providing
information pertaining to the situation to users while being away from home is tried to
overcome in this project.[9]
This Project employs an embedded SoC ESP32 for accessing devices and appliances
remotely. People's expectations regarding automation and security have changed to large
extent during the course of time due to the advancement of technology and services. Different
automation systems over the time tried to provide efficient, convenient and safe way for
inhabitants to access their workplace. Many existing systems still uses Bluetooth module
instead of the Wi-Fi module so the area of operation is greatly reduced. Augmented Reality
(AR) implementation in this project brings user executing direct interactions to manipulate
all objects in the surrounding world.
2
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
2. Literature Survey
➢ IOT based smart home automation using Sensor node.
Author: H. Singh, V. Pallagani, V. Khandelwal and U. Venkanna
Methodology and Principle Proposed: The Arduino is connected to the Bluetooth
module; all the appliances can be controlled using the Arduino but it needs to be within a
small distance for it to connect to the Bluetooth.[1]
Outcome: Since Bluetooth module is used, the range at which the home appliances can
be controlled is reduced.
3
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
➢ IoT based smart security and home automation system.
Authors: Ravi Kishore Kodali, Vishal Jain, Suvadeep Bose and Lakshmi Boppana
Methodology and Principle Proposed: This IoT project focuses on wireless home
security system which sends alerts to the owner by using Internet via Microcontroller. [6]
Outcome: The prototype can be used in following two ways:
1) As a smart security system
2) As a smart home automation system
4
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
• There is a great energy crisis in our country. Moreover, we often forget to switch-off
our home appliances due to hectic schedule which results high energy bills.
• Home automation is all about the management of your home and daily life. You can
remotely control lights and other home appliances by turning off them when not in
use. Also, day by day we have to develop and upgrade our controlling access and types
of controlling protocols.
• Physically disabled or handicapped people are not able move much from one place so
for them it is very difficult to access regular domestic appliances. For them it is
essential to develop a system which requires less human interaction.
• The benefits of home automation typically fall into a few categories, including
savings, safety, convenience and control. Additionally, some consumers purchase
home automation for comfort and peace of mind.
• Smart home automation system can save electricity as well as save energy, cutting
utility costs over time. Some home automation technologies monitor water usage too,
helping to prevent exorbitant water bills.
• Many home automation technologies can make a place safer than before. Consumers
purchase these devices because they want to make their homes safer and more secure
Automated lighting helps people to recover their mistakes. If anyone forgets to turn
off the lights, can turn it off with the help of automation system and with less work.
• People choose smart home devices to better control functions within the home.
Connected devices can also help create a comfortable atmosphere. They provide
intelligent and adaptive lighting, sound which can all help create an inviting
environment
5
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
3.2. Objectives:
• This project presents an idea or a concept for home automation using ESP32 with
Blynk App, Augmented Reality and switch to control four Relays with and without
internet.
• With this IoT-based smart home system the ESP32 connected with Wi-Fi. It can
monitor the real-time feedback of the relays in the Blynk app. If Wi-Fi is available the
ESP32 will automatically connect with Wi-Fi and indicate on PCB.
• Door Lock will be controlled by using R305 Fingerprint sensor along with ESP32. It
will help user to maintain the full authenticity and security.
• IoT and AR can be complementary to each other as, AR offers a convenient and
intuitive way for users to visualize and interact with IoT objects and their associated
data.
• Our Mobile App uses a standard AR enabled IoT service, here the user finds and
connects to the IoT device and the app shows an AR-based control interface.
• AR interaction for home appliances refers to device control to exchange with the
attached actuators in the real space. This technique expresses the situations where the
user can handle direct interactivity in terms of the physical devices.
• This project will be fully based on low cost and reliable home control monitoring
system for accessing and controlling devices and appliances remotely using Smart
phone application and Internet. While using this technology the system improves the
living standard at home, reduce human effort and human error, energy efficient and
time saving and thus make a smart home.
6
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
4.Work Done
a) Working principle:
Home automation involves automating the household environment. This is possible because
of the smartphones and internet that we are widely using. Home automation can be again
divided in to just controlling the appliances using a smartphone from a remote location and
another type filled with sensors which controls the lighting, temperature, door locks,
electronic gadgets, electrical appliances etc. using a “Smart” system.
In this project, we will design a simple home automation project using simple components
using which different electrical appliances can switched on or off. The project is based on
ESP32 and commands are sent via Augmented Reality (Blynk App), which controls relay
operation of project.
✓ Block Diagram:
This project presents an idea or a concept for home automation using ESP32 with Blynk,
Augmented Reality and manual switch to control 4 relays with and without internet and
monitor the real time feedback in the Blynk app. Automation of device has a wide scope for
this generation as well as in forthcoming generation. In this mobile communication
technology is playing a major role in the world of automation. And also, it will very helpful
for providing support to disable people and fulfill their needs in home and thus they lead a
normal life. This proposes system consists of Android mobile in using ESP32 with Blynk
app, Augmented reality & Manual control relays. We are a using Wi-Fi technology to monitor
the device because of its accuracy, high range and instant connectivity.
With this ESP32 project. It can control 4 home appliances from the smartphone, Augmented
reality application, and manual switches. If there is no internet available still it can control
the relay module from the augmented reality application and manual switches. With this IoT-
based smart home system, If the ESP32 connected with Each other Wi-Fi then it can also
monitor the real- time feedback of the relays in the Blynk app. If the Wi-Fi is available the
ESP32 with automatically connect with the Wi- Fi.
7
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
9
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
b) Methodology Developed and Adopted Design:
✓ AR (AUGMENTED REALITY)
Every AR system comprises 3 components - Hardware, Software, and the Application. I will
use the example of our smartphones to expound the concept of Hardware, Software and
Application
When these devices are connected to the internet, they are a part of Internet of Things. The
backbone of this automation system is a basic (SoC) System on Chip, connected to the
internet via USB serial or ESP32 WIFI Module. Models can be integrated as and when
required and also to ease human efforts.
11
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
Fig 4.7: Output Screen for Fingerprint scanner shit and logged data
12
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
5. Component Specifications
SOFTWARE:
1) EasyEDA:
EasyEDA is a web-based EDA tool suite that enables hardware engineers to design, simulate,
share - publicly and privately - and discuss schematics, simulations and printed circuit boards.
Other features include the creation of a bill of materials, Gerber files and pick and place files
and documentary outputs in PDF, PNG and SVG formats.
Features:
● Setting of themes
● BOM/DXF exports
● PCB module
A framework purpose-built for AR development allows you to develop your app once, then
deploy it across multiple mobile and wearable AR devices. It includes core features from
each platform, as well as unique Unity features that include photorealistic rendering, physics,
device optimizations, and more.
Features:
3) IFTTT
IFTTT can automate web-application tasks, such as posting the same content on several social
networks. Marketing professionals can use IFTTT to track mentions of companies in RSS
feeds. IFTTT also is used in home automation, for instance switching on a light when
detecting motion in a room (with associated compliant devices).
Features:
• Services (formerly known as channels) are the basic building blocks of IFTTT. They
mainly describe a series of data from a certain web service such as YouTube or eBay.
Services can also describe actions controlled with certain APIs, like SMS. Sometimes, they
can represent information in terms of weather or stocks. Each service has a particular set
of triggers and actions.
• Triggers are the "this" part of an applet. They are the items that trigger the action. For
example, from an RSS feed, you can receive a notification based on a keyword or phrase.
• Actions are the "that" part of an applet. They are the output that results from the input of
the trigger.
• Applets (formerly known as recipes) are the predicates made from Triggers and Actions.
For example, if you like a picture on Instagram (trigger), an IFTTT app can send the photo
to your Dropbox account (action).
• Ingredients are basic data available from a trigger—from the email trigger, for example;
subject, body, attachment, received date, and sender’s address.
14
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
HARDWARE:
This is an optical biometric fingerprint reader/sensor (R305) module with TTL UART
interface for direct connections to a microcontroller UART. The user can store the fingerprint
data in the module and can configure it in 1:1 or 1: N mode for identifying the person. This
module can directly interface with any 3.3V or 5V microcontrollers, but a suitable level
converter/serial adapter is required for interfacing with the serial port of a PC.
2) ESP32:
Features:
• CPU: Xtensa dual-core (or single-core) 32-bit LX6 microprocessor, operating at 160
or 240 MHz and performing at up to 600 DMIPS
• Ultra-low power (ULP) co-processor
• Memory: 320 KiB RAM, 448 KiB ROM
• Wireless connectivity:
• Wi-Fi: 802.11 b/g/n
• Bluetooth: v4.2 BR/EDR and BLE (shares the radio with Wi-Fi)
15
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
• Peripheral interfaces:
• 34 × programmable GPIOs
• 12-bit SAR ADC up to 18 channels
• 2 × 8-bit DACs
• 10 × touch sensors (capacitive sensing GPIOs)
• SDIO/SPI slave controller
• Ethernet MAC interface with dedicated DMA and IEEE 1588 Precision Time
• Protocol support
• CAN bus 2.0
• Infrared remote controller (TX/RX, up to 8 channels)
• Motor PWM
• LED PWM (up to 16 channels)
• Hall effect sensor
• Ultra-low power analog preamplifier.
16
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
3) Relay:
SPECIFICATIONS OF 5V RELAY
4) HI-LINK AC to DC Convertor:
17
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
Product features
1. Ultra-thin, ultra-small, smallest volume;
2. Global universal input voltage (90~265Vac)
3. Low power consumption, green environmental protection, no-load loss<0.1W
4. Low ripple, low noise
5. High output short circuit and over-current protection and self-recovery
6. High efficiency, high power density
7. Input and output isolation voltage 3000Vac
8. 100% full load aging and testing
9. High reliability, long life design, continuous working time is greater than 100,000 hours;
10. Meet UL, CE requirements; product design to meet EMC and safety testing
requirement;
11. Using high-quality environmentally friendly waterproof plastic potting, moisture,
vibration, water and dust to meet IP65 standards
12. Economic solutions, cost-effective
13. Work without external circuit
14. 1 year quality guarantee period
18
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
6. Cost Estimation
Table 6.1: Cost Estimation for project
Sr.
Particulars Price in Rs Quantity Cost in Rs
No.
1 PCB 1800 3 1800
7 5V Relay Module - 1P 59 1 59
19
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
Implementation of Blynk on
7th January, 2022
assembled PCB
20
(Permanently Affiliated to University of Mumbai)
Department of Electronics and Telecommunication Engineering
8. References
[1] H. Singh, V. Pallagani, V. Khandelwal and U. Venkanna, "IoT based smart home
automation system using sensor node," 2018 4th International Conference on Recent
Advances in Information Technology (RAIT), Dhanbad, 2018, pp. 1-5.
[2] Jolan Baccay Sy, Shaik Irfan, “Bluetooth Based Automation System Using Android
App,” International Journal of Engineering Research and Technology. ISSN 0974-3154,
Volume 13, Number 12 (2020), pp. 5190-5195.
[3] P.J. Rani, Jason Baktha kumar, “Voice controlled home automation system using
Internet of Things (IoT),” 2017 Third International Conference on Science Technology
Engineering & Management (ICONSTEM) DOI:10.1109/ICONSTEM.2017.8261311.
[4] N. Vikram, K. S. Harish, M. S. Nihal, R. Umesh, A. Shetty and A. Kumar, "A Low-
Cost Home Automation System Using Wi-Fi Based Wireless Sensor Network Incorporating
Internet of Things (IoT)," 2017 IEEE 7th International Advance Computing Conference
(IACC), Hyderabad, 2017, pp.174-178.
[5] N. Kushiro, S. Suzuki, M. Nakata, H. Takahara and M. Inoue, "Integrated residential
gateway controller for home energy management system," in IEEE Transactions on
Consumer Electronics, vol.49, no. 3, pp. 629-636, Aug. 2003.
[6] Ravi Kishore Kodali, Vishal Jain, Suvadeep Bose and Lakshmi Boppana, “IoT Based
Smart Security and Home Automation System,” International Conference on Computing,
Communication and Automation (ICCCA2016).
[7] N. Sriskanthan*, F. Tan, A. Karande, “Bluetooth based home automation system,”
School of Computer Engineering, Nanyang Technological University, Nanyang Avenue,
Singapore, Singapore 639798.
[8] Md. Wasif Bin Hasif, “Arduino Based Home Automation System Using Android
Application,” DO - 10.13140/RG.2.2.20219.03360.
[9] Rituparna Halder, Susmit Sengupta, Sudipta Ghosh, Debasish Kundu, “Artificially
Intelligent Home Automation System Based on Arduino as the Master Controller,” The
International Journal of Engineering and Science (IJES), ISSN (e): 2319 – 1813 ISSN (p):
2319 – 1805.
[10] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6806197/
[11] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7374396/
[12] https://techiesms.com/iot-projects/internet-and-manual-home-automation-using-
blynk/
21