YUVARAJA’S COLLEGE MYSORE

PROJECT ON

“VOICE BASED E-MAIL FOR

BLIND”

PRESENTED BY,
RAJENDRA PRASAD K
G(YBC20147)
PRASAD I(YBC20146)
 CONTENT

ABSTRACT
INTRODUCTION
OBJECTIVES
PROBLEM STATEMENT
EXISTING SYSTEM
DRWABACKS OF EXISTING
SYSTEM
PROPOSED SYSTEM
ADVANTAGES
SYSTEM REQUIREMENT
SYSTEM ARCHITECTURE
CONCLUSION AND FUTURE
WORK
REFERENCES
ABSTRACT
 The advancement of technology has made communication easier for individuals with
disabilities, but there is still a gap in accessing email for individuals who are blind. This
project aims to develop a voice-based email system that uses Mel-Frequency Cepstral
Coefficients (MFCC) and Natural Language Processing (NLP) in Python. MFCC is a
widely used technique in speech recognition that extracts features from audio signals,
which can then be used to train machine learning models. NLP is a subfield of artificial
intelligence that deals with the interaction between computers and humans using
natural language. The proposed system will use MFCC to convert the user's voice
input into text, which will then be processed by NLP to understand the intent of the
user's request. The system will then retrieve the user's emails from their account and
read them aloud to the user. The user can then dictate a response, which will be
converted to text using MFCC and sent as an email reply. This system will enable
individuals who are blind to access and manage their emails independently, without
requiring the assistance of others. Additionally, it will provide a more natural and
intuitive way for individuals to interact with their email, enhancing their user
experience. The system's accuracy and usability will be evaluated through user testing
and feedback, with the goal of improving the lives of individuals with disabilities.
INTRODUCTION
 Communication is an essential aspect of human interaction, and technology has
revolutionized the way we communicate. However, individuals with disabilities often face
barriers in accessing communication technologies, which can lead to social isolation and
exclusion. One such technology that presents challenges for individuals who are blind is
email. Email is a ubiquitous form of communication that has become a critical aspect of
modern life. However, its reliance on visual interfaces presents challenges for individuals
who are blind, who often require assistance in accessing and managing their emails. While
there are tools and assistive technologies available to facilitate email access for individuals
who are blind, they often require technical expertise and are not user-friendly. To address
this issue, this project aims to develop a voice-based email system that uses MFCC and NLP
in Python to enable individuals who are blind to access and manage their emails
independently. By using the user's voice as the input, the system provides a more natural
and intuitive way for individuals to interact with their email, improving their user
experience and promoting their independence. The project's significance lies in its potential
to enhance the lives of individuals with disabilities by improving their access to
communication technologies. The system's success will be evaluated through user testing
and feedback, with the ultimate goal of developing a more inclusive and accessible
technology for individuals with disabilities.
OBJECTIVES
 Develop a voice-based email system: The primary objective of the project is to
develop a system that enables individuals who are blind to access and manage their
emails independently. The system will utilize MFCC and NLP in Python to convert
the user's voice input into text and retrieve emails from their account.
 Improve accessibility: The project aims to improve the accessibility of email for
individuals who are blind by providing a more natural and intuitive way to interact
with their email. The system will be designed to be user-friendly and easy to navigate.
 Enhance user experience: By improving accessibility, the project aims to enhance the
user experience of email for individuals who are blind. The system will be designed to
provide a seamless and efficient experience for users.
 Evaluate system accuracy: The accuracy of the system will be evaluated through user
testing and feedback. The project aims to develop a system that can accurately
understand user requests and retrieve the correct emails.
 Evaluate system accuracy: The accuracy of the system will be evaluated through user
testing and feedback. The project aims to develop a system that can accurately
understand user requests and retrieve the correct emails.
PROBLEM STATEMENT
 Individuals who are blind face significant challenges in accessing and managing their
emails independently. Traditional email interfaces rely heavily on visual cues, making it
difficult for individuals who are blind to navigate and interact with their email. While
screen reader software can provide some assistance, the process is often cumbersome
and can be time-consuming. To address this problem, the project aims to develop a
voice-based email system that utilizes MFCC and NLP in Python to enable individuals
who are blind to access and manage their emails independently. The system will convert
the user's voice input into text using MFCC and process it using NLP to understand the
intent of the user's request. It will then retrieve the user's emails from their account and
read them aloud to the user. The user can dictate a response, which will be converted to
text using MFCC and sent as an email reply. The system will improve the accessibility
and user experience of email for individuals who are blind, enabling them to manage
their emails independently and efficiently. By providing a more natural and intuitive
way to interact with their email, the system aims to promote the independence of
individuals with disabilities, who may otherwise require assistance to access and manage
their emails. Additionally, the project aims to enhance the inclusivity of technology by
developing a system that is user-friendly and accessible to individuals with disabilities.
EXISTING SYSTEM
 Traditional email systems typically rely on a graphical user
interface (GUI) for composing, sending, and receiving emails.
These systems require users to read and write messages using
a visual interface, which can be challenging for individuals
with visual impairments. In order to compose an email, users
must navigate through various menus and options using a
mouse and keyboard. Moreover, the accessibility features
offered by these systems, such as screen readers, may not be
sufficient to enable blind users to effectively use the email
system. As a result, traditional email systems may pose
significant challenges for blind users, limiting their ability to
communicate effectively with others.
DRAWBACKS
 Inaccessible user interface: The visual interface of traditional email
systems is not designed for blind users, making it difficult for them to
navigate through the menus and options using a mouse and keyboard.
 Limited accessibility features: While traditional email systems may
offer some accessibility features, such as screen readers, they may not
be sufficient to enable blind users to effectively use the system.
 Dependency on visual cues: Traditional email systems rely heavily on
visual cues, such as icons and buttons, to perform various functions.
Blind users may have difficulty identifying and interpreting these cues
 inability to compose and read emails using voice: Traditional email
systems do not offer voice-based email composition and reading
capabilities, which may limit the ability of blind users to communicate
effectively with others.
PROPOSED SYSTEM
 The proposed system is a voice-based email system designed
specifically for blind users. It utilizes Mel Frequency Cepstral
Coefficients (MFCC) and Natural Language Processing (NLP)
techniques to enable users to compose, send, and receive emails
using voice commands. The system converts the user's voice input
into text using MFCC, which is then processed using NLP
techniques to interpret the user's intent and compose an email
accordingly. The system also offers voice-based capabilities for
reading and managingemails. By providing a voice-based
interface and leveraging MFCC and NLP technologies, the
proposed system aims to overcome the limitations of traditional
email systems for blind users and enable them to communicate
effectively and independently.
ADVANTAGES
 Improved accessibility: The system offers a voice-based interface
that is specifically designed for blind users, making it much easier
for them to navigate and use the email system independently.
 Voice-based email composition and reading: The system enables
users to compose and read emails using voice commands,
eliminating the need for a visual interface and enabling blind users
to communicate more effectively with others.
 Reduced dependency on assistive technology: The system's voice-
based interface and natural language processing capabilities can
reduce blind users' dependency on assistive technology such as
screen readers, simplifying the email composition and reading
process.
SOFTWARE AND HARDWARE DESCRIPTION

 Minimum Hardware Requirements

 Processor : Intel i5 2.53GHz
 Hard Disk : 30GB
 Ram : 8 GB or above

 Software Requirements
 Operating system : Windows 7 and above
 Coding Language : Python
 Version : 3.6 & above
 IDE : IDLE/Visual Studio 2017
System architecture of voice
based e-mail
Detailed Design
Detailed design starts after the system design phase is completed and the system design has been certified through the review. The goal of this phase is to develop the
internal logic of each of the modules identified during system design.

In the system design, the focus is on identifying the modules, whereas during detailed design the focus is on designing the logic for the modules. In other words, in
system design attention is on what components are needed, while in detailed design how the components can be implemented in the software is the issue.

The design activity is often divided into two separate phase system design and detailed design. System design is also called top-level design. At the first level focus is
on deciding which modules are needed for the system, the specifications of these modules and how the modules should be interconnected. This is called system
design or top-level design. In the second level the internal design of the modules or how the specifications of the module can be satisfied is decided. This design level
is often called detailed design or logic design.

 Data Flow Diagram

DFD graphically representing the functions, or processes, which capture, manipulate, store, and distribute data between a system and its
environment and between components of a system. The visual representation makes it a good communication tool between User and System
designer. Structure of DFD allows starting from a broad overview and expand it to a hierarchy of detailed diagrams. DFD has often been
used due to the following reasons:
 Logical information flow of the system
 Determination of physical system construction requirements
 Simplicity of notation
 Establishment of manual and automated systems requirements
BASIC NOTATION
Process: any process that changes the data, producing an output. It might perform
computations, or sort data based on logic, or direct the data flow based on business rules. A
short label is used to describe the process, such as “Submit payment.”

Data store: files or repositories that hold information for later use, such as a database table or
a membership form. Each data store receives a simple label, such as “Orders.”

External entity: an outside system that sends or receives data, communicating with the system
being diagrammed. They are the sources and destinations of information entering or leaving
the system. They might be an outside organization or person, a computer system or a business
system. They are also known as terminators, sources and sinks or actors. They are typically
drawn on the edges of the diagram

Data flow: the route that data takes between the external entities, processes and data stores. It
portrays the interface between the other components and is shown with arrows, typically
labeled with a short data name, like “Billing details.
 Speech
Use Audio recogniti Queries Execute
r input on input query

Send E- Write E-
mails mails

Level 1 User DFD

5.2 Use case diagram

Use case diagram is a graph of actors, a set of use cases enclosed by a system
boundary, communication associations between the actor and the use case. The use
case diagram describes how a system interacts with outside actors; each use case
represents a piece of functionality that a system provides to its users. A use case is
known as an ellipse containing the name of the use case and an actor is shown as a
stick figure with the name of the actor below the figure.

The use cases are used during the analysis phase of a project to identify and partition
system functionality. They separate the system into actors and use case. Actors
represent roles that are played by user of the system. Those users can be humans,
other computers, pieces of hardware, or even other software systems.
 Use case diagram

UserVoiceinput

Pre-
processing

Speechrecognitio
n

Voicequiresinput
Use
r

WriteE-
mails

SendE-
mails
5.4 Activity Diagrams
Activity diagrams represent the business and operational workflows of a system. An
Activity diagram is a dynamic diagram that shows the activity and the event that causes the
object to be in the particular state. It is a simple and intuitive illustration of what happens in
a workflow, what activities can be done in parallel, and whether there are alternative paths
through the workflow.

Basic Notations

Initial Activity
 This shows the starting point or first activity of the flow. It is denoted by a solid circle.

Final Activity

The end of the Activity diagram is shown by a bull's eye symbol, also called as a final activity.

Activity

Represented by a rectangle with rounded (almost oval) edges

Decisions

A logic where a decision is to be made is depicted by a diamond.

Workflow

Workflow is depicted with an arrow. It shows the direction of the workflow in the activity
diagram.
Activity Diagram

Voice command
input

Pre-
processing

Speech
recogntion

Write
mails

Send
mails

User activity diagram

 CONCLUSION

•The voice-based email system developed using Python Flask and NLP presents
a transformative solution for email communication. By leveraging the power of
voice commands and NLP techniques, the system offers a seamless, convenient,
and natural way for users to compose, manage, and interact with their emails.
Through the integration of Python Flask, the system provides a user-friendly
interface and efficient handling of user requests. Flask's flexibility and scalability
make it an ideal choice for building interactive web applications, ensuring a
smooth and intuitive user experience.
•The incorporation of NLP techniques enables the system to comprehend and
interpret natural language commands accurately. The system can extract key
information from voice inputs, such as recipients, subject lines, and email
content, facilitating effortless email composition. With deep learning models and
algorithms, the system achieves a higher level of contextual understanding and
sentiment analysis, generating email responses that reflect the user's intended
tone and emotion.
 FUTURE WORK

While the voice-based email system using Python Flask and NLP provides a
significant advancement in email communication, there are several areas of
future work that can further enhance its capabilities and user experience:
 REFERENCE

•Flask: A Python Web Framework. (n.d.). Flask.pocoo.org. Retrieved from

https://flask.pocoo.org/
•Natural Language Toolkit (NLTK). (n.d.). Retrieved from https://www.nltk.org/
•spaCy: Industrial-Strength Natural Language Processing in Python. (n.d.). Retrieved
from https://spacy.io/
•Goldberg, Y. (2016). A Primer on Neural Network Models for Natural Language
Processing. Journal of Artificial Intelligence Research, 57, 345-420. Retrieved from
https://www.jair.org/index.php/jair/article/view/11192
•Vaswani, A., et al. (2017). Attention is All You Need. In Proceedings of the 31st
Conference on Neural Information Processing Systems (NIPS 2017), 5998-6008.
Retrieved from
https://proceedings.neurips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abs
tract.html
THANK YOU