International School

Capstone Project 2
CMU-SE 451

Project Proposal
Version 1.0
Date: 20 - May - 2024

DnD Translate - Sign Language

Submitted by

Duy, Huynh Gia

Minh, Huynh Tan Quang
Sy, Nguyen Van
Dinh, Le Nguyen Nhut

Approved by

Proposal Review Panel Representative:

Name Signature Date

Capstone Project 2 - Mentor:

Name Signature Date
Thuan, Nguyen Tan Ph.D.
 Table of Contents

1. Project Overview...................................................................................................................3
2. Executive Summary.............................................................................................................. 4
3. Project Background.............................................................................................................. 4
4. Project Objectives................................................................................................................. 6
5. Scope and Requirements...................................................................................................... 6
5.1. Scope.............................................................................................................................. 6
5.2. Requirements................................................................................................................. 6
5.3. System context............................................................................................................... 7
6. Methodology and Approach.................................................................................................8
6.1. Technical Constraints..................................................................................................... 8
6.2. Business constraints....................................................................................................... 9
7. Project Timeline.................................................................................................................... 9
8. Resource Allocation............................................................................................................ 10
9. Budget and Cost Estimate.................................................................................................. 10
10. Risk Management..............................................................................................................11
11. Stakeholder Engagement.................................................................................................. 12
12. Project Constraints........................................................................................................... 13
13. References.......................................................................................................................... 14
14. Attachment: DESCRIPTION OF PRODUCT REQUIREMENTS FORM................ 15
15. Approval.............................................................................................................................15

2
 REVISION HISTORY
Version Date Description of Changes Author

1.0 15/02/2024 Initial document Team

1. Project Overview
PROJECT INFORMATION

Project
SLDS
acronym
Project Title Sign Language Detection System
Start Date 15 - Feb - 2024 End Date 20 - May - 2024
Lead
International School, Duy Tan University
Institution
Name: Thuan, Nguyen Tan Ph.D.
Project
Email: thuannt.it.dtu@gmail.com
Mentor
Tel: 0905.626.276
Project Name: Duy, Huynh Gia
Manager & Email: huynhduy25072002@gmail.com
contact
details Tel: 0762.555.759

Partner
Organization
Project Web
URL
Team
Name Email Tel
members
25211216743 Sy, Nguyen Van vansy01682937260@gmail.com 0377.445.085
25211208352 Minh, Huynh Tan Quang liverpool990minh12@gmail.com 0929.097.985
25217211295 Dinh, Le Nguyen Nhut lenguyennhutdinh@gmail.com 0965.925.991

3
C2SE.05 Team Proposal Document

2. Executive Summary
Our system is not just a means of communication, but also a transformative tool,
opening the doors to connection and understanding between individuals, regardless of
their form of communication. Through our website, users can participate in remote video
calls and experience a diverse communication space.
Easy to use and access, our website connects users through video calls where they
can communicate in sign or spoken language. Through the use of real-time translation
technology, gestures and sign language are automatically converted into spoken or
written language, facilitating the exchange of ideas and information.
Similar to Google Translate, our website acts as a flexible communication
companion, focusing on converting visual input. By simply pointing the camera at the
speaker or signer, our technology automatically interprets gestures and converts them into
the desired form of communication, including spoken, written, or spoken language. sign
language.
3. Project Background
In the age of technology, connecting deaf and mute people with the world through
video calls is necessary. This has spurred extensive research and development in the field
of sign language interpretation systems. Here, we explore existing solutions that have
paved the way for our own system.
Example:
- https://www.ngonngukyhieu.com/
- https://viesign.org.vn/

The General assessment

corresponding
website name

viesign Comprehensive: This is the first and only MOOC (Massive Open
Online Course) platform to learn Sign Language in Vietnam.
Up-to-date: The website is regularly updated with the latest news and
research on sign language.

4
C2SE.05 Team Proposal Document

ngonngukyhieu Comprehensive: This website shares free information about sign

language for the deaf and everyone.
Up-to-date: The website is regularly updated with the latest news and
research on sign language.

For our project.

The common features that we can provide The limitations

- The system allows users to translate sign - Understanding: Current AI systems

language into regular language and vice may struggle to fully understand the
versa context and meaning of sign language
- The system uses AI to analyze images gestures due to their complexity and
and make predictions about sign variety.
language. - Diversity of sign languages: There
- The system allows users to connect with are more than 200 different sign
each other via video call, automatically languages in the world and each
translating languages right on the call language has its own distinct
expressions.
- Limited data: The lack of large and
semantically rich sign language data
limits the development of accurate
translators.
- Video call connection: While there
are platforms that support real-time
sign language translation via video
call, they typically only support a
limited number of simple words and
phrases, and require Larger and
higher quality databases to improve
translation models.
To create an exceptional website that can compete with others, we have
incorporated unique and innovative features such as:

5
C2SE.05 Team Proposal Document

The system provides comprehensive solutions for connecting deaf and mute
people with everyone. It can recognize sign languages, analyze them with AI, and convert
them into natural language in the most natural way.
4. Project Objectives
- Facilitate Communication: Build a platform that allows deaf and mute people to
communicate naturally and effectively through video calls.
- Sign Language Translation: Develop automatic sign language translation technology
that uses machine learning to translate sign language in real time.
- Integrating Machine Learning Technology: Uses advanced machine learning models to
accurately recognize and translate sign language.
- Ensuring Security: Protects users' personal information and communication data.
- Multi-Language Support: Provides services for many different sign languages, not
limited to a specific language.
- Community Development: Create conditions for the deaf and mute community to
develop and support each other.
- Research and Development: Continue to research and update technology to improve
service quality.
5. Scope and Requirements
5.1. Scope
This document provides an overview of how the project will be developed. It includes
the description of business needs, the proposed solution, the financial forecast, and some
constraints that are involved in the project.
The document provides a comprehensive master plan for each phase of software
development based on the processes that have been selected. This document is made for
senior management to put forward a proposal.
5.2. Requirements
Functional Requirements:
● User Authentication: Implement user registration and login to manage user profiles.
● Data Management: Store and retrieve videos, user information, and call history.

6
C2SE.05 Team Proposal Document

● Integration with External Systems: Link to cloud storage services and third-party
APIs.
● Sign Language Translation: Use machine learning to translate sign language in real
time.
Non-functional Requirements:
● Performance: Ensure fast response times and smooth video processing.
● Reliability: Maintain stable operation with low error rates.
● Security: Protect user data and call information.
● Usability: Provide a user-friendly interface for easy access.
● Scalability: Support more users without compromising performance.
● Maintenance: Allow for easy updates and system maintenance.
5.3. System context

7
C2SE.05 Team Proposal Document

Figure 1: System context overview

System context description
Users:
● Join the room
● Video call
● Describe language
Sign language system:
● Convert language
● Learning data use provide
Admin:
● Pass data for training
● Manage users
6. Methodology and Approach
Our team is building a "Sign language detection system" - a diagnostic tool to
support the disability community. By leveraging the power of artificial intelligence (AI)
and image processing technology, our system analyzes images to help users translate
more accurately.
We will utilize the following technologies to create this website:
● TensorFlow: Deep learning AI model, providing accurate predictions.
● Google Sign-In API and Facebook Graph API are used to support registration or login
via email or Facebook.
Communication and collaboration will be facilitated through regular project
meetings, daily stand-ups, and online collaboration tools such as Zalo or Google Meet.
We will maintain open channels of communication with stakeholders, providing regular
updates on project progress, milestones, and any changes or issues that arise.
6.1. Technical Constraints
Server:
● Programming Language: Python.
● Database: PostgreSQL

8
C2SE.05 Team Proposal Document

● Framework: fastapi.
● Libraries: Tensorflow, websockets.
● Operating System: Windows, Linux, macOS.
Client:
● Programming language: JavaScript.
● Framework: NextJS.
● Libraries: ReactJS.
● Operating System: Windows, Linux, macOS.
● Web Browser: Chrome, Firefox, Microsoft Edge, …

6.2. Business constraints

● Resource: 4 people.
● Budget: $5000.
● Time: The project must be completed within 4 months.
7. Project Timeline

No Task Name Duration Start Finish

1 Start Up 31 days 22/01/24 21/02/24
1.1 Project Kick Off Meeting 1 day 22/01/24 22/01/24
1.2 Discuss project ideal 10 days 23/01/24 01/02/24
1.3 Create a document for project 20 days 02/02/24 21/02/24
2 Development 84 days 22/02/24 16/05/24
2.1 Sprint 1 21 days 22/02/24 13/03/24
2.2 Sprint 2 21 days 14/03/24 03/04/24
2.3 Sprint 3 21 days 04/04/24 24/04/24
2.4 Sprint 4 21 days 25/04/23 15/05/24
3 Project’s Meeting 1 day 17/05/25 17/05/24
4 Final Release 1 day 17/05/24 17/05/24

9
C2SE.05 Team Proposal Document

8. Resource Allocation
Team’s Information

Full Name Phone Email Position

Thuan, Nguyen Tan Ph.D. 0905626276 thuannt.it.dtu@gmail.com Mentor
Scrum
Duy, Huynh Gia 0899249275 huynhduy25072002@gmail.com
Master
Team
Minh, Huynh Tan Quang 0929097985 liverpool990minh12@gmail.com
Member
Product
Dinh, Le Nguyen Nhut 0965925991 hoanphuoc20021208@gmail.com
Owner
Team
Sy, Nguyen Van 0377445085 vansy01682937260@gmail.com
Member

9. Budget and Cost Estimate

Table 1: Cost person/hours

Full Name Role Salary Rate (USD/hour)

Duy, Huynh Gia Scrum Master 2
Dinh, Le Nguyen Nhut Product Owner 2
Sy, Nguyen Van Team Member 2
Minh, Huynh Tan Quang Team Member 2

Table 2: Total cost estimate

No. Criteria Price Amount Total (USD)

1 Working hours $2 2040 $4080

2 Party $4 3 $48
Total cost $4128

Description Amount Unit

10
C2SE.05 Team Proposal Document

Number of members 4 Person

Number of working-hour per day 6 Hours
Number of working-day per week 5 Days
The duration of the project 120 Days
Party cost per member per time 2 USD

Explain:
● Amount of working hours = 4 members * 6 hours * 85 days = 2040 hours
● Amount of party cost support = 4 members * $4/person * 3 times = $48

10. Risk Management

Risk Risk
Mitigation Plan Contingency Plan
ID Description
Conduct thorough Explore options for augmenting datasets
Data Quality
1 data validation and or collaborating with healthcare
and Availability
preprocessing. institutions for access to high-quality data.
Provide clear and detailed information
Use accurate and
Inaccurate about the accuracy of predictions
reliable medical
2 cancer Guide users on the limitations of
data from
prediction predictions and encourage them to seek
validated sources
advice from medical professionals
Strictly adhere to
legal and ethical Use clear and transparent contracts and
Legal and regulations in the service terms
3
ethical issues healthcare field Update and enforce data protection and
Consult and work privacy measures
with legal experts
Establish a
Technical Maintain clear communication channels to
4 comprehensive
Challenges address technical issues promptly.
testing framework.

11
C2SE.05 Team Proposal Document

Conduct thorough Prioritize tasks based on criticality and

Resource
5 resource planning explore options for outsourcing or
Constraints
and allocation. partnering with external vendors.
Establish clear Implement change management processes
6 Scope Creep project scope and and regularly review project progress
objectives. against defined scope.
Implement strong
security measures
such as data Respond promptly and effectively to any
Information encryption, breaches or cyberattacks
7
security authentication Regularly backup data to facilitate quick
checks, and recovery in case of incidents
continuous
monitoring
11. Stakeholder Engagement

Stakeholder Role Responsibilities Level of Involvement

Project Provides project funding and High, decision-making
Executive
Sponsor strategic direction. authority
Project Oversees project planning, High, day-to-day
Project Lead
Manager execution, and delivery. management
Development Technical Develops and implements the High, hands-on
Team Team cancer detection system. development
Utilizes the system for cancer
Healthcare Medium to High, user
End Users diagnosis and treatment
Professionals feedback and testing
planning.
Subject Medium to High,
Provide expertise in machine
Data Scientists Matter model development
learning and data analysis.
Experts and validation
Regulatory Ensures adherence to
Compliance Medium to High,
Compliance regulatory standards and
Specialist regulatory compliance
Officer guidelines.
Quality
QA Conducts testing and quality Medium, ensuring
Assurance
Specialists assurance checks. system reliability
Team

12
C2SE.05 Team Proposal Document

Promotes the system to

Marketing and Marketing Medium to Low,
healthcare institutions and
Sales Team Specialists customer outreach
professionals.
IT Support Technical Provides technical assistance Low, as needed
Team Support and troubleshooting. technical support
12. Project Constraints

Constraints
Constraint Guidelines for Acceptance
Description
Elements for consideration are design costs,
Economic production costs, maintenance costs,
operating costs, and sales price

The impact of the design on the environment

as well as the impact of the environment (e.g.,
temperature range, humidity, vibration,
Environmental electromagnetic interference immunity, and
shock) on the design should be considered.
Design for recycling and design to use
recycled materials should also be considered

Ethical considerations can be broad. Areas

that are typically addressed include
Ethical intellectual property, reverse- engineering,
privacy, security, and the conflict between
cost and safety

Includes safety standards as well as the

Public health,
safety, and impact of the design on users (for example,
welfare Electrical or physical hazards)

Addresses aspects such as benefits, risks, the

man-machine interface, the acceptance of
Social and products by the intended user or by society at
Global
large, and global and social responsible
engineering.

13
C2SE.05 Team Proposal Document

The database of clinical signs, symptoms,

genotypes, and genetic mutations is still
Database limited and incomplete to make an accurate
diagnosis in all cases.

Refers to the sustainability of resources,

including material, energy, supplies,
manufacturing techniques, personnel,
Sustainability operation, and the need for additional
infrastructure, as well as the sustainability of
the design including reliability, lifetime,
durability, reusability, and maintainability.

13. References

No. References Document Information

https://en.wikipedia.org/wiki/Scrum_(software_development)

https://www.atlassian.com/agile/scrum

https://www.digite.com/agile/scrum-methodology/
1 Scrum Model
https://docs.microsoft.com/en-us/azure/devops/boards/sprints/b
est-practices-scrum?view=azure-devops

https://www.scrum.org/resources/scrum-guide

https://cloud.google.com/dialogflow/docs/

https://slack.com/

2 Technical https://developers.google.com/identity/sign-in/web/sign-in

https://medium.com/

https://reactnative.dev/docs/getting-started
Software
https://www.nws.noaa.gov/oh/hrl/developers_docs/General_So
3 Engineering
ftware_Standards.pdf
Standards

14
C2SE.05 Team Proposal Document

https://standards.ieee.org/standard/12208-2017.html

https://sw-eng.larc.nasa.gov/

14. Attachment: DESCRIPTION OF PRODUCT REQUIREMENTS FORM

15. Approval

15