0% found this document useful (0 votes)
20 views34 pages

MINIPROJECT_REPORT

The document presents a mini project titled 'Neuromouse,' aimed at developing an assistive joystick device for individuals with tremors, particularly those affected by neurological conditions like Parkinson's disease. The project focuses on creating a user-friendly and affordable alternative to traditional computer input devices, integrating an accelerometer and Arduino for enhanced cursor control. The report includes acknowledgments, objectives, literature survey, and future prospects for the technology, emphasizing its potential to improve digital accessibility and independence for users.

Uploaded by

21wh1a04c7
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
20 views34 pages

MINIPROJECT_REPORT

The document presents a mini project titled 'Neuromouse,' aimed at developing an assistive joystick device for individuals with tremors, particularly those affected by neurological conditions like Parkinson's disease. The project focuses on creating a user-friendly and affordable alternative to traditional computer input devices, integrating an accelerometer and Arduino for enhanced cursor control. The report includes acknowledgments, objectives, literature survey, and future prospects for the technology, emphasizing its potential to improve digital accessibility and independence for users.

Uploaded by

21wh1a04c7
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 34

Mini Project

on

“Neuromouse”
Submitted in partial fulfillment of the requirements for the award of the degree of

BACHELOR OF TECHNOLOGY
in
ELECTRONICS AND COMMUNICATION ENGINEERING
by
Ms. B. Sathwika -21WH1A0472
Ms. A. Sonika -21WH1A0474
Ms. D. Bhashitha -21WH1A04B0
Ms. M. Jayakeerthana -21WH1A04C7
under the guidance of

Mr. N. M. Sai Krishna


Assistant professor

Department of Electronics and Communication Engineering


BVRIT HYDERABAD College of Engineering for
Women(UGC AUTONOMOUS)
(Approved by AICTE, New Delhi and Affiliated to JNTUH, Hyderabad)
Accredited by NBA and NAAC with A Grade
Bachupally, Hyderabad – 500090
2024-25
DECLARATION
We hereby declare that the work described in this report, entitled
“Neuromouse” which is being submitted by us in partial fulfilment for the award of
the degree of Bachelor of Technology in the Department of Electronics and
Communication Engineering at BVRIT HYDERABAD College of Engineering
for Women, affiliated to Jawaharlal Nehru Technological University Hyderabad,
Kukatpally, Hyderabad – 500085 is the result of original work carried out by us under
the guidance of Mr. N. M. Sai Krishna, Assistant professor.
This work has not been submitted for any Degree of this or any other
institute/university to the best of our knowledge and belief.

Place: Hyderabad

Date:

Names and Signatures of the Students:

Ms. B. Sathwika -
Ms. A. Sonika -
Ms. D. Bhashitha -
Ms. M. Jayakeerthana -
Department of Electronics and Communication Engineering
BVRIT HYDERABAD College of Engineering for
Women(UGC AUTONOMOUS)
(Approved by AICTE, New Delhi and Affiliated to JNTUH, Hyderabad)
Accredited by NBA and NAAC with A Grade
Bachupally, Hyderabad – 500090
2024-25

Certificate

This is to certify that the mini project report, entitled “Neuromouse” is a record of
bonafide work carried out by Ms. B. Sathwika [21WH1A0472], Ms. A. Sonika
[21WH1A0474], Ms. D. Bhashitha [21WH1A04B0], Ms. M.Jayakeerthana
[21WH1A04C7] in partial fulfilment for the award of the degree of Bachelor of
Technology in the department of Electronics and Communication Engineering at
BVRIT HYDERABAD College of Engineering for Women, affiliated to Jawaharlal
Nehru Technological University Hyderabad, Kukatpally, Hyderabad – 500085.

Supervisor Head of the Department


Mr. N. M. Sai Krishna Dr. Nagesh Deevi
Assistant Professor Associate Professor

External Examiner
ACKNOWLEDGMENT

The satisfaction that accompanies the successful completion of the task would
be incomplete without the mention of the people who made it possible.

We wish to express our deep sense of gratitude to our guide Mr. N. M. Sai
Krishna, Assistant professor, Department of Electronics and Communication
Engineering, BVRIT HYDERABAD College of Engineering for Women, for his able
guidance and suggestions, which helped us in completing this project work on time.

We would like to thank Dr. Nagesh Deevi, Associate Professor and Head,
Department of Electronics and Communication Engineering for his guidance, support
and encouragement.

We express our gratitude towards our honourable Principal, Dr. K V N Sunitha


and the management for providing all the facilities.

We also thank all the faculty and non-teaching staff members of the
Electronics and Communication Engineering department, who supported us directly or
indirectly in the successful completion of this project work.

Finally, we thank all our friends and family members for their continuous
support and help.

Names of the students:

Ms. B. Sathwika
Ms. A. Sonika
Ms. D. Bhashitha
Ms. M. Jayakeerthana
ABSTRACT
Approximately 60 million people worldwide experience tremors, which can
greatly hinder their ability to use traditional computer input devices. Tremors, caused
by involuntary muscle contractions, affect millions of people worldwide and are
frequently associated with neurological conditions such as Parkinson’s disease.
Parkinson’s is a progressive neurodegenerative disorder that impairs motor functions
and worsens over time, significantly affecting an individual’s ability to perform
everyday tasks. For many individuals with such conditions, using traditional computer
input devices becomes challenging, limiting their independence and digital
engagement. To address these difficulties, a specialized joystick mouse has been
developed to improve accessibility and quality of life. This device is designed to be
both affordable and easy to assemble using readily available materials, while offering
a high degree of customization to accommodate the specific needs of diverse users. It
integrates seamlessly with various computer systems without requiring additional
drivers, ensuring compatibility across different platforms. By providing a low-cost and
userfriendly alternative to expensive commercial solutions, this joystick mouse
enhances digital interactions , promotes independence, and empowers both users and
caregivers, making it a significant advancement in assistive technology.
CONTENTS

S.No Topic Page No.

1 Introduction 1
1.1 Objectives 2
1.2 Scope of the Project 3

2 Literature survey
2.1. The evolution of Assitive technologies for tremor
management 4-6
2.2. Emerging techniques 6
2.3. Future prospects of NeuroMouse 7-8

3 Introduction to Hardware and Software


3.1 Hardware Components 9-11
3.2 Software Tools 11
3.3 Component Setup 12

4 Implementation
4.1 Hardware Implementation 13
4.2 Workflow 14-18
4.3 Characteristics 18-19

5 Result 20

6 Conclusion 21

7 References 22-23

8 Appendix 24-27
LIST OF FIGURES

S.No Topic Page No.

1 Fig. 1. Hand Tremor 1

2 Fig. 2. Mouse for people with tremor 2

3 Fig. 3. Sensor based gloves 5

4 Fig. 4. Vibration dampening gloves 5

5 Fig. 5. Individual utilizing assistive technology for 8


accessible computer use.

6 Fig. 6. Arduino UNO 9

7 Fig. 7. MPU 6050 Sensor 10

8 Fig. 8. Bread Board 10

9 Fig. 9. Jumper wires and Arduino Cable 11

10 Fig. 10. Arduino IDE 11

11 Fig. 11. Circuit Implementation 13

12 Fig. 12. X-axis and Y-axis readings of accelerometer 15

13 Fig. 13. Cursor Movement 16

14 Fig. 14. Opening of Edge on pressing button 17

15 Fig. 15. Implementation of Hardware and Software Code 19


Neuromouse

1. Introduction

In recent times, technology has greatly advanced in aiding individuals with


disabilities, specifically those with brain or nervous system disorders. These
advancements have been particularly helpful for individuals who face tremors due to
conditions like Parkinson's disease, essential tremor, or other neurological issues.
However, these tremors can pose a significant obstacle when it comes to using
computers. Traditional input devices such as a computer mouse rely on precise
movements that can be extremely difficult for those with tremors to control.

Involuntary tremors are rhythmic movements that commonly affect the hands
and wrists, causing individuals to struggle with tasks such as pointing, clicking, and
dragging the mouse. This can result in frustration and reduced independence. With an
aging global population and a rise in conditions like Parkinson’s disease, there is an
increasing demand for assistive devices that allow those affected to effectively use
technology.

Fig.1. Hand Tremor

Department of ECE, BVRIT HYDERABAD CEW Page 1


Neuromouse

1.1. Objectives
The main objective is to create an assistive device utilizing a joystick as a replacement
for a computer mouse. This will greatly benefit individuals with tremors.
By incorporating an accelerometer and an Arduino Uno microcontroller, the joystick
can detect and process hand movements caused by tremors. The resulting data will then
control the movement of a cursor on the screen, enabling users to interact with the
computer with greater ease.
Specific objectives of the project include:
• Creating the Joystick-based Device: Designing a joystick interface with an
accelerometer for detecting hand movements, even during tremors.
• Refining Tremor Detection: Implementing noise-filtering algorithms to
differentiate tremors from regular hand movements and facilitate precise cursor
control.
• Integrating Software for Mouse Control: Utilizing Arduino to read
accelerometer data and transmit it to a Python-based program that translates it
into mouse motions on the computer screen.

Fig.2. Mouse for people with tremor

Department of ECE, BVRIT HYDERABAD CEW Page 2


Neuromouse

1.2. Scope of the Project


The scope here is focused on creating a functional device that can replace a
computer mouse for individuals suffering from tremors. It includes:
• Signal Processing :
Signal processing involves the use of filtering techniques to eliminate noise and
extract meaningful data from raw signals. Processed accelerometer data can be
analyzed to differentiate between intentional actions and unwanted disturbances,
enabling precise control and minimizing the effects of noise or irregularities in
the signal.

• Software Development for Mouse Control:


A program written in Python will be created to connect with the Arduino and
manage the mouse cursor. It will translate data from the accelerometer into on-
screen mouse movements and clicks.

• Prototyping and User Testing:


In order to create a user-friendly system, the design process will take into
consideration the needs of individuals with tremors. This will include testing the
device with real users in everyday situations to evaluate its effectiveness and
comfort.

Department of ECE, BVRIT HYDERABAD CEW Page 3


Neuromouse

2. Literature Survey
Hand tremors, often caused by neurological disorders like Parkinson's disease,
can significantly impair the ability to perform daily tasks, especially those requiring
fine motor control, such as using a computer mouse. Over the years, assistive
technologies have evolved to address this challenge, enabling individuals with tremors
to regain independence in using digital interfaces and performing other daily activities.
This section explores the historical advancements in assistive devices and technologies
designed for tremor management.

2.1. The Evolution of assistive technologies for Management


In the early stages, tremor management solutions were largely limited to basic
mechanical devices aimed at stabilizing the affected limb. These early efforts focused
on providing physical support but lacked the precision and adaptability needed to
effectively manage tremors.
2.1.1. Wearable Technologies: The First Step Toward Integration
Intelligent Gloves: One of the earliest solutions involved intelligent gloves
designed to stabilize hand movements. These gloves integrated sensors and actuators
to detect tremors and actively counteract them. By measuring tremor amplitude and
triggering corrective actions, such as vibrations or mechanical forces, intelligent gloves
provided users with a more stable and controlled grip. However, high production costs
and limited availability made these devices less accessible to the broader population.
• Sensor-Based Gloves: Featuring accelerometers and gyroscopes, sensor-based
gloves took the next step by detecting tremor patterns in real time. These gloves
used embedded motors or vibration-dampening systems to counteract tremors and
improve precision in hand movements. The focus was on providing users with a
more intuitive and seamless experience, but challenges such as bulkiness and
affordability remained.

Department of ECE, BVRIT HYDERABAD CEW Page 4


Neuromouse

Fig.3. Sensor based gloves

• Vibration-Dampening Gloves: Designed with either passive or active vibration


control mechanisms, these gloves aimed to reduce tremor amplitude, allowing for
smoother hand movements. These gloves were more affordable than intelligent gloves
and could be worn for longer durations, but their effectiveness in high-intensity tremors
remained limited.

Fig.4. Vibration dampening gloves

2.1.2. Non-Invasive Solutions: A Shift Toward Precision


• Adaptive Tremor Cancellation Systems: The 2000s saw the introduction of
adaptive tremor cancellation systems that utilized advanced algorithms to actively
cancel out tremor effects. These systems analyzed the user’s tremor signals in real
time and generated opposing forces to stabilize the affected limb. While these
systems were highly effective, their complexity, size, and cost made them less
practical for everyday use.

Department of ECE, BVRIT HYDERABAD CEW Page 5


Neuromouse

• IoT-Enabled Solutions: With the rise of the Internet of Things (IoT), researchers
began to develop connected devices that could monitor and manage tremor activity.
These solutions used cloud-based analytics to track tremor patterns and provide
real-time feedback. IoT-enabled solutions allowed users to adjust their devices
remotely, offering a higher degree of customization and remote control, though they
were still in the early stages of adoption.

2.2. Emerging Techniques:


• Machine Learning Based Detection Systems: In recent years, machine learning
have become key players in the fight against tremors. By analyzing tremor signals,
these systems can classify the severity of tremors and provide personalized
interventions. ML-based systems offer predictive modeling, allowing for real-time
feedback loops that continuously adapt to a user's unique tremor profile. While
these solutions offer impressive precision, their widespread implementation is still
constrained by the need for advanced hardware and computational resources.
2.2.1. Advancements and Expansion
As technology progressed, microcontroller development allowed for more
compact and cost-effective solutions for individuals with disabilities. With the advent
of MPU6050 and similar sensors, the accuracy and responsiveness of joystick-based
devices improved dramatically. These sensors, coupled with advanced signal
processing algorithms, enabled the translation of hand movements into precise cursor
actions, making the devices much more usable and effective for people with tremors.
Moreover, machine learning began to play a significant role in the development
of adaptive assistive technologies. The integration of predictive modeling and feedback
loops allowed joystick-based devices to learn from users' unique hand movements,
improving the system's responsiveness and offering personalized adjustments to
account for varying levels of tremor severity.
The expansion of IoT technologies enabled remote configuration and data
monitoring, allowing caregivers and health professionals to make real-time adjustments
and monitor user activity from a distance. These advancements allowed for greater

Department of ECE, BVRIT HYDERABAD CEW Page 6


Neuromouse

flexibility in design, making devices more portable and user-friendly for individuals
with different needs.

2.3. Future Prospects of Neuromouse


The future of Neuromouse looks promising, with numerous advancements on
the horizon that will likely enhance their effectiveness and expand their usability. Some
potential future directions include:
1. Integration with Smart Assistive Devices: The future could see greater
integration of joystick-based devices with smart. This could enable a seamless
experience, where the joystick mouse not only controls the cursor but also interacts
with other aspects of the user’s environment, such as home automation systems and
health monitoring devices.
2. Advanced Machine Learning Algorithms: The continued integration of Machine
learning will likely lead to more adaptive systems that can learn and predict tremor
patterns and adjust accordingly, offering even greater personalization. This would
improve both the accuracy and comfort of using the joystick, ensuring that users
with different levels of tremor severity have a device that adjusts to their needs.
3. Miniaturization and Portability: As technological miniaturization continues,
future joystick-based mice will become even more compact, portable, and discreet.
These devices could become even more wearable, allowing users to interact with
computers or mobile devices without needing to be tethered to a desk. Wireless
connectivity and Bluetooth integration could further enhance portability and ease
of use.
4. Enhanced User Experience: Future Neuromouse designs could incorporate haptic
feedback and voice-controlled interfaces, improving the user experience by
providing intuitive interactions. By integrating with virtual assistants like Alexa or
Siri, users could combine cursor control with voice commands for even more
seamless interaction.
5. Global Adoption in Healthcare: As awareness around the importance of
accessibility grows, joystick-based mice could be adopted more widely across
healthcare settings. This could include use in rehabilitation therapy, where devices

Department of ECE, BVRIT HYDERABAD CEW Page 7


Neuromouse

like the Neuromouse would assist not just in controlling the cursor but also in the
rehabilitation of fine motor skills.
6. Collaborative Efforts in Research and Development: Research collaborations
between universities, assistive technology companies, and medical organizations
will likely result in significant breakthroughs. These partnerships could lead to the
development of more affordable, robust, and effective solutions for a wide range of
users with different impairments, including those with severe tremors or other
neurological conditions.

Fig.5. Individual utilizing assistive technology for accessible


computer use.

Department of ECE, BVRIT HYDERABAD CEW Page 8


Neuromouse

3. Introduction to Hardware and Software

3.1. Hardware Components:


3.1.1. Arduino Uno
The Arduino is a microcontroller board based on the ATmega328P chip. It
operates on a 5V power supply and supports input voltages ranging from 6V to 20V. It
consists of 14 digital input/output pins and 6 analog input pins. The Arduino Uno is
responsible for reading sensor data from the MPU6050 and transmitting it to the
computer via a USB connection using serial communication. It serves as the core
hardware for data acquisition and processing in this project.

Fig 6. Arduino UNO


3.1.2. MPU6050
The MPU6050 is a 6-axis accelerometer and gyroscope sensor used to detect
motion and orientation. This sensor is connected to the Arduino Uno using the I2C
protocol, which enables efficient data transfer via two pins: SDA (data) and SCL
(clock). The MPU6050 collects real-time data on angular velocity and acceleration,
which is critical for interpreting the user's hand gestures or movements. This data is
sent to the Arduino Uno for further processing.

Department of ECE, BVRIT HYDERABAD CEW Page 9


Neuromouse

Fig.7. MPU 6050 Sensor


3.1.3. Bread Board
The breadboard is a versatile tool for connecting and testing electronic components
without the need for soldering. In this particular project, it serves as the foundation for
wiring the MPU6050 sensor, Arduino Uno, and additional parts such as resistors and
jumper wires. With its adaptability, the breadboard allows for effortless modifications
to the circuit during the testing and calibration stage of the joystick mouse.

Fig.8. Bread Board

Department of ECE, BVRIT HYDERABAD CEW Page 10


Neuromouse

3.1.4. Jumper Wires and USB Cable


Jumper wires are used to connect the pins of the MPU6050 to the Arduino Uno. The
USB cable links the Arduino Uno to the computer, enabling both power supply and
serial communication. This hardware integration ensures smooth data transfer and
realtime control.

Fig.9. Jumper wires and Arduino Cable

3.2. Software Tools


3.2.1. Arduino IDE
The Arduino IDE is used to write and upload the code to the Arduino Uno. The code
written in C++ reads the sensor data from the MPU6050 and sends it to the computer
via serial communication.

Fig.10. Arduino IDE

Department of ECE, BVRIT HYDERABAD CEW Page 11


Neuromouse

3.3. Component Setup


The MPU6050 accelerometer and gyroscope sensor was connected to the Arduino Uno
using jumper wires for reliable communication. The connections were as follows:
→ VCC: Connected to the 5V pin on the Arduino to provide power.
→ GND: Connected to the ground pin on the Arduino.
→ SCL: Connected to the A5 pin for I2C communication.
→ SDA: Connected to the A4 pin for I2C communication.

Prototyping with Breadboard:


A breadboard was used to connect the components without soldering, ensuring
a modular and adjustable setup. This allowed for easy troubleshooting and testing
before finalizing the connections.

Department of ECE, BVRIT HYDERABAD CEW Page 12


Neuromouse

4. Implementation
4.1. Hardware Implementation:
The hardware implementation centers around developing a joystick-based
interface that effectively replaces a conventional computer mouse. This
implementation involves several key components, including the accelerometer module,
the Arduino Uno microcontroller, and the physical assembly of the device.

4.1.1. Circuit Diagram:

Fig 11: Circuit Implementation

Department of ECE, BVRIT HYDERABAD CEW Page 13


Neuromouse

4.2. Workflow
Neuromouse
The Neuromouse system aims to provide an alternative means of controlling a
computer cursor for individuals with hand tremors. By using an MPU6050 sensor, the
device tracks the user’s hand movements and converts them into precise cursor
motions. The following workflow outlines the sequence of steps, starting from the
sensor’s initialization to the final interaction with the computer system.
Step 1: Sensor Initialization and Calibration
The first step in the process is initializing the MPU6050 sensor. This sensor is
designed to measure acceleration along two axes (X, Y) in real time. The sensor must
be calibrated to ensure that it accurately detects the user's hand movements, particularly
tilt.
• Configuration:
The sensor is configured to output real-time data, which includes both
accelerometer readings (to measure tilt). The system is set to capture X and Yaxis
movements, which correspond to horizontal and vertical hand gestures
respectively.
• Stabilization:
Before any meaningful data can be captured, a short period of stabilization is
needed. During this time, the system performs calculations to determine the offset
values for the sensor readings, ensuring the data is not skewed by any initial
sensor drift.
• Calibration:
Calibration of the sensor is crucial for eliminating any potential biases in the
system. This process involves setting the baseline for when the user's hand is at
rest and ensuring that any tilt is correctly interpreted relative to this resting
position.
Step 2: Conversion of Data to Cursor Movements
The next step in the workflow involves converting the sensor data into specific
actions that will control the mouse cursor on the computer screen. The processed tilt

Department of ECE, BVRIT HYDERABAD CEW Page 14


Neuromouse

data is used to calculate the corresponding horizontal (X-axis) and vertical (Y-axis)
movements of the cursor.
• Movement Detection:
As the user moves their hand, the tilt angle is continuously monitored. When a
tilt is detected, the system converts the angular displacement into a proportional
cursor movement. For example, a tilt to the right will result in a rightward
movement of the cursor, and a tilt forward will move the cursor upward on the
screen.
• Thresholding:
To avoid unnecessary cursor movements caused by minor hand tremors, a
threshold is applied to the detected tilt. The system only responds to movements
where the tilt angle exceeds a predefined threshold. This ensures that small,
involuntary hand shakes do not cause erratic cursor movement.
Step 3: Data Transfer to Computer via Serial Communication
Once the data has been processed and converted into cursor movements, it
needs to be transferred from the Arduino Uno to the computer. This is done using serial
communication, where the processed data is sent to the computer via a USB
connection.
• Serial Communication:
The Arduino uses serial communication protocols to send the tilt data and
corresponding cursor movement commands to the connected computer. The data
is sent in a readable format, typically as a series of X and Y angle values that
represent the amount of movement required for the cursor.

Fig.12. X-axis and Y-axis readings of accelerometer

Department of ECE, BVRIT HYDERABAD CEW Page 15


Neuromouse

• Python Script:
On the computer side, a Python script listens for the incoming serial data and
interprets the X and Y angle values. The script then uses the pyautogui library to
move the mouse cursor according to the received data. Pyautogui is a Python
library that allows for automation of keyboard and mouse control, making it ideal
for this device.
Step 4: Interaction and User Control
Once the system successfully translates the sensor data into cursor movements, the user
can begin interacting with the computer. The system allows for continuous monitoring
of the X and Y angles, enabling the cursor to move in real-time in response to the user’s
hand gestures.

Fig.13. Cursor movement

• Customization and Calibration:


The system allows users to customize the sensitivity of the cursor movement,
ensuring that it can be fine-tuned based on the user's needs. Calibration options
are provided, allowing users to adjust the tilt threshold and sensitivity to
minimize tremor interference and maximize precision.
• Button Click Simulation:
In addition to controlling the cursor, the system also simulates mouse button
presses. The joystick mouse includes three buttons (left, middle, and right) which
can be pressed by the user during interaction. The system detects button presses
and sends the appropriate click commands (left-click, middle-click, right-click)
to the computer.
Department of ECE, BVRIT HYDERABAD CEW Page 16
Neuromouse

Fig.14. Opening of Edge on pressing the button

Step 5: Continuous Monitoring and Responsiveness


The Neuromouse system is designed to continuously monitor the sensor data
and respond in real-time to changes in the user’s hand position. The system runs in a
loop, where the MPU6050 sensor readings are updated constantly to reflect the current
tilt or orientation of the user’s hand.
• Real-time Response:
The system ensures that the cursor movement remains responsive, with minimal
lag between hand movements and on-screen actions. As the user adjusts the
position of their hand, the system immediately translates those movements into
corresponding cursor changes.
• Button State Monitoring:
In parallel with cursor movement, the system constantly checks the state of the
joystick buttons (left, middle, and right). If a button is pressed, the corresponding
mouse click command is sent to the computer, allowing the user to interact with
software applications just like a traditional mouse.

Department of ECE, BVRIT HYDERABAD CEW Page 17


Neuromouse

Step 6: Looping
To maintain continuous functionality, the system operates in a continuous loop.
After processing the current sensor readings and sending the corresponding cursor data
and click commands, the system returns to the sensor reading phase to prepare for the
next set of data.
• Looping:
The system constantly reads new data from the MPU6050 sensor, processes it,
and sends it to the computer. This loop ensures that the user can maintain control
of the cursor without any interruptions.

4.3. Characteristics:
The joystick serves as a pivotal component designed to offer a more manageable
and accessible alternative to the traditional computer mouse, particularly for
individuals experiencing hand tremors due to conditions like Parkinson’s disease or
essential tremor.
1. Enhanced Control and Precision:
The joystick provides a stable and ergonomic way to control the computer cursor.
The joystick accommodates a broader range of motion, allowing users to control
the cursor with less precision. The accelerometer within the joystick captures the
direction and intensity of movements which are then processed to ensure smooth
and accurate cursor navigation.
2. Design and Comfort:
The joystick is designed to be easy to grip which helps in reducing the strain on
the user's hand and wrist. Its design ensures that users can comfortably operate
the device for extended periods without discomfort, making it a more practical
solution for everyday computer tasks.
3. Customizable Sensitivity:
Users can adjust the sensitivity of the joystick to match their specific needs. This
customization allows the device to respond to varying degrees of hand
movement, making it adaptable for users with different levels of tremor severity.

Department of ECE, BVRIT HYDERABAD CEW Page 18


Neuromouse

Fig 15: Implementation of Hardware and Software Code

Department of ECE, BVRIT HYDERABAD CEW Page 19


Neuromouse

5. Result

The Neuromouse effectively showcased the joystick-based mouse as a viable


solution for those with tremors or motor impairments. By utilizing the MPU6050
sensor, tilt and motion information was promptly transmitted to the serial monitor in
real-time. This included acceleration readings, delivering precise insight into the
positioning of the joystick. With calibration in place, consistent and reliable data was
obtained, allowing for accurate cursor control. The successful display of sensor data
on the serial monitor further confirmed the system's ability to perform accurately for
navigation purpose.

The device successfully transformed sensor data into precise cursor motions on
the computer screen. It responded promptly to joystick movements in every direction
up, down, left, and right facilitating effortless user interaction. Its sensitivity could be
adjusted to suit different needs, making it a versatile tool. What's more, this adaptable
prototype was also compatible with various systems without the need for additional
drivers. This cost-effective and customizable solution effectively fulfilled the project's
objective of empowering individuals with motor disabilities to use technology
independently.

Department of ECE, BVRIT HYDERABAD CEW Page 20


Neuromouse

6. Conclusion
The Neuromouse showcases the development of a sensor-based system
designed to enhance accessibility for individuals with nerve-related disabilities. By
converting sensor inputs into mouse controls, it demonstrates the potential of
integrating hardware like sensors and microcontrollers with software solutions to create
user-friendly interfaces for those with motor impairments. This highlights the role of
embedded systems and sensor technologies in developing cost-effective assistive
devices. Key features include the ability to filter unintended movements, ensuring
precise control, and customizable settings that adapt to various user needs making the
device suitable for individuals with different levels of tremors. Its compact and portable
design enhances its practicality for everyday use in multiple environments.
Emphasizing the importance of creating intuitive and efficient assistive devices that
bridge the gap between advanced technology and user accessibility, the scalable design
opens up possibilities for future improvements such as wireless capabilities, machine
learning integration, and broader platform compatibility. Overall, this demonstrates
how technological innovations can foster inclusivity and independence, contributing
significantly to the field of accessible and assistive technologies.

Department of ECE, BVRIT HYDERABAD CEW Page 21


Neuromouse

7. Reference
[1] L. Aljihmani, Y. Zhu, H. T. Abbas, R. Mehta, F. Sasangohar, and M.
Erraguntla, "Spectral analysis of hand tremors induced during a fatigue test,"
Proc. IEEE, 2020. [Online]

[2] Ferencik, N., Jascur, M., Bundzel, M., & Zolotova, I. (2018). “Measurement of
hand tremors”. 2018 IEEE 16th World Symposium on Applied Machine Intelligence
and Informatics (SAMI), 7–10 February 2018, Kosice and Herlany, Slovakia, pp.
245-250. doi: 10.1109/SAMI.2018.8323996.

[3] Koller, W. C., & Trimble, M. (2018). The impact of essential tremor on quality of
life: A cross-sectional study. Frontiers in Neurology, 9, 628.
Doi.org/10.3389/fneur.2018.00628

[4] Pinto, A. G., & de Souza, C. A. (2019). The impact of essential tremor on the
quality of life of patients and caregivers: A systematic review. Arquivos de
Neuro-Psiquiatria, 77(5), 340- 346,doi.org/10.1590/0004-282X20190004

[5] Mullins, D. R., & McGuire, J. M. (2016). Development of an Assistive


Technology Device for People with Tremors: The Gesture-Based Mouse. IEEE
Transactions on Neural Systems and Rehabilitation Engineering, 24(2), 149– 157.
doi: 10.1109/TNSRE.2015.2452583.

[6] Tsai, Y. S., & Lee, S. Y. (2019). Design of a Joystick for Disabled People
with Tremors. Proceedings of the 2019 IEEE International Conference on Systems,
Man, and Cybernetics (SMC), 7–11 October 2019, Bari, Italy, pp. 3242–3247. doi:
10.1109/SMC.2019.8914545.

Department of ECE, BVRIT HYDERABAD CEW Page 22


Neuromouse

[7] Hsieh, Y. T., & Chiu, S. H. (2018). Real-time Tracking of Tremor Movements
Using Accelerometers for Assistive Mouse Devices. 2018 IEEE International
Neuromouse Symposium on Signal Processing and Information Technology (ISSPIT),
17–19, December 2018, Abu Dhabi, UAE, pp. 123–128. doi:
10.1109/ISSPIT.2018.8685601

[8] Wang, H., & Xu, X. (2017). Development of a Virtual Mouse Based on Hand
Tremor Detection for Parkinson’s Disease Patients. Proceedings of the 2017
IEEE International Conference on Robotics and Automation (ICRA), 29 May– 3
June 2017, Singapore, pp. 1982–1987. doi: 10.1109/ICRA.2017.7989324.

[9] Berard, A., & Petit, E. (2020). Assistive Joystick for People with Parkinson’s
Disease: Enhancing Fine Motor Control. 2019 IEEE International Conference
on Human-Computer Interaction (HCI), 13–15 July 2019, Las Vegas, USA, pp.
431–436. doi: 10.1109/HCI.2019.00083.

[10] Lee, C., & Yu, T. (2021). Design of a Novel Joystick Interface for TremorDriven
Mouse Control. IEEE Access, 9, 29335–29345. doi:10.1109/ACCESS.2021.3058001.

Department of ECE, BVRIT HYDERABAD CEW Page 23


Neuromouse

8. Appendix
Python Script:
import serial
import pyautogui

# Configure the serial connection


arduino = serial.Serial('COM10', 9600, timeout=1) # Replace 'COM10' with your
Arduino's COM port
pyautogui.FAILSAFE = False # Prevents the mouse from stopping at screen corners

while True:
try:
# Read and decode data from Arduino
line = arduino.readline().decode(errors='ignore').strip()
if line.startswith("MOVE"):
_, y_move, x_move = line.split()
try:
y_move = int(y_move)
x_move = int(x_move)
pyautogui.moveRel(x_move, y_move, duration=0.1)
except ValueError:
# Ignore invalid movement values
pass
elif line == "CLICK LEFT":
pyautogui.click(button='left')
elif line == "CLICK MIDDLE":
pyautogui.click(button='middle')
elif line == "CLICK RIGHT":
pyautogui.click(button='right')
except serial.SerialException as e:
print(f"Serial error: {e}")

Department of ECE, BVRIT HYDERABAD CEW Page 24


Neuromouse

break
except KeyboardInterrupt:
print("Exiting...")
break

Arduino:
#include <Wire.h>
#include <MPU6050_light.h>

MPU6050 mpu(Wire);
unsigned long timer = 0;
int Xang = 0, Yang = 0;
int prevXang = 0, prevYang = 0;
const int threshold = 3; // Minimum change to register movement

// Button pins
const int leftButton = 7;
const int middleButton = 8;
const int rightButton = 9;

// Button states
bool leftButtonPressed = false;
bool middleButtonPressed = false;
bool rightButtonPressed = false;

void setup() {
pinMode(leftButton, INPUT_PULLUP);
pinMode(middleButton, INPUT_PULLUP);
pinMode(rightButton, INPUT_PULLUP);

Serial.begin(9600);
Wire.begin();
Department of ECE, BVRIT HYDERABAD CEW Page 25
Neuromouse

mpu.begin();
delay(1000);
mpu.calcOffsets();
}

void loop() {
mpu.update();

if (millis() - timer > 60) {


// Read angles
Xang = mpu.getAngleX();
Yang = mpu.getAngleY();

// Only send movement if it exceeds the threshold


if (abs(Xang - prevXang) > threshold || abs(Yang - prevYang) > threshold) {
Serial.print("MOVE ");
Serial.print(Yang);
Serial.print(" ");
Serial.println(Xang);
prevXang = Xang;
prevYang = Yang;
}

// Check button states and send messages only on press


if (digitalRead(leftButton) == LOW && !leftButtonPressed) {
Serial.println("CLICK LEFT");
leftButtonPressed = true;
} else if (digitalRead(leftButton) == HIGH) {
leftButtonPressed = false;
}

if (digitalRead(middleButton) == LOW && !middleButtonPressed) {

Department of ECE, BVRIT HYDERABAD CEW Page 26


Neuromouse

Serial.println("CLICK MIDDLE");
middleButtonPressed = true;
} else if (digitalRead(middleButton) == HIGH) {
middleButtonPressed = false;
}

if (digitalRead(rightButton) == LOW && !rightButtonPressed) {


Serial.println("CLICK RIGHT");
rightButtonPressed = true;
} else if (digitalRead(rightButton) == HIGH) {
rightButtonPressed = false;
}

timer = millis();
}
}

Department of ECE, BVRIT HYDERABAD CEW Page 27

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy