1

Document Application
Usability Test

Google Docs and Microsoft Word

English 317
Bailey Shawver
 2

Table of Contents
Introduction…………………………………………………………………………………3
Methodology………………………………………………………………………………...3
Tasks………………………………………………………………………………….3
Environment and Equipment…………………………………………………….3
Evaluating Criteria…………………………………………………………………4
Results
Task 1…………………………………………………………………………………5
Task 2…………………………………………………………………………………6
Task 3…………………………………………………………………………………7
Task 4…………………………………………………………………………………8
Task 5…………………………………………………………………………………9
Task 6………………………………………………………………………………..11
Task 7………………………………………………………………………………..12
Task 8………………………………………………………………………………..13
Task 9………………………………………………………………………………..14
Task 10………………………………………………………………………………14
Conclusion…………………………………………………………………………………..15
Bibliography………………………………………………………………………………...16
Appendix…………………………………………………………………………………….17

Introduction
 3

This white paper presents the findings from the cognitive usability test that compared the
phone application version of Google docs, a free to use online word processor and
Microsoft Word a subscription base offline word processor. As a free to use word
processor Google docs users are typical students or writers in need of a free alternative to
pay to use word processors such as Microsoft Word, which users are student and writers
who are willing to pay for a processor or received access through educational or work
programs. Each of these phone application versions are free to use.

Methodology
Tasks:
1. Open application and create a new document
2. Change orientation of page
3. Type “The quick brown fox jumps over the lazy dog.” into the document.
4. Change font to Times New Roman and font size to 14
5. Change font color to Orange
6. Create numbered/bulleted list naming three fruit
7. Insert a picture of a sloth
8. Create and Customize a Table
9. Create and Customize a Chart
10. Manually save and name document “Lastname_UsabilityTest_ApplicationUsed”

Environment and Equipment:

The test was done in my apartment using a Samsung J7 smart phone with the
1.20.402.06.02 version of Google docs and 16.0.13328.20160 version of
Microsoft Word.

Evaluating Criteria
Test metric:
 Effective: The task was completed according to the specifics asked
 Efficient: The task was completed in a timely manner
 Engaging: The processor’s appearance and style enhanced your experience
 4

 Error Tolerant: Errors made during the tasks were easy to fix
 Easy to Learn: The processor was easy to use

Likert scale:
Strongly Strongly Agrees
Disagrees
1 2 3 4 5

Results
Task 1: Open application and create a new document
GOOGLE DOCS made creating a new document very easy. After
starting the application all documents on the device being used will
be listed and accessible, as can be seen in Figure 1. by pressing on
the multicolored plus button at the bottom of the screen, the
options to choose template and new document will appear. By
pressing the new document option and untiled document will open
and be ready to use.
 5

MICROSOFT WORD made creating a new document very Figure 1. Google Docs new
document section pop-up
easy. After starting the application, the Microsoft Word
documents on the device being used will be listed and accessible.
By pressing on the blue plus button at the top of the screen the options for a new
document will appear, as can be seen in Figure 2. By
selection the document template you want a new document
will open and be ready to use.

For Task 1 both applications scored the same with little difference in
their creations of new document.

Task 1 Metric Camparison

6
5
4
Likert Score

3
2
1
0
Efficient Effective Engaging Error Engaging
Tolerant

Google Docs Microsoft Word

Figure 2. Microsoft Word new

document section pop-up

Graph 1. Google Docs and Microsoft Word Task 1 Likert scores

Task 2: Change orientation of page

GOOGLE DOCS made the orientation selection somewhat
difficult to find. To find this option you must press the show more
option button on top of the screen, then select the Page setup option,
that can be seen in Figure 3. to find the orientation selection. While
this option did change the page orientation to be able to view the
page in that orientation another setting had to be changed and the
document had to be switched to print layout.
 6

Figure 3. Google Docs more option drop

MICROSOFT WORD made the orientation selection somewhat down menu
difficult to find. To find this option you must press the more
option button on the bottom of the screen, then select the home
button to open the section drop down menu to select layout. In
the layout menu the orientation selection is second in the list.
The orientation options can be seen in Figure 4.

For Task 2 Google Docs scored better due to its orientation

options being in an easier to access area of the app.
 7

Figure 4. Microsoft Word new

document section pop-up

Graph 2. Google Docs and Microsoft Word Task 2 Likert scores

Task 2 Metric Camparison

6
5
4
Likert Score

3
2
1
0
Efficient Effective Engaging Error Engaging
Tolerant

Google Docs Microsoft Word

Task 3: Type “The quick brown fox jumps over the lazy dog.” into the document.
GOOGLE DOCS made typing hard to see as can be seen in Figure
5. While the objection was easy to do since by clicking on the page
the app brought up the phones keyboard allowing the user to
immediately type, the default zoom setting made viewing what was
being typed fairly difficult. To be able to see what was being typed
the user must first zoom, which in itself was a slightly cumbersome
process.
 8

MICROSOFT WORD made typing hard to see. While the

Figure 5. Google Docs typing screen
objection was easy to do since by clicking on the page the app
brought up the phones keyboard allowing the user to immediately
type, the default zoom setting made
viewing what was being typed fairly difficult. To be able to see
what was being typed the user must first zoom. Although
selecting the page allowed you to immediately type, the paste
and selection menu also automatically pops up and can be
confusing. When you start typing it will disappear but if not use
to this popping up whether or not you can type is confusing.

For Task 3 both applications scored the same with little

difference in their typing mechanics and
Figure 6. Microsoft Word typing problem.
screen

Task 3 Metric Camparison

6
5
4
Likert Score

3
2
1
0
Efficient Effective Engaging Error Engaging
Tolerant

Google Docs Microsoft Word

Graph 3. Google Docs and Microsoft Word Task 3 Likert scores

Task 4: Change
font to Times
New Roman and font size to 14
 9

GOOGLE DOCS text options were fairly easy to find with some
available on the default options available above the keyboard while
the majority of them were under the text option button at the top of
the screen. The second and third options under this category were
the font and size selection. Both of these selections were straight
forward but not optimized. As can be seen in Figure 7. to find the
font you wanted, you must manually scroll through all the fonts
available to make a selection and for the font size you could only
decrease and increase one point at a time.

MICROSOFT WORD text options

were fairly easy to find with some Figure 7. Google Docs font selection
available on the default options
available above the keyboard, as
can be seen in Figure 8. while the
majority of them were under the home section found under
the more options button on top of the keyboard. The top
options under this section are the font and size selection.
Both of these selections were straight forward but not
optimized. To find the font and size you wanted, you must
manually scroll through all the fonts and sizes available to
make a selection from the options available. This selections process also limits the font
sizes that can be used because the listed size only go up to 72 and skips fifty-six of these
number.

For Task 4 both applications scored the same with little difference in their font and sizing
capabilities and problem.
 10

Figure 8. Microsoft Word

selection home menu

Graph 4. Google Docs and Microsoft Word Task 4 Likert scores

Task 4 Metric Camparison

6
5
4
Likert Score

3
2
1
0
Efficient Effective Engaging Error Engaging
Tolerant

Google Docs Microsoft Word

Task 5: Change font color to Orange

 11

GOOGLE DOCS made changing the color of your font very easy. The option to change
the color of your font is on the default text options available above the keyboard. Once
the option was selected you could choose from the colors provided, as can be seen in
Figure 9. and even choose a different hue of that color. Although there were 100 total
color choices counting the hue variances the application did not offer the ability to create
custom colors.

MICROSOFT WORD made changing the color of your font very easy. The option to
change the color of your font is on the default text options available above the keyboard,
as can be seen in Figure 10. Once the option was selected you
could choose from the colors available in this menu or go down Figure 9. Google Docs text color option
page
and select from the additional colors from the more colors option.
Although there were 288 total color choices the application did not
offer the ability to create custom colors.

For Task 5 both applications scored the same with little difference
in their font color changing capabilities and problem.

Figure 10. Microsoft home selection

menu
Task 5 Metric Camparison
6
5
4
Likert Score

3
2
1
0
Efficient Effective Engaging Error Engaging
Tolerant

Google Docs Microsoft Word

Graph 5. Google Docs and Microsoft Word Task 5 Likert scores

 12

Task 6: Create numbered/bulleted list naming three fruit

GOOGLE DOCS made creating bulleted and number lists very
easy. The option to create a bulleted list is on the default text
options available above the keyboard, as can be seen in Figure 11.
Once the option is selected a second option will appear allowing
you to change the bullet to numbers.

MICROSOFT WORD made creating bulleted and numbered lists

very easy. The option to create a bulleted or numbered list is on
the default text options available above the keyboard. Under the
home section found, as can be seen in Figure 12, under the more
options button on top of the keyboard you can find more options Figure 11. Google Docs text option
menu
of the different styles of bullets and
numbers.

For Task 6 both applications scored the same with little

difference in their listing capabilities.
 13

Figure 12. Microsoft Word home

selection menu

Task 6 Metric Camparison

6
5
4
Likert Score

3
2
1
0
Efficient Effective Engaging Error Engaging
Tolerant

Google Docs Microsoft Word

Graph 6. Google Docs and Microsoft Word Task 6 Likert scores

Task 7: Insert a
picture of a sloth
GOOGLE DOCS made inserting an image very easy. By pressing
the plus button on the top of the screen the insert menu, as can be
seen in Figure 13, would become available on the bottom of the
screen. In this menu by pressing the image option, three more
option would pop up, allowing you to choose an image from your
device, to take a picture, or to search the web for an image.
 14

MICROSOFT WORD made inserting an image quite easy. To

Figure 13. Google docs Insert menu
find this option you must press the more option button on top of
the keyboard, then select the home button to open the section
drop down menu to select insert. In
the insert menu, as can be seen in figure 14, the image option
is fourth from the top and by pressing this option another
menu will pop up and you can choose whether to insert a
photo from your device or take a picture.

For Task 7 both applications scored the same with little

difference in their image interesting capabilities.

Task 7 Metric Camparison

6
Figure 14. Microsoft Word insert menu
5
4
Likert Score

3
2
1
0
Efficient Effective Engaging Error Engaging
Tolerant
Graph 7. Google Docs and Microsoft Word Task 7 Likert scores
Task 8: Create and Google Docs Microsoft Word
Customize a Table
GOOGLE DOCS did not seem to be made with the creations of tables
in mind. While inserting a table was very easy by pulling up the insert
menu, as can be seen in Figure 15, and choosing the size in the next
selection screen actually using the table is fairly difficult. Due to the
difficult zooming function mentioned before and the size of the default
table sections making selection difficult, inserting data was
troublesome. Though manually searching table customization could not
be found.

Figure 15. Google docs insert menu

 15

MICROSOFT WORD made creating a table easy enough but inserting a table the
correct size is hard. The insert table button is found in the more options menu under the
insert section, as can be seen in Figure 16. By pressing the table button, the app
automatically makes a 3 by 3 table. To make more rows and
columns they must be inserted one by one in the menu that appears
when the table is selected. In the same menu the style of the table
can be customized to various premade styles.
 16

For Task 8 Microsoft

Task 8 Meric Camparison
6 Word scored better due to
5
its ability to customize
4
Likert Score

3 tables.
2
1
0
Efficient Effective Engaging Error Engaging
Figure 16. Microsoft Word insert menu
Tolerant

Google Docs Microsoft Word

Task 9: Create and Customize a Chart

GOOGLE DOCS did not have the ability to create charts.
Graph 8. Google Docs and Microsoft Word Task 8 Likert scores

MICROSOFT WORD did not have the ability to create charts.

For Task 9 neither applications scored. When designing this task an assumption was
made that the phone app versions would be able to do most tasks that the computer
versions were capable of. This was proven wrong with this task since neither app had
chart making capabilities.

Task 10: Manually save and name document

“Lastname_UsabilityTest_ApplicationUsed”
GOOGLE DOCS made saving and naming documents easy. By
pressing the blue checkmark on the top of the screen the document
will save, then show the current document’s name at the top of the
screen. By pressing the current document title, the renaming options
appears, as can be seen in Figure 17, allowing the user to name the
document what they please.

MICROSOFT WORD made saving and naming documents

Figure 17. Google Doc document
easy. By minimizing the keyboard and menus a white renaming pop-up
 17

checkmark on the top of the screen will appear and save the document. Once saved the
current document name will appear on the top the screen. By pressing the current
document title, the renaming options appears, as can be seen in Figure 18. allowing the
user to name the document what they please.

For Task 10 both applications scored the same with little

difference in their saving and naming capabilities.
 18

Figure 18. Microsoft Word renaming

selection

Graph 9. Google Docs and Microsoft Word Task 10 Likert scores

Task 10 Meric Camparison

6
5
4
Likert Score

3
2
1
0
Efficient Effective Engaging Error Engaging
Tolerant

Google Docs Microsoft Word

Conclusion
Both Google Docs and Microsoft Words phone applications served their base purposes of
being an on the go word processor. While Microsoft Words app was able to better
customize tables both apps had almost identical scores. From the data collected from this
usage test Microsoft Words phone application did better then Google Docs.

While Microsoft Word allowed more table customization, neither app was able to create
and edit tables efficiently. With the average sized phone, the needed screen space for a
table is to large.
 19

Bibliography
Google LLC. (2020). Google Docs (1.20.402.06.02) [Mobile app]. Google Play
Store.
https://play.google.com/store/apps/details?id=com.google.android.apps.docs.editors.docs

Microsoft Corporation. (2020). Microsoft Word (16.0.13328.20160) [Mobile app].

Google Play Store.
https://play.google.com/store/apps/details?id=com.microsoft.office.word
 20

Appendix
Product Google Docs App Microsoft Word App
Task 1 Open application and create a new document
Efficient The task was completed according to the specifics asked
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Effective The task was completed in a timely manner

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Engaging The processor’s appearance and style enhanced your experience

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Error Tolerant Errors made during the tasks were easy to fix
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Easy to Learn The processor was easy to use

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

My notes The button to create a new document was on the The button to create a new document was on the
homepage homepage

Product Google Docs App Microsoft Word App

Task 2 Change orientation of page
Efficient The task was completed according to the specifics asked
 21

Strongly Strongly Strongly Strongly

Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Effective The task was completed in a timely manner

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Engaging The processor’s appearance and style enhanced your experience

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Error Tolerant Errors made during the tasks were easy to fix
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Easy to Learn The processor was easy to use

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

My notes Took about 3 clicks to find the option could be

difficult to find
: > Page Setup > Orientation

Product Google Docs App Microsoft Word App

Task 3 Type “The quick brown fox jumps over the lazy dog.” into the document.
Efficient The task was completed according to the specifics asked
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Effective The task was completed in a timely manner

 22

Strongly Strongly Strongly Strongly

Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Engaging The processor’s appearance and style enhanced your experience

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Error Tolerant Errors made during the tasks were easy to fix
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Easy to Learn The processor was easy to use

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

My notes With out zooming in it is hard to see text, zooming With out zooming in it is hard to see text,
in can be difficult to focus zooming in can be difficult to focus

Product Google Docs App Microsoft Word App

Task 4 Change font to Times New Roman and font size to 14
Efficient The task was completed according to the specifics asked
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Effective The task was completed in a timely manner

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Engaging The processor’s appearance and style enhanced your experience

 23

Strongly Strongly Strongly Strongly

Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Error Tolerant Errors made during the tasks were easy to fix
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Easy to Learn The processor was easy to use

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

My notes To adjust font you have to manually find the font

in a list and to change size you can only go up one
at a time

Product Google Docs App Microsoft Word App

Task 5 Change font color to Orange
Efficient The task was completed according to the specifics asked
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Effective The task was completed in a timely manner

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Engaging The processor’s appearance and style enhanced your experience

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Error Tolerant Errors made during the tasks were easy to fix
 24

Strongly Strongly Strongly Strongly

Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Easy to Learn The processor was easy to use

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

My notes No custom color wheel

Product Google Docs App Microsoft Word App

Task 6 Create numbered/bulleted list naming three fruit
Efficient The task was completed according to the specifics asked
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Effective The task was completed in a timely manner

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Engaging The processor’s appearance and style enhanced your experience

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Error Tolerant Errors made during the tasks were easy to fix
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Easy to Learn The processor was easy to use

 25

Strongly Strongly Strongly Strongly

Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

My notes

Product Google Docs App Microsoft Word App

Task 7 Insert a picture of a sloth
Efficient The task was completed according to the specifics asked
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Effective The task was completed in a timely manner

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Engaging The processor’s appearance and style enhanced your experience

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Error Tolerant Errors made during the tasks were easy to fix
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Easy to Learn The processor was easy to use

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5
 26

My notes

Product Google Docs App Microsoft Word App

Task 8 Create and Customize a Table
Efficient The task was completed according to the specifics asked
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Effective The task was completed in a timely manner

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Engaging The processor’s appearance and style enhanced your experience

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Error Tolerant Errors made during the tasks were easy to fix
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Easy to Learn The processor was easy to use

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5
 27

My notes Creating the Table was easy Cannot customize

table

Product Google Docs App Microsoft Word App

Task 9 Create and Customize a Chart
Efficient The task was completed according to the specifics asked
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Effective The task was completed in a timely manner

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Engaging The processor’s appearance and style enhanced your experience

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Error Tolerant Errors made during the tasks were easy to fix
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Easy to Learn The processor was easy to use

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5
 28

My notes A chart can not be made with the basic Google A chart can not be made with the basic
Docs App Microsoft Word App

Product Google Docs App Microsoft Word App

Task 10 Manually save and name document “Lastname_UsabilityTest_ApplicationUsed”
Efficient The task was completed according to the specifics asked
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Effective The task was completed in a timely manner

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Engaging The processor’s appearance and style enhanced your experience

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Error Tolerant Errors made during the tasks were easy to fix
Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5

Easy to Learn The processor was easy to use

Strongly Strongly Strongly Strongly
Disagrees Agrees Disagrees Agrees
1 2 3 4 5 1 2 3 4 5
 29

My notes