USOO7479949B2

(12) United States Patent (10) Patent No.: US 7479,949 B2

Jobs et al. (45) Date of Patent: *Jan. 20, 2009
(54) TOUCH SCREEN DEVICE, METHOD, AND (65) Prior Publication Data
GRAPHICAL USER INTERFACE FOR
US 2008/O17457OA1 Jul. 24, 2008
DETERMINING COMMANDS BY APPLYING
HEURISTICS Related U.S. Application Data
(75) Inventors: Steven P. Jobs, Palo Alto, CA (US); (63) Continuation of application No. 1 1/850,635, filed on
Scott Forstall, Mountain View, CA Sep. 5, 2007.
(US); Greg Christie, San Jose, CA (US); (60) Provisional application No. 60/937,993, filed on Jun.
Stephen O. Lemay, San Francisco, CA 29, 2007, provisional application No. 60/937,991,
(US); Scott Herz, San Jose, CA (US); filed on Jun. 29, 2007, provisional application No.
Marcel van Os, San Francisco, CA 60/879,469, filed on Jan. 8, 2007, provisional applica
(US); Bas Ording, San Francisco, CA tion No. 60/879,253, filed on Jan. 7, 2007, provisional
(US); Gregory Novick, Santa Clara, CA application No. 60/824,769, filed on Sep. 6, 2006.
(US); Wayne C. Westerman, San
Francisco, CA (US): Imran Chaudhri, (51) Int. Cl.
San Francisco, CA (US); Patrick Lee G09G 5/00 (2006.01)
Coffman, Menlo Park, CA (US); G06F 3/048 (2006.01)
Kenneth Kocienda, Sunnyvale, CA
(US); Nitin K. Ganatra, San Jose, CA (52) U.S. Cl. ....................... 345/173; 34.5/169; 715/786;
71.5/784
(US); Freddy Allen Anzures, San
Francisco, CA (US); Jeremy A. Wyld, (58) Field of Classification Search ................. 345/156,
San Jose, CA (US); Jeffrey Bush, San 345/157, 173-181
Jose, CA (US); Michael Matas, San See application file for complete search history.
Francisco, CA (US); Paul D. Marcos, (56) References Cited
Los Altos, CA (US); Charles J. Pisula,
San Jose, CA (US); Virgil Scott King, U.S. PATENT DOCUMENTS
Mountain View, CA (US); Chris 5,528.260 A 6/1996 Kent .......................... 345,684
Blumenberg, San Francisco, CA (US); 5,655,094. A * 8/1997 Cline et al. ................. 71.5/786
Francisco Ryan Tolmasky, Cupertino, 5,805,161 A * 9/1998 Tiphane ...................... 715,786
CA (US); Richard Williamson, Los 6,278.443 B1 8/2001 Amro et al. . ... 345,173
Gatos, CA (US); Andre M. J. Boule, 6,466,203 B2 10/2002 Van Ee ....... ... 345,173
Sunnyvale, CA (US); Henri C. 6,559,869 B1* 5/2003 Lui et al. .................... 71.5/785
Lamiraux, San Carlos, CA (US) 6,597,345 B2 * 7/2003 Hirshberg ................... 345,168
(73) Assignee: Apple Inc., Cupertino, CA (US) 6,657,615 B2 12/2003 Harada ............. ... 345,173
6,683,628 B1* 1/2004 Nakagawa et al. .......... 715/799
(*) Notice: Subject to any disclaimer, the term of this 6,690,387 B2 2/2004 Zimmerman et al. ........ 345/684
patent is extended or adjusted under 35 7,088,344 B2 8/2006 Maezawa et al. ...... ... 345,173
U.S.C. 154(b) by 0 days. 7,093,203 B2 8/2006 Mugura et al. ... ... 715,864
2002/0158838 A1 10, 2002 Smith et al. .... ... 345,156
This patent is Subject to a terminal dis 2003/0184593 A1 10/2003 Dunlop .......... ... 345,810
claimer. 2004/OO12572 A1 1/2004 Sowden et al. . ... 345,173
2004/0021676 A1 2/2004 Chen et al. ..... ... 345,684
(21) Appl. No.: 12/101,832 2004O160420 A1 8/2004 Baharav ..................... 345,173
2005, OO12723 A1 1/2005 Pallakoff .................... 345,173
(22) Filed: Apr. 11, 2008 2005/O193351 A1 9/2005 Huoviala .................... T15,840

Portable dutifunction eye

O

3. Cument Time 44
Welcome 394
http:iiwww.company.com:start 3908 381

3. Block 43914.4
33
3.
/
32 Blocks
394-3
3.
V 38 Y
Block 63914-8
I
39.18
-
Hom Accelerometer(s)
168
e was
 US 7,479,949 B2
Page 2

2006, OOO1652 A1 1/2006 Chiu et al. .................. 345,173 Hoover, J.N., “Computer GUI Revolution Continues with Microsoft
2006, OOO7178 A1 1/2006 Davis ......... 345,173 Surface's Touch Screen, Object Recognition.” Information Week,
2006/0022955 A1 2/2006 Kennedy .................... 345,173 May 30, 2007. http://www.informationweek.com/story/showArticle.
2006/0028428 A1 2/2006 Dai et al. .................... 345,156 jhtml?articleID=199703468.
2006, OO31786 A1 2/2006 Hillis et al. ... 715,863 IBM, "Method to Disable and Enable a TouchPad Pointing Device or
2006,00442.59 A1 3/2006 Hotelling et al. ............ 345,156 Tablet Input Device Using Gestures,” Jun. 11, 2002, pp. 1-3.
2006.0049920 A1 3/2006 Sadler et al. ............. 340/407.1 Johnson, R.C., "Gestures Redefine Computer Interface.” Electronic
2006/0101354 A1 5/2006 Hashimoto et al. .......... T15,863 Engingeering Times, No. 924, p. 42(1), Oct. 21, 1996.
2006, O132460 A1 6/2006 Kolmykov-Zotov et al... 345/173 Korpela, J., “Using Inline Frames (iframe elements) to Embed Docu
2006, O164399 A1 7/2006 Cheston et al. ............. 245,173 ments into HTML Documents.” (Online), Sep. 25, 2006, http://web.
2006, O181519 A1 8/2006 Vernier et al. ..... ... 345,173 archive.org/web/20060925113551/http://www.cs.itut.fi/{jkorpela/
2006/0253793 A1 11/2006 Zhai et al. ................... 71.5/773 html iframe.html.
2006/0294472 Al 12/2006 Cheng et al. ................ 71.5/771 Narayanaswamy, et al., “User Interface for a PCS Smart Phone.”
2007/0040812 A1 2/2007 Tang et al. ..... ... 345,173 Multimedia Computing and Systems, IEEE Conference 1999, Pub
2007, OO61126 A1 3/2007 Russo et al. .................. T13 24 lished Jun. 7-11, 1999, vol. 1, pp. 777-781.
2007, 0118400 A1 5/2007 Morita et al. .................. 705/2 Poon et al., “Gestural User Interface Technique for Controlling the
2007, 0120834 A1 5, 2007 Boillot .......... 345,173 Playback of Sequential Media.” Xerox Disclosure Journal, vol. 19.
2007/O130532 A1 6, 2007 Fuller et al. . ... 15,764 No. 2, Mar/Apr. 1994, pp. 187-190.
2007/O150826 A1 6/2007 Anzures et al. ... ... 715/772 PR Newswire, “FingerWorks Announces a Gestrue Keyboard for
2007/0152984 A1 7/2007 Ording et al. ..... ... 345,173 Apple PowerBooks.” Jan. 27, 2004, 2 pages.
2007/01778O3 A1 8, 2007 Elias et al. ..... ... 382,188 PR Newswire, “FingerWorks Announces the ZeroForce iGesture
Pad.” Feb. 18, 2003, 2 pages.
FOREIGN PATENT DOCUMENTS International Search Report and Written Opinion for International
Application PCT/US2007/088885, mailed Apr. 24, 2008.
EP O 827 064 A2 3, 1998 Examiner's Report on Australian Innovation Patent No. 2008100179
EP O 827 094 A2 3, 1998 dated Apr. 30, 2008.
EP 1517 228 A2 3, 2005 “Sprint Power Vision Smart Device TreoTM 700p by Palm.” Sprint
GB 2 347 200 A 8, 2000 Nextel, 432 pages, 2006.
WO WO O2/O1338 A1 1, 2002 “Google Maps API Google Code.” Google Inc. http://www.
WO WO 2004/111816 A2 12/2004 google.com/apis maps, 1 page, printed Apr. 10, 2008.
WO WO 2005, O74268 A1 8, 2005 * cited by examiner
WO WO 2006/02O305 A2 2, 2006
WO WO 2006/126055 A2 11/2006 Primary Examiner Duc Q Dinh
(74) Attorney, Agent, or Firm Morgan, Lewis & Bockius
OTHER PUBLICATIONS LLP

Examiner's Reporton Australian Innovation Patent No. 2008100179, (57) ABSTRACT

dated Apr. 30, 2008, which application claims priority to U.S. Appl. A computer-implemented method for use in conjunction with
No. 60/824.726, the same priority application of the instant applica a computing device with a touch screen display comprises:
tion.
Baguley, R., “Nokia Handlelds & Palmtops Internet Tablet 770, detecting one or more finger contacts with the touch screen
Nokia's Small, Svelte, Internet-Savvy PDA.” Jan. 31, 2006, http:../ display, applying one or more heuristics to the one or more
www.pcworld.com/printable/article/id, 124456/printable.html. finger contacts to determine a command for the device, and
Bordovsky et al., “Interpreting Commands from a Graphical User processing the command. The one or more heuristics com
Interface.” reproduced from International Technology Disclosures, prise: a heuristic for determining that the one or more finger
vol. 9, No. 6, Jun. 25, 1991, 1 page. contacts correspond to a one-dimensional vertical Screen
Cheng et al., “Navigation Control and Gesture Recognition Input scrolling command, aheuristic for determining that the one or
Device for Smaill, Portable User Interfaces.” Synaptics Inc. of San more finger contacts correspond to a two-dimensional Screen
Jose, California, pp. 1-13, 2004. translation command, and a heuristic for determining that the
Computergram International, "Next-Generation Sharp Organiser to one or more finger contacts correspond to a command to
carry Pen Interface.” No. 1955, Jul. 2, 1992. transition from displaying a respective item in a set of items to
Electronic Engineering Times, “Screen Can Tell Finger From Sty
lus.” No. 858, Jul. 24, 1995, p. 67. displaying a next item in the set of items.
Gillespie, D., “Novel Touch Screens for Hand-Held Devices.” Infor
mation Display, vol. 18, No. 2, Feb. 2002, 5 pages. 20 Claims, 293 Drawing Sheets
U.S. Patent Jan. 20, 2009 Sheet 1 Of 293 US 7479,949 B2

Memory Portable Multifunction Device

102
100
136
Operating System 126 Applications (continued) 148
Communication Module 128 Calendar Module 149
Contact Motion Module Widget Modules 149-1
Graphics Module Weather Widget 149-2
TextInput Module Stocks Widget 149-3
GPS Module 136 Calculator Widget 149-4
Applications 137 Alarm Clock Widget 149-5
Contacts Module 138 Dictionary Widget
Telephone Module 139 149-6
Video Conference Module 140 User-Created Widget(s) 150
E-mail Client Module 141 Widget Creator Module 151
instant Messaging Module 142 Search Module
Blogging Module 143
Camera Module 1 62
Image Management Module 144 POWer
145 System
Video Player Module
Music Player Module 146 External 124
147 POrt
Browsing Module
118 103 RF Circuitry
103 108 Speaker
104 A Y- 111
122 Controller t 103 Circuitry
Audio (
Peripherals 103
110 HO
Microphone
Interface
103 SensOr 166

Accelerometer(s)
1Y 103 168
I/O Subsystem 158
106
Display Optical Other input 160
Controller sensor(s)
Controller Controll
ontroller(s)
156
103 103 103

Touch-Sensitive
Optical Other input 116
112 Display System Sensor(s) Control
164 Devices

Figure 1A
U.S. Patent Jan. 20, 2009 Sheet 2 Of 293 US 7479,949 B2

Memory 102 Portable Multifunction Device 100 136

Operating System 126 Applications (Continued) 148
Communication Module 128 Calendar Module 149
Contact Motion Module g Widget Modules 149-1
Graphics Module Weather Widget(s)
134 149-2
Text input Module 135 Stocks Widget 149-3

EAE-
pplications 136
137 ENG-E.
t 149-4
149-5
Contacts Module 138 Dictionary Widget
Telephone Module 139 149-6
Video Conference Module 140 User-Created Widget(s) 150
E-mail Client Module 141 Widget Creator Module 151
Instant Messaging Module 142 Search Module 155
Blogging Module 143 Online Video Module
Camera Module 144
Image Management Module 152
Power - 162
153 System
Notes Module
Map Module 154 124
Browsing Module 147 POrt
118 103 RF Circuitry
103 103 108 Speaker
104 A H-1 111
Controller s AUCO EC
Peripherals 103
110 HO
Microhone
Interface 113
103 Sensor 166
120 Processor(s)
Accelerometer(s)
168
103
I/O Subsystem 158
106 Optical
Display sensor(s) Other input 160
Controller Controller Controller(s)
156
103 103 103

Touch-Sensitive s origit 116

112 Display System
164 Devices

Figure 1B
U.S. Patent Jan. 20, 2009 Sheet 3 Of 293 US 7479,949 B2

Portable Multifunction DeVice 100

Optical Proximity
Speaker 111 Sensor 164 Sensor 166

210 is SIM Card slot

212 is headphone jack

Touch Screen 11

Microphone Home Accelerometer(s)

113 204 168

External Port 124

Figure 2
U.S. Patent Jan. 20, 2009 Sheet 4 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 1OO

Current Time M 308

310 N Day and Date M 312
Wallpaper image
314

304
Slide to unlock

Touch SCreen 11

Microphone HOme Accelerometer(s)

113 204 168

Figure 3A
U.S. Patent Jan. 20, 2009 Sheet 5 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time M 308

310 \ Day and Date M 312

(e. Slide to unlock

Touch Screen 11

Microphone Home Accelerometer(s)

113 204 168

Figure 3B
U.S. Patent Jan. 20, 2009 Sheet 6 of 293 US 7479,949 B2

Portable Multifunction Device

2O6 1OO

Current Time 404

Enter PassCOce

o Do I

N
/

—
Emergency
Call
-

Microphone Home Accelerometer(s)

113 204 168

Figure 3C
U.S. Patent Jan. 20, 2009 Sheet 7 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

ooch
PhotoS
144
Camera
143
Videos
145

Jan
15

Stocks Blog Calendar

149-2 142 148

USer
ABC Created
Widget
Calculator Alarm Dictionary Widget
149-3 149-4 149-5 149-6

Mail Browser Music

140 147 146
O8

Touch Screen 11

Microphone HOme Accelerometer(s)

113 204 168

Figure 4A
U.S. Patent Jan. 20, 2009 Sheet 8 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Jan
15 (3) (C) (3)
Calendar PhotoS
148

Calculator Settings
149-3 412

414 410

Phone Mail Browser iPod

138 147 152
08
Touch Screen 11

HOme Accelerometer(s)
113 204 168

Figure 4B
U.S. Patent Jan. 20, 2009 Sheet 9 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Optical Proximity
Speaker 111 Sensor 164 Sensor 166

402 Current Time 404 c. 406

514
512 Instant Messages r 502
Jane DOer 504-1 pe- 51O-1
HOla WY 506-1 Today 3
John Smith YM 504-2 506-2 508-2 510-2
Are you going tonight? January 28, 2006 3
408-123-4567?r 504-3 508-3
S 51O-3
Bye Wr 506-3 January 27, 2006 :
Bob Adams M504-4 508-4 510-4
CUlater M 506–4 January 25, 2006 3.

Touch Screen 11

Microphone Home Accelerometer(s)

113 204 168

Figure 5
U.S. Patent Jan. 20, 2009 Sheet 10 Of 293 US 7479,949 B2

Portable Multifunction DeVice

100

Current Time 404

Instant Messages ||YY 602 Jane Doe SM 504-1
604-1 January 29, 2006
113; AM
608-1

1O
January 30, 2006
83AM
608-2

Text bOX

Microphone HOme Accelerometer(s)

113 204 168

Figure 6A
U.S. Patent Jan. 20, 2009 Sheet 11 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404

Instant Messages RM 602 Jane Doe M 504-1

January 30, 2006

8:30 Ay
608-2

(How was your vacat 612 (Send

(vacant) (vacate) (vacation) 622

As DFGHIJKL
123 so
Microphone Home Accelerometer(s)
113 204 168

Figure 6B
U.S. Patent Jan. 20, 2009 Sheet 12 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

1 402 Current Time 404

Instant Messages reO2 Jane Doe M 504-1
606-1

M is the best.
January 30, 2006
604-2 8:30 AM
608-2

(How was your vacat 612 ( Send sha

123456789 o
628 , so
st 2.
ABC
626

Microphone Home Accelerometer(s)

113 204 168

Figure 6C
U.S. Patent Jan. 20, 2009 Sheet 13 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

Instant Messages M602 Jane Doe M 504-1

606-1

January 30, 2006

8:30 AM R
608-2

(How was your vacat 612 614

(vacant ) (Vacate) (Vacation) 622

ass---
(III) -> --

639

Microphone Home Accelerometer(s)

113 204 168

Figure 6D
U.S. Patent Jan. 20, 2009 Sheet 14 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

Instant Messages M 602 Jane DOe M 504-1

January 30, 2006

8:30 AM
608-2 606-3
S

(How Was your vacation? 612 614

ow ERTYuto P.
As DFGHIJKL
ZxcvBNM
Microphone Home Accelerometer(s)
113 204 168

Figure 6E
U.S. Patent Jan. 20, 2009 Sheet 15 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

New Message 636

(Textbox 612 R (Send

awe Irty utop
As DFGHIJKL
7,123 Space
616

Microphone HOme Accelerometer(s)

113 204 168

Figure 6F
U.S. Patent Jan. 20, 2009 Sheet 16 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404 406

New Message 636 M Cancel

To: wl 632 634-(+)
Mike Van OS 650-123-2332
Venu A 712-666-34.66
M
ViCK TOm 642 872-739-2322

...
as DFGHIJKL
.
Zx c. v. BNM

Microphone Home Accelerometer(s)

113 204 168

Figure 6G
U.S. Patent Jan. 20, 2009 Sheet 17 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404

New Message 636
To: Mike Van OS 32

dinner M 644

616

Microphone Home Accelerometer(s)

113 204 168

Figure 6H
U.S. Patent Jan. 20, 2009 Sheet 18 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

New Message 636
To: Mike Van OS 632

656

you make dinner an/Y 648-1

Will
pick Dan from the day care. 612 (Send),
ow ERTYulop
As IDFGHNKL
ZxcvBNM
Accelerometer(s)
168

Figure 6
U.S. Patent Jan. 20, 2009 Sheet 19 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404

New Message 636
To: Mike Van OS 632

S-648
om the day care. 612

.........
Microphone Home Accelerometer(s)
113 204 168

Figure 6J
U.S. Patent Jan. 20, 2009 Sheet 20 Of 293 US 7479,949 B2

Portable Multifunction DeVice

206 100

Current Time 404

New Message 636
To: Mike Van OS 32

you make
656
dinner? I will
pick Danffrom the day care. e (Send)

Microphone HOme Accelerometer(s)

113 204 168

Figure 6K
U.S. Patent Jan. 20, 2009 Sheet 21 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Optical Proximity
Speaker 111 Sensor 164 Sensor 166

1 402 Current Time 404

Doners Instant Messages \ 502

(Jane Doe Wr 504-1 pe
HOla YM 506-1 Today
702-2
John Smith YY 504-2 506-2 spe-2
Are you going tonight?January 28, 2006
(408-123-4567~ 504-3 pes
Bye Yr 506-3 January 27, 2006
(1 *Bob Adams \ 504-4 5984
S Delete
CUlater January 25, 2006
704

Touch SCreen 11

Microphone Home Accelerometer(s)

113 204 168

Figure 7
U.S. Patent Jan. 20, 2009 Sheet 22 Of 293 US 7479,949 B2

Portable Multifunction Device

206 1OO

Current Time 404

All Contacts
802 294 296
(First Name DOLast Name)
(A) 56
80
Bob Adams
Darin Adler
Darin Amon A
Kim Brook W

12
Other Number

Touch Screen 11

Microphone Home Accelerometer(s)

113 204 168

Figure 8A
U.S. Patent Jan. 20, 2009 Sheet 23 Of 293 US 7479,949 B2

Portable Multifunction DeVice

206 100

Current Time 404

All Contacts
802 94 296
(First Name O Last Name)
(A) 865
Aaron Jones
Arlene Bascom A
Bob Adams W
-81.
Bruce Walker

810 812
r/
Cancel Other Number
Touch Screen 11

Home Accelerometer(s)
113 204 168

Figure 8B
U.S. Patent Jan. 20, 2009 Sheet 24 of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404

Instant Messages ||YY602 Jane DOe M 504-1

902 904

(408) 234-56

1234567890
-III () & a
(. ), ?
ABC 624

Microphone Home Accelerometer(s)

113 204 168

Figure 9
U.S. Patent Jan. 20, 2009 Sheet 25 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Viewfinder

Image
1012

Camera roll Shutter

1004 1006

Microphone Home Accelerometer(s)

113 204 168

Figure 10
U.S. Patent Jan. 20, 2009 Sheet 26 of 293 US 7479,949 B2

Portable Mutifunction DeVice

100

Current Time 404 406

1110
Camera Roll (32)

Thumbnail Thumbnail Thumbnail Thumbnail

1102-01 1102-02 1102-03 1102-04

Thumbnail Thumbnail Thumbnail Thumbnail

1102-05 1102-06 A 1102-07 1102-08
1112/n

Thumbnail ThumbnailW Thumbnail Thumbnail

1102-09 1102-10 1102-11 1102-12

la
108

Thumbnail Thumbnail Thumbnail Thumbnail

1102-13 1102-14 1102-15 1102-16

Microphone Home Accelerometer(s)

113 204 168

Figure 11
U.S. Patent Jan. 20, 2009 Sheet 27 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404 406

12O2
Camera Roll 11 Of 29 1110-Done)

Microphone HOme Accelerometer(s)

113 204 168

Figure 12A
U.S. Patent Jan. 20, 2009 Sheet 28 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404 to 406

12O2
Camera Roll 11 Of 29 1110-Done

CanCe 121

Camera
1104

Microphone Home Accelerometer(s)

113 2O4 168

Figure 12B
U.S. Patent Jan. 20, 2009 Sheet 29 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 1 OO

Current Time 404 to 406

12O2
Camera Roll 11 Of 29 1110- Done)

Microphone HOme Accelerometer(s)

113 204 168

Figure 12C
U.S. Patent Jan. 20, 2009 Sheet 30 Of 293 US 7479,949 B2

Portable Multifunction DeVice

206 100

Current Time 404

Photo Albums

Graphic 1308
1304-1 Album Name 1306-1 D

GE Album Name 1306-2 D

Graphic
1304-3 Album Name 1306–3 D

GE Album Name 1306-4

WD 1314

Graphic
1304-5 Album Name 1306-5

Graphic
1304-6 Album Name 1306-6

(i) YM 1310

Microphone HOme Accelerometer(s)

113 204 168

Figure 13A
U.S. Patent Jan. 20, 2009 Sheet 31 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

Photo Albums

Graphic 1308
1304-7 Photo Library 1306-7

O Camera Roll 1306-8

t Last 12 Months 1306-g

E. Wallpaper 1306-10
Graphic
1304-11 Beach Fun 1306-11

Graphic
1304-12 Camping 1306-12

Graphic
1304-13 Christmas 1306-13

Microphone Home Accelerometer(s)

113 204 168

Figure 13B
U.S. Patent Jan. 20, 2009 Sheet 32 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

Settings
Music: nM 1402
Now Playing
Repeat\M 1404
Off
Shuffle:M 1406
Off
Time Per Slide: M 1408
2 Seconds
Transition:\M 1410
Wipe across
TV Out:aM1412
On
TV Signal:M 1414
NTSC
Auto ROtate:M 1416
On

Microphone Home Accelerometer(s)

113 204 168

Figure 14
U.S. Patent Jan. 20, 2009 Sheet 33 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Optical Proximity
1500 Speaker 111 Sensor 164 Sensor 166

1 402 Current Time 404

Photo Albums SaM15O2

Album Name (32)

Thumbnail Thumbnail Thumbnail Thumbnail

1506-01 1506-02 1506-03 1506-04

Thumbnail Thumbnail Thumbnail Thumbnail

1506-05 1506-06 A 1506-07 1506-08

1514-M

Thumbnail ThumbnailW Thumbnail Thumbnail

1506-09 1506-10 1506-11 1506-12

A.
512

Thumbnail Thumbnail Thumbnail Thumbnail

1506-13 1506-14 1506-15 1506-16

Microphone Home Accelerometer(s)

113 204 168

Figure 15
U.S. Patent Jan. 20, 2009 Sheet 34. Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

1 402 Current Time 404

Album Name 11 of 87
16O2

HOme Accelerometer(s)
113 204 168

Figure 16A
U.S. Patent Jan. 20, 2009 Sheet 35 of 293 US 7479,949 B2

A8 O eueNuncIW
w CN
Seul Lueluno S
U.S. Patent Jan. 20, 2009 Sheet 36 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

Album Name 11 Of 87
1602

Image
1606

Email photo 1708

Assign to Contact 1710

Use as Wallpaper 1712

Cancel 1714

HOme Accelerometer(s)
113 204 168

Figure 17
U.S. Patent Jan. 20, 2009 Sheet 37 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Microphone Home Accelerometer(s)

113 204 168

Figure 18A
U.S. Patent Jan. 20, 2009 Sheet 38 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Microphone Home Accelerometer(s)

113 204 168

Figure 18B
U.S. Patent Jan. 20, 2009 Sheet 39 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404 to 406

1 Great Photo

Subject: 1 Great Photo

Microphone HOme Accelerometer(s)

113 204 168

Figure 18C
U.S. Patent Jan. 20, 2009 Sheet 40 Of 293 US 7479,949 B2

Portable Multifunction DeVice

206 100

Current Time 404 to 406

1 Great Photo

1822-(+)
i (+)
1 Great Photo 30
1806
a

Microphone Home Accelerometer(s)

113 2O4 168

Figure 18D
U.S. Patent Jan. 20, 2009 Sheet 41 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

1 Great Photo

o 1822-(+)
1818
Y (+)
1 Great Photo
1806
M

awaiver
As DFGHIJKL
Zxcvb NM
Microphone Accelerometer(s)
113 168

Figure 18E
U.S. Patent Jan. 20, 2009 Sheet 42 of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404 c. 406

1 Great Photo

TO: B (+)
Arlene BasCOm 1826 arleneGDdef.com
Bob Adams badamsGDabc.com
A
Kim BrOOk 1828 kimCDapple.com 1830
Bruce Walker w bwalkerOgmail.com

ow ERTYuto P.
As DFGHIJKL
ZxcvBNM
23 Space
61

Microphone Home Accelerometer(s)

113 204 168

Figure 18F
U.S. Patent Jan. 20, 2009 Sheet 43 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404 406

1 Great Photo

: Bob Adams
: Darin Adler
Subject: 1 Great Photo
Bob, took M1832
This is a picture I toom

lower or

Microphone
113
.."
616

Home
204
Accelerometer(s)
168

Figure 18G
U.S. Patent Jan. 20, 2009 Sheet 44 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

1 Great Photo

: Bob Adams (+)

: Darin Adler
Subject: 1 Great Photo
Bob, 1836
This is a picture I took while visiting New York
City.

ow ERITYuto P.
as DFGHIJKL
Zxc vBNM
2123 Space
616

Microphone Home Accelerometer(s)

113 204 168

Figure 18H
U.S. Patent Jan. 20, 2009 Sheet 45 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Co. 406

TO: Bob Adams

CC: Darin Adler
Subject:1 Great Photo
Bob,
This is a picture I took while visiting New
York City.
Image 1606

teor Save Draft

1812- Delete Message
to- Edit Message
Microphone Home Accelerometer(s)
113 204 168

Figure 18
U.S. Patent Jan. 20, 2009 Sheet 46 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

All Contacts

(First Name DOLast Name)

(A) des
Bob Adams
Darin Adler 820
Darin Amon 1828

Kim Brook

Other Email

Touch Screen 11

Microphone HOme Accelerometer(s)

113 204 168

Figure 18J
U.S. Patent Jan. 20, 2009 Sheet 47 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

All Contacts

( First Name I Last Name )

(A)
Bob Adams go
Darin Adler
Darin Amon

Kim Brook

Other Number

Touch Screen 11

Microphone Home Accelerometer(s)

113 204 168

Figure 19A
U.S. Patent Jan. 20, 2009 Sheet 48 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404

1902
This is What it Will look like When "Bob Adams'
Calls.
Move and scale to adjust.

1908
Image
1606

1912
V P

Microphone Accelerometer(s)
113 168

Figure 19B
U.S. Patent Jan. 20, 2009 Sheet 49 Of 293 US 7479,949 B2

Portable Multifunction Device

206 100

Current Time 404

2002

This is what the wallpaper will look like.

Move and scale to adjust.

2008
Image
1606
2010
s P

a
2012
all - P

Set
Wallpaper
2006

Home Accelerometer(s)
113 204 168

Figure 20
U.S. Patent Jan. 20, 2009 Sheet 50 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

VideOS

Playlists 310
Music VideoS

POdcasts

TV ShoWS

MOVies

Microphone Home Accelerometer(s)

113 204 168

Figure 21A
U.S. Patent Jan. 20, 2009 Sheet 51. Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

My Movies 39 e

Recently Added

Microphone Home Accelerometer(s)

113 204 168

Figure 21B
U.S. Patent Jan. 20, 2009 Sheet 52 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

My Movies

Graphic King Kong

3h 7m

Spiderman
2h15m

Star Wars
1h 55m

Home Accelerometer(s)
113 204 168

Figure 21C
U.S. Patent Jan. 20, 2009 Sheet 53 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

Settings

Scale to fit 32

Microphone Home Accelerometer(s)

113 204 168

Figure 22A
U.S. Patent Jan. 20, 2009 Sheet 54 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

2204

22O6 2208

C Scale to fit C Scale to full D

Home Accelerometer(s)
113 204 168

Figure 22B
U.S. Patent Jan. 20, 2009 Sheet 55 Of 293 US 7479,949 B2
U.S. Patent Jan. 20, 2009 Sheet 56. Of 293 US 7479,949 B2

?EunC61Z-I
U.S. Patent Jan. 20, 2009 Sheet 57 Of 293 US 7479,949 B2

eoun£61z-I
U.S. Patent Jan. 20, 2009 Sheet 58 Of 293 US 7479,949 B2
U.S. Patent Jan. 20, 2009 Sheet 59 Of 293 US 7479,949 B2

Portable Multifunction DeVice

206 1OO

Santa Cruz, CA O
H: 76° L: 58 swipe 2416
66
y
Monday 75° 58°
Y
Tuesday 72° 55° M
/
Wednesday 75° 57
Thursday 75° 58°
77 60°
78° 62

Accelerometer(s)
168

Figure 24A
U.S. Patent Jan. 20, 2009 Sheet 60 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

City, State or Zip Code

P V

W 2404
so a

San Francisco, CA
Cupertino, CA
Santa Cruz, CA
New York, NY

Fahrenheit

DOne

Microphone Home Accelerometer(s)

113 204 168

Figure 24B
U.S. Patent Jan. 20, 2009 Sheet 61 of 293 US 7479,949 B2

Portable Multifunction Device

206 100

City, State or Zip Code

Rutl|
San Francisco, CA
Cupertino, CA
(Rutl) (Rutland, VT) (Rutland, MAD 622
ow ERTYuto P.

Microphone HOme Accelerometer(s)

113 204 168

Figure 24C
U.S. Patent Jan. 20, 2009 Sheet 62 of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

406

Weather

(-) San Francisco, CA

(-) Cupertino, CA
(-) Santa Cruz, CA
(i) New York, NY

Microphone Home Accelerometer(s)

113 204 168

Figure 24D
U.S. Patent Jan. 20, 2009 Sheet 63 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Cupertino, CA
H: 76° L: 58° swipe 2416

80° 67°

*i)
Microphone Home Accelerometer(s)
113 2O4. 168

Figure 24E
U.S. Patent Jan. 20, 2009 Sheet 64 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

INDU 11240.35
AAPL 68.30
DIS 29.90
GOOG 373.78 - 1.61
NTC 17.49 +. 16

Microphone Home Accelerometer(s)

113 204 168

Figure 25A
U.S. Patent Jan. 20, 2009 Sheet 65 Of 293 US 7479,949 B2

POtable Multifunction DeVice

100

INDU 11240.35 -.01%

AAPL 68.30 -1.85%
DIS 29.90 -.46%
GOOG 373.78 -.42%
NTC 17.49 +.92%

Microphone HOme Accelerometer(s)

113 204 168

Figure 25B
U.S. Patent Jan. 20, 2009 Sheet 66 of 293 US 7479,949 B2

Portable Multifunction Device

206 100

Current Time 404

A W
2506

Dow Jones Ind. Avg. 2510

Apple Computer
Walt Disney Company
Google, Inc.
Intel

Microphone Home Accelerometer(s)

113 204 168

Figure 25C
U.S. Patent Jan. 20, 2009 Sheet 67. Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

INDU Dow Jones Ind. Avg.

AAPL Apple Computer
DIS Walt Disney Company

gigs.
zx c. v. BNM
Microphone HOme Accelerometer(s)
113 204 168

Figure 25D
U.S. Patent Jan. 20, 2009 Sheet 68 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

INDU DOW Jones Ind. Avg. 2510

AAPL Apple Computer
DIS Walt Disney Company
GOOG Google, Inc.
NTC Intel

Microphone HOme Accelerometer(s)

113 204 168

Figure 25E
U.S. Patent Jan. 20, 2009 Sheet 69 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

A
B
C
Bob Adams D
E
Darin Adler F
G
H
Darin Amon
J

(B) K
L
M
Kim Brook N
O
P
O
R
S
T
U
V
W
X
Y
Z

Contacts
O)
Voice Mail

Microphone HOme Accelerometer(s)

113 204 168

Figure 26A
U.S. Patent Jan. 20, 2009 Sheet 70 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404

Enter a name for this Contact

New Contact “save

First Name
Last Name

Microphone Home Accelerometer(s)

113 204 168

Figure 26B
U.S. Patent Jan. 20, 2009 Sheet 71 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

Enter a name for this Contact

New Contact *Save

ROn

Smith D
Company D

As DFGHIJKL
2123 616
Return
Microphone Home Accelerometer(s)
113 204 168

Figure 26C
U.S. Patent Jan. 20, 2009 Sheet 72 Of 293 US 7479,949 B2

Portable Multifunction Device

100

Current Time 404

All Contacts Info

Add fROn Smith

PhOtO
26O7
/

*+ Add New Phone >

/
261 + Add New Email P
/
261 + Add New URL D
261 + Add New Address >
Delete Card

ya CD
Favorites
OO
Voice Mail

Microphone HOme Accelerometer(s)

113 204 168

Figure 26D
U.S. Patent Jan. 20, 2009 Sheet 73 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404

Info

Ron Smith D

* + Add NeW PhOne >

"+. Add New Email >
Take Photo an
Choose Existing Photor"
a)
OO
Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 26E
U.S. Patent Jan. 20, 2009 Sheet 74. Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

3.
ABC

sJKL

8
TUV

o
Microphone Home Accelerometer(s)
113 204 168

Figure 26F
U.S. Patent Jan. 20, 2009 Sheet 75 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404 c. 406

Edit Phone Label 2630

mobile

home /
WOrk

main
Home fax
Work fax

pager
Other

preferred
Add Custom Label YM2628

Microphone HOme Accelerometer(s)

113 2O4 168

Figure 26G
U.S. Patent Jan. 20, 2009 Sheet 76. Of 293 US 7479,949 B2

Portable Multifunction DeVice

206 100

Current Time 404 406

mobile

home /
Work
main
Home fax

Work fax

pager
Other
N.
2632
- preferred
Add Custom Label

Microphone Home Accelerometer(s)

113 204 168

Figure 26H
U.S. Patent Jan. 20, 2009 Sheet 77 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Edit PhOne Label

/
mobile

home
WOrk

main
Home fax

Work fax

pager
Other
N.

2634 1) preferred 2- Delete)

N
(t. Add Custom Label
Microphone Home Accelerometer(s)
113 204 168

Figure 26
U.S. Patent Jan. 20, 2009 Sheet 78 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Microphone Home Accelerometer(s)

113 204 168

Figure 26J
U.S. Patent Jan. 20, 2009 Sheet 79 of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

aw ERTYuto P.
As IDFGHIJKL
ZxcvBNM
Microphone Home Accelerometer(s)
113 204 168

Figure 26K
U.S. Patent Jan. 20, 2009 Sheet 80 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404 C 406

EditAddress asse-Save

United States >

22 256
work D

ow ERTYuto P. U

As DFGHIJKL
.72123

Microphone Home Accelerometer(s)

113 2O4 168

Figure 26L
U.S. Patent Jan. 20, 2009 Sheet 81. Of 293 US 7479,949 B2

Portable Multifunction DeVice

206 100

Current Time 404 c. 406

All Contacts Info

2664

Bruce Walker
Graphic

(408) 123-4567
(408) 974-1234
bwalkerOCompany.Com D
bruceWGaol.com D

OO
Voice Mail

Microphone Home Accelerometer(s)

113 2O4 168

Figure 26M
U.S. Patent Jan. 20, 2009 Sheet 82 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Graphic Bruce Walker

C Work (408) 123-4567

/ as as War 1 as a 1

Send an instant message

2686 Work (408) 123-4567
2688W, Home (408) 974-1234

... O
Favorites
OO
Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 26N
U.S. Patent Jan. 20, 2009 Sheet 83 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Bruce Walker
Graphic
Apple Computer

(-) (Work (408) 123-4567

(-) (Home (408) 974-1234
(+ (Add new Phone
(-) (Work bWalkerOCompany.Com
(-) (Home bruceWGDaol.com
(+(Add new Email
(+(Add new URL
(+(Add new Address
C Delete Card

5, CD
Favorites Contacts Voice Mail

Microphone Home Accelerometer(s)

113 2O4. 168

Figure 26O
U.S. Patent Jan. 20, 2009 Sheet 84 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Microphone HOme Accelerometer(s)

113 204 168

Figure 26P
U.S. Patent Jan. 20, 2009 Sheet 85 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

Current Time 404 406

2710 FaVOrites 2704 aros---

Kim BrOOk-2702
Arlene BasCOm Mobile (>
Bob Adams Mobile (>
Bruce Walker WOrk (>
Aaron Jones Other (>
Darin Adler (>

CD Contacts
OO
Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 27A
U.S. Patent Jan. 20, 2009 Sheet 86 Of 293 US 7479,949 B2

Portable Multifunction DeVice

206 100

Favorites

(-Kim Brook Mobile":

(-) Arlene Bascom Mobile
2722
(-) Bob Adams Mobile Qu
V

(-) Bruce Walker WOrk

(-) Aaron Jones Other
(-) Darin Adler

fr CD
Favorites Contacts
Oo
Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 27B
U.S. Patent Jan. 20, 2009 Sheet 87 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Done-are Favorites
(-) Kim Brook Mobile
(-) Arlene Bascom Mobile
2714

( Bruce Walker arer Remove

(-) Aaron Jones Other
(-) Darin Adler WOrk

CD Contacts
Oo
Voice Mail

Microphone Home
113 204

Figure 27C
U.S. Patent Jan. 20, 2009 Sheet 88 Of 293 US 7479,949 B2

Portable Multifunction Device

2O6 100

(-) Arlene Bascom

(-) Bob Adams
(-) Aaron Jones
(-) Darin Adler

OO
Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 27D
U.S. Patent Jan. 20, 2009 Sheet 89 of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

(-) Aaron Jones

(C) Darin Adler

OO
Favorites Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 27E
U.S. Patent Jan. 20, 2009 Sheet 90 Of 293 US 7479,949 B2

Portable Multifunction DeVice

206 100

Current Time 404

Done 2718 Favorites

(-) Kim Brook Mobile

(-) Arlene Bascom Mobile
(-) Bruce Walker Work
|(-) Bob Adams Mobile
(-) Aaron Jones Other
(C) Darin Adler WOrk

fr CD
Favorites Contacts
Oo
Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 27F
U.S. Patent Jan. 20, 2009 Sheet 91. Of 293 US 7479,949 B2

Portable Multifunction DeVice

206 100

Current Time 404 406

28.10 2812 2832

28O2 2804 2806 2808

Kim Brook (3) 2am >

C Bruce Walker (2) Jan 26 10:53 AM
Bob Adams Jan 26 10:30 AM

(408) 654-3210 (5) Jan 26 9:16 AM

CDarin Adler A Jan 26 9-09 AM (>
2814Jan 25 10:37 PM
Aaron Jones (>
Bruce Walker W Jan 25 932 PM
(>
John Smith Jan 25 8:27 PM
(>
5, CD
Favorites Recent Contacts
OO
Voice Mail

Microphone HOme Accelerometer(s)

113 204 168

Figure 28A
U.S. Patent Jan. 20, 2009 Sheet 92 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404 406

28.10 2812 2832

C Bruce Walker (2) Jan 26 10:53 AM

(2) Darin Adler Jan 26 9:09 AM

(...) Bob Adams AJan 25643 PM

r 2814
(2) Kim Brook (3) : Jan 255:30 PM
C (408) 234-5678 vian 25 4:48 PM
(C Arlene Bascom Jan 25 4:04 PM
(...) Bruce Walker Jan 253:30 PM

OO
Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 28B
U.S. Patent Jan. 20, 2009 Sheet 93 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

1 402 Current Time 404

Recent Calls Bruce Walker

Graphic Bruce Walker

2 Missed Calls
12/07/2006 10:53 AM; 10:58 AM
Work (408) 123-4567 2816

C Home (408)974-1234 2a1a)

Work bWalkerGDCompany.com 2820
( Home bruceWCDaol.com 282)
Instant Message Add to Favorites
2682 2684

OO
Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 28C
U.S. Patent Jan. 20, 2009 Sheet 94. Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

402 Current Time 404

Recent Calls Outgoing Call

(408) 654-3210
San Jose, CA
Five missed Calls
O1/29/06 1:27 pm, 3:02 pm, 4:15 pm,
4:47pm, and 6:29 pm

( Call (408)654-3210
C Instant Message

Create NeW Contact

Add to Existing Contact

Contacts Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 28D
U.S. Patent Jan. 20, 2009 Sheet 95 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

1 402 Current Time 404

(650) 132-22

Call"KX
5, CD
Favorites Recent Contacts
SOO Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 29
U.S. Patent Jan. 20, 2009 Sheet 96 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

(650) 132-2234
Calling. .. 3002

H
Add Call HOld Contacts
N 3018 3008 3020

Ala End Cal

fr CD
Favorites Recent Contacts

Microphone HOme Accelerometer(s)

113 204 168

Figure 30A
U.S. Patent Jan. 20, 2009 Sheet 97 Of 293 US 7479,949 B2

Portable Multifunction DeVice

2O6 100

Current Time 404

(650) 132-2234
3004 OO:55

H
Add Call Contacts
\ 3018 o -/

Ala End Call 3014

5, CD
Favorites Recent Contacts
||OO Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 30B
U.S. Patent Jan. 20, 2009 Sheet 98 Of 293 US 7479,949 B2

Portable Multifunction Device

206 100

Graphic for
Arlene Arlene BasCOm
3024
BasCOm
3022

Ignore 3026

HOld Ca+ Answerica

End Ca+ Answero)

5: GD
Favorites Recent
. Soo
Contacts Voice Mail

Microphone Home Accelerometer(s)

113 204 168

Figure 30C