US006243071B1

(12) United States Patent Shwarts et al.

(10) Patent N0.: (45) Date of Patent:

US 6,243,071 B1 Jun. 5, 2001

(54) TOOL SET FOR NAVIGATING THROUGH AN ELECTRONIC BOOK

(75) Inventors: Scott L. Shwarts, Scottsdale, AZ (US); David R. Dunham, Seattle, WA (US)

(73) Assignee: Apple Computer, Inc., Cupertino, CA (Us)

( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b) by 0 days.

(21) Appl. No.: 08/147,143

(22) Filed: Nov. 3, 1993

(51) Int. Cl.7 ..................................................... .. G09G 5/08

(52) US. Cl. ......................... .. 345/146; 345/350; 345/347 (58) Field of Search ................................... .. 395/155—161,

395/600, 650; 345/179, 117—120, 326, 347, 350, 146; 382/11, 12, 13, 14

(56) References Cited

U.S. PATENT DOCUMENTS

4,972,496 * 11/1990 SklareW ............................... .. 382/13

5,157,783 * 10/1992 Anderson et a1. 395/600 5,199,104 3/1993 Hiryama .......... .. 395/145

5,237,651 * 8/1993 Randall 395/155 5,283,864 * 2/1994 Knowlton ........ .. 395/158

5,341,293 8/1994 Vertelney et a1. 364/419.17 5,347,295 9/1994 Agulnick et a1. 345/156 5,367,453 * 11/1994 Capps et a1. .... .. 395/155

5,377,281 12/1994 Ballard et a1. 382/229 5,390,281 * 2/1995 LuciW et a1. . . . . . . . . . . . . . .. 395/12

5,392,387 * 2/1995 Fitzpatrick et a1. .. 395/156 5,398,310 * 3/1995 Tchao et a1. ........ .. 395/155

5,404,442 * 4/1995 Foster et a1. ....................... .. 395/159

OTHER PUBLICATIONS

Nordgren, Layne, “The NeW Grolier Multimedia Encyclo pedia”, CD—ROM Professional, v6, N3, p. 133—134, May 1993*

/510

Screen Dumps From “Microsoft® Windows@ Help”, Microsoft Corp., 1985—1992, pp. 1—7.* O’Connor, Rory J ., “Apple Banking on NeWton’s Brain”, Apr. 22, 1992, San Jose Mercury NeWs. Weiman, Liza and Moran, Tom, “AStep ToWard the Future”, Aug. 1992, MacWorld Magazine. Soviero, Marcelle M., “Your World According to NeWton”, Sep. 1992, Popular Science Magazine. Abatemarco, Fred, “From the Editor”, Sep. 1992, Popular Science Magazine. PenBook by Slate Corporation brochure, approx. 1991. Release of the NeWton Message Pad on Aug. 2, 1993.

* cited by examiner

Primary Examiner—Ulka J. Chauhan (74) Attorney, Agent, or Firm—Beyer Weaver & Thomas LLP

(57) ABSTRACT

The present invention provides a method for controlling a screen display of an electronic book. The contents of the book are displayed on a screen of the computer system as pages With Which the user interacts by a pointer such as a pen or stylus. The navigational tool set performs various func tions including one or more of the folloWing: (1) creating page displays for content of the book, (2) providing a navigation interface for identifying material in the book and moving to desired locations, (3) ?nding character strings located Within the book, and (4) accepting handwritten information on pages of the book. The electronic book includes a “bookmark” button Which When selected displays a bookmark icon and inserts a bookmark in the book at the page that is currently displayed. Thereafter the user can close the book or move to another page and automatically return to the marked page by selecting the bookmark icon. The user can also move to other pages by scrolling With scroll keys or other navigational devices such as tables of contents broWsers and menu pages Which are provided on the computer system.

23 Claims, 28 Drawing Sheets

\512

U.S. Patent Jun. 5, 2001 Sheet 1 0f28 US 6,243,071 B1

mm

P .5

E 3 52¢ 56m

mm Eon E. wm/H #mm /m:

1- Eon. .EEww

\ 20 ‘J! 50.6

pm.

_ n<n_>m_v_ mw Wm

\ /

vw NF

‘ l l l l l I l l I | I I l l

\ >._m_>_mww< M 2 a 5&2. mm

.» ><._n_m_n_

U.S. Patent Jun. 5, 2001 Sheet 2 0f28 US 6,243,071 B1

mm

mm

W #0 1 .D

5/ "a" unmununnnnmww. mC; IEZbmII\ "n I IUMTUHKQ. 0% "Bunnie"; ans“ unwunnnnsum/ zjrlg®w D__ ________"6 k

E: :“::"_/\ m: IIIII§©J§ W: unnunnnnmmnam/ A: :mmnmmmmlmn E a: :m":%:“ w: :mnuulnun m: "Quin"; % : IQTZT m rflm. 66_ hr /2 w 5 5 5

49

Fig. 2

U.S. Patent

74

Jun. 5, 2001 Sheet 3 0f 28

@ Newton 800 Numbers @ »Dornestic Air Carriers

Alaska

_Aloha Airlines America West American Continental Delta Mesa Airlines Midwest Express Northwest Southwest Trans World US Air United

(300) 426-0333 (800) 227-4900 (800) 247-5692 (300) 433-7300 (800) 525-0280 (800)221-1212 (300) 637-2247 (300) 452-2022 (800) 225-2525 (300) 531-5301 (300) 221-2000 (800) 423-4322 (800) 241-6522

US 6,243,071 B1

52

U.S. Patent Jun. 5, 2001 Sheet 4 0f28

100

/102 Install Book Package

User selected an Installed

/106 Set up Selected Book

/ 108 Create Views of Current Page of Selected Book

v /110 Display Content of Page and Update Page Button

Process User lnputs /112

Has Selected Book Been

Closed

US 6,243,071 B1

U.S. Patent Jun. 5, 2001 Sheet 5 0f28 US 6,243,071 B1

102 120 /

Start 1 0o

Notify Librarian that a Book / 122 Package has arrived

Notify Package Manager of / 134 Invalid Book

Add Entry to Librarian for / 128 the New Book

V / 130

Make Book Available to User

132 Done 104

Fig. 5

U.S. Patent Jun. 5, 2001 Sheet 6 0f28 US 6,243,071 B1

124 K 138

146

Fig. 6

U.S. Patent Jun. 5, 2001 Sheet 7 0f28 US 6,243,071 B1

150 Start 104

Set Current Book to Selected / 152 Book

Put Frame Work on / 154 Selected Book

i Determine Current Page of / 156 Current Book

158 Done 108

106 I/

Fig. 7

U.S. Patent Jun. 5, 2001 Sheet 8 0f28 US 6,243,071 B1

\‘ Start 106

Get Page Description for Current Page

/ 162

/ 164 NBLOCKS = Number of

blocks in Current Page

182 v / 166

Dorie . i = 1 l | NBLOCKS i = i + 1 ~

168 / 170

Create Paragraph View at the Coordinates Referred to —> by B|ock(i)

B|ock(i) of type Text

?

/174 Create a Picture View at the Coordinates Referred to by B|ock(i)

/178 Create a Template as specified by B|ock(i) *

180

Create View for Block Type of B|ock(i)

Fig. 8

U.S. Patent

pg. 5

C36 :=

Jun- 5, 2001 Sheet 9 of 28 US 6,243,071 B1

[186 [188 51 [03,240,120] [C36] B2 [ ] [C37] r184 B3 [ ] [038]

Fig. 9a

Text: "Text Stream Here..." r161 Styles: [15,51,10,52,11,57...] (163

Tabs: Layout: Centered,Borders, r167 Script: {Script associated with Text}*"165 Color: Blue Phone: 411

Fig. 9b

Icon: [lnstructionsforGraphic] r169 Layout: Side-by-Side r171r_173 Script: {Script associated with Graphic} Food: Sushi City: Scottsdale

Fig. 9c

U.S. Patent Jun. 5, 2001 Sheet 10 0f 28 US 6,243,071 B1

Fig. 1 0 / 203

Process __

Scrolling

/220 /205 Close

Process Book and B Book — rowser Reader

Application

/ 207 / 217 Process Bookmark+ (P3235332 -> Dialog

/209 /219 Process Process Mark-up * Events _'

/211 > Process Page -> Number

/213 Process Routing

U.S. Patent Jun. 5, 2001 Sheet 11 0f28 US 6,243,071 B1

203 \ 226

the Down Arrow been selected

Current Page = _> Current Page + 1

234 Has

the Up N Arrow been >

selected

/238 Current Page =

Current Page - 1

240

Fig. 11

U.S. Patent Jun. 5, 2001 Sheet 12 0f28

205 \ 244

/ 250

Open Overview Dialog Box

US 6,243,071 B1

/ 256

Close Overview Box

Fig. 12

270

Close Button Selected

260 /262 , Selected Display Subtopics

from overv'ew Subject have below Selected BOX Selected Subtopics Subject

v /264 Current Page = First page on which Subject Appears; Display Current Page

v / 266

Move "You are Here" Indicator to Subject Currently Displayed

U.S. Patent Jun. 5, 2001 Sheet 13 0f 28 US 6,243,071 B1

@ Newton 800 Numbers @

Domestic Air Carriers / 52

Alaska (800) 426-0333 Aloha Airlines (800) 227-4900 America West (800) 247-5692 American (800) 433-7300 Continental (800) 525-0280 Delta (800) 221 -1 21 2 Mesa Airlines (800) 637-2247 Midwest Express (800) 452-2022 Northwest (800) 225-2525 Southwest (800) 531 -5601

274 \\\ Contents Domestic Air Carriers <0 International Air Carriers \ 276 Auto Rental Agencies Hotels, Motels, & Inns Express Mail/Package Service Flowers, Gourmet Food & Gifts About this book

J 272 @I/ 286

Fig. 13

U.S. Patent Jun. 5, 2001 Sheet 14 0f 28 US 6,243,071 B1

Quick Astrology Guide RAT 52 1912, 24, 36, 48, 60, 72, 84 / ox 1913, 25, 37, 49, 61, 73, 85

TIGER 1914, 24, 38, 50,62, 74, 86 CAT 1915, 27, 39, 51, 63, 75, 87 DRAGON 1916, 28, 40, 52, 64, 76, 88 SNAKE 1917, 29, 41, 53, 65, 77, 89

Contents

Birthday Finder <1" 278 \/"\ Signs Of The Zodiac \ 276 280 \_/"\ Chinese Astrology

Year Of The Rat /' Year Of The Ox About This Book

/

282

286

[Xkf

Fig. 14

U.S. Patent Jun. 5, 2001 Sheet 15 0f 28 US 6,243,071 B1

300 {-207

/302 Fig. 15 Display Bookmark Dialoq Bo}

/ 308 I 328

Close Dialog Box ———> A

/ 322 Make a Bookmark

/ 312 < for the Current Search Backwards Page in Book until Nearest Menu is V

Located; Display |S Nearest Menu there

Y already a / 316 Bookmark for

Current Page = l

Page of Bookmark;Display Page of Selected t—— Bookmark

/ 326 Current Page = Previous Page; Display New Current Page

U.S. Patent Jun. 5, 2001 Sheet 16 0f 28 US 6,243,071 B1

@ Newton 800 Numbers @ Domestic Air Carriers

Alaska (800) 426-0333 Aloha Airlines (800) 227-4900 America West (800) 247-5692 American (800) 433-7300 Continental 332 (800) 525-0280

Delta \ (800) 221-1212 0 Mesa Airi'w‘ \' Imam-2247 /' 33 Midwest Mark this page -20 Northwe: ~‘- 525

Southwe| , Return to page 2 -5601

Trans W -2000 Us Air Return to menu [2] 4322

United ) (> \ouu) 2g |—6522 52 334 336 338

4/

U.S. Patent Jun. 5, 2001 Sheet 17 0f 28 US 6,243,071 B1

@ Newton 800 Numbers @

Domestic Air Carriers

Alaska (800) 426-0333 Aloha Airlines (800) 227-4900 America West (800) 247-5692 Americar ‘9-903-433-7300 Continen 0280 Delta : -1212 Mesa Air g 2247 /_ 330 Midwest g -20 Northwe: " 340 —*- 525

Southwe 5601 Trans W 3 -2000 US Air -4322 United , Return to page 2 -6522

Return to menu [2]

334 J

Fig. 17

U.S. Patent Jun. 5, 2001 Sheet 18 0f 28 US 6,243,071 B1

Newton 800#'s

0 Domestic

L ‘ Air Carriers

International Air Carriers

Auto Rental Agencies

Hotels, Motels Inns

Elf‘ Express Mail ~\ 2 Package Service

Flowers, Gourmet E Food & Gifts

@[Xl

Fig. 18

U.S. Patent Jun. 5, 2001 Sheet 19 0f 28 US 6,243,071 B1

209 \ 350

/ 352

Highlight Mark-up Button

354 Are / 356

there any Create View with Marks and Marks 0" the Display this View Overlying

Current Current Page Page ? N / 358

Process Pen Events as Marks on Current Page

Button been Y Selected

I V / 364

ACTIOI'I been Hide View of Marks Taken

? 365

Fig. 19