26
Spell checking when working online E.A. Draffan and Abi James

Spell checking when working online E.A. Draffan and Abi James

Embed Size (px)

Citation preview

Page 1: Spell checking when working online E.A. Draffan and Abi James

Spell checking when working online

E.A. Draffan and Abi James

Page 2: Spell checking when working online E.A. Draffan and Abi James

Children who use technology are “better writers”Zoe Kleinman, BBC News. 3 December, 2009

• Children who blog, text or use social networking websites have better writing skills than those who do not, according to the National Literacy Trust.

• A survey of 3,001 children aged nine to 16 found that 24% had their own blog and 82% sent text messages at least once a month, 73% used instant messaging services to chat online with friends.

Page 3: Spell checking when working online E.A. Draffan and Abi James

Working online - patterns of reading and writing Jonathan Douglas, director of the National

Literacy Trust. • "Engagement with online technology drives

their enthusiasm for writing short stories, letters, song lyrics or diaries."

• "Does it damage literacy? Our research results are conclusive - the more forms of communications children use the stronger their core literary skills." Debate later!

Page 4: Spell checking when working online E.A. Draffan and Abi James

Well-known user-interface, evolved from tools within word processors. “red squiggly line”

Page 5: Spell checking when working online E.A. Draffan and Abi James

How are the students spell checking blogs, wikis etc?

Guildford College – 15 students 6 depended on using MS Word with ‘Cut and Paste’.

32 LexDis participants http://www.lexdis.org some used assistive technologies, others said ‘not sure it is right’ ask a human, others cut and pasted from Word, used Google etc…

34 Post graduate students 4 suggested use of Word, Google search and toolbar or Safari on Mac

Page 6: Spell checking when working online E.A. Draffan and Abi James

Is online word processing here?

Who would win in a fight: Microsoft Office or Google Docs?

Microsoft Office 51% (1365 votes) Google Docs 37% (994 votes) Tie: They're Both Good 12% (315

votes) Total Votes: 2674 (Mashable Nov. 09)

Page 7: Spell checking when working online E.A. Draffan and Abi James

The message from students – Keep it simple!

Page 8: Spell checking when working online E.A. Draffan and Abi James

Performance of spell checkers varies

Page 9: Spell checking when working online E.A. Draffan and Abi James

Performance of spell checkers varies BUT so does usability

Page 10: Spell checking when working online E.A. Draffan and Abi James

PersonalisationWill this do for all of you? Showing one size t-shirtNo that won’t fit me We are all unique with individual needs and requirements

Page 11: Spell checking when working online E.A. Draffan and Abi James

So how accurate are spell checkers?

Test:

1. Single word spelling errors (or non-words)

2. non-word errors and real word errors in context (controlled sample)

3. non-word errors and real word errors in context (free writing example)

Page 12: Spell checking when working online E.A. Draffan and Abi James

Non-word error testWhy? assess the accuracy of spell checkers and particularly how close to the top of a suggestion list the target word occurs.

Used database and tests from James & Draffan (2005) of errors made by dyslexic adults and children in free writing and spelling tests

1.Random sample of 96 errors, includes duplicate errors for the same target word

2.Random sample of 30 miss-spelling for 30 words from publically available sub-section of the James & Draffan database.

Page 13: Spell checking when working online E.A. Draffan and Abi James

Single non-word error correction accuracy

Page 14: Spell checking when working online E.A. Draffan and Abi James

Single non-word error correction accuracy

No updates Results may be updated from users errors

Results may be updated from server database

4 7 1 6 (1) 1 1 0 0 7

Page 15: Spell checking when working online E.A. Draffan and Abi James

Some checkers can also correct real word errorsReal word errors can be a caused by a…

Homophone e.g. piece / peace Typing error, e.g. form / from Spelling error creating a real-word which a

poor reader is unable to detect e.g. told / fold

Homophone checkers identify homophone and suggest alternatives spellings

Contextual spell checkers claim to be able to identify and correct any real-word errors.

Page 16: Spell checking when working online E.A. Draffan and Abi James

Some checkers can also correct real word errors

Page 17: Spell checking when working online E.A. Draffan and Abi James

Testing contextual spell checkersNot based on a wordlist or lexicon. Need to:

– Identifying the real word error– Suggest correct word

Reasons for failure, in order of magnitude:

1. Not identifying the real-word error (false negative)

2. Identifying a correct word as an error (false positive)

3. Identifying a real-word error but not suggesting the correct word

Page 18: Spell checking when working online E.A. Draffan and Abi James

Test 1: Controlled data Created 30 sentences, each containing a

non-word error from the James & Draffan (2005) database.

Then added a real-word error to each sentence.

Real word error could be: A homophone e.g. need / knead Letter transposition , addition or removal to

produce a real word e.g. bank / blank Similar looking or sounding word e.g. involved /

evolved

Page 19: Spell checking when working online E.A. Draffan and Abi James

Results of controlled data

Page 20: Spell checking when working online E.A. Draffan and Abi James

Test 2: Free writing example74 word paragraph by a year 10 dyslexic:

He duse this at the begen by saying about this purson “sat in a wheeled chair, wating for dark,” now Owen in this poem starts off if he was fare away from the solder like he is looken on to the solder. Then leter on in the poem he get moor clowser to him and sturts to discrid his amosins and even get the reader in the amoshen like if you where the solder.

11 non-word errors

7 real-word errors

Page 21: Spell checking when working online E.A. Draffan and Abi James

Word 2007 corrected version

He does this at the begen by saying about this person “sat in a wheeled chair, waiting for dark,” now Owen in this poem starts off if he was fare away from the solder like he is looking on to the solder. Then later on in the poem he get moor closer to him and starts to discrid his amosins and even get the reader in the amoshen like if you where the solder.

Page 22: Spell checking when working online E.A. Draffan and Abi James

Google toolbar corrected version

He duse this at the begen by saying about this person “sat in a wheeled chair, waiting for dark,” now Owen in this poem starts off if he was fare away from the solder like he is looking on to the solder. Then later on in the poem he get moor closer to him and starts to discrid his amosins and even get the reader in the amoshen like if you where the solder.

Page 23: Spell checking when working online E.A. Draffan and Abi James

Ginger corrected version

He does this at the begen by saying about this person “sat in a wheeled chair, waiting for dark,” now Owen in this poem starts off if he was far away from the soldier like he is looking onto the solder. Then later on in the poem he gets more closer to him and starts to describe his emotions and even get the reader in the emotions like if you where the solder.

Page 24: Spell checking when working online E.A. Draffan and Abi James

Conclusions Online working is a reality but learners don’t

adapt the same proofing strategies as off line working

There are many spell-checking tools that can be used with online work But their usability and accuracy vary Who knows of their existence?

Contextual correction has arrived REMEMBER – keep it simple & personal

Page 25: Spell checking when working online E.A. Draffan and Abi James

Contact Details

E.A. Draffan

Learning Societies Lab,Electronics and Computer Science,University of Southampton.Mobile 07976 289103E-mail: [email protected]

Abi James

Iansyst Ltd

Cambridge

01223 420101

E-mail:

[email protected]

www.dyslexic.com

Page 26: Spell checking when working online E.A. Draffan and Abi James

Useful Links

LexDis Project website:www.lexdis.org

James and Draffan (2004):

www.dyslexic.com/accuracy