A A ANI KATA DE - patentimages.storage.googleapis.com · U . S . Patent Sep . 12 , 2017 Sheet 3 of 17 | US 9 , 761 , 226 B2 32 mement , METHY WWW R3 : ?? REFFFFFFFFFFH? EX HERAM TELYSSER

A A ANI KATA DE US009761226B2

( 12 ) United States Patent Michaelangelo et al .

( 10 ) Patent No . : ( 45 ) Date of Patent :

US 9 , 761 , 226 B2 Sep . 12 , 2017

( 54 ) SYNCHRONIZED TRANSCRIPTION RULES HANDLING

USPC . . . . . . . . . . . . . . . . . . 704 / 235 , 251 , 260 , 267 , 270 . 1 See application file for complete search history .

( 71 ) Applicant : MModal IP LLC , Franklin , TN ( US ) ( 56 ) References Cited

U . S . PATENT DOCUMENTS ( 72 ) Inventors : Nixon Michaelangelo , Bangalore ( IN ) ; Dennis Graham , Berryville , VA ( US ) ; Doug Smith , Berryville , VA ( US ) ; Paula Appley , Walla Walla , WA ( US )

( 73 ) Assignee : MModal IP LLC , Franklin , TN ( US )

( * ) Notice : Subject to any disclaimer , the term of this patent is extended or adjusted under 35 U . S . C . 154 ( b ) by 0 days .

5 , 148 , 366 A * 9 / 1992 Buchanan et al . . . . . . . . . . . . . 715 / 234 6 , 377 , 922 B2 * 4 / 2002 Brown et al . . . . . . . . . . . . . . . . . . 704 / 251 7 , 613 , 610 B1 * 11 / 2009 Zimmerman et al . . . . . . . . . 704 / 235 7 , 869 , 998 B1 * 1 / 2011 Di Fabbrizio et al . . . . . . . . 704 / 251 7 , 933 , 777 B2 4 / 2011 Koll 8 , 024 , 196 B1 * 9 / 2011 Wodtke et al . . . . . . . . . . . . . . . . 704 / 277 8 , 583 , 439 B1 * 11 / 2013 Kondziela . . . . . . . . . . . 704 / 267 8 , 694 , 309 B1 * 4 / 2014 Fisher . . . . . . . . . . . . . . . . . . . . . GIOL 15 / 19

704 / 216 9 , 015 , 047 B1 * 4 / 2015 Fisher . . . . . . . . . . . . . . GIOL 15 / 08

704 / 251 9 , 244 , 901 B1 * 1 / 2016 Murata . . . . . . . . . . . . . . . . . . . GO6F 17 / 27

2002 / 0077819 A1 * 6 / 2002 Girardo . . . . . . . . . . . 704 / 260 2004 / 0254816 Al 12 / 2004 Myers 2005 / 0071194 A1 3 / 2005 Bormann

( Continued )

( 21 ) Appl . No . : 14 / 310 , 557

( 22 ) Filed : Jun . 20 , 2014 ( 65 ) ( 65 ) Prior Publication Data

US 2014 / 0303977 A1 Oct . 9 , 2014 Primary Examiner — Douglas Godbold Assistant Examiner — Mark Villena ( 74 ) Attorney , Agent , or Firm — Blueshift IP , LLC ; Robert Plotkin

Related U . S . Application Data ( 63 ) Continuation of application No . 12 / 606 , 823 , filed on

Oct . 27 , 2009 , now abandoned . ( 60 ) Provisional application No . 61 / 108 , 646 , filed on Oct .

27 , 2008 .

( 51 ) Int . Cl . GIOL 15 / 26 ( 2006 . 01 ) G06F 17 / 27 ( 2006 . 01 ) GIOL 15 / 22 ( 2006 . 01 ) GIOL 15 / 06 ( 2013 . 01 )

( 52 ) U . S . Cl . CPC . . . . . . . . . . . . GIOL 15 / 26 ( 2013 . 01 ) ; G06F 17 / 273

( 2013 . 01 ) ; G06F 17 / 274 ( 2013 . 01 ) ; G06F 17 / 2725 ( 2013 . 01 ) ; GIOL 15 / 063 ( 2013 . 01 ) ;

GIOL 15 / 22 ( 2013 . 01 ) ( 58 ) Field of Classification Search

CPC . . . . . . GIOL 15 / 26 ; GIOL 15 / 183 ; G1OL 15 / 187

( 57 ) ABSTRACT Methods , systems , and software are disclosed for providing rule handling functionality in a distributed transcription environment . Some embodiments provide client - server workflow management for providing and supporting distrib uted transcription services . Other embodiments provide audio - to - text synchronization to support certain transcrip tion functionality . Still other embodiments provide logging functionality to support quality , personnel , billing , and / or other enterprise tasks . And other embodiments provide functionality to support rule generation , editing , validation , and / or execution .

37 Claims , 17 Drawing Sheets

100

120 - 1

User Site

o use 120 - 2

Department 124

User Site 1241

User : 154 Customer

194 1 Customer

124 Userung

124 www124 LU 140

Quality Control Site 143 142OS Mertor - - - Home * 2 142

Mertou 134

onsoronist 1444 Editor Horkfur Markize - - > Transcriptorist 166

Auditor Audiot 144 346

350 Editor

Customer

130 Customer Site Transcriba

1 . 34 Customer 154 Transcriptionist

134 1 . 34 Transcriptionist Ventex

142 Transcriptiorst Sile

| US 9 , 761 , 226 B2 Page 2

( 56 ) References Cited U . S . PATENT DOCUMENTS

2006 / 0041428 A12 / 2006 Fritsch 2006 / 0212292 A1 * 9 / 2006 Laulvergne et al . . . . . . . . 704 / 235 2007 / 0106494 A1 * 5 / 2007 Detlef … … … … … … … . G06F 17273

17049 2007 / 0203708 A1 * 8 / 2007 Polcyn et al . . . . . . . . 704 / 270 . 1 2007 / 0299652 A1 12 / 2007 Koll 2007 / 0299665 A1 12 / 2007 Koll 2008 / 0091426 A1 * 4 / 2008 Rempel . . . . . … . . . G10L 15 / 26

704 / 251 2008 / 0255837 A1 * 10 / 2008 Kahn et al . . . . … … … … … … . 1704 / 235 2009 / 0055184 A1 * 2 / 2009 Hebert . … … … . … … . . G06F 17 / 2705

704 / 257 2009 / 0113293 A1 * 4 / 2009 Schubert . . . … . … … . . . . G06F 17 / 24

715 / 256

* cited by examiner

U . S . Patent Sep . 12 , 2017 Sheet 1 of 17 US 9 , 761 , 226 B2

10

120 - 1 0

124 User Sie 120 - 2

User 125 Musixation

10X Departytent Usar Site

12 : 41 User 144 154

Customer CuSOTA 12 0 00000000000000 wwwwwwwwwwwwwwwwwwwww fas 124 mm

User www

Det AVTYAXLAVA VYSAV

REEEEEEE

* 24

40 maart { { y . , { { ? 142 $ 42

Monitor Merilor 144 134 Workflow

Manager 134 - - -

140 - Editor { p } } www wwwwwwwwwwwwwwwww Auditorium

Editorial manyte Auditor

4 146 Hoitor

www

one event that

144 in 150 but QUS00 & ri 157 or the

C omer Site W Transcripbonisi

www 134 mm } { { ??? .

ter ARENHALA { " ????is : 1 . 34 ???

wwwAAN

Mentor 39 : 40103VEL 142

Transcriptionist Site

U . S . Patent Sep . 12 , 2017 Sheet 2 of 17 US 9 . 761 , 226 B2

Turnet 16 Preservers

?? ? Sexy REGIS NHHHHH * * * * * HHHHHHHHHHH * - - more MMMMMMMMMMMMM4444444444 ? ANNAMIYAMATHE M - N900MM

- - wometernamewerence & & &

htthhhhhhh SY SE Processing MOMONOM

PS4??1000 AC . ??? Ster

MA .

arenamewow HAMAHAS MMMMM , 66MM , M

Mixt / KHCO ?

? % A - M . Y? 4h???y MMMM ?

= ?

MANASON? ? TASKipTMS??

???????????????????????

177?? F essing

Woose Room

u sinaimage ? ffff A iriti Li 888 ?

M rigine .

SHAPPERHAMM A

WinRunning wow .

MAMAHA MMMMMMMMM ,

Wood http : / ?

OOOOOP , Henter

SY : ?TF ?

ster CSS … … … … … … ticatics htthhhhhh AAAAAA ' MMMMMMMMMMMANNAAAAAAAniminipin

VENNNNNN N NNNNNNNN?

s

MAMMMMMMMMMMA AIR ? ” Egg FSC ? : GERSEXY .

Priusn = 1 HAM

? ? .

MANAAAAAAAAMING

.

? ?

.

MM ?WWEARNINEMAN , ? 94 Stevie ; … … 3 . SiriticSx

??

WOW ? , ?

U . S . Patent Sep . 12 , 2017 Sheet 3 of 17 | US 9 , 761 , 226 B2

32 mement ,

WWW METHY R3 : ??

EX TELYSSER

WWWWW REFFFFFFFFFFH? HERAM ?? : FFFFEE Sky

HAMAHAHPLLS

HHHHHHHH } { ? EXC? SWS

?? MMMMMMMMMMMMMMMFFFF … … WHAMAHAMMMMMMMMMMMMMMMMMMEWHERMAN F WWWHHHHHHHHHHHMMMMMMMMMMMMMMMMMMMMMMMMMMMMM ?? HANNAHAMAHA WHArrrrrritientin HHHHHHHHHHHHHHHHHHHFFrierry rrenter

?

www . sundM dnew Air

? ?SS STER

Transcription ????

HANNHENNHEIM ?STENTS M mmmmm

AA + + + + + _ EffffffFFFFFFF

Ykf } & www . nt SES

hanna SS www Nissic Sir ?

F11

33

YSP - S? askF RS?

? traWANMAtter STANMANAKAMAHAINMINMENHANNIN MMMMMMMMM .

Pro ASSY ?tersite

conograssweeke t1

?SC? : Assignight = ?

RSSD ? HHHHHHHH???????? ? ???????

CSYS

,

US 9 , 761 , 226 B2 _ Sheet 4 0f17 _ Sep . 12 , 2017 US . Patent

$ ? fkKXXK33 ??? fj ????

?????????? 8 ? 8 ???

rp4 ? ????? % ??? ? VW ??????????????????? $ $ $ immed ?

??

: ????? . : urr rr · _ : mw

?????????????? ? w ? * * *

tmm ?????????? ????????????????????????????

? . ; : ( ??????????? ? ? ???????????????????? ?????????????????? ?

vk vvvv + 4 + v v ?????? ? ? ? ? ? ) * ????????

???????????????????????????????

??? ??? ????? ? ??? ?????? ????

4444 ? ????????????? ? ? 14

fe ; ; ; ?? fi ??????? ????

??? ? . ti ???? mr www ? ??????? www ???

???????????? ; A ; ; Kffc ? v AyyAviv Avv . ??????????????????????????????

' ??? ? ) faxf www . wwwvwww3 ???

8 « ' ?

???????? ? ????????????????????? ?

????? ??????? . ????? . ? ? . ??????????? , M ????? ?? ??? ??? ?? ? ? ? ??? ?????????? - - ?? ? ?? ?? ?? ? ? ?? ??????? ??? ?? ? ? ?? ? ? ? ?

{ { { ) 2 Vi { ? ? ? df & figk 4444444444444???????????????????????????????? ??? ? ? ?????? ? ; ri : ??? ?? n ??????? ? ?

vn +

+

v

? ? * ? ? ? ??? ? ? ? ???

??????????? ??? ? ?????????????????????????? ??????????

? $ ? ( ; &

???????????

23 ?? ry ???????????? ????????? ??????

? t ? X ?????? > ?????????????

: ????? graqswramus « .

greger ,

indic ?????????????????? 59 - .

£ro ???????????????? ? ? . - ??????????????????????????????????? ? ? ? ? ? ???????? ??????????? n 4

:

;

?

?????????????? ???????????? wwww

????? oldu Sue

f ???????

???? ? ?? ? ?????? xxvnam ??? ??????????????????????? ? ? ? ? ?? ?????????????????????????????? ?????????????????????????? 433 ? . ?????????????????

? ?????????? ???? ? . ; f3 ?? ???????????

textOscEX ????????????????????? P { { { { { { ; : f ? V iigik

* * * * > - * * * * * ? * * * * * * * ý * * * * * * * * * * * * * * * * * * s? ? s * * * * * * * * * . * vs "

??? ; -


500 ,

* n e w me , * ~ … * * * ~ … - ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ '

«

» ' '

» Dea ) * * '

{ } } } { . k Aii { 3 ???

?

}? ??? ?

{ ? ? }

S?? } . ??? ' '

?? f

Laç . ???

Sr * * * * *

* * * * * * * * * * * * *

»

? ~ * * * ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ *

1?? ?

+ +

???? ???? { 4

???

{ 4 5Q "

{ t { { { { $ | = = = { { { { 3 }

} } } } { s

Sa?? ? y C { }

????Y aa } } { }

a fe } ? kuk

- - - - - - - - - - - - - - - * * * * * ?? ht Cursurications Sirdsystem

* WWWF ????? ( 2 { a } Working ???? ?

{ < $ wwwwwwwwwww . p

kid atiY sl?????

Network AA { } } } } } d?

{ P } ?????? :

* - - * * * = * * * * * * * . ' - ~ *

? *

? *

.

« « « « « « « « « « « « « « « ?

* K )

P ( { xc } { { { } } =

FQZSS . ???

1 ?g

{ { } ? P ces } } } ?? *

*

* * * * * * * * * * * * . ' A . . . . . . . = * * * * * * * * *

F { G , ???

U . S . Patent Sep . 12 , 2017 Sheet 6 of 17 US 9 . 761 , 226 B2

AirA

SE ?????????? W

????SN

WW

shippetter xxx CSSSS )

SNIS ?? Ryzes

TOYS?? ?? ? ????

| RUE ?

YWELLER

MMMMMMMMm m wwwm a sure som ww tem errary

? , htter SYSTE : BENERS SAGEST ; mmmmmm

“ ???? ????ty HHHH H ' ?? ock

?? , w

?

gay ? MMMMMMMMMMMMMMMMMMMMMY PTT AAAAAAA )

SSSSS SIS

remen erren therm , www . sin we any wave we ' ou wo www we wan 4

MMMMMM

??SSEY ??? : ??

every | ?? ,

| www . e

AAAAAAAAAmerry www . mmmmmmmmmmmmm * * * movemmmmmmm . .

new My Rangersitem , www . w y . · · Instin , HHHHHHH ”

? ? ??


600 500 wwwww * * * * * * * * *

Receive dication data from user W * * * wwwhattualetewa * * * *

608 ddddddd wwwww

Generato transcuption assignment based on diciation data wy 4444444444444TLETTERE

- Assign transcription assignment to Transcriptionist wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww

wwwwwwwwwwwwwwwwwwwwwwwwwwww . i Syectopizo Gian WorkOW and data with server Workflow and sata * * As

wwwveer ??????????????

n Meceive draf transcription product olm * * * * * *

*

wawi

Valdato submitted transcription oroduct www www

Valid ?

* * * * * * * * * * * * *

Geronto final transcription product froin valiosted transcription product

VAYYYYYYYYYYYYYYY 222

Deliver final transcription product to customer wwwwwwwwwwwwwww MAMAN

???? Ww LLY * *

Log relevant information from assicuriant anima Law

?????? ??????

Clean up client dala wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwsikikialaman


700 meny 700

70 VenXXW WWwwwwwwwww

Accept new or saved anscription Skont from transcription worklow

W herever

708 Ut

? : : 18 ? } as?????? sociatexiata

wwwwwwwwwwwww

712

Transcribe asicament W wwwwwwwwwwww

AWAKALA Query information

rules wwwvvwvvwvvitit

*

* * * * *

Subat osatt transcription product *

*

W AAVUTTAVAT * * * wwwwwwwwwww w ww *

* *

{ z } } t?? ? Q1160CFYONS

* * towa WWWAAAAAAKKAAKOFFER XXN

Receive error feril

der

m mmmmmmmmmmm Blocking rules violated ? more than

Wwwwwwwavn * * *

Www UKRYWKA

Validate submitted iranscription product WY

740

Valla ?

W W WAAA44444444

Ffzz tan } { } { } { } { { 2 } }

FIG . 7

en men woman . com U . S . Patent Sep . 12 , 2017 Sheet 9 of 17 US 9 , 761 , 226 B2

wwwm V YYYYYYYYYYY

Receivegergrate fequest for mewoodatad rule roluding a set of rule requiexerts

wMHR

wan

Initialize rule builder wwwwwwwwww .

812 in

Tarsiate ule requisitients into a role function congatible with the rate exito

Mirimizi

* * * * * * * *

Valinate rules logic *

SYYDENWwwwwwwwww Luiz * * wwmizin Valid ?

824

asigi validated me to hierarchy javels in rules engine

4 4 24 * * * * * * * * * * * *

hayat 222222222

Publish validated rule to cules engine ww

FIG .

US 9 , 761 , 226 B2 _ Sheet 10 0f17 Ser . 12 , 2017 US . Patent

. ; { Pf ? ? v?

? ????? ???????????????? ??????? . ? . . ; xef ? ? ? ? ? ?? ? ??? ' A ' . . ? ?? ?? : ' " . ; ; r ? ??? : ; ' : ? ?? ??? ? ?????? ? ? ? ? ? ? : ? ? ? ? ? ?? ? % } % 3 ? ? ? ? ? ? ? ? ? ? ? ???? ?? ? ? ° : ???????? ? ??? : 43 ; : ?? ??? ? ? ? ? ??? ???????? 3 : ???? ? ? 33 . cf ???????????? ; ; ; ? ????

. 3 ? ? ? ? ; ?? ? ? ? ) » ' ; . ' ????????????? ; . dxcd ; ? ? ? £ ? $ $ ; N N ; } % $ ????????? $ ?????????? ? ? & ? ???? ? ?? : & V : x { ' . . ??? 3 ? $ » ? ; x diffe ? ??? e : ; . » ??? ? ??? ? . ?? ? ????? . . . 3 : x : 8 có th? s? XV . . hóa ve s - thi hàng chi và 3 Ms : 7 : ? . . . ? ; ] ; Q ?? ? ? : ??? ? ??? . ?? $ ? ????? ????? ? ? ? ? ? ? ?

? . . . . . . ; ; f ; * ????? ? ? % . . ??? ? ? ?? ??????? ?

? ? ? ? ? ? ?? ?

? ? ? ? ? ? ? ???? ? P : ??? ??? ?? ? ????? ? ? ? ; ; ; ; ; ? & ? ' . . ? ? ? ? ? ; $ ; ; ; ; ; ? ????? ? V - ; ???? ; » ; Ss " ? ? ? & Forro ? ??? ??? ? ? ? ? ? ? ? ? ? L . ? ? ? ? x ? ix . ; : th ? ?? ? ? : : : ? ? . ???? . ? ? ? ? ? . . ???? ? . . ?????? ?? ????? ?? ? ? ? ? ? ? ? ? ?? ? ? ? ? ? 24 ? ? . . . ? ????????? ????? ; ? ? & & ; s ??? ????? ????? ? ? ? & ??????? ?? ???? ? ??

. . ? ? ? ? ? ? Giaº ! xe x Ka . . x . . . . r?ng x x x 3 (

. . . . x

c c k N3 thi

x 4 : Ni và cài

| xe inh ? các thí s : 3 ? ? ? ???? ? ?? ? ? ; » .

? ? ? ??????? ? ????? ??? ????? ? ; ) ? ? ccxui

' : : : : '

. ?? ? ? ?? ??? ? $ ; ? ? ? ? ? ? ? . ? ' ' ?? ??? ? * ' ? ?

ri ? ; » ? ?? ' ? [ : ??? ? ? ?? ? ; . . . ; : . x : ;

???? : { ? ? . : . ; : : -

? : ? ? ? ? ? : f : ? ? ? . ??????? ? ? ? ? ? ; R fkkk ? ?

- R ? ? ? ???? ? € ; ??? ? 3 - 4 x ca si . . - t? - 21 - 2 t? 2 8 : 00 N 1 : . . x 8 . 9 : N ? : 4 ? ? 9 : 29 $ ; ? ? ? ? ? ? ? 4 ? ? ? ; : cum ' ?????? : 4 ? ? ? ? 03 & : ' ' $ $ ???? ???????????? ???? ? ?? ? ? ; ; ; ; ; ; ; ° ? ??? 8 ? ? ? ? ? ; ?? ? ? ? ? ? ? ? ? ? ? ? ? ? xf '

? . . 83 ??? ?? . * ????? ? ??? ??? ?? ? ???? r ; ; ? ? ??? ; } ? ? i ; » ; Ch ; ' . . . ?? ? ??? ; COrfix : 5 : > 3 ????? ? : ; X XV . ? ? ? ???????????? * f t : ????? ????????? ; ;

3 . ??????? ?? ????? ; ? ? ; : : : ; . xx ? : ? ? » : X

? ??? ? ?? ? ? ? ? ? ????????? 3 5 : . ' . . . .

: * : * : * : * ha C 4 . ??? ? ??? ????

P { G . 94

300 ????

?????? ? ??? ??? ?????????

?????? ? ????? ????? ; ; . ? ???????? - ? ? ; ? ??? ? ????? ?? ???

??? g « ; r ; 32 ????????? ??? ???

??

? ???????

?? : ??? ??????? : me & - ????????? ??????????? ? & : i ??????????? - 43 : 8 - f ? ;

? | ? % xf " 46238F ???? ; » xf " ? ??? ; ; £3 ?? ? : ? ?? MA

? ? ? ? ? } ? Si

8 ??? ? 69 ???? ????? ? ? ? ? ? ?

?? ? ??? ???? ?? ??? ? ?????? ????? ? ? ?

????? ? ?

? ????? ? ?

98 . G } ?


1000a

Fonctionne SS3

14 . 1 . 1 . 1 ,

la pa

min rections Swarmer Bootprakse ( Documin och lining marks Szalon Ixongs Slaveno Tabelce .

Womer Norinsk Evo de nie okies Society Stadio Tao pagos TO Page Lolik ? ? WWWWWW 2267

R ise SON DOES NO www SCAR

WiiN S *

FIG . 10A

th

om www

Swad

olac OSTAIN Bio Of le

medicatori Down Body brains noknak Sa Has Sitio 1 b . pages and Laokuje

* Cars roman

Ernsrad Valve Birde Bicknak Set Kenge Staro 13439es Tot fage 0

KLBOS Roll Upsala NY

LI 003875

FIG . 10B


10000 elementoni

. . . . . . og B dosad 27 .

EXPRESS XX

5 oard

GEODESIGN osika Contors Custom Damen Booty rter tooks

keus

WA

WA Su Tesis Pat Page Lady Lane

Suas 12 . 17 . . Wswira .

UN

Elence AS9NE 7 : 4

24 / 7 Questo Pinotex No Arpitskle

FIG . 100

10000

Det er 1997 .

Slats at Po Tafas le

0031 WWW XXXX lain ! CMS

soms oorks . parissent Body Cage net sookouks Amante

GARET Omsorgedalt Static Iso Mason

M arinelas : : : : :

e GTX . . ww TI W ' W ' WWW W W

OG

FIG . 100


Se expressione

olotica Motorola Moto

L 30 anos Sin Costante ??? - . . ???? ? Sarti

S

ast ( 3800 ms tone Bookmik

ROKA en leuristus

slala sages Tags Lodkarp

within SCHWA

Frete w

FIG . 106 1000€

Semenskin line Mwisho vode istenene este eismo morate acest tutores

Semina Val a poco ges

WWWWW Par

W home non stora Jankierky

Set Custom Bootika It ' s king

29 FaNarva Hallra Aystk VIK sWbPixiv wir

08

the force * * * *

FIG . 105 10006

Randers S

Search

orazons Qus a rki Dogmont Rods

Sooksmaka X

et la promotie Swaze

Paga los X

:

Whion ATX

spriever

FIG . 10G new 10000


eneration 10009

EXT ? ?????????????

: . . . . wN Star WW : Lange av Correos unter Bookmake

si B W

Wo Tao Mars galvos AY . VY .

Benia colmarks Sektedirgs vinasHAWI - ?????? 4 % 5 ???????????????????? ? ??????? 5 - 1 ????? . . . . . . . . . . . . .

* OMAS Okty Intex

LLLLLLLLLLLS ? ?? ??? ? : ?? ?? ???? ???? 1 ???

immer

FIG . 14

9000

SEMENTS But XXXW

xx box WWW .

Remix Deck Set we W ieszance WWWWWWW

Wai ?? ??

YB KIWN AS haricis Amon

> > NON 01xers ? : : ?iers : :

Chwactersin Chiw : * Dot

3XSHOP Welva OX Omanik Ochrona OS FEE DERSEN

2 :

www . Seard Search Cearce SMS

Y .

FIG . 116


300C MICHA Gia

WY Bussi les ne sommeren se s * kobe sa

Ww WWWXXE XSseXXoc - OS vestirs AVC KW * * * H O , 100

DONW S Siden sich XXXXXXXXXXXWWWWWWWWWWWWW

N o es Agassi Sot 2 . Se os usgs « WELL AS

B ESKN

* * Sex Um u pala

Promena CHEK . Andoxe Oso onde

Sam i fi : Sex

wwvwwww

Somet St andard WW

FIG . 12

teething

hin hii

m issioni

Com

. . . .

FIG . 13


1400

green E ????? ?? ?? ??? ???? ?? Metapplicatio www

Addres Sivuar NY ??????????? ?

STAQonun cixsan , *

WWW W w ? ? ?

S Y . . . .

Power voit mulle Voit mosbe w

. ' : ' : Www :

. ' , '

. . . . . .

17 . MWANAM 11

Delete ard or i W

nin ????????????

FIG . 14

US 9 , 761 , 226 B2 Sheet 17 of17 Se [ . 12 , 2017 US . Patent

; ??? ? ?

? & $ ; ? .

?? ? ???????????

,

? ?

" : 383

??? ?? ? ???? ? ? ; » ??? > ? ???? ? ? ? ? ) ???? ? ? ??????? ? ????? ? ? ??? ??? ; ' . ? ? ? ? ? ???????? . ? . . ? ??? . ? ? ? ? ? ? ? ??? ???????? ? ?? ? ; » ????????????? ? ?????? ? . ? . ???????????? ; ; ? ????? ? & « c

? ???? ??? ?? ?? ? ? ??? ? ????????????????? - Qia q r ; ? : ? ? * * xyy ????? ????? ??? ; . Fix ? ??? ?? & ; tus ? : ; , ; ? ' 3 ? ?? ? ? ?? : ; ? - ????? ? ???? Nik ? ? ? » ; ; ???????????????? ???? ? ? ? ? ? : :

???????? ?? ? ) ; r ' fxoq - xxx - * ( ; - X ' ???? ; ' xx ; ( ics « ] ???? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ???? | ?? * ; ; 3 Ruk y : ; * ??? » ? { ? ? ? ? ? ? ? , ???? ? ? ??? ' ???? ?????????? 8 : 33333

? ? ????? ???? ? ; : ??????? ; ; - cri £g ???? ? ? 23 ? ?? : xfex ' ; . . . . . . . . . . . . . ?????????????????? ? ? ? ? ? ??????? ????? ?????????? ' x ; . ; ? . P ; : ) ' ? ?? ? ???????? ' ?

* ; x£ « - ?? ? ?? ???????? ? ? ??????? ?? ? ?? ? ; : ? ? ?????????? ? ?? » w ?? ?? ? ?????

rc ? ? »

: . ? - « ?

? ? * ; ? ? ? ?

? ?? ? } ?

code ? ? : ? ? % . . " . ' - " . ? ? ' . : - ? ? ??? ?? … . . ?

????? ? ? i ?? ? ????????????????? . . . . . . ?

?? ? ?????? f ? ? ???????????????????? ??? ???? ? ; iri ? . ? ? ?

? ; 6 ; ; ; ; ; ; ; ; ; i ???? * ; ? ? F ? ? ? ? ? - fg ? f ? [ igf ?

+ » f ???? » ; cxf ? ; ; X

. - ?? ; ?? ??? ? ??? ? ; x f . ? ??? ? ?

?? ? ; : ???? ? ? ? ? : ; ?

$ - * * * *

r

? ? ? ? ? ? ? ? ? . -

wins -

www -

? ? ????????? ? ; ; ??? ????????????????????????????????????????????? . . . . ? ?? ???? ????? ;

?? ? ????????? ???????????????? ? .

r

???? - - ? ? ??????????????

???????? ?

? • • • • • •• • • : : - - - - - ???????? . ? . ?? . ? ? - x - www - . ?????????? * * - * * « ??????????? ?????? ? ? ? ? . ? * * - » * : ii ixiiiitr " " . - - * ?????????????????? * * * * ? - ? ? ??????????????? ?

8 % 3 . ? % 8A

fa ; ???

??? ?????? ?? ? ? ? ?

: 2 ?? ??? ? ?? | ? ? ? ???? ?????? ? ? : ? : ? ????????????????????????

ef ; ; ; ; ; ; ; BbX ; : sz ??? R ; ; w ?? - ; ; . ??? ? ? ? ? ?????? ?????? ; « r qiq ; rcyq ) ; f ' 5 * * bikers = te tip : x 8 = $ $ $ 3 : * * * * na na na x Na na

?

: ? ????? ? : : : ?? ???????? o ? ; ; ? ; f & . effos ?? ???? ; - i ??????????????? ; & Y ' & A " ????????? ? ; : warrinxri - ?? wwwwaw - "

www

? ; wwwwax ra

fx £x : Vox .

difficult . * * she is xº so * * * * * ?????????????????? ? * ? ? ? , ari ? ; ; » ; ?? ? ? » ; ; ????? ? ? ? ? ? ????????? ?

?? ; ? ? ? ; ; Fir - y X « « , ? ? ? ? ; ? » ? ??????? ???? ? ? ? R ? q ? $ ; xxx - ???? ? ???? hf ? ? & ?? ??????????? ? ??????? ? ?????? y ?

???????????? ? ? ? - SKkk ( ir » ( ? 3 & * * ? ; ; ???? ? ? ?????????????? r «

* * * * * * * * * : * * * * * - - - - - - - - - - - - - - - - - - - - ? ?

+ RA six y ???? ? ????? ??? ; ? R » ! ) . ? ww ???? ??????? mw $ $ p ( . . ???? ??? ? ?? : ? ? ? s

???? ?

3w - . ? ? ? ? ? ? ????

. ? £ ? ? ? ? ? ??? : ????

" " " 4 . 153 8 x : x : 4 . : * * * * * * . ? A ???? ? ? ? ? ? ? ? '

????? ? ? . . ? ??? ? ??????????????? ???????????????????????????????

rxx ? ? ?

????? ?? ? ??? ? ?????? ? ? ? ?

? ?

? ? :

? : ? ???

?????? ? ; » ?

' ??? ???? ? ? xay ; » ????????????

? ??? ????????????????? $ ???? : ???????? $ ; ? ? . ?

? ??? ??????? ? . t ras . 4K

? ? ? ? ? ????? : ; : ????

???? : ? ? ? $

?

? ? ?

M ????? ? www ?????????????? ?

?

: , ? ? ?

???? ? . fifh : x - ? ??????? s ? . ????????? ????? ?

? ? ??? ' : . ? ????????????

? ???????????? ? ? ? ?????? . ???????????? ????????????????????????????????????? ? ? ? $ - ici ? ???? : - ; ?? ? ? ? ? ? $

? ?????? . ' . ' . . : " ? ? . ? . ? ? ?????????????? ? ???????????? ? ????????????? ???????????? ? ??? ???????? - * ??????? * * ? ? ? ? ? ? ? ? ???? . ' . ? ? ? . ? ?

% 8 Fi

US 9 , 761 , 226 B2

SYNCHRONIZED TRANSCRIPTION RULES violation being associated with a textual representation and HANDLING substantially synchronized with the corresponding portion

of the dictation data ; and displaying an indication of the rule BACKGROUND violation to the transcriptionist via the computer - imple

5 mented transcription environment . Embodiments of the invention are related to transcription According to another set of embodiments , a system is

services and , in particular , to systems and methods for rules provided for rules handling in a distributed transcription handling with respect to distributed transcription services . system . The system includes a transcription module and a

In certain industries , transcription services may be pro - validation module . The transcription module is configured vided to support the recording and flow of information 10 to : receive a transcription assignment , the transcription between multiple parties and / or formats . For example , in the assignment having : dictation data comprising audio infor medical industry , doctors may gather information from a mation dictated by an author into a dictation interface , the patient and dictate the information into an audio file . Tran - author being associated with a context designation : and a scriptionists may then transcribe the dictated information transcription rule set being one of a number of transcription into it textual format for charting , compliance , and / or other 15 rule sets stored in a rules data store and generated for record - keeping uses . application to the dictation data as a function of the context

In some cases , transcription services are provided within designation ; receive transcription data via a computer a distributed transcription environment , in which transcrip - implemented transcription environment from a transcrip tion functions are distributed among multiple entities in tionist via a transcription interface , the transcription data multiple locations . With a distributed workforce , it may be 20 including textual representations of corresponding portions desirable to implement workflow management , rule han - of the dictation data , the textual representations being at dling , quality control , and other support functions . These least partially synchronized with the corresponding portions support functions may help to maximize accuracy and of the dictation data ; and generate a draft transcription efficiency of transcription services . product including the transcription data . The validation

25 module is communicatively coupled with the transcription SUMMARY module , and configured to validate the draft transcription

product to generate a validated transcription product by : Among other things , embodiments of the invention pro - identifying rule violations by applying the transcription rule

vide methods and systems for handling rules in a distributed set to the transcription data , each rule violation being transcription environment . Some embodiments of the inven - 30 associated with a textual representation and substantially tion receive dictation information from multiple users ( e . g . , synchronized with the corresponding portion of the dictation from various doctors ) . A workflow management system uses data ; and resolving each rule violation . the dictation information and other information to generate According to a third set of embodiments , a machine a transcription assignment , which it assigns to one or more readable medium is provided for rules handling in a tran of a group of transcriptionists . The transcriptionists interact 3 scription environment , the machine - readable medium hav with a transcription interface to transcribe the dictation ing instructions stored thereon which , when executed by a information into a transcription product . The interface may machine , cause the machine to perform steps . The steps provide various functionality , including audio - to - transcrip - include : receiving a transcription assignment at a computer tion synchronization and rule handling . The transcription implemented transcription environment , the transcription product may be validated ( e . g . , by auditors or editors ) and 40 assignment including : dictation data comprising audio infor otherwise finalized into a final transcription product for m ation dictated by an author into a dictation interface , the delivery to a customer . Certain embodiments provide rule author being associated with a context designation : and a building functionality , including systems and methods for transcription rule set being one of a number of transcription rule creation , editing , validation , publishing , etc . Other rule sets stored in a rules data store and generated for embodiments provide logging and evaluating functionality , 45 application to the dictation data as a function of the context including statistical processing of logged job information to designation ; receiving transcription data at the computer evaluate quality metrics . implemented transcription environment from a transcrip

According to one set of embodiment , a method is pro - tionist via a transcription interface , the transcription data vided for rules handling in a distributed transcription sys - having textual representations of corresponding portions of tem . The method includes receiving a transcription assign - 50 the dictation data , the textual representations being at least ment at a computer - implemented transcription environment , partially synchronized with the corresponding portions of the transcription assignment including : dictation data com the dictation data ; and identifying a rule violation by apply prising audio information dictated by an author into a ing the transcription rule set to the transcription data using dictation interface , the author being associated with a con - the computer - implemented transcription environment , the text designation , and a transcription rule set being one of a 55 rule violation being associated with a textual representation number of transcription rule sets stored in a rules data store and substantially synchronized with the corresponding por and generated for application to the dictation data as a tion of the dictation data . function of the context designation . The method further includes receiving transcription data at the computer - imple BRIEF DESCRIPTION OF THE DRAWINGS mented transcription environment from a transcriptionist via 60 a transcription interface , the transcription data including A further understanding of the nature and advantages of textual representations of corresponding portions of the the present invention may be realized by reference to the dictation data , the textual representations being at least figures , which are described in the remaining portion of the partially synchronized with the corresponding portions of specification . In the figures , like reference numerals are used the dictation data ; identifying a rule violation by applying 65 throughout several figures to refer to similar components . In the transcription rule set to the transcription data using the some instances , a reference numeral may have an associated computer - implemented transcription environment , the rule sub - label consisting of a lower - case letter , or a dash fol

US 9 , 761 , 226 B2

lowed by a numeral , to denote one of multiple similar FIG . 11A shows one illustrative screen shot of the rule components . When reference is made to a reference numeral builder application , in which an expression is created for without specification of a sub - label , the reference is intended restricting a particular character identified as an illegal to refer to all such multiple similar components . character for the transcription product .

FIG . 1 shows a simplified illustration of an embodiment 5 FIG . 11B shows an illustrative screen shot of the rule of a distributed transcription environment , according to editor tab in an embodiment of the rule generation wizard for various embodiments of the invention . a rule that searches for all illegal characters for a transcrip

FIG . 2 shows a simplified block diagram of an embodi - tion product . ment of distributed transcription environment , according to FIG . 12 shows an illustrative screen shot of the rule editor various embodiments of the invention . 10 tab in an embodiment of the rule generation wizard , in which

FIG . 3 shows a simplified block diagram of an embodi - grouping is used in a rule . ment of a server - side of a distributed transcription system , FIG . 13 shows an embodiment of a “ Test ” window in an according to various embodiments of the invention . embodiment of the rule generation wizard .

FIG . 4 shows a simplified block diagram of an embodi - FIG . 14 shows additional rule building functionality illus ment of a client - side of a distributed transcription system , 15 trated by way of a multi - entity refinement screen . like the one shown in FIG . 3 , according to various embodi - FIG . 15A shows an illustrative screenshot of a transcrip ments of the invention . tion environment in which a rule violation is identified ,

FIG . 5A shows an illustrative computational system for according to various embodiments . providing some or all of the functionality of a server - side of FIG . 15B shows another illustrative screenshot of a tran a distributed transcription system , like the one shown in 20 scription environment , in which an auditor can see what rule FIG . 3 , according to various embodiments of the invention . violations have been identified and what remedial action has

FIG . 5B shows an illustrative computational system for occurred , according to various embodiments . providing some or all of the functionality of a client - side of a distributed transcription system , like the one shown in DETAILED DESCRIPTION FIG . 4 , according to various embodiments of the invention . 25

FIG . 6 shows a simplified flow diagram of an illustrative In the following description , for the purposes of expla method fir server - side workflow management in a distrib - nation , numerous specific details are set forth in order to uted transcription environment , according to various provide a thorough understanding of embodiments of the embodiments of the invention . invention . It will be apparent , however , to one killed in the

FIG . 7 shows a simplified flow diagram of an illustrative 30 art that embodiments may be practiced without some of method for client - side workflow management in a distrib - these specific details . For example , while various features uted transcription environment , according to various are ascribed to particular embodiments , it should be appre embodiments of the invention . ciated that the features described with respect to one

FIG . 8 shows a simplified flow diagram of an illustrative embodiment may be incorporated with other embodiments method for handling rules for use in a distributed transcrip - 35 as well . By the same token , however , no single feature or tion environment , according to various embodiments of the features of any described embodiment should be considered invention . essential to the invention , as other embodiments of the

FIG . 9A shows an illustrative screen shot of an existing invention may omit such features . Further , while various rules tab in an embodiment of the rule generation wizard . embodiments are described with reference to medical tran

FIG . 9B shows an illustrative screen shot of a rule editor 40 scription environments , embodiments may be implemented tab in an embodiment of the rule generation wizard . with any type of transcription environment .

FIG . 10A shows an illustrative screen shot of a rule FIG . 1 shows a simplified illustration of an embodiment builder application in an embodiment of the rule generation of a distributed transcription environment , according to wizard . various embodiments of the invention . It will be appreciated

FIG . 10B shows one illustrative screen shot of the rule 45 that many types of transcription environment 100 are pos builder application , in which selecting “ customer book - sible with many types , numbers , and / or locations of partici marks ” as the left operand reveals a list of available cus - pants . As such , the transcription environment 100 illustrated tomer bookmarks in the adjacent window and available in FIG . 1 shows only one embodiment and should not be operators and right operands . construed as limiting the scope of the invention .

FIG . 10C shows another illustrative screen shot of the rule 50 The transcription environment 100 includes users 124 builder application , in which selecting " Static Tab Pages ” or ( e . g . , those participants who provide dictation data ) ; tran “ Tab Page Lookup " reveals new controls on the builder s criptionists 134 ( e . g . , those participants who transcribe the screen . dictation data into a transcription product ) , mentors 142 ,

FIG . 10D shows an illustrative screen shot of the rule editors 144 , and auditors 146 ( e . g . , those participants who builder application , in which a rule is generated for evalu - 55 validate the transcription product ) ; and customers 154 ( e . g . , ating whether an AttendingName field has been filled in on those participants intended to receive the final transcription a patient tab . product ) . The transcription environment 100 further

FIG . 10E shows an illustrative screen shot of the rule includes a workflow manager 110 that manages the flow of builder application , in which an embodiment of a " search ” transcription services among the multiple participants in expression is shown . 60 their respective distributed locations . Embodiments of the

FIG . 10G shows an illustrative screen shot of the rule workflow manager 110 may be centralized or distributed , as builder application , in which a function is provided called described more fully below . “ Age Value , " which becomes available when searching the In one embodiment , multiple users 124 of a transcription document body . service provided within the transcription environment 100

FIG . 10G shows another illustrative screen shot of the rule 65 generate and / or provide dictation information from their builder application , in which a function searches a particular respective locations to the workflow manager 110 . For section of the document for identified information . example , multiple doctors ( i . e . , users 124 ) may dictate

US 9 , 761 , 226 B2

information from a patient visit into a Dictaphone , over a Even further , auditors 146 may perform detailed audits of telephone , or into an audio file by some other interface . audio - to - text transcriptions , audit some or all of the various

The interface may be located at any useful location , drafts of a transcription product , score and / or document including at a fixed user site 120 ( e . g . , a doctor ' s hospital , quality information and feedback , track error statistics , clinic , house , etc . ) or at a mobile location ( e . g . , a doctor ' s 5 develop quality remedies , etc . In certain embodiments , men cell phone , laptop , etc . ) . For example , a first user site 120 - 1 tors 142 and editors 144 provide pre - delivery quality func is a hospital with multiple doctors working in multiple tions , while auditors 146 provide post - delivery quality func locations throughout the user site 120 - 1 . Two user 124 are tions . providing dictation information from within a particular Once a final transcription product has been created ( e . g . , department 125 . 10 the product has been validated and prepared for release ) , it

It will be appreciated that the location associated with a may be delivered to a customer 154 . This delivery may be user 124 may not be the user ' s physical location at the time handled by the workflow manager 110 . In some cases , a the user provides dictation information . For example , a user single participant may be a user / customer 124 / 154 . For 124 may be registered with the transcription environment example , a doctor may dictate patient information and also 100 as a physician ' s assistant working for County General 15 be the intended recipient of the transcription product for use hospital in the Intensive Care Unit . It may be desirable to in the doctor ' s charts . implement certain types of functionality ( e . g . , workflow Further , in some embodiments , the workflow manager management , rule handling , compliance , etc . ) differently , 110 may provide additional functionality . For example , the depending at least in part on the location data associated work flow manager 110 may log information about the with the user 124 . For example , the Intensive Care Unit at 20 assignment and / or the delivered transcription product . This County General may have certain types of procedures for logged information may then be used in many ways , includ charting patients , transferring information , etc . that should ing to track trends , generate quality statistics , supplement be applied to the dictation information coming from the user billing information , or suggest services or upgrades to 124 . Notably , it may be desirable to associate the location participants . In some embodiments , transcription assign information to the dictation information even when the user 25 ments may be assigned partially as a function of the logged 124 is not physically in that location ( e . g . , the user 124 is data . For example , transcriptionists may be evaluated based dictating charts at home after leaving the hospital ) . on logged data and may receive assignments partly accord

In some embodiments , the workflow manager 110 ing to the results of those evaluations . receives the dictation information and / or other information , It may be useful to consider certain functionality of the and generates a transcription assignment . The transcription 30 workflow manager 110 and other parts of the transcription assignment may then be assigned to one or more transcrip - environment 100 as functional blocks . FIG . 2 shows a tionists 134 . Like the users 124 and other participants of the simplified block diagram of an embodiment of a distributed transcription environment 100 , the transcriptionists 134 may transcription environment , according to various embodi be physically located at or associated with any useful ments of the invention . Embodiments of the transcription locations , including distributed locations . For example , as 35 environment 200 of FIG . 2 may provide the same or illustrated , the workflow manager 110 may assign transcrip - different functionality as the transcription environment 100 tion assignments to a transcriptionist site 130 ( e . g . , an office of FIG . 1 . in India , where there are three transcriptionists 134 and a Certain functional blocks in the transcription environment mentor 142 to oversee the work of the transcriptionists 134 . 200 may be associated with particular participants and / or

In some embodiments , the transcriptionists 134 transcribe 40 data . For example , the transcription environment 200 may the dictation information to create a transcription product . In provide a dictation block 210 . The dictation block 210 certain embodiments , creation of the transcription product receives information from a user 124 and generates dictation includes playback of the dictation information , synchroni data 214 . In some embodiments , the dictation block 210 zation of the dictation information with the transcription , includes one or more dictation interfaces for providing rule handling , etc . Some or all of the transcription function - 45 functionality , such as receiving audio ( e . g . , through a trans ality may be provided by a dedicated transcription interface . ducer ) , interacting with the user 124 ( e . g . , by providing Embodiments of the transcription environment 100 pro - prompts , etc . ) , processing audio ( e . g . , encoding into a digital

vide functionality for validating the transcription product . In or other format , compression , noise reduction , etc . ) , and some embodiments , the validation includes rule building generating metadata ( e . g . , time / date stamping , processing and other rule handling functionality . In one embodiment , a 50 macro prompts , etc . ) . The dictation data 214 may include rule builder application allows rules to be created , and a rule any representation of the user 124 dictation , including a engine allows those rules to be used by some or all of the digital or analog audio file . participants of the transcription environment 100 . For The dictation data 214 may be stored in a server - side data example , during transcription or after submission of a draft store 224 . The server - side data store 224 may include one or transcription product , the transcription product may be 55 more files , databases , servers , etc . , which may be collocated evaluated against a set of rules to find different types of or distributed . The server - side data store 224 may store any errors . Rule - related functionality is explained in more detail data required or desired by the transcription environment below . 200 in providing transcription or related services . For

In other embodiments , validation of the transcription example , the server - side data store 224 may include a rules product includes validation by one or more participants , 60 server for storing rules data , a document repository server other than the transcriptionist 134 . For example , mentors for storing versions of documents ( e . g . , templates , forms , 142 may provide coaching , mentoring , management , shad - transcription products , supporting documentation , etc . ) , a owing , quality feedback , and / or other support for transcrip - log server for storing log data , and a workflow server for tionists 134 . Further , editors 144 may review transcription storing workflow data ( e . g . , employees , participants , work products and / or other reports , research and / or send alerts , 65 loads , skill sets , schedules , etc . ) . make corrections to transcription products , submit transcrip In some embodiments , data in the server - side data store tions to customers , and / or provide other quality functions . 224 is processed by a server - side processing block 220 . For

US 9 , 761 , 226 B2

example , the server - side processing block 220 may be Each of these data stores may be implemented in any useful adapted to use various data to generate transcription assign - way , for example , in one or more files , in one or more ments . The transcription assignments may be sent to a servers , etc . The server - side of the distributed transcription workflow handling block 230 for assignment to a transcrip - system 300 further includes a number of modules that tionist 134 . 5 receive data from multiple data stores and / or other modules ,

In some embodiments , the transcriptionist 134 accesses and uses the data to generate server - level information for the transcription assignments assigned to the transcriptionist providing and managing transcription services . 134 through functionality of a client - side processing block In some embodiments , the audio data store 304 is adapted 240 . Data relating to the transcription assignment may be to store audio files representing dictation data 348 . The stored in a client - side data store 244 . In certain embodi - 10 dictation data 34 may be the same as or different from the ments , a synchronization block 234 maintains a level of dictation data 214 of FIG . 2 . For example , the dictation data synchronicity between the server - side data store 224 and the 348 may or may not be specially formatted or encoded ( e . g . , client - side data store 2441 . For example , when the transcrip - compressed , encrypted , transcoded , etc . ) , and may or may tionist 134 accepts a transcription assignment , only infor not include related metadata . mation relating to the transcription assignment ( e . g . , dicta - 15 The rules data store 308 may be adapted to store rule tion data 214 and specific workflow data , rules data , etc . ) is related information . The rule - related information may downloaded to the client - side data store 244 . The synchro - include , for example , existing rules ( e . g . , rule conditions or nization block 234 may periodically or constantly check for , expressions ) , information for use in creating or editing rules and possibly rectify , discrepancies between the server - side ( e . g . , available expressions , operands , operators , etc . ) , infor data store 224 and the client - side data store 244 . 20 mation on rule hierarchies ( e . g . , which rules apply to or may Embodiments of the client - side processing block 240 be edited by which participants ) , etc .

additionally provide transcription interface functionality for The context data store 312 may be adapted to store the transcriptionist 134 . The transcriptionist may use the context data 320 relating to contexts for applying rules , interface functionality to generate a draft transcription prod - managing workflow , and providing other functions of the uct 248 from the dictation data 214 and / or other data . In 25 server - side of the distributed transcription system 300 . In some embodiments , the transcription interface pre - validates some embodiments , the context data 320 includes data the draft transcription product 248 . For example , the tran - relating to various organizations ( e . g . , quality control cen scription interface may provide spell checking , grammar ters , hospitals , clinics , offices , places of business , etc . ) , sites checking , and / or pre - validation of certain data within the ( e . g . , countries , office sites within larger organizations , etc . ) , document ( e . g . , based on templates , formatting , rules , etc . ) . 30 departments ( e . g . , intensive care unit , radiology , pediatrics ,

In other embodiments , the pre - validation and / or other etc . ) , work types ( e . g . , emergency room admission , routine validation functionality is provided by a validation block physical , insurance physical , follow - up visit , etc . ) , user 250 . Some or all of the functionality of the validation block types ( e . g . , physicians , physicians ' assistants , techs , etc . ) , 250 may be accessible by the transcriptionist 134 ( e . g . , may specific users ( e . g . , a specific physician , a specific medical be accessed through the transcription interface ) , by quality 35 transcriptionist , etc . ) . control participants ( e . g . , mentors 142 , editors 144 , or audi - In certain embodiments , the context data 320 is associated tors 146 ) , or automatically ( e . g . , by the client - side process with certain permissions and / or hierarchies . Certain rules , ing block 240 whenever a draft transcription product 248 is forms , assignments , etc . may only be available to or acces submitted ) . The validation block 250 may generate a vali - sible in certain contextual environments . In one example , dated transcription product 254 . 40 transcription assignments being sent to India may be asso

In some embodiments , additional functionality is pro - ciated with certain rules , like specific word usages , compli vided by a delivery block 260 . The delivery block 260 may ance requirements , etc . In another example , a physician may receive the validated transcription product 254 and generate have certain preferred ways of dictating charts or a tran a final transcription product 264 for delivery to a customer scriptionist may tend to make certain specific errors ( e . g . , as 154 . For example , the customer 154 may have certain 45 determined by predefined arrangements with the physician delivery preferences ( e . g . , report formatting , paper type , or transcriptionist , learned from analyzing patterns of use , electronic file type , addressing , etc . ) . The delivery block 260 etc . ) . may receive an electronic file of a final transcription product Embodiments of the workflow data store 324 are adapted 264 , print it in a format adapted for the files of the customer to store different types of workflow data for use in handling 154 , and generate a mailing label with the mailing informa - 50 the flow of information throughout the transcription envi tion of the customer 154 . ronment . In some embodiments , the workflow data includes

It will be appreciated that many types of functionality , personnel information ( e . g . , personnel schedules , hourly participants , and / or data are possible according to the inven - rates , skill sets , etc . ) , load balancing information ( e . g . , tion . Further , it will be appreciated that the functionality of workloads per personnel , predicted assignment time , due the transcription environment 100 of FIG . 1 and the tran - 55 dates , etc . ) , and / or any other information useful for manag scription environment 200 of FIG . 2 may be implemented in ing workloads . a number of ways . For example , FIGS . 3 and 4 illustrate One module included in embodiments of the server - side embodiments of systems for providing server - side and cli - of the distributed transcription system 300 is a rule process ent - side functions of a distributed transcription environment , ing module 328 . In some embodiments , the rule processing respectively . 60 module 328 provides functionality for generating workflow

FIG . 3 shows a simplified block diagram of an embodi rules 336 . Workflow information may be received from the ment of a server - side of a distributed transcription system , workflow data store 324 and used by the rule processing according to various embodiments of the invention . module 328 to generate workflow rules 336 for supporting Embodiments of the server - side of the distributed transcrip - workflow management functions . In other embodiments , the tion system 300 include an audio data store 304 , a rules data 65 rule processing module 328 receives the rule - related infor store 308 , a context data store 312 , a document data store mation from the rules data store 308 and the context data 320 316 , a workflow data store 324 , and a log data store 364 . from the context data store 312 , and generates transcription

US 9 , 761 , 226 B2 10

rules 332 . In still other embodiments , the rule processing how to assign the transcription assignment 356 and what module 328 provides functionality for creating and / or edit - information to transmit in support of the transcription ing rules , including workflow rules 336 and transcription assignment 356 ) . rules 332 . In some embodiments , the server - side of the distributed

In some embodiments , the transcription rules 332 include 5 transcription system 300 further includes a log processing information rules , warning rules , and error rules . Informa module 368 for receiving log data and / or generating log tion rules may typically include triggers based on certain reports 372 . In certain embodiments , the log data is stored in transcription assignment attributes that generate informa and received from the log data store 364 . Data may be tional prompts to a transcriptionist , editor , or other partici logged from multiple parts of the transcription environment , pant . For example , the transcriptionist may be prompted 10 including the server - side of the distributed transcription during transcription with the following : “ Ensure correct date system 300 and one or more client - sides of the distributed format has been used in reports date expanded in full transcription system 400 . For example , logged data may within the document . ” Warning rules may typically include triggers based on conditions found within a scanned tran include workflow logs ( e . g . , what assignments have been scription product that indicate a possible error . For example , 15 assigned and to w e 15 assigned and to whom , actual versus predicted completion after submitting a draft transcription product including the times for assignments , etc . ) , error logs ( e . g . , what rules were word “ perineal , ” the transcriptionist may be prompted with triggered during the transcription process , what errors were the following : “ Possible incorrect word usage . . . double identified during other quality control processes , whether the check choice of perineal versus peroneal versus perennial . ” rules were resolved , at what level the rules were resolved , Error rules may typically include triggers based on condi - 20 etc . ) , etc . tions found within a scanned transcription product that After receiving log data , embodiments of the log process indicate a definite error . For example , after attempting to ing module 368 process the data to generate certain types of submit a transcription product including an electroencepha - log reports 372 . It will be appreciated that the log data may logram ( “ EEG ” ) without including a required carbon copy to be used in many different ways for different participants and the EEG lab , the transcriptionist may be prompted with the 25 parties of interest . For example , the log data may be used to following : “ Requird CC — worktype EEG requires a CC to generate log reports 372 for evaluating system performance be sent to the EEG lab . ” ( e . g . , trends in performance or quality , quality statistics ,

In certain embodiments , informational rules are provided etc . ) , evaluating personnel performance ( e . g . , tracking only to transcriptionists by way of an informational panel employee performance , audits , reviews , sick leave , hourly within a transcription interface . In other embodiments , 30 rates , etc . , supplementing billing information ( e . g . , deter warning and error rules are triggered when a transcription mining invoice data , finding billing issues or inefficiencies , product as run through a rules engine . The transcription etc . ) , or suggesting services or upgrades ( e . g . , suggesting product may be run through a rules engine manually ( e . g . , new rules , security , or reporting functionality to a user or during transcription , editing , auditing , etc . ) or automatically transcriptionist , etc . ) . The log processing module 368 may ( e . g . , whenever a draft transcription product is submitted by 35 receive data from or pass data to other modules , including a transcriptionist ) . In still other embodiments , triggering of the server - side workflow processing module 352 . certain types of rules may block submission of a transcrip - Embodiments of the server - side of the distributed tran tion product . For example , an error rule may be set to block scription system 300 are in communication with a network submission of a transcription product until the error has been 360 ( e . g . , a local network , a wide area network , the Internet , resolved . 40 etc . ) . For example , the server - side of the distributed tran

In some embodiments , the transcription rules 332 gener - scription system 300 may be in communication with the ated by the rule processing module 328 are used by a form network 360 via the server - side workflow processing mod processing module 340 . The form processing module 340 ule 352 , configured to manage network traffic relating to may also use certain document data from the document data transcription and related services . In certain embodiments , store 316 . Embodiments of the document data store 316 45 the server - side workflow processing module 352 communi store various types and drafts of documents . Some embodi - cates the transcription assignment 356 to one or more of the ments store various drafts of transcription products , forms , client - sides of the distributed transcription system 400 . The templates , supporting documentation , and / or other docu - server - side workflow processing module 352 may also ments . In certain embodiments , the document data store 316 receive information from one or more of the client - sides of includes document management functionality ( e . g . , storing 50 the distributed transcription system 400 over the network or tracking document revisions , checking in or checking out 360 . For example , the server - side workflow processing documents , searching for documents , creating new docu - module 352 may receive draft and / or final transcription ments , etc . ) . By combining certain document data and products for routing to other participants , status updates on transcription rules 332 , the form processing module 340 transcription assignments , data for synchronizing client and may generate form data 344 . The form data 344 may include 55 server data ( e . g . , as in the synchronization block 234 of FIG . information useful for providing a transcription assignment 2 ) , log data for use by the log processing module 368 , etc . to a transcriptionist , like template information , informa - This and / or other data may be provided by various func tional rule panels , pre - filled fields , text entry sections , etc . tionality of one or more of the client - sides of the distributed

In some embodiments , the form data 344 , transcription transcription system 400 . rules 332 , workflow rules 336 , other data from the workflow 60 FIG . 4 shows a simplified block diagram of an embodi data store 324 , and / or any other useful data is passed to a ment of a client - side of a distributed transcription system , server - side workflow processing module 352 . The server - like the one shown in FIG . 3 , according to various embodi side workflow processing module 352 may also receive ments of the invention . As with the server - side of the dictation data 348 from the audio data store . This and / or distributed transcription system 300 , embodiments of the other data may be used by the server - side workflow pro - 65 client - side of the distributed transcription system 400 cessing module 352 to generate a transcription assignment include a number of modules configured to receive , process , 356 and to make workflow determinations ( e . g . , determine and generate data . The client - side of the distributed tran

11 US 9 , 761 , 226 B2

12 scription system 400 may be in communication with the example , the transcription module 410 may record the server - side of the distributed transcription system 300 via a actions of the transcriptionist with timestamps , so as to network 360 . synchronize when certain transcription actions were taken

In certain embodiments , the client - side of the distributed ( e . g . , when a particular word was typed , when a rule was transcription system 400 includes a client workflow manager 5 triggered , etc . ) , with a particular time index in the audio 408 configured to perform certain high - level workflow man - dictation file ( e . g . , an elapsed time , a number of elapsed bits , agement functions . In one embodiment , the client workflow etc . ) . In one embodiment , when the transcriptionist selects a manager 408 provides an interface for a transcriptionist by portion of the transcribed text , an audio control ( e . g . , a which the transcriptionist can see how many transcription slider ) jumps to a location in the audio dictation file corre assignments 356 are currently waiting in the transcription - 10 sponding with the transcription of the text . ist ' s queue ( e . g . , and other information , like the status of In other embodiments , the transcription module 410 pro certain transcription assignments 356 ) . For example , the vides functionality for interfacing with certain types of transcriptionist may log into a workflow management inter - metadata that may be present in the dictation data . In one face and select a transcription assignment 356 from a queue . embodiment , the dictation data includes macro prompts . For Either before or after the selection is made , the transcription 15 example , a telephonic dictation interface may provide assignment 356 and / or related information may be down - prompts to a user to aid in certain dictations ( e . g . , “ Patient ' s loaded to the client - side of the distributed transcription Birth Date ? ' ' ; [ wait for response ] ; [ confirm response ] ; system 400 . In some embodiments , the client - side of the “ Patient ' s Weight ” . . . ) . In another embodiment , the distributed transcription system 400 receives the transcrip - metadata may include other dictation - related information , tion assignment 356 from the network 360 . 20 like time of call , originating phone number , user login

Embodiments of the client - side of the distributed tran information , etc . For example , the metadata may be used to scription system 400 include a client - side data store 404 identify the user ( e . g . , by recording a login identifier , the ( e . g . , like the client - side data store 244 of FIG . 2 ) . In some transcription system may look up information on the user , embodiments , data in the client - side data store 404 is including name , occupation , employer , department , site , maintained by the client workflow manager 408 . In one 25 etc . ) . It may be desirable to use these and / or other types of embodiment , the client workflow manager 408 provides metadata to enhance transcription functionality ( e . g . , by certain synchronization functionality ( e . g . , like the synchro - auto - filling certain fields of a transcription product form , by nization block 234 of FIG . 2 ) for maintaining a level of allowing the transcriptionist to jump to those sections in the synchronicity between data in the server - side of the distrib - audio file , by associating rules triggered by the text or uted transcription system 300 and data in the client - side data 30 indices set by the transcriptionist to associate with a specific store 404 . location in the audio dictation data , etc . ) .

For example , when a transcriptionist accepts a transcrip In still other embodiments , the transcription module 410 tion assignment 356 , information relating to the transcrip - provides functionality tailored to the type of data being tion assignment 356 may be downloaded to the client - side transcribed . In embodiments used in a medical transcription data store 404 . This data may include dictation data , form 35 environment , certain medical functionality may be desir data , transcription rules , workflow rules , context data , log able . For example , a panel may be provided adjacent to a data , and / or any other useful data for supporting client - side form text entry area , having various tabs for accessing transcription or related functionality . In some embodiments , patient data , user data , and other information . In certain the client workflow manager 408 periodically or constantly embodiments , the transcription module 410 may display checks for , and possibly rectifies , discrepancies between the 40 other panels for prompting the transcription with certain server - side and the client - side data . triggered rules ( e . g . , informational rules ) or other useful

It is worth noting that the synchronization functionality information . may be implemented in a number of ways , according to The transcriptionist may use the transcription interface embodiments of the invention . For example , the server - side provided by the transcription module 410 to generate a draft data may be stored in a particular file structure ( e . g . , a certain 45 transcription product 248 from the dictation data 214 and / or set of servers , directories , naming conventions , etc . ) , and the other data . In some embodiments , the transcription module client - side data store 404 may be representative of that file 410 further provides functionality for pre - validating the structure ( e . g . , by using the same numbers , names , and types draft transcription product 248 . For example , the transcrip of data stores , but each likely containing less data than their tion interface may provide spell checking , grammar check server - side counterparts ) . In some embodiments , server - side 50 ing , and / or pre - validation of certain data within the docu data may be attributed ( e . g . , with certain types of flags ) to ment ( e . g . , based on template , formatting , rules , etc . ) . define if , when , and / or how the data is transferred to the In some embodiments of the client - side of the distributed client - side data store 404 . transcription system 400 , pre - validation and / or other vali

Embodiments of the client - side of the distributed tran - dation functionality is provided by a validation module 420 . scription system 400 include a transcription module 410 . In 55 In some embodiments , the validation module 420 function some embodiments , the transcription module 410 function - ality is provided as a module of the client workflow manager ality is provided as a module of the client workflow manager 408 . The validation functionality of the validation module 408 . The transcription module 410 may receive data from 420 may be accessed in various ways . the client - side data store 404 that relates to the selected In one embodiment , the validation functionality is transcription assignment 356 , and generate a transcription 60 accessed by the transcriptionist through the transcription interface for use by a transcriptionist . interface . For example , the transcriptionist may run a vali

In some embodiments , the transcription module 410 pro dation routine from a menu provided by the transcription vides some or all of the functionality of a word processing interface , at which point a rules engine may evaluate the application , with additional transcription - specific function current transcription text against a set of rules applicable to ality . In certain embodiments , the transcription - specific 65 the transcription assignment 356 . In another embodiment , functionality includes synchronization between the audio the validation functionality is accessed by one or more dictation data and transcribed or auto - generated text . For quality control participants ( e . g . , mentors , editors , or audi

US 9 , 761 , 226 B2 13 14

tors ) . For example , a quality control participant may access other sources . For example , logged data may include work a transcription interface similar to the one used by the flow logs ( e . g . , what assignments have been assigned and to transcriptionist , or a dedicated interface for validating a draft whom , actual versus predicted completion times for assign transcription product 248 ( e . g . , with tailored functionality ) , ments , etc . ) , error logs ( e . g . , what rules were triggered through which the participant may run the validation rou - 5 during the transcription process , what errors were identified tine . In still another embodiment , the validation routine may during other quality control processes , whether the rules automatically run when certain conditions are met . For were resolved , at what level the rules were resolved , etc . ) , example , the validation routine may run periodically ( e . g . , etc . In some embodiments , the log data 444 is communi once per hour ) , each time a draft transcription product 248 cated back to the server - side of the distributed transcription is saved , each time a draft transcription product 248 is 10 system 300 over the network 360 . submitted ( e . g . , to the validation module 420 from the It will be appreciated that the functionality of the various transcription module 410 ) , etc . modules , data stores , and other elements of the client - side of

In some embodiments , the validation module 420 controls the distributed transcription system 400 and the server - side whether or not the draft transcription product 248 can of the distributed transcription system 300 ( e . g . , as in FIG . proceed through the transcription system . In one embodi - 15 3 ) may be implemented in many ways , according to embodi ment , the validation module 420 will block sending of the ments of the invention . For example , while certain function draft transcription product 248 to quality control participants ality and participants are described with reference to client until triggered rules ( e . g . , error rules ) have been resolved . In side or server - side elements , these designations are intended another embodiment , the validation module 420 will send only for convenience and should not be construed as limiting the draft transcription product 248 back to the transcription - 20 the scope of the invention . In fact , any of the server - side ist ( e . g . , from a quality control participant ) , prompting the functionality may be performed or implemented in one or transcriptionist to make certain corrections ( e . g . , and poten more client - side elements , and any of the client - side func tially blocking resubmission of the draft transcription prod - tionality may be performed or implemented in one or more uct 248 until some or all of those corrections have been server - side elements . made ) . 25 Further , the various functionality of a distributed tran

Once the draft transcription product 248 has been vali - scription environment ( e . g . , as shown in FIGS . 1 - 4 ) may be dated by the validation module 420 , a validated transcription implemented in one or more computational systems , for product 254 is generated . In some embodiments , the vali example , by using the computational systems to interface dated transcription product 254 is delivered to a customer or with certain functionality or to execute the functionality by other participant . In other embodiments , the validated tran - 30 way of routines or applications . Embodiments of illustrative scription product 254 is passed to a delivery module 430 for computational systems for providing server - side and client further processing . side transcription functionality are described with reference

In some embodiments , the delivery module 430 receives to FIGS . 5A and 5B , respectively . the validated transcription product 254 and generates a final FIG . SA shows an illustrative computational system for transcription product 264 for delivery to a customer . For 35 providing some or all of the functionality of a server - side of example , the customer may have certain delivery prefer - a distributed transcription system , like the one shown in ences ( e . g . , report formatting , paper type , electronic file FIG . 3 , according to various embodiments of the invention . type , addressing , etc . ) . The delivery module 430 may The computational system 500 is shown having hardware receive an electronic file of a final transcription product 264 , elements that may be electrically coupled via a bus 526 ( or print it in a format adapted for the files of the customer , and 40 may otherwise be in communication , as appropriate ) . The generate a mailing label with the mailing information of the hardware elements may include one or more processors 502 , customer . In some embodiments , the final transcription including without limitation one or more general - purpose product 264 is communicated over the network 360 to the processors and / or one or more special - purpose processors customer or to the server - side of the distributed transcription ( such as digital signal processing chips , graphics accelera system 400 45 tion chips , and / or the like ) ; one or more input devices 504 ,

In some embodiments , the delivery module 430 ( or which can include without limitation a mouse , a keyboard , another module , e . g . , the client workflow manager 408 ) is and / or the like ; and one or more output devices 506 , which configured to clean up the client - side data store 404 . For can include without limitation a display device , a printer , example , information specific to the transcription assign - and / or the like . ment may be deleted from the client - side data store 404 . This 50 The computational system 500 may further include ( and / may be required or desirable , for example , to comply with or be in communication with ) one or more storage devices record - keeping or privacy regulations , to prevent outdated 508 , which can comprise , without limitation , local and / or versions of data from existing on the system , to save storage network accessible storage and / or can include , without limi space , etc . tation , a disk drive , a drive array , an optical storage device ,

Embodiments of the client - side of the distributed tran - 55 a solid - state storage device such as a random access memory scription system 400 further include a logging module 440 ( “ RAM ” ) , and / or a read - only memory ( “ ROM ” ) , which can for logging certain type , of client - side data to generate log be programmable , flash - updateable , and / or the like . data 444 . In some embodiments , the transcription module Embodiments of the storage devices 508 may include or 410 functionality is provided as a module of the client provide functionality of a data storage module . For example , workflow manager 408 . It will be appreciated that data may 60 the storage devices 508 may include or be in communication be logged from any useful part of the transcription environ - with various server - side data stores ( e . g . , the audio data store ment , including any participant or module of the client - side 304 , rules data store 308 , context data store 312 , document of the distributed transcription system 400 . data store 316 , workflow data store 324 , and log data store Some embodiments of the logging module 440 are in 364 of FIG . 3 ) .

communication with some or all of the transcription module 65 The computational system 500 may also include a com 410 , the validation module 420 , and the delivery module munications subsystem 514 , which can include without 430 . Log data 444 may be logged from any of these and / or limitation a modem , a network card ( wireless or wired ) , an

US 9 , 761 , 226 B2 15 16

infra - red communication device , a wireless communication module 328 , form processing module 340 , workflow pro device and / or chipset ( such as a Bluetooth device , an 802 . 11 cessing module 352 , and / or log processing module 368 of device , a WiMAX device , cellular communication facilities , FIG . 3 ) . In another embodiment , some or all of the func etc . ) , and / or the like . The communications subsystem 514 tionality of those components may be implemented in dedi may permit data to be exchanged with one or more net - 5 cated or multi - purpose components that are in communica works , including any networks or devices described herein tion with the bus 526 . ( e . g . , the network 360 of FIG . 3 ) . In many embodiments , the It is worth noting that the terms " machine readable computational system 500 will further comprise a working medium ” and “ computer readable medium , ” as used herein , memory 518 , which can include a RAM or ROM device , as refer to any medium that participates in providing data that described above . 10 causes a machine to operate in a specific fashion . In an

The computational system 500 also may include software embodiment implemented using the computational system elements , shown as being currently located within the work 500 , various machine - readable media might be involved in ing memory 518 , including an operating system 524 and / or providing instructions / code to processor ( s ) 502 for execu other code , such as one or more application programs 522 , tion and / or might be used to store and / or carry such instruc which may include computer programs of the invention , 15 tions / code ( e . g . , as signals ) . In many implementations , a and / or may be designed to implement methods of the computer readable medium is a physical and / or tangible invention and / or configure systems of the invention , as storage medium . Such a medium may take many forms , described herein . including but not limited to , non - volatile media , volatile

Merely by way of example , functionality of one or more media , and transmission media . Non - volatile media systems , components , or procedures described herein might 20 includes , for example , optical or magnetic disks , such as the be implemented as code and / or instructions executable by a storage device ( s ) ( 508 or 510 ) . Volatile media includes , computer ( and / or a processor within a computer ) . A set of without limitation , dynamic memory , such as the working these instructions and / or code might be stored on a computer memory 518 . Transmission media includes coaxial cables , readable storage medium 510b . In some embodiments , the copper wire , and fiber optics , including the wires that computer readable storage medium 510b is the storage 25 comprise the bus 526 , as well as the various components of device ( s ) 508 described above . In other embodiments , the the communications subsystem 514 ( and / or the media by computer readable storage medium 510b might be incorpo - which the communications subsystem 514 provides com rated within a computational system , such as the system 500 . munication with other devices ) . Hence , transmission media In still other embodiments , the computer readable storage can also take the form of waves ( including , without limita medium 510b might be separate from the computational 30 tion , radio , acoustic and / or light waves , such as those system 500 ( i . e . , a removable medium , such as a compact generated during radio - wave and infra - red data communi disc , etc . ) , and / or provided in an installation package , such cations ) . that the storage medium can be used to configure a general Common forms of physical and / or tangible computer purpose computer with the instructions / code stored thereon . readable media include , for example , a floppy disk , a flexible These instructions might take the form of executable code , 35 disk , a hard disk , magnetic tape , or any other magnetic which is executable by the computational system 500 and / or medium , a CD - ROM , any other optical medium , punch might take the form of source and / or installable code , which , cards , papertape , any other physical medium with patterns of upon compilation and / or installation on the computational holes , a RAM , a PROM , an EPROM , a FLASH - EPROM , system 500 ( e . g . , using any of a variety of generally avail any other memory chip or cartridge , a carrier wave as able compilers , installation programs , compression / decom - 40 described hereinafter , or any other medium from which a pression utilities , etc . ) , then takes the form of executable computer can read instructions and / or code . code . In these embodiments , the computer readable storage Various forms of machine - readable media may be medium 510b may be read by a computer readable storage involved in carrying one or more sequence of one or more media reader 510a . instructions to the processor ( s ) 502 for execution . Merely by

In one embodiment , the invention employs the computa - 45 way of example , the instructions may initially be carried on tional system to perform functionality of embodiments of a magnetic disk and / or optical disc of a remote computer . A the invention . According to a set of embodiments , some or remote computer might load the instructions into its all of the functions are performed by the computational dynamic memory and send the instructions as signals over a system 500 in response to processor 502 executing one or transmission medium to be received and / or executed by the more sequences of one or more instructions ( which might be 50 computational system 500 . These signals , which might be in incorporated into the operating system 524 and / or other the form of electromagnetic signals , acoustic signals , optical code , such as an application program 522 ) contained in the signals , and / or the like , are all examples of carrier waves on working memory 518 . Such instructions may be read into which instructions can be encoded , in accordance with the working memory 518 from another machine - readable various embodiments of the invention . medium , such as one or more of the storage device ( s ) 508 ( or 55 The communications subsystem 514 ( and / or components 510 ) . Merely by way of example , execution of the sequences thereof ) generally may receive the signals , and the bus 526 of instructions contained in the working memory 518 might then may carry the signals ( and / or the data , instructions , etc . cause the processor ( s ) 502 to perform one or more proce - carried by the signals ) to the working memory 518 , from dures of the methods described herein . In this way , the which the processor ( s ) 502 may retrieve and execute the computational system 500 can be " configured to " or " oper - 60 instructions . The instructions received by the working able to ” perform any number of such procedures or methods . memory 518 may optionally be stored on a storage device

It will be appreciated that all or some of the server - side 508 either before or after execution by the processor ( s ) 502 . functions of a distributed transcription system may be imple - Notably , in certain embodiments , the communications sub mented as software or firmware components , dedicated system 514 , input devices 504 , output devices 506 , and / or hardware components , etc . In one embodiment , the working 65 other components of the computational system 500 may be memory 518 includes code 522 for executing the function - used to communicate with one or more other computational ality of various server - side modules ( e . g . , the rule processing systems 500 for increased or distributed functionality .

17 US 9 , 761 , 226 B2

18 A similar or different computational system may be used from a user . In block 608 , the dictation data and / or other data

to provide client - side functionality of a distributed transcrip - is used to generate a transcription assignment . tion environment . FIG . 5B shows an illustrative computa - In some embodiments , the transcription assignment is tional system for providing some or all of the functionality assigned to a transcriptionist in block 612 . In block 616 , of a client - side of a distributed transcription system , like the 5 client data may be prepared for the transcription assignment one shown in FIG . 4 , according to various embodiments of by synchronizing the server and client workflows and data the invention . As with the computational system 500 of FIG . ( e . g . , as part of the assignment in block 612 , subsequent to SA , the computational system 550 of FIG . 51 is shown the assignment in block 612 , etc . ) . In certain embodiments , having hardware elements that may be electrically coupled a draft transcription product is received at block 620 ( e . g . , via a bus 526 ( or may otherwise be in communication , as from a transcriptionist , after the transcriptionist has tran appropriate ) . The hardware elements may include one or scribed the dictation data associated with the transcription more processors 502 , input device 504 , and output devices assignment ) . 506 . Embodiments of the method 600 may then validate the

The computational system 550 may further include ( and / 15 draft transcription product at block 624 . The result of the or be in communication with ) one or more storage devices validation may include a determination at decision block 508 . Embodiments of the storage devices 508 may include 628 of whether or not the draft transcription is valid . If the or provide functionality of a client - side data storage module draft transcription product is invalid , the method 600 may ( e . g . , the client - side data store 404 of FIG . 4 ) . In some return to block 612 to reassign the transcription assignment embodiments , the storage device ( s ) 508 is or includes a 20 to the transcriptionist . For example , the validation in block computer readable storage medium 510b . In other embodi - 624 may generate certain data ( e . g . , triggered rules , etc . ) that ments , the computer readable storage medium 510b might is passed back to the transcriptionist for correction . be incorporated within a computational system , such as the If the draft transcription is determined in block 628 to be system 550 . In still other embodiments , the computer read - valid , the method 600 may generate a final transcription able storage medium 150b is separate from the computa - 25 product from the validated transcription product at block tional system 550 , and may be read by a computer readable 632 . In block 636 , the final transcription product may be storage media reader 510a . delivered to the customer . It will be appreciated that embodi

The computational system 550 may also include a com - ments of the method 600 may provide additional function munications subsystem 514 , a working memory 518 , and ality . In some embodiments , in block 640 , relevant infor software elements ( e . g . , shown as being currently located 30 mation from or relating to the transcription assignment may within the working memory 518 and including an operating be logged . In other embodiments , client data may be cleaned system 524 and / or other code , such as one or more appli - up in block 644 after the transcription assignment is sub cation programs 522 ) . It will be appreciated that all or some mitted ( e . g . , at block 632 ) . of the client - side functions of a distributed transcription FIG . 7 shows a simplified flow diagram of an illustrative system may be implemented as software or firmware com - 35 method for client - side workflow management in a distrib ponents , dedicated hardware components , etc . In one uted transcription environment , according to various embodiment , the working memory 518 includes code 522 embodiments of the invention . The method 700 begins at for executing the functionality of various server - side mod block 704 with a transcriptionist accepting a new or saved ules ( e . g . , the transcription module 410 , validation module transcription assignment from a client - side work flow man 420 , delivery module 430 , and / or logging module 440 of 40 ager . The transcription assignment and associated informa FIG . 4 ) . In another embodiment , some or all of the func - tion may be received at block 708 . At block 712 , the tionality of those components may be implemented in dedi - transcriptionist may transcribe the assigned data . cated or multi - purpose components that are in communica - Embodiments of the method 700 may include one or more tion with the bus 526 . levels of validation . In some embodiments , the transcrip

It is worth noting that both the computational system 500 45 tionist may trigger ( e . g . , manually or automatically ) certain of FIG . SA and the computational system 550 of FIG . 5B information rules at block 716 . In other embodiments , other may employ one or more of various types of data architec - rules may be manually or automatically evaluated or trig tures , data formats , storage formats , etc . For example , vari - gered during transcription . After the transcriptionist has ous embodiments store data and / or implement various func - completed a draft transcription product in block 712 , the tionality using Clinical Document Architecture ( “ CDA ” ) 50 transcriptionist may attempt to submit the draft transcription data formats , like HL7 ( e . g . , HL7 version 2 . 6 was approved product in block 720 . as an ANSI standard on Oct . 12 , 2007 under the title In some embodiments , submission of the draft transcrip “ Application Protocol for Electronic Data Exchange in tion product in block 720 may initiate certain steps of the Healthcare Environments Version 2 . 6 " ) . method 700 . In certain embodiments , upon submission at

It will now be appreciated that many different types of 55 block 720 , a determination is made at decision block 724 of systems may be used to implement functionality of a dis - whether any blocking rules have been violated . Blocking tributed transcription environment ( e . g . , as shown in FIGS . rules may include any rules ( e . g . , warning or error rules ) that 1 - 5 ) , according to various embodiments of the invention . have been designated as blocking final submission of a draft FIGS . 6 - 8 provide illustrative flow diagrams of some transcription product until the rules have been remedied . method embodiment , that may be performed using systems 60 If blocking rules have not been triggered , submission may embodiments of the invention , including those described continue to a validation stage at block 736 . Validation of the above . draft transcription product at block 736 may include evalu

FIG . 6 shows a simplified flow diagram of an illustrative ating the draft transcription product against a set of rules method for server - side workflow management in a distrib - ( e . g . , some or all of which having been created by a method uted transcription environment , according to various 65 like the method 800 of FIG . 8 ) The validation in block 736 embodiments of the invention . The method 600 begins at may include a determination at decision block 740 of block 604 by receiving dictation data ( e . g . , an audio file ) whether the draft transcription product is valid .

19 US 9 , 761 , 226 B2

20 If blocking rules are deemed triggered in decision block determined to be invalid at decision block 820 , the method

724 or if the draft transcription product is deemed not 800 may return to block 812 for another attempt at trans validated in decision block 740 , the method 700 may trigger lating the rule requirements into a rule function . certain functionality . In some embodiments , the transcrip - Embodiments of the method 800 may associate the rule tionist receives an error report at block 728 ( e . g . , prompts in 5 with certain attributes at block 824 . In one embodiment , the a displayed panel in a transcription interface ) indicating rule is assigned to certain hierarchies within the transcription and / or describing the blocking and / or other rules that have environment . For example , a particular rule may be applied been violated . At block 732 , the transcriptionist may attempt globally ( e . g . , to all hierarchies and accounts ) , or to a to remedy the various triggered rules . After the triggered particular work location ( e . g . , United States . India , etc . ) , rules have been remedied in block 732 , the transcriptionist 10 work role ( e . g . , transcriptionist , editor , user , etc . ) , account may re - submit the draft transcription product in block 720 . level ( e . g . , based on certain account preferences or entitle Blocks 720 . . . 740 may continue to loop until the tran - ments ) , location level ( e . g . , department , site , etc . ) , worktype scription product is deemed valid at decision block 740 . level ( e . g . , routine visit , radiology report , etc . ) , clinician Once the draft transcription product is deemed valid at level ( e . g . , radiologist , Dr . Smith , etc . ) . In certain embodi

decision block 740 , the transcription assignment may be 15 ments , hierarchical rule management may be used to effect finalized at block 744 . In some embodiments , finalizing the changes to a rule across one or more levels of the hierarchy transcription assignment may include generating a final without having to change the rule multiple times . For transcription product for delivery to a customer or other example , if a client has ten sites located around the world , participant . In other embodiments , finalizing the transcrip - the hierarchical rule framework may be configured so that tion product includes cleaning up client - side data . In still 20 modifying a rule associated with one site will automatically other embodiments , finalizing the transcription product modify the rule for all other sites and / or other ( e . g . , subor includes configuring the method to allow selection of a new dinate ) levels of the hierarchy , if desired . transcription assignment ( e . g . , by returning to block 704 ) . If the rule is determined to be valid at decision block 820 ,

It will be appreciated that some of the server - level func - the method 800 may publish the validated rule to a rule tionality of FIG . 6 and some of the client - level functionality 25 engine at block 828 . The rule may then be available for use of FIG . 7 relates to rules handling . As described above with within the distributed transcription environment . For reference to certain system embodiments , there are many example , the rule engine may be configured to provide some ways of providing rule handling functionality within the or all of the rules ( e . g . , according to associated hierarchies ) scope of various embodiments of the invention . FIG . 8 for use by the distributed transcription environment in shows a simplified flow diagram of an illustrative method 30 evaluating transcription products ( e . g . , as part of the vali for handling rules for use in a distributed transcription dation in block 624 of FIG . 6 or as part of the validation in environment , according to various embodiment , of the block 736 of FIG . 7 ) . invention . As discussed above , while the method 800 of FIG . 8

The method 800 begins at block 804 by receiving a describes some embodiments of rules handling , many other request to build a rule . In some embodiments , the request 35 embodiments are possible . One specific embodiment , imple includes new requirements for editing an existing rule . In mented as part of a computer - implemented transcription other embodiments , the request includes requirements for environment ( e . g . , the computational system 550 of FIG . 51 , building a new rule . For example , the requirements may be the rule processing module 328 of FIG . 3 , etc . ) , is described received from a participant ( e . g . , a user ) . In certain embodi - with reference to FIGS . 9 - 13 . FIGS . 9 - 13 describe certain ments , the requests may only be received through certain 40 functionality of an application , titled " Quality Scan Rules , ” administrative channels , from certain individuals or entities , or " OSR . ” or by certain individuals or entities . QSR is an illustrative embodiment of rule handling imple Once the requirements have been received in block 8041 , mentation for a transcription environment , according to

a rule builder ( e . g . , a rule building application ) may be various embodiments of the invention . QSR is described as initialized at block 808 . In some embodiments , the rule 45 a software application with a graphical user interface builder includes a rule building interface that provides ( “ GUI ” ) . The GUI provides a user of QSR with access to various controls , functionality , access to available rule ele - various functionality , including rule generation , editing , ments ( e . g . , operators , operands , operand functions , etc . ) . publishing , and testing . In one illustrated function , a user Embodiments of the rule builder may be initialized at block may initialize a rule generation wizard . 808 based on certain entitlements . For example , certain 50 When the wizard first initializes , an existing rules tab is functionality may be available only to certain types of displayed , showing any rules that exist under a current job ' s account holders . domain . FIG . 9A shows an illustrative screen shot of an

In some embodiments , at block 812 , the rule requirements existing rules tab 910 in an embodiment of the rule genera received in block 804 are translated into a rule function . The tion wizard 900a . As illustrated , the existing rules tab 910 rule function may be adapted to be compatible with the rule 55 shows a number of columns , including a name column for builder initialized in block 808 . In certain embodiments , the indicating the name of the rule , a user message column for rule function may include standard types of logic ( e . g . , indicating message displayed to the user if the rule resolves Boolean logic , etc . ) , plain language ( e . g . , which may be to be displayed , a description column including a description parsed within the rule builder ) , etc . For example , the rule of the rule , a test column for providing test results for the may be defined by one or more expressions . 60 rule , and / or any other useful information about existing

It may be desirable , in some embodiments , to minimize or rules . These columns are used to effectively provide a list of prevent creation of invalid or incorrect rules by validating illustrative rules that may be run against the job upon rules at block 816 . This validation at block 816 may include validation ( e . g . , when the transcriptionist tries to submit the making a determination at decision block 820 of whether or job ) . not the rule logic is valid . For example , the rule logic may 65 In certain embodiments , other functionality is provided . be self - inconsistent or may not produce the desired result For example , in some embodiments , clicking on a “ Test " according to the request received in block 804 . If the rule is button in the existing rules tab 910 while the existing rules

21 US 9 , 761 , 226 B2

22 tab 910 is active resolves each rule against the currently or more expressions , and the rule editor tab 930 shows a high active job and displays the results to the user . Rows may level overview of each expression that makes up the rule highlight in red to indicate that the rule condition ( s ) asso - conditions . For example , the rule illustrated may be trig ciated with that row were not met ( e . g . , the rule would not gered whenever a search of the text of the transcription be triggered anywhere in the job and would not be displayed 5 product finds characters equal to either “ intraatrial septum " to the user when the user either submits the job or manually or “ intraatrial septal . ” It will be appreciated that may types runs QSR ) and highlight in green to indicate that condi - of expression are possible , including many types of logic tion ( s ) were met ( e . g . , the rule would be triggered some - ( e . g . , plain language parsing , Boolean expressions , etc . ) , where in the job and would be displayed to the user when the operands , operators , types , hierarchies ( e . g . , blocking or user either submits the job or manually runs QSR ) . In certain 10 grouping , etc . ) , etc . Further , there may be no limit to the embodiments , the test column displays " True ” if the rule number of expressions allowed fir a particular rule . resolved to be displayed and “ False ” if it will not be The rule editor tab 930 may provide other functionality displayed . Other GUI elements may provide additional through other GUI elements . For example , the GUI may functionality . For example , as illustrated , a “ Reset " button provide an Un - Group / Group button for creating groupings may be included in the existing rules tab 910 . 15 and hierarchies in the expressions ( e . g . , to force a particular

In some embodiments , double clicking on a row or order of operations ) , a Delete button for deleting an expres selecting a row and clicking an edit button ( e . g . , or otherwise sion in the Expressions list , a Cancel button for canceling the interacting with a particular existing rule ) will load that rule rule editing dialog , etc . In some embodiments , a " Clear ” into a rule editor tab . FIG . 9B shows an illustrative screen button is provided in the GUI for clearing the current rule shot of a rule editor tab 930 in an embodiment of the rule 20 information and starting over with creating a rule . In certain generation wizard 900b . As illustrated , the rule editor tab embodiments , selecting the rule editor tab 930 when the 930 includes various regions with information about the rule wizard is first initialized generates essentially the same selected for editing . Some regions may correlate to regions screen as if the " Clear ” button is pressed while editing an of the existing rules tab 910 . For example , there may be a existing rule . Certain embodiments include buttons for inter “ Name ” region , a user message region , and a description 25 acting with additional condition processing functions . For region , substantially correlating with the name column , the example , " Group ” and “ Un - Group ” buttons ( e . g . , explained user message column , and the description column of the more below ) , “ Move Up ” and “ Move Down ” buttons , and / or existing rules tab 910 , respectively . It is worth noting that other buttons or controls may be included in the rule editor certain text processing functionality may be provided . For tab 930 . example , embodiments of the user message column may be 30 Embodiments of the rule creation wizard 900 additionally configured to allow the user message to be derived from the provide functionality for creating and / or editing individual text that trigger : the rule ( e . g . , if transcriptionists often expressions for use in defining rule conditions . In certain confuse “ interatrial ” and “ intraatrial , ” a rule may return the embodiments , clicking an “ Add ” button on the rule editor string “ Phrase . . . intraatrial septum ' . . . is found in report . tab 930 will initialize a rule builder application . FIG . 10A Change to ' interatrial septum ” ” , where the potentially con - 35 shows an illustrative screen shot of a rule builder application fused words are automatically filled into fields ) . 1000a in an embodiment of the rule generation wizard . As As discussed above , various types of rules may be used illustrated , the rule builder application 1000 may be config

for various reasons . In some embodiments , the rule editor ured to allow building of rules according to different rule tab 930 allows a selection of the rule type , for selecting types . The builder screen may add and remove controls and whether the rule is , for example , an informational , a warn - 40 options based on user selections . The selected rule type in ing , or an error rule . In some embodiments , rule types are FIG . 10A is a “ Standard ” rule , indicating one category of color coded or otherwise indicated ( e . g . , informational rules rule formulated as a logical operator acting on left and right are green , warning rules are blue , and error rules are red ) . operands . Text associated with the rules ( e . g . , when a rule - related Many embodiments of expressions involve putting message is displayed to the user ) may also correspond to 45 together two sets of operands with an operator between these colors or indicia . them . For example , this may limit possible invalid rules that

Notably , some rules may indicate definite errors that must could cause problems within the application . Many types of be fixed , while others may indicate possible or probable operand are possible . For example , operands may include : errors that may or may not need fixing . For example , many blanks ( e . g . , an inserted blank bookmark in the document , informational and warning rules may indicate certain infor - 50 where a transcriptionist could not understand an audio mation or warnings to the transcriptionist ( e . g . , or other dictation file ) , corrections ( e . g . , as included in the transcrip validator ) . It may be at the discretion of the validator , or tion product by proofers or auditors ) , customer bookmark someone in the validation chain , to determine whether the ( e . g . , customer - specific bookmarks , like macro prompts or trigger for the rule warrants a fix , at which point , the issue specific fields ) , document body ( e . g . , the body of the report , may be resolved . Many error rules , however , may require 55 not including tab pages ) , internal bookmarks ( e . g . , book fixing before allowing submission of the transcription prod - marks internal to the application , application provider , uct . In some embodiments , the determination of whether to workflow manager , etc . ) , section headings ( e . g . , section allow submission even when a particular rule is triggered is headings in the document body ) , static tab pages ( e . g . , the a function of the rule type ( e . g . , submission is allowed when set of tabs that include the job , internal flags , customer flags , informational or warning rules are triggered , but not when 60 etc . ) , tab page lookup ( e . g . , the dynamically built tabs like error rules are triggered ) . In other embodiments , the rule Author , CC , etc . ) , entered value ( e . g . , may only be available editor tab 930 includes a selection ( e . g . , a radio button or in the right operand for use in hard - coding a value ) , etc . other GUI element ) for indicating whether to allow submis A user may use the rule builder by working from left to sion . right inside the builder . As certain selections are made ,

Embodiments of the rule editor tab 930 also enable 65 controls and selections may change on other portions of the indication of the functionality , or conditions , of the rule . In builder FIG . 10B shows one illustrative screen shot of the some embodiments , the rule functionality is provided as one rule builder application 1000b , in which selecting “ customer

24 US 9 , 761 , 226 B2

23 bookmarks ” as the left operand reveals a list of available invention . For added clarity , some additional functionality is customer bookmarks in the adjacent window and available described below with reference to specific rule building operators and right operands . FIG . 10C shows another examples . illustrative screen shot of the rule builder application 1000c , In one embodiment , the count function may be used to in which selecting “ Static Tab Pages ” or “ Tab Page Lookup " 5 count other types of document contents or parameters ( e . g . , reveals new controls on the builder screen . As illustrated in the number of sections in a document ) . FIG . 10F shows an FIG . 10C , an upper combobox control displays a tab page illustrative screen shot of the rule builder application 1000f , name , while a lower listbox displays tab page elements . Of in which a function is provided called “ Age Value , " which course any number or type of control may be displayed for becomes available when searching the document body . The various functionality . For example , if a control that is a 10 “ Age Value ” function may scan the body of the transcription checkbox is selected , the user interface may change to allow product for the age of the patient , looking for years , month , checking or un - checking the option . weeks , and days . The right operand indicates another func

In addition to the many types of operands possible , tion called " Age Type , ” relating to Tab Page “ Patient : embodiments of the rule builder provide many types of Birthdate . ” The application will evaluate the rule by reading operand functions for handling specific tasks relating to 15 the patient ' s birth date from the Patient tab , and converting selected operands ( e . g . , which may be listed below the the birth date to days , weeks , months , and years for the scan operand selections ) . Some illustrative operands are dis rule evaluation . cussed herein , however , these are intended only to provide FIG . 10G shows another illustrative screen shot of the rule non - limiting examples of possible operands . One operand builder application 1000g , in which a function searches a function may be " characters in text , ” which may look inside 20 particular section of the document for identified information . the text of the operand for whatever value it is being According to the illustrated expression , the left operand compared against . Another operand function may be indicates that the expression will search section headings for " count , ” which may check for a count of how many itera - the " Medications ” heading . Text only within that section of tions of a multi - entity exist . For example , count may be used the document will then be searched for the string “ Zocor . " to determine whether there is more than one CC in a report . 25 Of course , other section headings may be searched , includ Still other operand functions may include " First ( num ) ing subheadings , and other types of right operands may be Characters ” and “ last ( num ) Characters ” for evaluating used to identify other types of data within those sections . whether a certain sub - string is present at the beginning or I t is worth noting that the rule builder application 1000 end of a string . Yet other operand functions may include works together with other functionality of the rule genera “ Date Year , ” “ Date Month . ” and “ Date Day ” for evaluating 30 tion wizard 900 , like the rule editor tab 930 . FIGS . 11A and certain date fields and / or formats . 11B show use of the rule builder application 1000 to build

Even another operand function may be " length , " which expressions for part of a rule in the rule editor lab 930 , may evaluate the length of a string . FIG . 10D shows an respectively . FIG . 11A shows one illustrative screen shot of illustrative screen shot of the rule builder application 1000d , the rule builder application 1000g , in which an expression is in which a rule is generated for evaluating whether an 35 created for restricting a particular character " } " identified as AttendingName field has been filled in on a patient tab . an illegal character for the transcription product ( e . g . , as part “ TabPageLookup " is used as the left operand . “ Patient of the handling instructions agreed to with a particular AttendingName ” is set as the Tab Page to evaluate , Length facility ) . The expression illustrated in FIG . 11A effectively is used as the left operand function , and the rule evaluates searches through the document body of the transcription whether the “ entered value ” is greater than zero ( > 0 " ) . 40 product for all occurrences of the character .

While the expressions described above include various FIG . 11B shows an illustrative screen shot of the rule types of " standard ” expressions , other categories of expres - editor tab 930 in an embodiment of the rule generation sions may be available . In some embodiments , expressions wizard 900c for a rule that searches for all illegal characters may be available as " search " expressions . FIG . 10 shows an for a transcription product . It will be appreciated that the illustrative screen shot of the rule builder application 1000e , 45 expression created in the rule builder application 1000g in which an embodiment of a " search " expression is shown . embodiment of FIG . 11 A is one of a number of expressions

The left operands illustrated in FIG . 10E include “ Cor - used in the rule shown in FIG . 11B . In many embodiments , rections . " which evaluates corrections made to the transcrip - there is effectively no limit to the number of expressions tion document ( e . g . , by an auditor or editor ) ; “ Customer allowed for a single rule . Each expression may be created Bookmarks . ” which evaluates certain customer - specified 50 independently , or otherwise , through the rule builder appli bookmarks ( e . g . , allergies , dictation macro prompts , etc . ) ; cation 1000 , to search through the document body for a “ Document Body , ” which evaluates the body text of the particular illegal character . These expressions are combined document . “ Internal Bookmarks , ” which evaluates non into the full rule in the rule editor tab 930 . It is worth noting customer - specific bookmarks ; and “ Section Headings , ” that the rule message suggests removing the illegal charac which evaluates information within specific hierarchical 55 ters prior to submitting the transcription product . However , sections and / or sub - sections . Search expressions may also the rule also indicates that job submission is allowed , even provide other functionality , like the option to search only for if the triggering condition ( s ) for the rule are not resolved . words of a certain case , only for entire words , etc . It will be In addition to adding and editing expressions , embodi appreciated that many other types of “ search " expression are m ents of the rule builder allow the user to group expressions . possible . 60 FIG . 12 shows an illustrative screen shot of the rule editor

Embodiments of the rule builder application 1000 may tab 930 in an embodiment of the rule generation wizard provide many different types of functions . Additionally , the 900c , in which grouping is used in a rule . For example , application may be continually updated to meet the requests grouping expressions may change the overall rule logic by of various customers and / or other parties . As such , the forcing a specific order of operations . The first condition descriptions of specific functionality provided in this 65 illustrated in FIG . 12 evaluates whether the body of the description should not be construed as limiting the scope of report does not contain the admit date . The operand value the QSR application or any other embodiments of the “ ! = ” represents not equal . The second line looks at the tab

US 9 , 761 , 226 B2 25 26

page admit date and evaluates whether it is filled in ( i . e . , not to operate on the same data type with different filtering , it equal to empty ) . The third condition here evaluates whether may not be processed properly by certain embodiments of the body of the report does not contain the discharge date . the QSR application . The final condition here evaluates whether the discharge By way of example , a rule is created to ensure that all date in the tab page is empty . The rightmost column of the 5 documents submitted by attending physician , Dr . Smith , are listview containing the expressions shows the conditions copied ( e . g . , " CC ’ d ” ) to Dr . Johnson , the Chief of Medicine . ( e . g . , logical “ And ” and “ Or ” ) . A first condition is evaluated to look at provider types

Grouping expressions together may change the way that associated with the document to find the attending physi the overall rule evaluates . In this rule the first two lines are c ian , and determine whether the attending physician is Dr . grouped together and the last two lines are grouped together . 10 Smith ( e . g . , " ProviderType . AttendingPhysician = ' Dr . This is shown by the open parenthesis in the firm expression Smith ” ) . If so , a second condition is evaluated to look at and the close parenthesis in the second expression . With the provider types associated with the document to find the Or condition between the two groupings , this rule indicates people copied upon submission , and determine whether the that if either the first two expressions resolve true , or the last 16 Chief of Medicine is included ( e . g . , two expressions resolve true , then display the message . “ ProviderType . JobCopyRecipient = “ Dr . Johnson ” ) . One As discussed above , after creating or editing a rule , it may embodiment of the rules engine may evaluate the first

be desirable to test the rule to ensure that the rule logic is condition by filtering all “ ProviderType ” data to “ Attend valid and operates as intended . In some embodiments , a rule ingPhysician , ” effectively discarding the remaining “ Provid may be tested by clicking on a “ Test ” button on the rule 20 erType " data . As such , evaluation of the second condition editor tab 930 . Clicking on the “ Test ” button may cause a would not be evaluated as desired . The multi - entity refine new window to appear . An embodiment of a “ Test ” window ment screen 1400 allows embodiments of the rule generation 1300 is shown in FIG . 13 . The results of each expression wizard 900 to process rules having multiple types of refine may be displayed to the user . In some embodiments , the ment to the same data type ( e . g . , multiple conditions of the results are color - coded . For example , if the background is 25 came rule addressing different provider types ) . green , that part of the expression is true ; if it is red , it is false . Once the rules are created and published , they may be The last column in the listview also shows the value spelled applied to a transcription product to determine whether there out . The two boxes at the bottom of the screen show you the are any rule violations in the product . FIG . 15A shows an overall results for the rule . The data results ( e . g . , color , illustrative screenshot of a transcription environment 1500

value , etc . ) may tell you whether or not the overall rule 30 in which a rule violation is identified , according to various embodiments . The transcription environment 1500 may resolved as True or False . Additionally , the parsing results include any useful regions , GUI elements , etc . As illustrated , may indicate whether the rule is valid ( e . g . , whether the the transcription environment 1500 includes a transcription logic is self - consistent , whether the rule may publish , etc . ) . text region that shows the text of the transcription product , In the case illustrated in FIG . 13 , the rule is designed to 10 35 and a QSR region that shows identified rule violations and evaluate whether the patient service data is blank . In the corresponding descriptions .

tested condition , the operand of the rule is “ Aug . 24 , 2005 , " In one embodiment , one rule violation is found in the not blank . As such , the expression evaluates as “ FALSE . ” as transcription product . In particular , the rule is configured to indicated in the rightmost column and the Data Results box . identify the sex of the patient and determine whether correct The “ FALSE ” result , however , is the intended result , indi - 40 pronouns are used in the transcription text to describe the cating that the rule appears to be operating properly . This is patient according to the patient ' s sex . As illustrated , the indicated by the “ PASS ” result in the Parsing Results box . patient is identified as a female ( e . g . , according to patient

After creating , editing , and / or testing a rule , the rule may data , as shown in a patient data region of the transcription be published for use in the transcription environment . In environment 1500 ) . A rule is invoked that includes the rule some embodiments , the user is only allowed to select or 45 message : “ Patient is female . Verify he / his / him pronouns in restrict the locations for publication of the rule to domains report are not in reference to patient . ” An occurrence of the falling below the existing domain in the domain hierarchy rule violation is identified in the transcription text region of ( e . g . , the worktypes under the current location ( s ) and the transcription environment 1500 as highlighted text ( the whether or not the rule is specific to the current author ) . term “ He " is highlighted ) . It will be appreciated that the Various domains may be available , including Organizatio - 50 validator ( e . g . , the transcriptionist , auditor , etc . ) may then nID , SiteID , LocationID , Location WorktypeID , PersonID , choose to ignore the rule , correct the transcription text where WorkLocationID and WorkRoleID . Clicking the publish appropriate , validate that the text is correct as is ( e . g . , the button may publish the rule and return the results of the “ He ” refers to a male individual that is not the patient ) , etc . publication in a popup message . After the transcription product is validated using the rules ,

In certain embodiments , publication will only be available 55 or otherwise submitted , various levels of auditing may ( e . g . , the “ Publish ” button will only be active ) when mini - occur , as described above . For example , a transcription mum requirements for publishing a rule type have been met . assignment may include data supplied by an author through For example , for an informational rule , publication may a speech recognition system . The first level of transcription require Name and Message to be filled in . However , for may be performed by a speech recognition system ( e . g . , a warning or error rules , publication may additionally require 60 software application ) . A second level of transcription may conditions to be provided and pre - tested . then be performed by a human transcriptionist acting as a

Other GUI control and / or screens may be used to provide speech recognition editor . For example , rather than the additional rule building functionality . In some embodiments , human transcriptionist actually transcribing the author ' s as shown in FIG . 14 , additional rule building functionality is audio from scratch , the human transcriptionist may merely illustrated by way of a multi - entity refinement screen 1400 . 65 edit mistakes in the speech recognition ' s automatic tran For example , certain types of rules include conditions that scription of the audio . A proofer may then proofread the effectively filter a data type . If a later condition is configured document prior to submission .

27 US 9 , 761 , 226 B2

28 FIG . 15B shows another illustrative screenshot of a tran - wise . Consequently , although the invention has been

scription environment 1550 in which an auditor can see what described with respect to exemplary embodiments , it will be rule violations have been identified and what remedial action appreciated that the invention is intended to cover all has occurred , according to various embodiments . As in FIG . modifications and equivalents . 15A , the transcription environment 1500 may include any 5 useful regions , like a transcription text region , and a QSR What is claimed is : region . In FIG . 15B , however , the QSR region may be 1 . A method for rules handling in a distributed transcrip configured to show data that is useful for auditing the tion system , the method comprising : transcription workflow and / or quality . receiving a transcription assignment at a computer - imple As illustrated , a number of rule violations were identified 10 mented transcription environment , the transcription

when the transcription rules were applied to the original assignment comprising : transcription product . For example , the original transcription dictation data comprising audio information dictated by product may include text generated automatically by a an author into a dictation interface , the author being speech recognition system . The QSR region may show that associated with a context designation ; and some rules were identified to a speech recognition editor and 15 a transcription rule set being one of a plurality of others were provided to a proofer ( e . g . each of the editor and transcription rule sets stored in a rules data store and proofer being identified by a user ID ) . Additionally , the OSR generated for application to the dictation data as a region may indicate what rule was violated , whether the function of the context designation , the context des particular user fixed the rule , what fix was performed , and / or ignation including at least one context tag indicating any other useful information for the auditor . The auditor may 20 a context for the transcription assignment , wherein be provided with additional functionality , such as the ability the at least one context tag is associated with at least to scroll through the list , filter the list ( e . g . , on role , error one of a plurality of transcription rules , and wherein type , action , etc . ) , process statistical metrics , run reports , etc . the context designation is associated with a prompt

It will be apparent to those skilled in the art that substan provided to the author substantially when the author tial variation , may be made in accordance with specific 25 dictated the dictation data , and wherein the transcrip requirements to all of the systems , methods , software , and tion rule set includes at least one of a warning rule or other embodiments described above . For example , custom an error rule , the warning rule including a trigger ized hardware might also be used , and / or particular elements based on a condition indicating a possible error , the might be implemented in hardware , software ( including error rule including a trigger based on a condition portable software , such as applets , etc . ) , or both . Further , 30 indicating a definite error ; connection to other computing devices such as network receiving transcription data at the computer - implemented input / output devices may be employed . transcription environment from a transcriptionist via a

While the invention has been described with respect to transcription interface , the transcription data compris exemplary embodiments , one skilled in the art will recog ing textual representations of corresponding portions of nize that numerous modifications are possible . For example , 35 the dictation data , the textual representations being at die methods and processes described herein may be imple least partially synchronized with the corresponding mented using hardware components , software components , portions of the dictation data ; and / or any combination thereof . Further , while various identifying a rule violation by applying the transcription methods and processes described herein may be described rule set to the transcription data after receiving the with respect to particular structural and / or functional com - 40 transcription data using the computer - implemented ponents for ease of description , methods of the invention are transcription environment , the rule violation being not limited to any particular structural and / or functional associated with a textual representation and substan architecture but instead can be implemented on any suitable tially synchronized with the corresponding portion of hardware , firmware , and / or software configuration . Simi the dictation data , the application of the transcription larly , while various functionality is ascribed to certain sys - 45 rule set triggering at least one of the warning rule or the tem components , unless the context dictates otherwise , this error rule ; and functionality can be distributed among various other system displaying an indication of the rule violation to the components in accordance with different embodiments of transcriptionist via the computer - implemented tran the invention . scription environment . Moreover , while the procedures comprised in the methods 50 2 . The method of claim 1 , further comprising :

and processes described herein are described in a particular receiving an interaction with the computer - implemented order for ease of description , unless the context dictates transcription environment from the transcriptionist otherwise , various procedures may be reordered , added , indicating a selection of the rule violation ; and / or omitted in accordance with various embodiments of in response to receiving the interaction , configuring play the invention . Moreover , the procedures described with 55 back of the audio information from a position associ respect to one method or process may be incorporated within ated with the corresponding portion of the dictation other described methods or processes ; likewise , system data substantially synchronized with the rule violation . components described according to a particular structural 3 . The method of claim 1 , wherein the transcription architecture and / or with respect to one system may be assignment is received at the computer - implemented tran organized in alternative structural architectures and / or incor - 60 scription environment from a workflow management server porated within other described systems . Hence , while vari - over a communications network , the workflow management ous embodiments are described with or without certain server being communicatively coupled with the rules data features for ease of description and to illustrate exemplary store and configured to : features , the various components and / or features described receive the dictation data from the author , the author being herein with respect to a particular embodiment can be 65 one of a plurality of authors in communication with the substituted , added , and / or subtracted from among other workflow management server over the communications described embodiments , unless the context dictates other network ;

15

20

US 9 , 761 , 226 B2 29 30

identify the transcription rule set from the rules data store 12 . The method of claim 1 , wherein the set of transcrip for application to the dictation data ; tion rules comprises :

generate the transcription assignment , such that the tran an information rule configured to trigger a rule violation scription assignment comprises the dictation data and as a function of an association between the dictation the transcription rule set and is formatted for use in the 5 data and a context tag associated with the information computer - implemented transcription environment ; rule , regardless of the transcription data received from

assign the transcription assignment to the transcriptionist , the transcriptionist , a triggering of the information rule the transcriptionist being one of a plurality of transcrip indicating information relating to a handling instruction

associated with the dictation data ; tionists in communication with the workflow manage ment server over the communications network ; and a warning rule configured to trigger a rule violation as a

function of applying the warning rule to the transcrip communicate the transcription assignment over the com tion data received from the transcriptionist , a triggering munications network to the transcriptionist for use in of the warning rule indicating a possible error in the the computer - implemented transcription environment . transcription data ; and 4 . The method of claim 1 , wherein the context designation 15 an error rule configured to trigger a rule violation as a

comprises a plurality of context tags that indicate the context function of applying the error rule to the transcription for the transcription assignment , each of the plurality of data received from the transcriptionist , a triggering of context tags being associated with the plurality of transcrip the error rule indicating a definite error in the transcrip tion rules , and wherein the transcription rule set is derived tion data . from the plurality of transcription rules . 13 . The method of claim 1 , further comprising :

5 . The method of claim 4 , wherein each context tag receiving a submission instruction from the transcription indicates at least one of an organization identifier , a site ist at the computer - implemented transcription environ identifier , a location identifier , a work type identifier , an ment that a transcription product comprising the tran author identifier , an author type identifier , an author role scription data received from the transcriptionist is identifier , a work role identifier , a dictation interface iden - 25 complete ; and tifier , or a transcriptionist identifier . validating the transcription product automatically in

6 . The method of claim 4 , further comprising : determin response to receiving the submission instruction , vali ing the context designation by identifying the context tags dating the transcription product comprising identifying associated with the dictation data , wherein at least some of the rule violation . the context tags are identified by analyzing the dictation 30 14 . The method of claim 13 , further comprising : when data . validating the transcription product comprises identifying

7 . The method of claim 4 , further comprising : determin - triggering of an error rule indicating a definite error in the ing the context designation by identifying the context tags transcription data , preventing submission of the transcrip associated with the dictation data , wherein at least some of tion product while the rule violation persists . the context tags are associated with prompts provided to the 35 15 . The method of claim 13 , further comprising : substan author substantially when the dictation data is dictated by tially upon completion of validating the transcription prod the author . uct , generating a log characterizing performance of at least

8 . The method of claim 1 , wherein receiving transcription one of the transcription environment or the transcriptionist . data at the computer - implemented transcription environ 16 . The method of claim 15 , further comprising : receiving ment from the transcriptionist comprises : 40 the log associated with the transcription assignment at a

playing the audio information comprised by the dictation workflow management server , the log being one of a plu data from the computer - implemented transcription rality of logs associated with a plurality of transcription environment to the transcriptionist ; assignments , the workflow management server being con

receiving the transcription data during playback of the figured to adjust a workflow metric as a function of the audio information , such that at least some of the textual 45 plurality of logs and to assign transcription assignments to representations are received via the transcription inter - one or more of a plurality of transcriptionists as a function face substantially as the respective corresponding por - of the workflow metric . tions of the dictation data are being played to the 17 . The method of claim 1 , wherein the transcriptionist is transcriptionist . a computer - implemented speech recognition application .

9 . The method of claim 1 , further comprising : providing 50 18 . A system for rules handling in a distributed transcrip a transcription template to the transcriptionist configured to tion system , the system comprising : receive the transcription data from the transcriptionist via a transcription module , configured to : the transcription interface , the transcription template being receive a transcription assignment , the transcription generated at least according to the set of transcription rules . assignment comprising :

10 . The method of claim 1 , wherein identifying the rule 55 dictation data comprising audio information dictated violation by applying the transcription rule set to the tran by an author into a dictation interface , the author scription data using the computer - implemented transcription being associated with a context designation ; and environment comprises : a transcription rule set being one of a plurality of

applying the transcription rule set to the transcription data transcription rule sets stored in a rules data store substantially while receiving the transcription data 60 and generated for application to the dictation data from the transcriptionist via the transcription interface , as a function of the context designation , the con such that identifying the rule violation occurs substan text designation including at least one context tag tially in real time while receiving the transcription data . indicating a context for the transcription assign

11 . The method of claim 1 , further comprising : ment , wherein the at least one context tag is receiving an instruction to validate the transcription data , 65 associated with at least one of a plurality of wherein identifying the rule violation occurs substantially transcription rules , and wherein the context des

in response to receiving the instruction . ignation is associated with a prompt provided to

32

15

US 9 , 761 , 226 B2 31

the author substantially when the author dictated communicate the transcription assignment over the com the dictation data , and wherein the transcription munications network to the transcriptionist for use in rule set includes at least one of a warning rule or the computer - implemented transcription environment . an error rule , the warning rule including a trigger 23 . The system of claim 18 , wherein the transcription based on a condition indicating a possible error , 5 module is configured to provide the computer - implemented the error rule including a trigger based on a transcription environment such that receiving transcription condition indicating a definite error ; data at the computer - implemented transcription environ

receive transcription data via a computer - implemented ment from the transcriptionist comprises : transcription environment from a transcriptionist via playing the audio information comprised by the dictation

data from the computer - implemented transcription a transcription interface , the transcription data com environment to the transcriptionist ; and prising textual representations of corresponding por receiving the transcription data during playback of the tions of the dictation data , the textual representations audio information , such that at least some of the textual being at least partially synchronized with the corre representations are received via the transcription inter sponding portions of the dictation data ; and face substantially as the respective corresponding por generate a draft transcription product comprising the tions of the dictation data are being played to the transcription data ; and transcriptionist .

a validation module , communicatively coupled with the 24 . The system of claim 18 , wherein the transcription transcription module , and configured to validate the module is configured to provide a transcription template draft transcription product to generate a validated tran - 20 configured to receive the transcription data from the tran scription product by : scriptionist via the transcription interface , the transcription identifying rule violations by applying the transcription template being generated at least according to the set of

rule set to the transcription data after receiving the transcription rules . transcription data , each rule violation being associ 25 . The system of claim 18 , wherein the validation ated with a textual representation and substantially 25 module is configured to apply the transcription rule set to the synchronized with the corresponding portion of the transcription data substantially while the transcription mod dictation data , the application of the transcription ule receives the transcription data from the transcriptionist , rule set triggering at least one of the warning rule or such that validating the draft transcription product occurs

substantially in real time while receiving the transcription the error rule ; and 30 data . resolving each rule violation .

19 . The system of claim 18 , wherein resolving each rule 26 . The system of claim 18 , wherein the validation module is configured to receive an instruction to validate the violation comprises : transcription data , wherein validating the draft transcription providing an indication of the rule violation to the tran product occurs substantially in response to receiving the scriptionist ; and 35 instruction . receiving a resolution instruction from the transcriptionist * * 27 . The system of claim 18 , further comprising : a delivery

at the validation module . module , communicatively coupled with the validation mod 20 . The system of claim 19 , wherein resolving each rule ule , and configured to output a final transcription product

violation further comprises : according to the validated transcription product and accord receiving an interaction with the computer - implemented 40 ing to a formatting scheme associated with the context

transcription environment from the transcriptionist designation . indicating a selection of the rule violation ; 28 . The system of claim 27 , wherein the delivery module

in response to receiving the interaction , configuring play - is configured to : back of the audio information from a position associ determine whether the draft transcription product has ated with the corresponding portion of the dictation 45 been validated to generate the validated transcription data substantially synchronized with the rule violation . product ; and

21 . The system of claim 18 , wherein the transcription when the draft transcription product has not been vali module is communicatively coupled with a workflow man dated to generate the validated transcription product , agement server over a communications network and prevent output of the final transcription product . receives the transcription assignment from the workflow 50 29 . The system of claim 18 , further comprising : management server . a logging module , communicatively coupled with the

22 . The system of claim 21 , wherein the workflow man validation module , and configured to generate a log agement server is configured to : substantially upon completion of validating the draft

receive the dictation data from the author , the author being transcription product , the log characterizing perfor one of a plurality of authors in communication with the 55 m ance of at least one of the transcription environment workflow management server over the communications or the transcriptionist . network ; 30 . A non - transitory machine - readable medium for rules

identify the transcription rule set from the rules data store handling in a transcription environment , the non - transitory for application to the dictation data ; machine - readable medium having instructions stored

generate the transcription assignment , such that the tran - 60 thereon which , when executed by a machine , cause the scription assignment comprises the dictation data and machine to perform steps comprising : the transcription rule set and is formatted for use in the receiving a transcription assignment at a computer - imple computer - implemented transcription environment ; mented transcription environment , the transcription

assign the transcription assignment to the transcriptionist , assignment comprising : the transcriptionist being one of a plurality of transcrip - 65 dictation data comprising audio information dictated by tionists in communication with the workflow manage an author into a dictation interface , the author being ment server over the communications network ; and associated with a context designation ; and

US 9 , 761 , 226 B2 33 34

a transcription rule set being one of a plurality of tran - transcription rules , and wherein the transcription rule set is scription rule sets stored in a rules data store and derived from the plurality of transcription rules . generated for application to the dictation data as a 33 . The non - transitory machine - readable medium of function of the context designation , the context desig - claim 30 , the instructions stored thereon , when executed by nation including at least one context tag indicating a 5 5 a machine , causing the machine to perform steps further context for the transcription assignment , wherein the at comprising :

providing a transcription template to the transcriptionist least one context tag is associated with at least one of configured to receive the transcription data from the a plurality of transcription rules , and wherein the con transcriptionist via the transcription interface , the tran text designation is associated with a prompt provided to scription template being generated at least according to the author substantially when the author dictated the 10 the set of transcription rules . dictation data , and wherein the transcription rule set 34 . The non - transitory machine - readable medium of includes at least one of a warning rule or an error rule , claim 30 , wherein identifying the rule violation by applying the warning rule including a trigger based on a condi rigger based on a condi . the transcription rule set to the transcription data using the tion indicating a possible error , the error rule including 15 computer - implemented transcription environment com a trigger based on a condition indicating a definite 3 prises : error ; applying the transcription rule set to the transcription data

receiving transcription data at the computer - implemented substantially while receiving the transcription data transcription environment from a transcriptionist via a from the transcriptionist via the transcription interface , transcription interface , the transcription data compris - 20 such that identifying the rule violation occurs substan ing textual representations of corresponding portions of tially in real time while receiving the transcription data . the dictation data , the textual representations being at 35 . The non - transitory machine - readable medium of least partially synchronized with the corresponding claim 30 , the instructions stored thereon , when executed by portions of the dictation data ; and a machine , causing the machine to perform steps further

identifying a rule violation by applying the transcription 25 comprising :

rule set to the transcription data after receiving the receiving an instruction to validate the transcription data , transcription data using the computer - implemented wherein identifying the rule violation occurs substantially transcription environment , the rule violation being in response to receiving the instruction .

associated with a textual representation and substan 36 . The non - transitory machine - readable medium of tially synchronized with the corresponding portion of 30 claim 30 , the instructions stored thereon , when executed by the dictation data , the application of the transcription 30 a machine , causing the machine to perform steps further rule set triggering at least one of the warning rule or the comprising : error rule . receiving a submission instruction from the transcription

31 . The non - transitory machine - readable medium of ist at the computer - implemented transcription environ claim 30 , the instructions stored thereon , when executed by 35 ment that a transcription product comprising the tran a machine , causing the machine to perform steps further scription data received from the transcriptionist is comprising : complete ; and

displaying an indication of the rule violation to the validating the transcription product automatically in

transcriptionist via the computer - implemented tran response to receiving the submission instruction , vali scription environment ; dating the transcription product comprising identifying

40 receiving an interaction with the computer - implemented the rule violation . transcription environment from the transcriptionist 37 . The non - transitory machine - readable medium of indicating a selection of the rule violation ; and claim 36 , the instructions stored thereon , when executed by

in response to receiving the interaction , configuring play - a machine , causing the machine to perform steps further back of the audio information from a position associ - 45 comprising : ated with the corresponding portion of the dictation when validating the transcription product comprises iden data substantially synchronized with the rule violation . tifying triggering of an error rule indicating a definite

32 . The non - transitory machine - readable medium of error in the transcription data , preventing submission of

claim 30 , wherein the context designation comprises context the transcription product while the rule violation per sists . tags that indicate the context for the transcription assign

ment , each context tag being associated with the plurality of to *

Documents

A A ANI KATA DE - patentimages.storage.googleapis.com · U . S . Patent Sep . 12 , 2017 Sheet 3 of 17 | US 9 , 761 , 226 B2 32 mement , METHY WWW R3 : ?? REFFFFFFFFFFH? EX HERAM TELYSSER