Sikuli Demo + NoVaTAIG Presentation

June 8, 2012Raghavendra

University of JNTU

Outline• Sikuli User Experience at OMB (Rudy and Dan)

– Sikuli environment diagram– Sikuli workflow– Recording a Sample Script– Tool Settings

• Fuzzy Logic Pattern matching– Flow Control Features

• Loops, delays, etc• Assertions, interfacing with Jython

– Record a script and playback• Sikuli Current Status (Dr. Yeh)

– Sikuli history – User Communities– New Developments and future direction

Sikuli Environment Diagram

Sikuli Proof Of Concept @ OMB BSB

Shared Desktop App – similar to Adobe Connect

What Shared Desktop does

• Can open a personal or group room for sharing• Person who opens a room is the room owner• Room owner sends URL invitations to attendees• Room owner can accept attendees individually or

automatically• Room owner can change attendees permissions –

view only, mouse only, keyboard/mouse, host (full permissions including changing other attendee permissions)

What we did @ OMB• Wrote two Sikuli scripts:

– One represented the actions of the room owner– One represented the actions of an attendee

• The two scripts simulated how a room works, and were launched at the same time:– The room owner opened his room and waited for the attendee to

enter– The attendee sent the room URL and waited for the room to open– Once the room was opened the room owner accepted the

attendee– The room owner gave the attendee Host permission– The attendee opened up a Word document and the room and

entered text– The room owner also entered text into the same Word document

NoVaTAIG Demo Outline

1) How to record Sikuli script using IDEa) Sikuli syntax - keywordsb) Image Pattern Matching

2) How to call Sikuli from Watir-Webdriver/ Cucumbera) Feature file b) Scenarios/ Scenario Outline c) Step Definitionsd) HTML output

Start by Using Sikuli IDE to record

Verify the images are recognized

Verify, then migrate sikuli images to Cucumber/ Watir-Webdriver folder

structure

Feature file

Step definitions

Supporting ruby methods

Run the cucumber (happy cuking!)

All Green

Failure scenario

References http://www.software-testing.com.au/blog/2010/08/16/automating-flash-ajax-popups-and-more-using-ruby-watir-and-sikuli/http://catherinedevlin.pythoneers.com/presentations/sikuli/sikuli.htmlhttp://bob.igo.name/wp-content/uploads/2010/10/Bob_Igo_Sikuli_cposc2010.pdfhttp://www.cuberick.com/2010/06/testing-image-generation-with-cucumber.html

For a copy of the cucumber/watir-webdriver/sikuli scripts that were demo’d, please contactFor a copy of the prototype sikuli storyboard and runner that was demo’d, please contacttomyeh@umiacs.umd.edu