sikuli final

SIKULI SCRIPT

Name: Mangesh BhapkarClass: TE (Computer)Roll No: 12Guided by : Mr.D.D.Sapkal

How to instruct computer,to perform specific task ??? shell script,codding

If you...

Don’t know good programming ?Want to avoid repeting , boring codding ?

An Introduction to…

General Introduction: Silkuli script was developed by User Interface

Design Group,MIT Computer Science and Artificial Intelligence Laboratory(CSAIL).

The developer behind this project are…

What is Sikuli script???Sikuli means “God’s Eye” in the language of native

Mexicans.Sikuli is the new way to program anything on your

computers.Sikuli is a visual technology to search and automate

graphical user interface(GUI) using images (screenshots).It automates anything on the screen without internal API’s

support.You can programmatically control a web page,desktop

application running on Windows/MAC os /Linux or even on iphone application running on an emmulator.

WHAT DO YOU SEE IS WHAT YOU SCRIPT

Platform IndependentWorks on any GUI that can be displayed on

Windows/Linux/MAC Virtual machines Remote desktops Mobile simulators:Android ,iphone Web:Flash,HTML+javascript

Sikuli Environment Diagram…

How it works?Combination of GUI

and Traditional codingJython coding that can

use images as parameters and variables

Screen capture utilised for image selection

Can upload image files

Making program…

Taking snapshots…

Need of Sikuli script…Allows programmer to make visual referances

instead of using names or keywords.

More intuitive and natural approach.

Useful for specific applications that involves manipulation of GUI.

Applications…Execution of repeated task

• Changing system settings• Resetting IP address

Monitoring Constantly looks for a specific change on

screenVisually search the content in a document

Defence against hacking• Test site by repeatedly attacking the site,etc

without having to do yourself.

Sikuli in real world…

Checking new status messages on facebook

LimitationCurrently sikuli script operates only in the

visible screen space and thus is not applicable to invisible GUI elements, such as those hidden underneath other windows,in another tab,or scrolled out of the view.

Dealing with moving and animated object was hard.

Future Development…To automate scrolling or tab switching

actions to bring the GUI elements into view to interact with it visually

Fast and accurate OCR on screen

Who is using it?

References…http://sikuli.orghttp://blog.sikuli.org/http://groups.csail.mit.edu/uid/sikuli/http://groups.csail.mit/demo.shtmlhttp://www.makeuseof.com/tag/create-

automation-scripts-easily-screenshotsTom Yeh Tsung-Hsiang Chang Robert C. Miller

EECS MIT & CSAIL Cambridge, MA, USA 02139 {tomyeh,vgod,rcm}@csail.mit.edu

THANK YOU...