sikuli final
TRANSCRIPT
SIKULI SCRIPT
Name: Mangesh BhapkarClass: TE (Computer)Roll No: 12Guided by : Mr.D.D.Sapkal
How to instruct computer,to perform specific task ??? shell script,codding
If you...
Don’t know good programming ?Want to avoid repeting , boring codding ?
An Introduction to…
General Introduction: Silkuli script was developed by User Interface
Design Group,MIT Computer Science and Artificial Intelligence Laboratory(CSAIL).
The developer behind this project are…
What is Sikuli script???Sikuli means “God’s Eye” in the language of native
Mexicans.Sikuli is the new way to program anything on your
computers.Sikuli is a visual technology to search and automate
graphical user interface(GUI) using images (screenshots).It automates anything on the screen without internal API’s
support.You can programmatically control a web page,desktop
application running on Windows/MAC os /Linux or even on iphone application running on an emmulator.
WHAT DO YOU SEE IS WHAT YOU SCRIPT
Platform IndependentWorks on any GUI that can be displayed on
Windows/Linux/MAC Virtual machines Remote desktops Mobile simulators:Android ,iphone Web:Flash,HTML+javascript
Sikuli Environment Diagram…
How it works?Combination of GUI
and Traditional codingJython coding that can
use images as parameters and variables
Screen capture utilised for image selection
Can upload image files
Making program…
Taking snapshots…
Need of Sikuli script…Allows programmer to make visual referances
instead of using names or keywords.
More intuitive and natural approach.
Useful for specific applications that involves manipulation of GUI.
Applications…Execution of repeated task
• Changing system settings• Resetting IP address
Monitoring Constantly looks for a specific change on
screenVisually search the content in a document
Defence against hacking• Test site by repeatedly attacking the site,etc
without having to do yourself.
Sikuli in real world…
Checking new status messages on facebook
LimitationCurrently sikuli script operates only in the
visible screen space and thus is not applicable to invisible GUI elements, such as those hidden underneath other windows,in another tab,or scrolled out of the view.
Dealing with moving and animated object was hard.
Future Development…To automate scrolling or tab switching
actions to bring the GUI elements into view to interact with it visually
Fast and accurate OCR on screen
Who is using it?
References…http://sikuli.orghttp://blog.sikuli.org/http://groups.csail.mit.edu/uid/sikuli/http://groups.csail.mit/demo.shtmlhttp://www.makeuseof.com/tag/create-
automation-scripts-easily-screenshotsTom Yeh Tsung-Hsiang Chang Robert C. Miller
EECS MIT & CSAIL Cambridge, MA, USA 02139 {tomyeh,vgod,rcm}@csail.mit.edu
THANK YOU...