SIKULI SCRIPT
Name: Mangesh Bhapkar
Class: TE (Computer)
Roll No: 12
Guided by : Mr.D.D.Sapkal
How to instruct computer,to perform
specific task ???
shell script,codding
sikuli final
An Introduction to…
 General Introduction:
 Silkuli script was developed by User Interface Design
Group,MIT Computer Science and Artificial Intelligence
Laboratory(CSAIL).
 The developer behind this project are…
 What is Sikuli script???
 Sikuli means “God’s Eye” in the language of native
Mexicans.
 Sikuli is the new way to program anything on your
computers.
 Sikuli is a visual technology to search and automate
graphical user interface(GUI) using images (screenshots).
 It automates anything on the screen without internal API’s
support.
 You can programmatically control a web page,desktop
application running on Windows/MAC os /Linux or even
on iphone application running on an emmulator.
WHAT DO YOU SEE IS WHAT YOU SCRIPT
 Platform Independent
 Works on any GUI that can be displayed on
Windows/Linux/MAC
 Virtual machines
 Remote desktops
 Mobile simulators:Android ,iphone
 Web:Flash,HTML+javascript
 Sikuli Environment Diagram…
 How it works?
 Combination of GUI and
Traditional coding
 Jython coding that can use
images as parameters and
variables
 Screen capture utilised for
image selection
 Can upload image files
 Making program…
 Taking snapshots…
 Need of Sikuli script…
 Allows programmer to make visual referances instead of
using names or keywords.
 More intuitive and natural approach.
 Useful for specific applications that involves manipulation
of GUI.
 Applications…
Execution of repeated task
• Changing system settings
• Resetting IP address
Monitoring
 Constantly looks for a specific change on screen
 Visually search the content in a document
Defence against hacking
• Test site by repeatedly attacking the site,etc without
having to do yourself.
 Sikuli in real world…
 Checking new status
messages on facebook
 Limitation
Currently sikuli script operates only in the visible
screen space and thus is not applicable to invisible GUI
elements, such as those hidden underneath other
windows,in another tab,or scrolled out of the view.
Dealing with moving and animated object was hard.
 Future Development…
 To automate scrolling or tab switching actions to
bring the GUI elements into view to interact with it
visually
 Fast and accurate OCR on screen
 Who is using it?
 References…
 http://sikuli.org
 http://blog.sikuli.org/
 http://groups.csail.mit.edu/uid/sikuli/
 http://groups.csail.mit/demo.shtml
 http://www.makeuseof.com/tag/create-automation-
scripts-easily-screenshots
 Tom Yeh Tsung-Hsiang Chang Robert C. Miller EECS MIT
& CSAIL Cambridge, MA, USA 02139
{tomyeh,vgod,rcm}@csail.mit.edu
THANK YOU...

More Related Content

PDF
Sikuli script
PPTX
Exploring the internal state of user interfaces using sikuli
PPSX
Sikuli script
PPTX
PPTX
Sikuli Slides
PDF
PDF
Automation Testing with Sikuli
PPTX
Sikuli_Demo.pptx
Sikuli script
Exploring the internal state of user interfaces using sikuli
Sikuli script
Sikuli Slides
Automation Testing with Sikuli
Sikuli_Demo.pptx

What's hot (20)

PPSX
Mateusz Radkiewicz - "Automate user's actions with Selenium, Auto it and Sikuli"
PPTX
PDF
Practical Sikuli: using screenshots for GUI automation and testing
PPTX
Make manual testing to automated by Sikuli bug daybkk2013
PPTX
Introduction_to_android_and_android_studio
PDF
Ankit goel cv
PPTX
Building UI for games using the new UI Builder - Unite Copenhagen 2019
PPTX
Gdsc android introduction
PPTX
Anroid Tutorial Beginner level By SAMRAT TAYADE
PPTX
Introduction to Android and Android Studio
PPTX
Android game ppt
PDF
Android UI Design Tips
PDF
Android development basics
PPTX
Android Development
PDF
Android studio 2.2 Tips and Tricks
PPTX
Intel XDK in Brief
PPTX
Android development training
PPTX
Android study jams 1
PDF
Android Development Workshop
PPTX
Basic iOS Training with SWIFT - Part 1
Mateusz Radkiewicz - "Automate user's actions with Selenium, Auto it and Sikuli"
Practical Sikuli: using screenshots for GUI automation and testing
Make manual testing to automated by Sikuli bug daybkk2013
Introduction_to_android_and_android_studio
Ankit goel cv
Building UI for games using the new UI Builder - Unite Copenhagen 2019
Gdsc android introduction
Anroid Tutorial Beginner level By SAMRAT TAYADE
Introduction to Android and Android Studio
Android game ppt
Android UI Design Tips
Android development basics
Android Development
Android studio 2.2 Tips and Tricks
Intel XDK in Brief
Android development training
Android study jams 1
Android Development Workshop
Basic iOS Training with SWIFT - Part 1
Ad

Similar to sikuli final (13)

PPT
Prasadraj SIKULI Presentation 1
PPTX
Sikuli UI Automation
PPTX
PRASADRAJ SIKULI Presentation 2
PPTX
See monkey demo
PPTX
See monkey demo
PPTX
See monkey demo
PPTX
See monkey demo
PDF
High speed script execution for GUI automation using computer vision
PDF
Présentation SikuliX
PPTX
Sikuli_Demo(1)
PDF
Infographic | What are the Benefits of Sikuli | Betsol
PDF
Automation testing using Sikuli
PPTX
SikuliX
Prasadraj SIKULI Presentation 1
Sikuli UI Automation
PRASADRAJ SIKULI Presentation 2
See monkey demo
See monkey demo
See monkey demo
See monkey demo
High speed script execution for GUI automation using computer vision
Présentation SikuliX
Sikuli_Demo(1)
Infographic | What are the Benefits of Sikuli | Betsol
Automation testing using Sikuli
SikuliX
Ad

sikuli final

  • 1. SIKULI SCRIPT Name: Mangesh Bhapkar Class: TE (Computer) Roll No: 12 Guided by : Mr.D.D.Sapkal
  • 2. How to instruct computer,to perform specific task ??? shell script,codding
  • 5.  General Introduction:  Silkuli script was developed by User Interface Design Group,MIT Computer Science and Artificial Intelligence Laboratory(CSAIL).  The developer behind this project are…
  • 6.  What is Sikuli script???  Sikuli means “God’s Eye” in the language of native Mexicans.  Sikuli is the new way to program anything on your computers.  Sikuli is a visual technology to search and automate graphical user interface(GUI) using images (screenshots).  It automates anything on the screen without internal API’s support.  You can programmatically control a web page,desktop application running on Windows/MAC os /Linux or even on iphone application running on an emmulator. WHAT DO YOU SEE IS WHAT YOU SCRIPT
  • 7.  Platform Independent  Works on any GUI that can be displayed on Windows/Linux/MAC  Virtual machines  Remote desktops  Mobile simulators:Android ,iphone  Web:Flash,HTML+javascript
  • 9.  How it works?  Combination of GUI and Traditional coding  Jython coding that can use images as parameters and variables  Screen capture utilised for image selection  Can upload image files
  • 12.  Need of Sikuli script…  Allows programmer to make visual referances instead of using names or keywords.  More intuitive and natural approach.  Useful for specific applications that involves manipulation of GUI.
  • 13.  Applications… Execution of repeated task • Changing system settings • Resetting IP address Monitoring  Constantly looks for a specific change on screen  Visually search the content in a document Defence against hacking • Test site by repeatedly attacking the site,etc without having to do yourself.
  • 14.  Sikuli in real world…  Checking new status messages on facebook
  • 15.  Limitation Currently sikuli script operates only in the visible screen space and thus is not applicable to invisible GUI elements, such as those hidden underneath other windows,in another tab,or scrolled out of the view. Dealing with moving and animated object was hard.
  • 16.  Future Development…  To automate scrolling or tab switching actions to bring the GUI elements into view to interact with it visually  Fast and accurate OCR on screen
  • 17.  Who is using it?
  • 18.  References…  http://sikuli.org  http://blog.sikuli.org/  http://groups.csail.mit.edu/uid/sikuli/  http://groups.csail.mit/demo.shtml  http://www.makeuseof.com/tag/create-automation- scripts-easily-screenshots  Tom Yeh Tsung-Hsiang Chang Robert C. Miller EECS MIT & CSAIL Cambridge, MA, USA 02139 {tomyeh,vgod,rcm}@csail.mit.edu