Sikuli script
Download as PPSX, PDF4 likes5,326 views
The document discusses Sikuli Script, a visual programming tool developed by MIT's CSAIL that automates graphical user interfaces using images instead of traditional coding. It enables interaction with various applications across different platforms by using screenshots to script tasks without the need for source code access. While Sikuli Script offers a user-friendly approach for automation, it currently has limitations, such as operating only within visible screen space and challenges in handling animated elements.
Sikuli script
- 1. MAHATMA GANDHI INSTITUTE OFTECHNICAL EDUCATION &RESEARCH CENTREA Seminar Presentation on,Sikuli ScriptBy,SNEHAL M PATELE-mail: sne007@ymail.com
- 2. How to instruct computers, For doing Specific Task?Shell Script , Codding ?
- 3. Don’t Know the Good Programming ?
- 4. Want to Avoid Repeating, Boring or Annoying Codding ?
- 5. Want to automate something, but Don‘t have an access to its source ?
- 8. Sikuli Script was developed by User Interface Design Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL).
- 9. The developer behind this project are...What is Sikuli Script ?
- 10. Sikuli means "God’s Eye" in the language of native Mexicans.
- 11. Sikuli Script is the new way to Program anything on your computers.
- 12. Sikuli is a visual technology to search and automates graphical user interfaces (GUI) using images (screenshots).
- 13. It automates anything you see on the screen without internal API's support. You can programmatically control a web page, a desktop application running on Windows/Linux/Mac OS X, or even an iphone application running in an emulator. what you see is what you script
- 15. Works on ANY GUI that can be displayed on Windows / Linux / Mac
- 16. Virtual machines
- 17. Remote desktop
- 18. Mobile simulators: Android, iPhone
- 19. Web: Flash, HTML + Javascript
- 21. Sikuli programs are written against the user interface instead of an API.How it Works ?
- 22. Combination of GUI & Traditional CodingJython coding that can use images as parameters and variablesScreen Capture utilizedfor image selectionCan upload image filesHow it Works ?Taking Screenshot
- 23. How it Works ?Making ProgramCODE EDITORInsert ImageExecute ScriptTake Screen ShotsSelect region
- 24. Need of Sikuli Script ...
- 25. Allows programmer to make visual references insteadof using names or keywords.More intuitive and natural approach.
- 26. i.e. a child pointing to a cookie jar for a cookiewhen unable to ask for a cookie.Useful for specific applications that involve manipulation of GUI.
- 27. Application
- 28. Execution of Repeated Task
- 31. Monitoring
- 32. Constantly looks for a specific change on screen
- 33. Visually search the content in a Document
- 35. Test site by repeatedly attacking the site, etc. without having to do it yourself
- 36. Sikuli Script in Real World...
- 37. Monitoring a BabySikuli Script in Real World...
- 38. Checking new status messages on Facebook
- 39. Limitation
- 40. Currently, Sikuli Script operates only in the visible screen space and thus is not applicable to invisible GUI elements, such as those hidden underneath other windows, in another tab, or scrolled out of view.Dealing with moving, animated objects was hard.Future Development
- 41. To automate scrolling or tab switching actions to bring the GUI elements into view to interact with it visuallyFast and accurate OCR on screen
- 43. Who is Using ?Digital Arc SystemPlus many more….
- 44. References
- 51. http://www.makeuseof.com/tag/create-automation-scripts-easily-screenshots/Thank You....If any Questions then, contact me on: sne007@ymail.com