Computer vision activities in ui path
- 1. Computer Vision Using Computer Vision Activities in UiPath
- 2. Computer Vision ā¢ The AI Computer Vision pack contains refactored fundamental UIAutomation activities such as Click, Type Into, or Get Text. ā¢ The main difference between the CV activities and their classic counterparts is their usage of the Computer Vision neural network developed in-house by UiPath Machine Learning department.
- 3. Computer Vision- Neural Networks ā¢ A Neural network is a series of algorithms that endeavors to recognize underlying relationships in a set of data through a process that mimics the way the human brain operates. ā¢ Vision activities help in sending images of the window you are automating to the neural network, where it is analyzed and all UI elements are identified and labeled according to what they are. ā¢ The neural network is able to identify UI elements such as buttons, text input fields, or check boxes without the use of selectors.
- 4. CV Activity Used in? ā¢ Created mainly for automation in virtual desktop environments, such as Citrix machines, VDIās. ā¢ Bypass the issue of inexistent or unreliable selectors.
- 5. Pre-requisites ā¢ Package UiPath.UIAutomation.Activities must be installed. ā¢ UiPath version for using the activity should be v18.3 or higher.
- 6. Computer Vision Activities ā¢ CV Screen Scope ā¢ CV Click ā¢ CV Type into ā¢ CV Get text ā¢ CV Element exists ā¢ CV Highlight ā¢ CV Hover ā¢ CV Refresh
- 7. CV Screen Scope ā¢ Initializes the UiPath Computer Vision neural network, performing an analysis of the indicated window and provides a scope for all subsequent Computer Vision activities. ā¢ Enables us to select which OCR engine you want to use for scraping the text in the target application. ā¢ The default OCR engine used for this activity is Microsoft OCR.
- 8. CV Screen Scope- Key properties ā¢ API Key : The API key used for authenticating to the Computer Vision server. ā¢ URL : The URL of the server that runs the Computer Vision service.
- 9. Example
- 10. CV Click ā¢ Clicks a specified UI element which is targeted by using the UiPath Computer Vision neural network. ā¢ Similar to the basic UiPath click activity.
- 11. Example
- 13. THANK YOU