Mobile Test Automation using one API and one infrastructure
- 1. 30.09.2014 1 MOBILE TEST AUTOMATION SELENIUM SELENDROID IOS-DRIVER
- 2. AGENDA ● Welcome ● Selenium Crash Course ● ios-driver + Selendroid ● Building a cross platform infrastructure 2
- 3. WHO AM I ? 3 Gridfusion Software Solutions Michael Palotas Dipl. Ing. (FH) Nachrichtentechnik Email: michael.palotas@gridfusion.net LinkedIn: http://ch.linkedin.com/in/michaelpalotas/ Xing: https://www.xing.com/profile/Michael_Palotas Twitter: @michael_palotas Kontakt: Gerbiweg 2 8853 Lachen SWITZERLAND Tel.: +41 79 6690708 Founder / Principal Consultant Gridfusion Software Solutions Head of Productivity & Test Engineering eBay International
- 4. WARM-UP 4 Why do you automate tests? Which tests should be automated? Who should automate? What is different about mobile?
- 5. DISCLAIMER 5 THIS IS NOT A SELENDROID OR IOS-DRIVER TRAINING
- 6. MOBILE TEST AUTOMATION 6 Not as mature as web automation Immature tools market Tools are usually platform specific Multi code base
- 7. EMULATORS VS. DEVICES 7 What to test where?
- 8. SAME AUTOMATION CODE BETWEEN PLATFORMS? 8 Sounds good first but Most apps are different between platforms Different element locator strategy Do reuse the helper functions
- 9. TEST INFRASTRUCTURE 9 AUT API DB Browsers Mobiles
- 10. 2. SELENIUM 10
- 11. A LITTLE SELENIUM HISTORY Selenium was so named because Huggins, dissatisfied with testing tools on the market, was seeking a name that would position the product as an alternative to Mercury Interactive QuickTest Professional commercial testing software. The name, Selenium, was selected because selenium mineral supplements serve as a cure for mercury poisoning, Huggins explained. 11
- 12. WHAT IS SELENIUM? 12 SELENIUM AUTOMATES BROWSERS THAT'S IT ... One more thing ... Selenium is becoming a W3C standard: http://www.w3.org/TR/webdriver
- 13. WHAT IS SELENIUM? 13 Protocol which describes user interactions Supports most browsers Supports most programming languages
- 14. SELENIUM – WHAT IT IS NOT 14 a drag & drop tool a network testing / monitoring tool a performance testing tool a reporting tool a testcase management tool
- 15. WHY OPEN SOURCE? 15 It is free (…) Independent of 3rd parties Faster innovation cycles Motivated employees Easier hiring
- 16. THE SELENIUM „FLAVORS“ 16 Selenium IDE Selenium Selenium GRID Let’s forget about this one real quick
- 17. 5. WEBDRIVER PROTOCOL 17
- 18. SELENIUM 2 / WEBDRIVER 18 JSON WIRE PROTOCOL Client Java C# Ruby Python Server Server Server i.e. Selendroid, iOS-Driver
- 19. SELENIUM CLIENT 19 Is seen as Selenium by the users Generates HTTP request, which are received by the server Is called by the test framework or the CI server Supported languages: Java, C#, Python, Ruby, Perl, PHP, JS
- 20. SELENIUM SERVER 20 Receives HTTP requests from server Start and teardown of browser Translates requests into browser specific commands Communicates back to the client
- 21. 6. SELENIUM BASICS 21
- 22. DOWNLOADS - http://www.seleniumhq.org/ - http://selenium.googlecode.com/files/ selenium-server-standalone-2.42.2.jar - Maven example: 22
- 23. DRIVER 23 Each browser has its own driver Firefox driver is part of the standalone jar http://selenium.googlecode.com/files/selenium-server-standalone-2.42.2.jar Chrome: https://code.google.com/p/selenium/wiki/ChromeDriver Opera: https://code.google.com/p/selenium/wiki/OperaDriver Internet Explorer: https://code.google.com/p/selenium/wiki/ InternetExplorerDriver
- 24. DRIVER Each driver implements the JSON Wire Protocol Driver interacts with the browser (or mobile) CLIENT SERVER 24 JSON Wire Protocol BROWSER DRIVER
- 25. OUR FIRST TEST Open a Firefox Browser Go to http://gridfusion.net Close the browser @Test public void myFirstTest() { WebDriver driver = new FirefoxDriver(); driver.get("http://gridfusion.net"); driver.quit(); } 25
- 26. DRIVER API 26
- 27. PAGE TITLE Open a Firefox browser Go to http://gridfusion.net Print the page title in the console Close the browser @Test public void pageTitleTest() { WebDriver driver = new FirefoxDriver(); driver.get("http://gridfusion.net"); String pageTitle = driver.getTitle(); System.out.println(pageTitle); driver.quit(); } 27
- 28. ASSERTS Open a Firefox Browser Go to: http://gridfusion.net Verify Page Title = GRIDFUSION.net – Home Close the browser 28
- 29. WEBELEMENT 29 Represents an HTML Element Interactions on a page happen via WebElement http://selenium.googlecode.com/svn/trunk/docs/api/java/org/openqa/selenium/WebElement.html
- 30. LOCATORS id cssSelector linkText name partialLinkText tagName xpath 30 driver.findElement(By.XYZ)
- 31. 7. REMOTE WEBDRIVER 31
- 32. REMOTE WEBDRIVER Decouples tests from browsers WebDriver driver = new RemoteWebDriver(new URL("http://localhost:4444/wd/hub"), DesiredCapabilities); 32 Machine 1 Eclipse TestNG CI Machine 2 HTTP Browser
- 33. DESIRED CAPABILITIES - BROWSER 33 DesiredCapabilities capability = new DesiredCapabilities(); capability.setBrowserName(“firefox”); https://code.google.com/p/selenium/wiki/DesiredCapabilities
- 34. REMOTEWEBDRIVER ● Start a selenium server: 34 ● java –jar selenium-server-standalone-2.42.2.jar ● Use RemoteWebDriver and set DesiredCapabilities to Firefox ● Open a Firefox browser ● Go to: http://gridfusion.net ● Close the browser @Test public void remoteWebdriverFireFoxTest() throws MalformedURLException { DesiredCapabilities capability = DesiredCapabilities.firefox(); WebDriver driver = new RemoteWebDriver(new URL("http://localhost:4444/wd/hub"), capability); driver.get("http://gridfusion.net"); driver.quit(); }
- 35. 8. SELENIUM GRID 35
- 36. WHY SELENIUM GRID? 36 Environment Management & Control Scaling Parallel execution of tests Reduction of execution times Crossover tests (web, mobile)
- 37. SELENIUM GRID 37 SEQUENTIAL EXECUTION TEST TEST TEST TEST TIME n PARALLEL EXECUTION TEST TEST TEST TEST TEST TEST TEST TEST TEST TEST TEST TEST TEST TEST TEST TEST TIME n
- 38. SCALING – SELENIUM GRID 38 DEV CI …. SELENIUM GRID HUB IOS ANDROID WINDOWS LINUX OSX
- 39. 1. STEP– START THE GRID HUB 39 Open a new terminal window Start the Selenium GRID hub by typing: java -jar selenium-server-standalone-2.42.jar -role hub Enter http://localhost:4444/grid/console into the browser
- 40. 2. STEP– REGISTER A NODE 40 Open a second terminal window Start and register a Selenium node by entering: java -jar selenium-server-standalone-x.y.z.jar –role wd -hub http://localhost:4444/grid/register
- 41. SELENIUM NODE – STANDARD CONFIG - Go to: http://localhost:4444/grid/console Standard Configuration: 5 Firefox 5 Chrome 1 Internet Explorer 41
- 42. SCREENSHOTS 42
- 43. 10. REPORTING 43
- 44. STANDARD REPORTS - TestNG reports are put into: **/test-output - Look for: emailable-report.html 44
- 45. CUSTOM REPORTING - By calling Reporter.log(“your log message”), you can add additional information to the report 45
- 46. SCREENSHOTS - Screenshots can also be placed directly into the report 46
- 47. 12. MOBILE AUTOMATION 47
- 48. SELENIUM 2 / WEBDRIVER 48 JSON WIRE PROTOCOL Client Java C# Ruby Python Server Server Server i.e. Selendroid, iOS-Driver
- 49. (SOME) MOBILE AUTOMATION REQUIREMENTS * Reuse of the existing Selenium infrastructure for the web * Implementation of the Selenium protocol (JSON wire protocol) * The application under test (aut) should not need to be modified * Support for emulators/simulators as well as real devices * Parallel execution of tests in a Selenium Grid * Management of multiple applications, versions, languages * Support for runtime inspection for the app * Hybrid app support * No jailbreaking of device required 49
- 50. IOS-DRIVER + SELENDROID 50 IOS: http://ios-driver.github.io/ios-driver/index.html ANDROID: http://selendroid.io/ Both projects implement the Webdriver API (JSON Wire Protocol)
- 51. ANDROID: MOBILE WEB 51
- 52. ANDROID: NATIVE APP 52
- 53. IOS: MOBILE WEB 53
- 54. WRITE ONCE RUN EVERYWHERE 54
- 55. WRITE ONCE RUN EVERYWHERE 55
- 56. INSPECTOR 56
- 58. WHAT HAVE YOU LEARNED TODAY? 58
- 59. 59 THANK YOU