Acceptance testing plone sites and add ons with robot framework and selenium

Acceptance testing!
Plone sites and add-ons
with Robot Framework!
and Selenium
Asko Soukka, asko.soukka@iki.fi
University of Jyväskylä, Finland

Hello!
+ Asko Soukka
Twitter: @datakurre
IRC: datakurre
Email: asko.soukka@iki.fi
Web: datakurre.pandala.org
+ Software developer at
University of Jyväskylä
Finland
+ Plone Foundation Member

Menu
Terminology!
+ Acceptance testing
+ Robot framework
+ Selenium
!
Acceptance testing Plone!
+ Just do it with a live instance
+ Do it safely with a dedicated instance
+ Do it correctly in a p.a.testing sandbox
+ Do it with while writing your
documentation with screenshots
!

Acceptance testing
Functional testing of user stories!
!
!
Scenario: As an editor I can translate a document
Given a site owner
and a document in English
When I translate the document into Catalan
Then I can view the document in Catalan

Acceptance tests
!
Integration tests
!
!
!
Unit tests
!
!

Robot Framework
!
Keyword driven testing in your own
domain specific language!
!
Extend with Python, Java or XML-RPC
$ pip install robotframework
$ pybot —-help
$ pybot my_test_suite.robot

Robot Framework
*** Settings ***
!
Library string WITH NAME string
!
*** Test Cases ***
!
Convert string to uppercase
${value} = string.upper twist and shout!
Should be equal ${value} TWIST AND SHOUT!

!
*** Settings ***
!
Library ...
Resource ...
!
*** Variables ***
${NAME} value
!
*** Test Cases ***
Scenario title
Some keyword argument ${NAME}
!
*** Keywords ***
!
Some keyword
[Arguments] ${arg1} ${arg2}
Another keyword ${arg1} ${arg2}
!
!
test_suite.robot!

Acceptance testing plone sites and add ons with robot framework and selenium

Selenium
Browser automation framework!
!
All browser and service logos and trademarks on this slide are property of their respective owners.

Selenium2Library
Selenium2 (WebDriver) keywords!
for Robot Framework!
$ pip install robotframework-selenium2library
$ pybot —-help
$ pybot my_selenium_test_suite.robot

Selenium2Library
*** Settings ***
!
Library Selenium2Library
!
*** Test Cases ***
!
Front-page should contain search box
Open browser https://www.jyu.fi/
Element should be visible
... css=form[name='searchform'] input
[Teardown] Close all browsers
!

Testing Plone with live data
[buildout]
parts += testinstance
!
[testinstance]
recipe = plone.recipe.zope2instance
...
eggs =
...
zc.beforestorage
Products.PrintingMailHost
...
before-storage = now
demo-storage = true
shared-blob = false

Testing Plone add-ons
*** Settings ***
!
Resource plone/app/robotframework/selenium.robot
Library Remote ${PLONE_URL}/RobotRemote
!
*** Test Cases ***
!
Scenario: Powered by Plone remains visible
Open test browser
Go to ${PLONE_URL}
Page should contain Powered by Plone

import unittest
!
import robotsuite
from myproduct.testing import MYPRODUCT_ROBOT_TESTING
from plone.testing import layered
!
!
def test_suite():
suite = unittest.TestSuite()
suite.addTests([layered(
robotsuite.RobotTestSuite(’test_hello.robot'),
layer=MYPRODUCT_ROBOT_TESTING)])
return suite

from plone.testing import z2
from plone.app.testing import FunctionalTesting
from plone.app.robotframework.testing import
REMOTE_LIBRARY_BUNDLE_FIXTURE
!
MYPRODUCT_ROBOT_TESTING = FunctionalTesting(
bases=(MYPRODUCT_FIXTURE,
REMOTE_LIBRARY_BUNDLE_FIXTURE,
z2.ZSERVER_FIXTURE),
name="MyProduct:Robot")

http://docs.plone.org/search.html?q=robotframework
extras_require={
'test': [
...
'plone.app.robotframework',
],
},

To BDD or not to…
...
Scenario: As an editor I can translate a document
Given a site owner
and a document in English
When I translate the document into Catalan
Then I can view the document in Catalan
!
*** Keywords ***
!
A site owner
Enable autologin as Site Administrator
...

Testing Plone with live data
!
eggs =
...
plone.app.robotframework
collective.monkeypatcher
...
zcml-additional =
<configure
xmlns="http://namespaces.zope.org/zope"
xmlns:monkey="http://namespaces.plone.org/monkey">
<include package="collective.monkeypatcher" />
<monkey:patch
description="Enable Robot Framework remote library"
class="Products.CMFPlone.Portal.PloneSite"
original="RobotRemote"
replacement="plone.app.robotframework.testing.RobotRemote"
ignoreOriginal="true"
/>
</configure>
REVISITED!

Sphinx integration
extensions = ['sphinxcontrib_robotframework']
.. code:: robotframework
!
*** Settings ***
!
Library string WITH NAME string
!
*** Test Cases ***
!
Convert string to uppercase
...

$ pip install Sphinx
$ pip install sphinxcontrib-robotframework
$ pip install robotframework-selenium2library
.. figure:: ploneconf.png
!
*** Settings ***
!
Library Selenium2Library
!
*** Test Cases ***
!
Show Plone Conference 2014 website
Open browser http://2014.ploneconf.org/
Capture page screenshot ploneconf.png

!
.. figure:: portal-footer.png
!
*** Settings ***
!
Resource plone/app/robotframework/server.robot
Resource Selenium2Screenshots/keywords.robot
!
*** Test Cases ***
!
Scenario: Powered by Plone remains visible
Setup Plone site
... plone.app.testing.PLONE_ZSERVER
Go to ${PLONE_URL}
Page should contain Powered by Plone
Capture and crop page screenshot
... portal-footer.png id=portal-footer
[Teardown] Run keywords
... Tear down Plone site
... Close all browsers
!

More
+ Robot Framework
http://robotframework.org/
+ Selenium2Library (for Robot Framework)
https://github.com/rtomac/robotframework-selenium2library
+ Overview of Plone-related Robot ecosystem
http://datakurre.pandala.org/2013/09/meet-robot-family-
for-plone-developers.html

Acceptance testing plone sites and add ons with robot framework and selenium

More Related Content

What's hot (20)

Viewers also liked (17)

Similar to Acceptance testing plone sites and add ons with robot framework and selenium (20)

More from Asko Soukka (9)

Recently uploaded (20)

Acceptance testing plone sites and add ons with robot framework and selenium