From Good to Great: Functional and Acceptance Testing in WordPress.
1 like2,092 views
The document discusses the importance of quality in WordPress development, emphasizing the need for both code quality and user experience. It introduces automated testing methods, particularly unit testing and acceptance testing using tools like Codeception, to ensure that software meets user expectations and performs correctly. The author highlights the significance of fulfilling business outcomes through effective testing strategies.
![How does Unit Testing look like?
/**
* Returns whether a telephone number is valid or not.
*
* The telephone number has to be a list of digits. Any
* other char is not accepted.
*/
function validateTelNumber( $num ) {
return preg_match( '/^[0-9]+$/', $num );
}](https://image.slidesharecdn.com/wceu2015-150627092423-lva1-app6892/85/From-Good-to-Great-Functional-and-Acceptance-Testing-in-WordPress-19-320.jpg)
![Behavior-Driven Development
(BDD)
Story - Title
As a [role]
I want [feature]
So that [benefit]
Acceptance Criteria
Scenario - Title
Given [context]
When [event]
Then [outcome]
Dann North & Associates
http://dannorth.net/whats-in-a-story/
BDD starts at the outside by identifying
business outcomes, and then drills down into the
feature set that will achieve those outcomes.](https://image.slidesharecdn.com/wceu2015-150627092423-lva1-app6892/85/From-Good-to-Great-Functional-and-Acceptance-Testing-in-WordPress-30-320.jpg)
From Good to Great: Functional and Acceptance Testing in WordPress.
- 1. From good to great! Functional and Acceptance Testing in WordPress
- 2. David Aguilera I co-founded Nelio Software (2013) You can find me at @davilera Who I am...
- 3. My Work at Nelio ◎ Plugin Development ◉ A/B Testing for WordPress ◉ External Featured Images ◉ Others... ◎ Customer Support
- 4. My Work at Nelio ◎ Plugin Development ◉ A/B Testing for WordPress ◉ External Featured Images ◉ Others... ◎ Customer Support
- 5. The Problem with A/B Testing ◎ Several Dashboard Screens ◎ Impact on Front-end ◎ Data Synchronization to Cloud
- 6. The Problem with A/B Testing ◎ Several Dashboard Screens ◎ Impact on Front-end ◎ Data Synchronization to Cloud Complex Architecture How can we make sure it works?
- 7. WordPress Plugins and Themes 1 Quality
- 8. What Is Quality? “how good or bad something is” “a high level of value or excellence” Merriam Webster Dictionary
- 9. What Is Quality? ◎ WordPress Coding Standards ◎ Guidelines ◉ Plugin Handbook ◉ Theme Handbook ◎ Plugin and Theme Reviews
- 10. Quality is (also) about User Experience Image by Moyan Brenn - http://flickr.com/photos/aigle_dore/
- 11. My Experience (and yours?) 2 Plugin & Theme Development
- 12. Development ◎ Functionalities ◎ Write New Code ◎ Try it out Image by WordPress Barcelona - http://www.wpbarcelona.com
- 13. Pre-Release ◎ Check-List ◎ Do things work as expected? Image by Crispy - http://flickr.com/photos/37333113@N03/
- 14. Release… and bug! ◎ Unnoticed ◎ Obvious ◎ WSOD Image by Nokton - http://flickr.com/photos/nokton/
- 15. Quality matters! Especially when it affects your users Image by Peter A. Hess - http://flickr.com/photos/peterhess/
- 16. There must be a better way! and it’s called Automated Testing Image by Mark Strozier - http://flickr.com/photos/r80o/
- 17. The First Step Towards Excellence 3 Unit Testing
- 18. What is Unit Testing? “A method for verifying that individual units of source code are fit for use”
- 19. How does Unit Testing look like? /** * Returns whether a telephone number is valid or not. * * The telephone number has to be a list of digits. Any * other char is not accepted. */ function validateTelNumber( $num ) { return preg_match( '/^[0-9]+$/', $num ); }
- 20. How does Unit Testing look like? class TheTest extends PHPUnit_Framework_TestCase { public function testTelephoneNumber() { // Arrange $num = ‘934.123.456’; // Act $result = validateTelNumber( $num ); // Assert $this->assertTrue( $result ); }
- 21. How does Unit Testing look like? david@nelio:~$ phpunit … Time: 102 ms, Memory: 8.92Mb There was 1 failure: 1) TheTest::testTelephoneNumber Failed asserting that false is true. /home/david/sandbox/tests/TheTest.php:23 FAILURES! Tests: 1, Assertions: 1, Failures: 1.
- 22. We’re already using it! https://make.wordpress.org/core/ handbook/automated-testing/ Really?
- 23. But... It’s focused on individual units and the internal structure
- 24. But... It’s focused on individual units and the internal structure It tells us nothing about: Do we satisfy our users’ expectations?
- 25. Image by Todd Martin - http://flickr.com/photos/tmartin/ How?
- 26. Acceptance and Functional Testing 4 The Next Level
- 27. “Software delivery is about writing software to achieve (business) outcomes Dann North & Associates http://dannorth.net/whats-in-a-story/
- 28. Quality is about Achieving These Outcomes Image by Kieran Clarke - http://flickr.com/photos/goonerpower/
- 29. “Acceptance Tests replicate user’s experience and are driven by expectation logic Chris Lema
- 30. Behavior-Driven Development (BDD) Story - Title As a [role] I want [feature] So that [benefit] Acceptance Criteria Scenario - Title Given [context] When [event] Then [outcome] Dann North & Associates http://dannorth.net/whats-in-a-story/ BDD starts at the outside by identifying business outcomes, and then drills down into the feature set that will achieve those outcomes.
- 31. Story - An author (John) publishes a post As an author (John) I want to publish a post So that new content is available in my blog Example
- 32. Scenario 1 - John has a draft post Given a draft post in the Dashboard and the post’s author is John and the post’s title is X and the post’s content is Y When John publishes the post Then the post’s status is no longer Draft and the Latest Posts page contains X and Y Example
- 33. “Functional Tests replicate developer’s experience. Not only we look into expectations, but also into the implementation
- 34. Acceptance and Functional Testing with Codeception and WebDriver 5 How-To
- 35. Codeception It’s all about behavior-driven testing. For each part of application, - user actions and - expected results Codeception (open-source and MIT licensed) - http://codeception.com
- 36. Quick Demo
- 37. Acceptance Tests in Codeception $I = new AcceptanceTester( $scenario ) $I->am( ‘an Author’ ); $I->wantTo( ‘publish a post’ ); $I->lookForwardTo( ‘seeing more content’ );
- 38. Acceptance Tests in Codeception As an author (John) I want to publish a post So that new content is available in my blog $I = new AcceptanceTester( $scenario ) $I->am( ‘an Author’ ); $I->wantTo( ‘publish a post’ ); $I->lookForwardTo( ‘seeing more content’ );
- 39. //... $I->amOnPage( ‘/wp-admin/edit.php?p=X’ ); $I->click( ‘Publish’, ‘#submitdiv’ ); $I->see( ‘Post published.’ ); $I->amOnPage( ‘/blog’ ); $I->see( ‘The title X’ ); $I->see( ‘First words of the content Y’ ); Acceptance Tests in Codeception
- 41. Codeception Commands You can reproduce user’s behavior on a simulated environment
- 42. Codeception Commands You can reproduce user’s behavior on a simulated environment wait… “simulated”?
- 43. WebDriver http://w3c.github.io/webdriver/webdriver-spec.html The WD API is a platform and language-neutral interface (...) that allows programs or scripts to introspect into, and control the behaviour of, a web browser.
- 44. WebDriver In other words, you can start a new instance of Chrome, Firefox, IE… and control them from a script.
- 45. Pros/Cons ◎ Real Browsers ◎ Real Behavior ◎ JavaScript ◎ Slower ◎ Platforms WebDriver New Methods wait waitForElementVisible waitForElementChange waitForJS moveMouseOver pressKey reloadWindow
- 46. ◎ User Automated Tests ◎ Developer Automated Tests So, Codeception will help you with…
- 47. ◎ User Automated Tests ◎ Developer Automated Tests ◎ Automate Bug (re)detection On real or simulated browsers! So, Codeception will help you with…
- 48. ◎ Acceptance Tests are not the solution to all your problems. ◎ There’s a whole range of tests. Use the one that better suits your needs But...
- 49. What I Want You to Remember 6 Summary
- 50. Remember 1. Quality matters 2. That means code quality matters 3. But also fulfilling expectations 4. Codeception is a great tool
- 51. Remember 1. Quality matters 2. That means code quality matters 3. But also fulfilling expectations 4. Codeception is a great tool
- 52. Remember 1. Quality matters 2. That means code quality matters 3. But also fulfilling expectations 4. Codeception is a great tool
- 53. Remember 1. Quality matters 2. That means code quality matters 3. But also fulfilling expectations 4. Codeception is a great tool
- 54. Thanks! Always Test Your Work You can find me at @davilera david.aguilera@neliosoftware.com ? Feedback Link europe.wordcamp.org/2015/speaker/david-aguilera