Katrina Kolt, Enterprise Agile Coach, ANZ
22 September 2017
Teaching a company the size of
a small nation to test & learn
https://www.linkedin.com/in/katrinakolt/
@agilesista
Because members of the project team stay in close
touch with outside sources of information, they can
respond quickly to changing market conditions.
Team members engage in a continual process of trial
and error to narrow down the number of alternatives
that they must consider.
Takeuchi, Hirotaka and Nonaka, Ikujiro. Harvard Business
Review, The New New Product Development Game, 1986.
https://www.linkedin.com/in/katrinakolt/
@agilesista
Teaching a company the size of a small nation to test and learn
Describe what problem you are trying to solve
Establish for whom
Identify your skateboard equivalent
A test and learn approach sees you…
https://www.linkedin.com/in/katrinakolt/
@agilesista
Every new something we build for our customers is
really a question we are asking.
“Did you like it? Did you hate it? Will you use it
again?”
It is the humbling notion, that although we think we
know what our customers like, want and respond to,
we don’t really know unless we treat product
development as a series of experiments.
https://www.linkedin.com/in/katrinakolt/
@agilesista
In most cases, it’s impossible to realise anything more
than incremental improvements, because only part of
the organization has changed …
And that part needs to work with the rest of the
organization, which expects them to behave in the
traditional way.
Humble, Jez, Molesky, Joanne and O’Reilly, Barry. Lean Enterprise:
How High Performance Organisations Innovate at Scale, 2014
https://www.linkedin.com/in/katrinakolt/
@agilesista
Minimum viable everything – product,
experience and process
Measure outcomes (value), not outputs
(stuff done)
Experiment to learn – create a generative
safe to try culture to continuously improve
Patterns to introduce business agility
https://www.linkedin.com/in/katrinakolt/
@agilesista
We’re reshaping ANZ’s Australian division into
approximately 18 tribes of around 10 squads each.
That’s 180 start-ups … up and running.
180 components of the organisation, which all have
autonomy and agility to adapt to what customers need
very, very quickly.
Chris Venter, General Manager of Technology and Digital Banking, ANZ
https://www.linkedin.com/in/katrinakolt/
@agilesista
Value difference & encourage everyone to
have a voice
Find solutions by testing and learning
Find ways to use data to learn and improve
Behaviours that support test & learn
Teams learn best from the lessons of their peers.
What challenges did they face?
How did they address them?
What would they do differently?
People remember stories and take inspiration from the
experiences of others.
O’Reilly, Barry. Blog - 10 Principles to Transform
The most expensive way to find out if a product works
is to build the entire product and then release it.
The key to rapid experimentation is not to prove that
all our ideas are winners, but to kill losing ideas early
to cut wasted effort, time and further poor
investment.
O’Reilly, Barry. Blog - Stop Typing, Start Testing

More Related Content

PDF
How Agile Leaders Improve Results With The Responsibility Process
PDF
Seeing the emergent patterns in organisations - the power of observation as a...
PPTX
Agile Leadership by gro.team
PDF
Action plan for managing business and organisational challenges with agility ...
PPTX
PDF
Leadership that gets results
PDF
Agile Leadership introduction
PPTX
Agile leadership
How Agile Leaders Improve Results With The Responsibility Process
Seeing the emergent patterns in organisations - the power of observation as a...
Agile Leadership by gro.team
Action plan for managing business and organisational challenges with agility ...
Leadership that gets results
Agile Leadership introduction
Agile leadership

What's hot (18)

PDF
Agile Leadership - Beyond the Basics
PDF
AGILE AND HR
PDF
Agile innovation and Thinking Like a Startup
PDF
Charles Randles- You're the problem why leadership culture is the last barrier
PDF
Coaching is the Product: building your agile coaching backlog
PDF
06. Compound Agility - Colleen Johnson - #Scabru18
PDF
Business Agility and Organisational Learning
PPTX
A Twelve Step Guide to Being a Change Agent
PDF
Agile Leadership
PDF
Agile Leadership — Hubspot's Inbound 2016
PDF
Agile HR at Faster Horses - Transforming the Employee Experience
PPTX
Leaders as change agents
PPTX
Developing leadership in the agile organization
PPTX
High Performance Organization Model
PDF
Avery culture-of-responsibility-rally on14
PDF
Shifting Consciousness
PPTX
Agile Leadership: A Different Mindset
Agile Leadership - Beyond the Basics
AGILE AND HR
Agile innovation and Thinking Like a Startup
Charles Randles- You're the problem why leadership culture is the last barrier
Coaching is the Product: building your agile coaching backlog
06. Compound Agility - Colleen Johnson - #Scabru18
Business Agility and Organisational Learning
A Twelve Step Guide to Being a Change Agent
Agile Leadership
Agile Leadership — Hubspot's Inbound 2016
Agile HR at Faster Horses - Transforming the Employee Experience
Leaders as change agents
Developing leadership in the agile organization
High Performance Organization Model
Avery culture-of-responsibility-rally on14
Shifting Consciousness
Agile Leadership: A Different Mindset
Ad

Similar to Teaching a company the size of a small nation to test and learn (20)

PDF
about agility
PDF
Move Beyond User Stories... What's Next? - Global Scrum Gathering 2018
PPTX
Agility and Organisational Change
PDF
IIT Academy - Masterclass - Enterprise Agile
PDF
Andy van der Gugten, Agile Tauranga 2018 Presentation
PDF
Agile’s Day has Truly Arrived
PPTX
Fundamentals of Software Engineering
PPTX
Agility2020 few of my key takeaways
PPTX
Agile product development
PPTX
Impactful experimentation is a leadership challenge
PDF
NUS-ISS Learning Day 2018- Business agility for business leaders
PPTX
Achieving Hi-end Agility in Large R&D Enterprises
PPTX
AgileInnovation
PDF
Agile leadership practices for PIONEERS
PDF
The journey of a lean enterprise
PPTX
Lessons in Rapid Experiments and Learning From Failure
PPTX
Agility In Innovation - Delivering Breakthrough Products
PPTX
Ale 2013, from software devt to building an agile company
PDF
DevOps and the Culture of High-Performing Software Organizations
PPTX
Cobis and Oikosofy 5 Innovation shots for the banking industry
about agility
Move Beyond User Stories... What's Next? - Global Scrum Gathering 2018
Agility and Organisational Change
IIT Academy - Masterclass - Enterprise Agile
Andy van der Gugten, Agile Tauranga 2018 Presentation
Agile’s Day has Truly Arrived
Fundamentals of Software Engineering
Agility2020 few of my key takeaways
Agile product development
Impactful experimentation is a leadership challenge
NUS-ISS Learning Day 2018- Business agility for business leaders
Achieving Hi-end Agility in Large R&D Enterprises
AgileInnovation
Agile leadership practices for PIONEERS
The journey of a lean enterprise
Lessons in Rapid Experiments and Learning From Failure
Agility In Innovation - Delivering Breakthrough Products
Ale 2013, from software devt to building an agile company
DevOps and the Culture of High-Performing Software Organizations
Cobis and Oikosofy 5 Innovation shots for the banking industry
Ad

More from Scrum Australia Pty Ltd (20)

PDF
We made agile look hard & why it doesn't have to be
PDF
Changing the way we change – leveraging a combination of Lean, Design, and S...
PDF
Telling My Story by Shelvia Loveridge
PDF
Extraordinary retrospectives by Alex Sloley
PDF
Crafting digital experiences with agile and design by James Hayes
PDF
So you want to hire an agile coach? by Sally Sloley
PDF
What a scrum master really does by Rowan Bunning
PPTX
Situational Scrum Mastering: What the Scrum guide didn’t tell me about leadin...
PDF
Embrace the Storm by Renae Craven
PDF
Discover your leadership agility
PDF
Discover your leadership agility self assessment
PDF
Choice and Control, how Hireup’s Empowering Vision aligns with Agile Principles
PDF
Experimentation from the real world; move from outputs to outcomes
PDF
Test Driven Development – how it benefits business and teams alike
PDF
Get outcomes by putting people over processes: Trust us… We’re social workers!
PPTX
Do you always take the stairs? How to use your growth mindset to build smar...
PDF
The product owner and scrum master brain transplant! Mwuhahahaha!!!
PDF
What leaders can learn from filmmakers
PDF
Is an Agile Team Dynamics like a House of Cards?
PDF
8 steps to collaboration
We made agile look hard & why it doesn't have to be
Changing the way we change – leveraging a combination of Lean, Design, and S...
Telling My Story by Shelvia Loveridge
Extraordinary retrospectives by Alex Sloley
Crafting digital experiences with agile and design by James Hayes
So you want to hire an agile coach? by Sally Sloley
What a scrum master really does by Rowan Bunning
Situational Scrum Mastering: What the Scrum guide didn’t tell me about leadin...
Embrace the Storm by Renae Craven
Discover your leadership agility
Discover your leadership agility self assessment
Choice and Control, how Hireup’s Empowering Vision aligns with Agile Principles
Experimentation from the real world; move from outputs to outcomes
Test Driven Development – how it benefits business and teams alike
Get outcomes by putting people over processes: Trust us… We’re social workers!
Do you always take the stairs? How to use your growth mindset to build smar...
The product owner and scrum master brain transplant! Mwuhahahaha!!!
What leaders can learn from filmmakers
Is an Agile Team Dynamics like a House of Cards?
8 steps to collaboration

Recently uploaded (20)

PDF
Communication Tactics in Legal Contexts: Historical Case Studies (www.kiu.ac...
DOCX
Hand book of Entrepreneurship 4 Chapters.docx
PDF
Comments on Clouds that Assimilate Parts I&II.pdf
PPTX
basic introduction to research chapter 1.pptx
PDF
Second Hand Fashion Call to Action March 2025
PDF
Vinod Bhatt - Most Inspiring Supply Chain Leader in India 2025.pdf
PPTX
CTG - Business Update 2Q2025 & 6M2025.pptx
PDF
Engaging Stakeholders in Policy Discussions: A Legal Framework (www.kiu.ac.ug)
PDF
Stacey L Stevens - Canada's Most Influential Women Lawyers Revolutionizing Th...
PPTX
33ABJFA6556B1ZP researhchzfrsdfasdfsadzd
PPTX
Understanding Procurement Strategies.pptx Your score increases as you pick a ...
PDF
Sustainable Digital Finance in Asia_FINAL_22.pdf
PDF
Highest-Paid CEO in 2025_ You Won’t Believe Who Tops the List.pdf
DOCX
Handbook of Entrepreneurship- Chapter 5: Identifying business opportunity.docx
PDF
Tortilla Mexican Grill 发射点犯得上发射点发生发射点犯得上发生
PPTX
Market and Demand Analysis.pptx for Management students
PDF
Robin Fischer: A Visionary Leader Making a Difference in Healthcare, One Day ...
PDF
Immigration Law and Communication: Challenges and Solutions {www.kiu.ac.ug)
PDF
income tax laws notes important pakistan
PDF
Chapter 2 - AI chatbots and prompt engineering.pdf
Communication Tactics in Legal Contexts: Historical Case Studies (www.kiu.ac...
Hand book of Entrepreneurship 4 Chapters.docx
Comments on Clouds that Assimilate Parts I&II.pdf
basic introduction to research chapter 1.pptx
Second Hand Fashion Call to Action March 2025
Vinod Bhatt - Most Inspiring Supply Chain Leader in India 2025.pdf
CTG - Business Update 2Q2025 & 6M2025.pptx
Engaging Stakeholders in Policy Discussions: A Legal Framework (www.kiu.ac.ug)
Stacey L Stevens - Canada's Most Influential Women Lawyers Revolutionizing Th...
33ABJFA6556B1ZP researhchzfrsdfasdfsadzd
Understanding Procurement Strategies.pptx Your score increases as you pick a ...
Sustainable Digital Finance in Asia_FINAL_22.pdf
Highest-Paid CEO in 2025_ You Won’t Believe Who Tops the List.pdf
Handbook of Entrepreneurship- Chapter 5: Identifying business opportunity.docx
Tortilla Mexican Grill 发射点犯得上发射点发生发射点犯得上发生
Market and Demand Analysis.pptx for Management students
Robin Fischer: A Visionary Leader Making a Difference in Healthcare, One Day ...
Immigration Law and Communication: Challenges and Solutions {www.kiu.ac.ug)
income tax laws notes important pakistan
Chapter 2 - AI chatbots and prompt engineering.pdf

Teaching a company the size of a small nation to test and learn

  • 1. Katrina Kolt, Enterprise Agile Coach, ANZ 22 September 2017 Teaching a company the size of a small nation to test & learn https://www.linkedin.com/in/katrinakolt/ @agilesista
  • 2. Because members of the project team stay in close touch with outside sources of information, they can respond quickly to changing market conditions. Team members engage in a continual process of trial and error to narrow down the number of alternatives that they must consider. Takeuchi, Hirotaka and Nonaka, Ikujiro. Harvard Business Review, The New New Product Development Game, 1986. https://www.linkedin.com/in/katrinakolt/ @agilesista
  • 4. Describe what problem you are trying to solve Establish for whom Identify your skateboard equivalent A test and learn approach sees you… https://www.linkedin.com/in/katrinakolt/ @agilesista
  • 5. Every new something we build for our customers is really a question we are asking. “Did you like it? Did you hate it? Will you use it again?” It is the humbling notion, that although we think we know what our customers like, want and respond to, we don’t really know unless we treat product development as a series of experiments. https://www.linkedin.com/in/katrinakolt/ @agilesista
  • 6. In most cases, it’s impossible to realise anything more than incremental improvements, because only part of the organization has changed … And that part needs to work with the rest of the organization, which expects them to behave in the traditional way. Humble, Jez, Molesky, Joanne and O’Reilly, Barry. Lean Enterprise: How High Performance Organisations Innovate at Scale, 2014 https://www.linkedin.com/in/katrinakolt/ @agilesista
  • 7. Minimum viable everything – product, experience and process Measure outcomes (value), not outputs (stuff done) Experiment to learn – create a generative safe to try culture to continuously improve Patterns to introduce business agility https://www.linkedin.com/in/katrinakolt/ @agilesista
  • 8. We’re reshaping ANZ’s Australian division into approximately 18 tribes of around 10 squads each. That’s 180 start-ups … up and running. 180 components of the organisation, which all have autonomy and agility to adapt to what customers need very, very quickly. Chris Venter, General Manager of Technology and Digital Banking, ANZ https://www.linkedin.com/in/katrinakolt/ @agilesista
  • 9. Value difference & encourage everyone to have a voice Find solutions by testing and learning Find ways to use data to learn and improve Behaviours that support test & learn
  • 10. Teams learn best from the lessons of their peers. What challenges did they face? How did they address them? What would they do differently? People remember stories and take inspiration from the experiences of others. O’Reilly, Barry. Blog - 10 Principles to Transform
  • 11. The most expensive way to find out if a product works is to build the entire product and then release it. The key to rapid experimentation is not to prove that all our ideas are winners, but to kill losing ideas early to cut wasted effort, time and further poor investment. O’Reilly, Barry. Blog - Stop Typing, Start Testing