SlideShare a Scribd company logo
200. Bootstrap & Act
Get out of the building
Nikos Palavitsinis, Agro-Know
Lean AKademy, Mar-Apr, 2014
Definition
Adjective
(of a person or project) using one's own resources
rather than external help.
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
201. Revisit our Lean Canvas
• Let’s take a look at your new versions of your
Lean Canvases
• Which were the parts of the LC that you
changed during the past week? Why did you
do so?
Lean AKademy, Mar-Apr, 2014
202. Loose ends have to end!
• It’s all about hypotheses right?
• What if you have the problems wrong?
• What if you have the prices too low?
Lean AKademy, Mar-Apr, 2014
203. Three Stages of a Startup
• Do I have a problem worth solving?
• Have I built something that people want?
• How can I scale this up?
204. What’s an
Experiment?
a scientific procedure
undertaken to make
a discovery,
test a hypothesis, or
demonstrate a known fact.
Lean AKademy, Mar-Apr, 2014
Validated Learning Loop
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
Steps
• Understand the Problem: Conduct customer
interviews or use other customer observational
techniques to understand whether you have a problem
worth solving.
– Who has the problem, what is the top problem, and how is
it solved today?
• Define the Solution: Take a stab at defining the
solution, build a demo that helps the customer
visualize the solution, and then test it with customers.
– Will the solution work? Who is the early adopter? Does
the pricing model work?
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
Steps
• Validate Qualitatively: Build your MVP and then
soft-launch it to your early adopters. Do they
realize the unique value proposition (UVP)?
– How will you find enough early adopters to support
learning? Are you getting paid?
• Verify Quantitatively: Launch your refined
product to a larger audience. Have you built
something people want?
– How will you reach customers at scale? Do you have a
viable business?
205. Identify your Risk
Risk
A state of uncertainty where some of
the possibilities involve a loss,
catastrophe, or other undesirable
outcome
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
Product Risk
• Getting the product right
– First make sure you have a problem worth solving,
– Then define the smallest possible solution (MVP),
– Build and validate your MVP at small scale
(demonstrate UVP),
– Then verify it at large scale
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
Customer Risk
• Building a path to customers
– First identify who has the pain,
– Then narrow this down to early adopters who
really want your product now,
– It’s OK to start with outbound channels,
– But gradually build/develop scalable inbound
channels—the earlier the better.
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
Market Risk
• Building a viable business
– Identify competition through existing alternatives
and pick a price for your solution,
– Test pricing first by measuring what customers say
(verbal commitments),
– Then test pricing by what customers do,
– Optimize your cost structure to make the business
model work.
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
Ranking of Business Models
• You may find yourselves with more than one
canvases filled out
– This may happen in case of different problems for
different customer segments
• But how do you decide on the one to act
upon?
Lean AKademy, Mar-Apr, 2014
Weights
• Customer pain level (Problem): Prioritize customer
segments that you believe will need your product the
most.
• Ease of reach (Channels): If you have an easier path
to one segment of customers over others, take that
into consideration.
• Price/gross margin (Revenue Streams/Cost
Structure): Pick a customer segment that allows you
to maximize on your margins.
Lean AKademy, Mar-Apr, 2014
Weights
• Market size (Customer Segments): Pick a customer
segment that represents a big enough market given
the goals for your business.
• Technical feasibility (Solution): Visit your Solution
box to ensure that your planned solution not only is
feasible, but also represents the minimum feature
set to put in front of customers
Lean AKademy, Mar-Apr, 2014
206. Seek External Advice
• Get out of the building
• Find “advisors”
– Prototypical customer
– Potential investor
– Other entrepreneur
• Ask specific questions, 20% setup – 80% talk,
talk to visionary people, don’t take their input
as validation or judgement
[Lean 101] Bootstrapping & Getting Out of the Building
Lean AKademy, Mar-Apr, 2014
207. Running Effective Experiments
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
What to do?
• Measure one thing: Stay focused on the key learning
or key metric you need to achieve, which will vary by
the type and stage of your product,
• Do the smallest thing possible to learn: Challenge
yourself to find the simplest thing you can do to test a
hypothesis,
• Formulate a Falsifiable Hypothesis: Don’t accumulate
just enough evidence to convince yourself that your
hypothesis is correct,
• Validate Qualitatively, Verify Quantitatively: Your
initial goal is to get a strong signal that typically doesn’t
require a large sample size,
Lean AKademy, Mar-Apr, 2014
What to do?
• Correlate Results back to Specific Actions:
Inform your product development in really
specific actions from your side,
• Create Accessible Dashboards: Share your
experiments and their results, openly with
your team,
• Communicate Learning Early & Often:
Periodically communicate the lessons learned
from your last batch of experiments.
208. Interviews
a meeting of people face to face, esp.
for consultation
Lean AKademy, Mar-Apr, 2014
No surveys – No focus groups!
Lean AKademy, Mar-Apr, 2014
Why?
• Surveys assume you know the right questions,
• Surveys assume you know the right answers,
• You can’t see the customer during a survey,
• Focus groups are just plain wrong,
• Maybe you can use surveys to validate what
you learn from your initial interviews
Lean AKademy, Mar-Apr, 2014
Tips
• Build a frame around learning, not pitching. In a learning
frame, the roles are reversed: you set the context, but then you
let the customer do most of the talking,
• Don’t ask customers what they want. Measure what they do.
It’s fairly common to find customers lying in interviews, out of
politeness or they really don’t know or don’t care enough,
• Stick to a script. You need to bind the conversation around
specific learning goals. Otherwise, you can blow off a lot of time
and end up with an overwhelming amount of unactionable
information,
• Cast a wider net initially. Not all of your prospects will (or
should) be early adopters,
Lean AKademy, Mar-Apr, 2014
Tips
• Prefer face-to-face meetings. Pick up body language, connect
and communicate. Create a sense of closeness,
• Start with people you know. Get comfortable with your
script, rehearse it.
• Take someone along with you. Might help with
documentation and following the script in case something is
overlooked,
• Pick a neutral location. Create a casual atmosphere, not make
it business-like from day 1. Let them choose the place if they
want to,
Lean AKademy, Mar-Apr, 2014
Tips
• Ask for sufficient time. Let them know how much time
you will need and stick to this. Don’t ask them 30
minutes and keep them occupied for three times the
time,
• Don’t pay or provide other incentives. You want to
attract customers, truly, you don’t want to pay their kind
words,
• Avoid recording the interviews. Don’t make your
interviewees think about what they are about to say 2-3
times before they say it,
• Document results immediately after the interview. Get
five minutes alone with silence and document all the
results on paper.
Lean AKademy, Mar-Apr, 2014
These do NOT apply
• Customers don’t know what they want,
• Talking to 20 people isn’t statistically
significant,
• I only rely on quantitative metrics,
• I am my own customer, I don’t need to talk to
anyone,
• My friends think it’s a great idea,
Lean AKademy, Mar-Apr, 2014
These do NOT apply
• Why spend weeks talking to customers when I
can build something over the weekend?
• No need to test the problem, it’s obvious,
• I can’t test the problem, it’s not obvious,
• People will steal my idea
Be prepared
Before venturing into the unknown,
you need a thing or two…
Lean AKademy, Mar-Apr, 2014
209. Prepare your Interview Form & Script
• An interview script
– To follow by the letter
• An interview form
– To help you document everything
• A data collection/analysis instrument
– To make sense of it
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
You need to know
• Product risk: What are you solving?
– How do customers rank the top three problems?
• Market risk: Who is the competition?
– How do customers solve these problems today?
• Customer risk: Who has the pain?
– Is this a viable customer segment?
Lean AKademy, Mar-Apr, 2014
Lean AKademy, Mar-Apr, 2014
Example
• Idea: Build a tool/service/process that would
help Project Managers prepare proposals for
EU-funding
• We got three problems
• A list of possible interviewees
• Booked the appointments
Lean AKademy, Mar-Apr, 2014
Story
• Recently we found ourselves in the middle of yet
another proposal preparation to secure funding
for this amazing idea we had for one project.
Following all the typical methods and tools to
prepare the proposal, with a highly skilled team
supporting it, we did submit it and we were more
than positive related to its results. Getting the
results back, we found out that the proposal was
not accepted, reaching a really low score. What
was worse, looking at the remarks made, they did
make a lot of sense and we were really surprised
how we did not address them at the first place.
Lean AKademy, Mar-Apr, 2014
Story
• There and then, instead of blaming it on our tiredness,
the magnitude of the proposals submitted for the same
call, the politics or the weather, we decided to analyze
the causes of our failure and try to trace them back to
specific things that could have been improved. Looking
at that, we find ourselves with a bunch of problems
that were related either to the process or specific
people that we would like to share with you and ask for
your honest feedback on whether or not these
problems look familiar for you and if you have faced
them in the past. It’s really useful for us to learn about
the problems you have to contribute as well as the
ways you use to tackle them.
Lean AKademy, Mar-Apr, 2014
210. Making sense of it all
• Review results weekly
• Home in on early adopters
• Refine the problems
• Understand alternatives
• Essence lies in the detail (words)
• Find ways to reach your early adopters
Lean AKademy, Mar-Apr, 2014
211. Collect Data & Report Findings
• Identify the demographics of early adopters
– Build an archetype
• Have a must-problem
– A burning issue that has to be resolved!
• Have accurate alternatives
– What do customers use today?
Lean AKademy, Mar-Apr, 2014
Initial Problems
• There’s a slow and problematic Proposal/Bid
Development
• When preparing a proposal we are not matching
brainstorming & discussion outcomes into
tangible proposal/bid contributions
• Having difficulty in analyzing existing funding
opportunities & identifying project ideas
• Identifying appropriate project roles and partners
to match them is a difficult and troublesome task
that needs addressing
Lean AKademy, Mar-Apr, 2014
Final Problems
• Problems with excessive communication
overhead with partners and unnecessary
interactions that get in the way of real work
• Problem of slow collection of partner input for
the various stages of a proposal
• Problem of low engagement of the majority of
the partners in the proposal preparation
Lean AKademy, Mar-Apr, 2014
Phase III 1st Priority
(weight: 3)
2nd Priority
(weight: 2)
3rd Priority
(weight: 1)
Not a
problem
(weight: 0)
TOTAL AVG
Problem a 2 3 1 2 13 1.63
Problem b 5 2 0 1 19 2.38
Problem c 4 2 0 2 16 2
Phase III Must Solve
(weight: 2)
Nice to Solve
(weight: 1)
Not needed
(weight: 0)
TOTAL AVG
Problem a 2 2 4 6 0.75
Problem b 5 2 1 12 1.5
Problem c 3 3 2 9 1.13
Lean AKademy, Mar-Apr, 2014
Problem Alternative
Excessive
Communication
Overhead
[new] Careful selection of partners
[new] Sending out instructions through e-mail
[new] Asking only really basic information
[new] Organize working meetings
[new] Skyping to cover all issues in the minimum time possible
[new] One person deals with communication
Slow Collection of
Input
[new] Strict deadlines
[new] Reminders through e-mail
[new] Phone
[new] Look at old proposals to find input needed
[new] Google
[new] Careful selection of partners
[new] Write on our own
[new] Dropbox
Limited Engagement
in Proposal
[new] We fill in the gaps by writing their parts on our own
[new] Setting clear rules from day 1
[new] We engage a core of partners, no more
[new] Communication through e-mail, Skype, phone
Lean AKademy, Mar-Apr, 2014
212. Takeaways & Assignments
• Three stages of a start up
• Experiment basics
• Risks
• Interview basics
Lean AKademy, Mar-Apr, 2014
212. Takeaways & Assignments
• Have three must-have problems
• Prepare the interview script and form
• Prepare a list with early adopters that can be
reached for interview
Lean AKademy, Mar-Apr, 2014
Bonus
• https://www.udacity.com/course/ep245
Lean AKademy, Mar-Apr, 2014
Questions?

More Related Content

PPTX
[Lean 101] Introduction to Lean - Preparing a Lean Canvas
PPTX
Onboarding New Sales Resources Doesn't Need to be So Difficult
PPTX
How to consistently get around sales objections
PPTX
Business Startup Bootcamp - Day 3
PPTX
How to Build a Cold Call Script that Works
PPTX
How to Consistently Get Around Gatekeepers When B2B Cold Calling
PPTX
Monday morning meeting 022414
PPTX
Planning, refining and testing your idea
[Lean 101] Introduction to Lean - Preparing a Lean Canvas
Onboarding New Sales Resources Doesn't Need to be So Difficult
How to consistently get around sales objections
Business Startup Bootcamp - Day 3
How to Build a Cold Call Script that Works
How to Consistently Get Around Gatekeepers When B2B Cold Calling
Monday morning meeting 022414
Planning, refining and testing your idea

What's hot (20)

PPTX
How to Use Prospect Pain to Generate Leads
PPTX
Indi Singh - Excel in Health
PPTX
How to improve your control over the sales process
PPTX
ECRDA: Loan officer training - Session 1
PPTX
Session 1 - Introduction to lean and problem interviews
PDF
Pitching4 startups
PPT
How to Effectively Manage the Sales Process
PPTX
How to Get Prospects to Answer the Phone When Cold Calling
PPTX
How to Build and Maintain Mental Strength
PPTX
How to Immediately Become a Better Closer
PPT
How to Deal with Gatekeepers when Sales Prospecting
PDF
Lean StartUp: Basics of Customer Discovery & Development
PPTX
How to build a value proposition that generates leads
PPTX
ECRDA: Loan officer training - Session 4
PPTX
Intro to Lean Startup - Women's Startup Lab April 2015
PPTX
Lean Startup in 1 Hour
PDF
Customer interview @Lean Startup Machine-Amman
PDF
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
PPTX
Session 2 - Interviews techinques
PPTX
MY SALES PEOPLE WON'T USE MY CRM! WHAT YOU CAN DO ABOUT IT.
How to Use Prospect Pain to Generate Leads
Indi Singh - Excel in Health
How to improve your control over the sales process
ECRDA: Loan officer training - Session 1
Session 1 - Introduction to lean and problem interviews
Pitching4 startups
How to Effectively Manage the Sales Process
How to Get Prospects to Answer the Phone When Cold Calling
How to Build and Maintain Mental Strength
How to Immediately Become a Better Closer
How to Deal with Gatekeepers when Sales Prospecting
Lean StartUp: Basics of Customer Discovery & Development
How to build a value proposition that generates leads
ECRDA: Loan officer training - Session 4
Intro to Lean Startup - Women's Startup Lab April 2015
Lean Startup in 1 Hour
Customer interview @Lean Startup Machine-Amman
UXSG2014 Workshop (Day 1) - Lean Startup (Bryan Long)
Session 2 - Interviews techinques
MY SALES PEOPLE WON'T USE MY CRM! WHAT YOU CAN DO ABOUT IT.
Ad

Viewers also liked (10)

PPTX
[Lean 101] Channels & Metrics - Reaching and Measuring
PPTX
MetadataTheory: Quality for Learning Resources (11th of 10)
PPTX
[Lean 101] Costs & Revenues - Breaking even or Breaking bad???
PPTX
PPTX
Quality of Learning Resources & Metadata through Quality Seals, Badges, Marks...
PPTX
Αξιολόγηση Μαθησιακών Αντικειμένων και Σφραγίδες Ποιότητας [Εργαστήρια ΕΕΛ/ΛΑΚ]
PPTX
Σχολείο ΑΕΠ (Συνάντηση 2)
PPTX
Σχολείο ΑΕΠ (Συνάντηση 1)
PDF
Making Sense of ISO/IEC 19788
PDF
Digital Educational Content Quality Assurance Process
[Lean 101] Channels & Metrics - Reaching and Measuring
MetadataTheory: Quality for Learning Resources (11th of 10)
[Lean 101] Costs & Revenues - Breaking even or Breaking bad???
Quality of Learning Resources & Metadata through Quality Seals, Badges, Marks...
Αξιολόγηση Μαθησιακών Αντικειμένων και Σφραγίδες Ποιότητας [Εργαστήρια ΕΕΛ/ΛΑΚ]
Σχολείο ΑΕΠ (Συνάντηση 2)
Σχολείο ΑΕΠ (Συνάντηση 1)
Making Sense of ISO/IEC 19788
Digital Educational Content Quality Assurance Process
Ad

Similar to [Lean 101] Bootstrapping & Getting Out of the Building (20)

PPTX
Testing your business idea. Lets make your idea more successful
PPTX
[Lean 101] Solution and Unique Value Proposition
PPTX
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
PPTX
Bus model and cust dev june 2013
PDF
Product Management Guide - A Work In Progress
PDF
Continuous discovery - Caitlin Blackwell
PPT
Getting to Product Market Fit - An Overview of Customer Discovery & Validation
PPTX
Lean startup meetup
PDF
Ideation, business models; and how and where to start
PPTX
Business Validation presentation ppt.pptx
PPT
Sw next 2- meetup informativo - rev2
PDF
Understand & Accelerate Sustainable Growth
PPTX
Business Model Canvas and How to validate the idea
PDF
ilide.info-darden-case-book-2022231-pr_1e16344f303112287e97e1fc0e66565c.pdf
PDF
Lean Startup 301
PDF
IECT Summer School 2024 - Things I never knew I never knew - About Sales
PDF
Kaseya Connect 2013: A step by-step sales process guaranteed to supercharge r...
PDF
NAA - Work experience workshop 2
PDF
Elevator Pitch and networking tips
PDF
10 Tips on how to be an Awesome Product Manager
Testing your business idea. Lets make your idea more successful
[Lean 101] Solution and Unique Value Proposition
The First 2 Steps to the Epiphany: Customer Discovery, Customer Validation an...
Bus model and cust dev june 2013
Product Management Guide - A Work In Progress
Continuous discovery - Caitlin Blackwell
Getting to Product Market Fit - An Overview of Customer Discovery & Validation
Lean startup meetup
Ideation, business models; and how and where to start
Business Validation presentation ppt.pptx
Sw next 2- meetup informativo - rev2
Understand & Accelerate Sustainable Growth
Business Model Canvas and How to validate the idea
ilide.info-darden-case-book-2022231-pr_1e16344f303112287e97e1fc0e66565c.pdf
Lean Startup 301
IECT Summer School 2024 - Things I never knew I never knew - About Sales
Kaseya Connect 2013: A step by-step sales process guaranteed to supercharge r...
NAA - Work experience workshop 2
Elevator Pitch and networking tips
10 Tips on how to be an Awesome Product Manager

More from Nikos Palavitsinis, PhD (18)

PPTX
A Hero’s Journey Through Metadata Quality
PPTX
Metadata Mapping & Crosswalks
PPTX
Παιχνίδι Ανοικτών Εκπαιδευτικών Πόρων (25/11/2015)
PPTX
[Lean 101] Learn, Adapt & Pivot
PPT
Presentation of my MSc thesis (Greek)
PPTX
MetadataTheory: Repository Operational Models (10th of 10)
PPTX
MetadataTheory: Learning Repositories Technologies (9th of 10)
PPTX
MetadataTheory: Introduction to Repositories (8th of 10)
PPTX
MetadataTheory: Metadata Tools (7th of 10)
PPTX
MetadataTheory: Metadata Standards (6th of 10)
PPTX
MetadataTheory: Introduction to Metadata (5th of 10)
PPTX
MetadataTheory: Introduction to Learning Objects (1st of 10)
PPTX
MetadataTheory: Learning Technologies (3rd of 10)
PPTX
MetadataTheory: Learning Design & Theories (2nd of 10)
PPTX
MetadataTheory: Policies & Copyrights for LOs (4th of 10)
PPTX
A story of my professional life post-2005, farewell to Agro-Know
PPTX
Defining Lean: What is it?
PPT
Metadata Quality Issues in Learning Repositories
A Hero’s Journey Through Metadata Quality
Metadata Mapping & Crosswalks
Παιχνίδι Ανοικτών Εκπαιδευτικών Πόρων (25/11/2015)
[Lean 101] Learn, Adapt & Pivot
Presentation of my MSc thesis (Greek)
MetadataTheory: Repository Operational Models (10th of 10)
MetadataTheory: Learning Repositories Technologies (9th of 10)
MetadataTheory: Introduction to Repositories (8th of 10)
MetadataTheory: Metadata Tools (7th of 10)
MetadataTheory: Metadata Standards (6th of 10)
MetadataTheory: Introduction to Metadata (5th of 10)
MetadataTheory: Introduction to Learning Objects (1st of 10)
MetadataTheory: Learning Technologies (3rd of 10)
MetadataTheory: Learning Design & Theories (2nd of 10)
MetadataTheory: Policies & Copyrights for LOs (4th of 10)
A story of my professional life post-2005, farewell to Agro-Know
Defining Lean: What is it?
Metadata Quality Issues in Learning Repositories

Recently uploaded (20)

PPTX
M365 Business Central features for small Business
PPT
Marketing Kỹ thuật số - Digital Marketing_Bài 4.ppt
PPTX
Session 1 strategic management for beginners
PPTX
1. MCS Business Communication powerpoint.pptx
PDF
The Potential for EV Battery Recycling in Europe.pdf
PPTX
6. FINANCE FOR NON-FINANCIAL MANAGERS.15.08.2024.pptx
PDF
Bio-based puffy stuff - business opportunity
PPTX
Introduction to Computing Profession.pptx
PDF
Solar without Electrician - Startup Presentation
PDF
Qloudhost DMACA ignored hosting provider
PPTX
Daily stand up meeting on the various business
PPTX
Week 4-5 1stq Analyze the Market Need and Products
PDF
Why DevOps Teams Are Dropping Spreadsheets for Real-Time Cloud Hygiene.pdf
PPTX
Time Management, time management powerpoint
PPTX
Structure of Organization in Professional Practices.pptx
PDF
Captivating LED Visuals, Built to Impress Brightlink.pdf
PDF
What is the PSM Process in Automation in India
PPTX
Session 6 & 7.strategic management for MBA
PPTX
Transforming Finance with Ratiobox – Oracle NetSuite Bookkeeping & Accounting...
PPT
Organizational Culture and Management.ppt
M365 Business Central features for small Business
Marketing Kỹ thuật số - Digital Marketing_Bài 4.ppt
Session 1 strategic management for beginners
1. MCS Business Communication powerpoint.pptx
The Potential for EV Battery Recycling in Europe.pdf
6. FINANCE FOR NON-FINANCIAL MANAGERS.15.08.2024.pptx
Bio-based puffy stuff - business opportunity
Introduction to Computing Profession.pptx
Solar without Electrician - Startup Presentation
Qloudhost DMACA ignored hosting provider
Daily stand up meeting on the various business
Week 4-5 1stq Analyze the Market Need and Products
Why DevOps Teams Are Dropping Spreadsheets for Real-Time Cloud Hygiene.pdf
Time Management, time management powerpoint
Structure of Organization in Professional Practices.pptx
Captivating LED Visuals, Built to Impress Brightlink.pdf
What is the PSM Process in Automation in India
Session 6 & 7.strategic management for MBA
Transforming Finance with Ratiobox – Oracle NetSuite Bookkeeping & Accounting...
Organizational Culture and Management.ppt

[Lean 101] Bootstrapping & Getting Out of the Building

  • 1. 200. Bootstrap & Act Get out of the building Nikos Palavitsinis, Agro-Know
  • 2. Lean AKademy, Mar-Apr, 2014 Definition Adjective (of a person or project) using one's own resources rather than external help.
  • 4. Lean AKademy, Mar-Apr, 2014 201. Revisit our Lean Canvas • Let’s take a look at your new versions of your Lean Canvases • Which were the parts of the LC that you changed during the past week? Why did you do so?
  • 5. Lean AKademy, Mar-Apr, 2014 202. Loose ends have to end! • It’s all about hypotheses right? • What if you have the problems wrong? • What if you have the prices too low?
  • 6. Lean AKademy, Mar-Apr, 2014 203. Three Stages of a Startup • Do I have a problem worth solving? • Have I built something that people want? • How can I scale this up?
  • 7. 204. What’s an Experiment? a scientific procedure undertaken to make a discovery, test a hypothesis, or demonstrate a known fact.
  • 8. Lean AKademy, Mar-Apr, 2014 Validated Learning Loop
  • 10. Lean AKademy, Mar-Apr, 2014 Steps • Understand the Problem: Conduct customer interviews or use other customer observational techniques to understand whether you have a problem worth solving. – Who has the problem, what is the top problem, and how is it solved today? • Define the Solution: Take a stab at defining the solution, build a demo that helps the customer visualize the solution, and then test it with customers. – Will the solution work? Who is the early adopter? Does the pricing model work?
  • 12. Lean AKademy, Mar-Apr, 2014 Steps • Validate Qualitatively: Build your MVP and then soft-launch it to your early adopters. Do they realize the unique value proposition (UVP)? – How will you find enough early adopters to support learning? Are you getting paid? • Verify Quantitatively: Launch your refined product to a larger audience. Have you built something people want? – How will you reach customers at scale? Do you have a viable business?
  • 14. Risk A state of uncertainty where some of the possibilities involve a loss, catastrophe, or other undesirable outcome
  • 18. Lean AKademy, Mar-Apr, 2014 Product Risk • Getting the product right – First make sure you have a problem worth solving, – Then define the smallest possible solution (MVP), – Build and validate your MVP at small scale (demonstrate UVP), – Then verify it at large scale
  • 20. Lean AKademy, Mar-Apr, 2014 Customer Risk • Building a path to customers – First identify who has the pain, – Then narrow this down to early adopters who really want your product now, – It’s OK to start with outbound channels, – But gradually build/develop scalable inbound channels—the earlier the better.
  • 22. Lean AKademy, Mar-Apr, 2014 Market Risk • Building a viable business – Identify competition through existing alternatives and pick a price for your solution, – Test pricing first by measuring what customers say (verbal commitments), – Then test pricing by what customers do, – Optimize your cost structure to make the business model work.
  • 24. Lean AKademy, Mar-Apr, 2014 Ranking of Business Models • You may find yourselves with more than one canvases filled out – This may happen in case of different problems for different customer segments • But how do you decide on the one to act upon?
  • 25. Lean AKademy, Mar-Apr, 2014 Weights • Customer pain level (Problem): Prioritize customer segments that you believe will need your product the most. • Ease of reach (Channels): If you have an easier path to one segment of customers over others, take that into consideration. • Price/gross margin (Revenue Streams/Cost Structure): Pick a customer segment that allows you to maximize on your margins.
  • 26. Lean AKademy, Mar-Apr, 2014 Weights • Market size (Customer Segments): Pick a customer segment that represents a big enough market given the goals for your business. • Technical feasibility (Solution): Visit your Solution box to ensure that your planned solution not only is feasible, but also represents the minimum feature set to put in front of customers
  • 27. Lean AKademy, Mar-Apr, 2014 206. Seek External Advice • Get out of the building • Find “advisors” – Prototypical customer – Potential investor – Other entrepreneur • Ask specific questions, 20% setup – 80% talk, talk to visionary people, don’t take their input as validation or judgement
  • 29. Lean AKademy, Mar-Apr, 2014 207. Running Effective Experiments
  • 31. Lean AKademy, Mar-Apr, 2014 What to do? • Measure one thing: Stay focused on the key learning or key metric you need to achieve, which will vary by the type and stage of your product, • Do the smallest thing possible to learn: Challenge yourself to find the simplest thing you can do to test a hypothesis, • Formulate a Falsifiable Hypothesis: Don’t accumulate just enough evidence to convince yourself that your hypothesis is correct, • Validate Qualitatively, Verify Quantitatively: Your initial goal is to get a strong signal that typically doesn’t require a large sample size,
  • 32. Lean AKademy, Mar-Apr, 2014 What to do? • Correlate Results back to Specific Actions: Inform your product development in really specific actions from your side, • Create Accessible Dashboards: Share your experiments and their results, openly with your team, • Communicate Learning Early & Often: Periodically communicate the lessons learned from your last batch of experiments.
  • 33. 208. Interviews a meeting of people face to face, esp. for consultation
  • 34. Lean AKademy, Mar-Apr, 2014 No surveys – No focus groups!
  • 35. Lean AKademy, Mar-Apr, 2014 Why? • Surveys assume you know the right questions, • Surveys assume you know the right answers, • You can’t see the customer during a survey, • Focus groups are just plain wrong, • Maybe you can use surveys to validate what you learn from your initial interviews
  • 36. Lean AKademy, Mar-Apr, 2014 Tips • Build a frame around learning, not pitching. In a learning frame, the roles are reversed: you set the context, but then you let the customer do most of the talking, • Don’t ask customers what they want. Measure what they do. It’s fairly common to find customers lying in interviews, out of politeness or they really don’t know or don’t care enough, • Stick to a script. You need to bind the conversation around specific learning goals. Otherwise, you can blow off a lot of time and end up with an overwhelming amount of unactionable information, • Cast a wider net initially. Not all of your prospects will (or should) be early adopters,
  • 37. Lean AKademy, Mar-Apr, 2014 Tips • Prefer face-to-face meetings. Pick up body language, connect and communicate. Create a sense of closeness, • Start with people you know. Get comfortable with your script, rehearse it. • Take someone along with you. Might help with documentation and following the script in case something is overlooked, • Pick a neutral location. Create a casual atmosphere, not make it business-like from day 1. Let them choose the place if they want to,
  • 38. Lean AKademy, Mar-Apr, 2014 Tips • Ask for sufficient time. Let them know how much time you will need and stick to this. Don’t ask them 30 minutes and keep them occupied for three times the time, • Don’t pay or provide other incentives. You want to attract customers, truly, you don’t want to pay their kind words, • Avoid recording the interviews. Don’t make your interviewees think about what they are about to say 2-3 times before they say it, • Document results immediately after the interview. Get five minutes alone with silence and document all the results on paper.
  • 39. Lean AKademy, Mar-Apr, 2014 These do NOT apply • Customers don’t know what they want, • Talking to 20 people isn’t statistically significant, • I only rely on quantitative metrics, • I am my own customer, I don’t need to talk to anyone, • My friends think it’s a great idea,
  • 40. Lean AKademy, Mar-Apr, 2014 These do NOT apply • Why spend weeks talking to customers when I can build something over the weekend? • No need to test the problem, it’s obvious, • I can’t test the problem, it’s not obvious, • People will steal my idea
  • 41. Be prepared Before venturing into the unknown, you need a thing or two…
  • 42. Lean AKademy, Mar-Apr, 2014 209. Prepare your Interview Form & Script • An interview script – To follow by the letter • An interview form – To help you document everything • A data collection/analysis instrument – To make sense of it
  • 44. Lean AKademy, Mar-Apr, 2014 You need to know • Product risk: What are you solving? – How do customers rank the top three problems? • Market risk: Who is the competition? – How do customers solve these problems today? • Customer risk: Who has the pain? – Is this a viable customer segment?
  • 46. Lean AKademy, Mar-Apr, 2014 Example • Idea: Build a tool/service/process that would help Project Managers prepare proposals for EU-funding • We got three problems • A list of possible interviewees • Booked the appointments
  • 47. Lean AKademy, Mar-Apr, 2014 Story • Recently we found ourselves in the middle of yet another proposal preparation to secure funding for this amazing idea we had for one project. Following all the typical methods and tools to prepare the proposal, with a highly skilled team supporting it, we did submit it and we were more than positive related to its results. Getting the results back, we found out that the proposal was not accepted, reaching a really low score. What was worse, looking at the remarks made, they did make a lot of sense and we were really surprised how we did not address them at the first place.
  • 48. Lean AKademy, Mar-Apr, 2014 Story • There and then, instead of blaming it on our tiredness, the magnitude of the proposals submitted for the same call, the politics or the weather, we decided to analyze the causes of our failure and try to trace them back to specific things that could have been improved. Looking at that, we find ourselves with a bunch of problems that were related either to the process or specific people that we would like to share with you and ask for your honest feedback on whether or not these problems look familiar for you and if you have faced them in the past. It’s really useful for us to learn about the problems you have to contribute as well as the ways you use to tackle them.
  • 49. Lean AKademy, Mar-Apr, 2014 210. Making sense of it all • Review results weekly • Home in on early adopters • Refine the problems • Understand alternatives • Essence lies in the detail (words) • Find ways to reach your early adopters
  • 50. Lean AKademy, Mar-Apr, 2014 211. Collect Data & Report Findings • Identify the demographics of early adopters – Build an archetype • Have a must-problem – A burning issue that has to be resolved! • Have accurate alternatives – What do customers use today?
  • 51. Lean AKademy, Mar-Apr, 2014 Initial Problems • There’s a slow and problematic Proposal/Bid Development • When preparing a proposal we are not matching brainstorming & discussion outcomes into tangible proposal/bid contributions • Having difficulty in analyzing existing funding opportunities & identifying project ideas • Identifying appropriate project roles and partners to match them is a difficult and troublesome task that needs addressing
  • 52. Lean AKademy, Mar-Apr, 2014 Final Problems • Problems with excessive communication overhead with partners and unnecessary interactions that get in the way of real work • Problem of slow collection of partner input for the various stages of a proposal • Problem of low engagement of the majority of the partners in the proposal preparation
  • 53. Lean AKademy, Mar-Apr, 2014 Phase III 1st Priority (weight: 3) 2nd Priority (weight: 2) 3rd Priority (weight: 1) Not a problem (weight: 0) TOTAL AVG Problem a 2 3 1 2 13 1.63 Problem b 5 2 0 1 19 2.38 Problem c 4 2 0 2 16 2 Phase III Must Solve (weight: 2) Nice to Solve (weight: 1) Not needed (weight: 0) TOTAL AVG Problem a 2 2 4 6 0.75 Problem b 5 2 1 12 1.5 Problem c 3 3 2 9 1.13
  • 54. Lean AKademy, Mar-Apr, 2014 Problem Alternative Excessive Communication Overhead [new] Careful selection of partners [new] Sending out instructions through e-mail [new] Asking only really basic information [new] Organize working meetings [new] Skyping to cover all issues in the minimum time possible [new] One person deals with communication Slow Collection of Input [new] Strict deadlines [new] Reminders through e-mail [new] Phone [new] Look at old proposals to find input needed [new] Google [new] Careful selection of partners [new] Write on our own [new] Dropbox Limited Engagement in Proposal [new] We fill in the gaps by writing their parts on our own [new] Setting clear rules from day 1 [new] We engage a core of partners, no more [new] Communication through e-mail, Skype, phone
  • 55. Lean AKademy, Mar-Apr, 2014 212. Takeaways & Assignments • Three stages of a start up • Experiment basics • Risks • Interview basics
  • 56. Lean AKademy, Mar-Apr, 2014 212. Takeaways & Assignments • Have three must-have problems • Prepare the interview script and form • Prepare a list with early adopters that can be reached for interview
  • 57. Lean AKademy, Mar-Apr, 2014 Bonus • https://www.udacity.com/course/ep245
  • 58. Lean AKademy, Mar-Apr, 2014 Questions?