SlideShare a Scribd company logo
www.15inno.com
15inno by Stefan Lindegaard at LinkedIn Groups
stefanlindegaard@me.com
Twitter: @lindegaard
Hey! Free books on 15inno.com!
Using Metrics for R&D and Innovation
What should we measure?
How should we do it?
Using Metrics for R&D and Innovation - Innovation MasterClass May 5
Common understanding on input, process
and output
Top 5 metrics (Goldsense Group, 2013):
1. R&D spending
2. R&D headcount
Both are input metrics, the next three are output
metrics
“Headcount is a key metric for R&D. In
operations, the unit of production capacity is
generally “a piece of equipment assisted by
people.” In R&D, however, the unit of production
capacity is generally “people assisted by a piece
of equipment.” An R&D organization’s capacity is
best measured by its people. Appropriately,
these are the top two metrics.”
Bradford Goldsense
Is spending, headcount really that important?
The power of the ecosystems can change this.
Common understanding on input, process
and output
Top 5 metrics (Goldsense Group, 2013):
3. % of current sales due to new
products/services launched in x years
4. Patent production
5. New products released
Too little focus on process metrics?
Common understanding on input, process
and output
Much focus on leading versus lagging indicators
Lagging indicators: Historic, can’t be changed
(patents granted, expenses, new revenue)
Input, output is fairly easy to identify. Processes
are more difficult, but could be more rewarding.
Leading indicators: Predictive, can be changed
(patents filed, development time spent, # of
ideas and ongoing projects)
Jimm Feldborg, Director Global Projects
Leading indicators let you know what to expect.
Have two leading indicators for each one
lagging. (Doug Wick)
Using Metrics for R&D and Innovation - Innovation MasterClass May 5
Number of innovation-related rewards and recognitions
Numbers from various feedback mechanisms, showing employee
acceptance and understanding of the initiative
Results from the innovation self assessment capability maturity
framework (survey measuring five levels of maturity related to innovation
behavior)
Percentage of our budget dedicated to innovation, research, and
exploration of emerging technologies
Shareholder value created from innovation activities. (Shareholder Value
= IT Efficiencies + Business Value provided to the IT customers)
# of ideas generated in specific innovation harvesting campaigns
# of ideas harvested from campaigns, turned into implementable projects
# of Intel patent submissions
#Number of white papers published
1) Focus on engagement, training and
participation of individuals. Get critical mass
2) Shift / add focus on innovation pipeline (active
projects by stage, flow of projects, development,
launch and kill)
3) Shift / add focus on end goals (ROI,
successful products/services, revenue/savings
from new launches, optimized processes)
Hundreds of potential metrics, but not more than
8-10
Jeff Murphy, former Executive Director
What should we measure?
How should we do it?
Why you should NOT pay too much
attention to this?
Using Metrics for R&D and Innovation - Innovation MasterClass May 5
Faster pace, shrinking window of
opportunity, less time for cash cows
Driven by global megatrends: faster, more
open, more transparent and more connected
The future of innovation is open and holistic
(go beyond technology and products =
business models and services)
A new paradigm for innovation changes the
perspectives and approaches for metrics
on research and innovation
Using Metrics for R&D and Innovation - Innovation MasterClass May 5
Using Metrics for R&D and Innovation - Innovation MasterClass May 5
What are good metrics for or good ways to
quantify foundational activities / enablers (i.e.
databases or knowledge system or
proprietary devices that accelerate the
development of products for a customer)?
Today, we measure usage, users, # of projects it
was used in.
Klaus Gassenmeier, Givaudan
Experimentation is key due to many unknowns
Ask yourself at management team level: What are our
company objectives and how do we best measure
them?
If you change your company's objectives or
measurements later, that's fine. In fact, I would argue
that if you're producing charts that nobody is reading or
acting on, you're probably measuring the wrong stuff.
And if you're not meeting as a team to discuss these
metrics and have a regular debate about how you're
doing and what needs to change, then I can assure you
that you'll never reach your destination. You'll have no
idea when you're off course.
Mark Suster, GRP Partners
Using the metrics for R&D is a critical subject.
Importantly from the point of view on how the
project is doing - "no-go" - "pivot or not pivot" etc.
Additionally, as we use these metrics, how is the
best way in the evaluation of employees during
performance appraisal or bonus purposes?
Jim French, Panasonic
Reward behaviors as well as outcomes; what
metrics can be applied to “smartfailing”?
How to track the R&D impact during a multi-year
time cycle? How to quantify the impact of an
R&D activity when the output takes a different
form than the original idea but was influenced by
it? Both qualitative and quantitative metrics seem
to be needed and more importantly assessing
R&D based on an indicator of change that R&D
brings to the company that needs to innovate
continuously could be an idea.
Jean-Claude Junqua, Panasonic
Change is key - don’t get stuck with fixed
metrics; measure impact on overall innovation
capabilities in each project?
Get in touch!
www.15inno.com
15inno by Stefan Lindegaard at LinkedIn Groups
stefanlindegaard@me.com
Twitter: @lindegaard
Hey! Free books on 15inno.com!
A recent comment on 15inno.com
KPI = Kill Potential Innovation

More Related Content

PDF
The Australian Startup Stack
PDF
ClickZ Live: Smart Analytics
PDF
The Swedish Startup Toolkit
PDF
UX STRAT Online 2020: Jing Jing Tan, Uber
PDF
The pivotal power of data science - Influencing the business model of a media...
PDF
Simplify your analytics strategy
PDF
UX STRAT Online 2020: Colette Kolenda, Spotify
PDF
The New Startup Toolkit
The Australian Startup Stack
ClickZ Live: Smart Analytics
The Swedish Startup Toolkit
UX STRAT Online 2020: Jing Jing Tan, Uber
The pivotal power of data science - Influencing the business model of a media...
Simplify your analytics strategy
UX STRAT Online 2020: Colette Kolenda, Spotify
The New Startup Toolkit

What's hot (20)

PDF
Marianne Dahl Steensen - Strategi og organisationsledelse i den digitale æra
PPTX
Insights 2021 | Powering Human Experience
PDF
Agile Innovation - A Study of Practices and Challenges
PDF
Bright Spots Analysis
PDF
Ton van der Greef - Exponentieel Groeien
PDF
Innovation Strategy Canvas
PDF
HPMC 2014 - The value of analytics - SAS
PPTX
What Now? Webinar
PDF
2013 12-05 data-driven innovation - fitzgerald analytics workshop at gilbane ...
PDF
UX STRAT Europe 2021: Angel Brown, Digitas Health
PDF
A Human Centric L&D Approach in Today's Digital Age
PDF
Innovation for Start-ups
PPTX
Agile And Finance : Global Product Lifecycle
PPSX
Managing Innovation in any Market
PDF
The New Face of CTO/CIO
PDF
Innovation Planning
PDF
Hackathon - Continuous Innovation by Design
PDF
Prioritizing winning opportunities
PDF
Agile digital enterprise framework v1.4
PPTX
The New Pattern Of Innovation
Marianne Dahl Steensen - Strategi og organisationsledelse i den digitale æra
Insights 2021 | Powering Human Experience
Agile Innovation - A Study of Practices and Challenges
Bright Spots Analysis
Ton van der Greef - Exponentieel Groeien
Innovation Strategy Canvas
HPMC 2014 - The value of analytics - SAS
What Now? Webinar
2013 12-05 data-driven innovation - fitzgerald analytics workshop at gilbane ...
UX STRAT Europe 2021: Angel Brown, Digitas Health
A Human Centric L&D Approach in Today's Digital Age
Innovation for Start-ups
Agile And Finance : Global Product Lifecycle
Managing Innovation in any Market
The New Face of CTO/CIO
Innovation Planning
Hackathon - Continuous Innovation by Design
Prioritizing winning opportunities
Agile digital enterprise framework v1.4
The New Pattern Of Innovation
Ad

Viewers also liked (8)

PDF
My Single Point budget portfolio management
PDF
Service in the Industry is not a Product Feature but a Business Model
PDF
Deloitte Innovation
PDF
The Chief Innovation Officer, Redefined
PDF
Benchmarking Study On Innovation Policy 29012010
PPTX
Startup Roadmap Workshop
PDF
Fonction R&D et Innovation au sein des entreprises, pratiques internationales...
PDF
10 New Business Models for this Decade
My Single Point budget portfolio management
Service in the Industry is not a Product Feature but a Business Model
Deloitte Innovation
The Chief Innovation Officer, Redefined
Benchmarking Study On Innovation Policy 29012010
Startup Roadmap Workshop
Fonction R&D et Innovation au sein des entreprises, pratiques internationales...
10 New Business Models for this Decade
Ad

Similar to Using Metrics for R&D and Innovation - Innovation MasterClass May 5 (20)

PPTX
Measuring Return on Research and Innovation
PDF
The global innovation 1000 strategy-business winter-2013
PPTX
Sentient Services (Ubiquity Marketing Un Summit 2009) V1
PDF
Outcome Engineering 101: Five Guidelines to Delivering Products that Create I...
PDF
Successful Implementations Report
PDF
UX STRAT Europe 2019: Zachary Jean Paradis, Publicis Sapient
PDF
The Invention Of An Invention
PDF
Google's guide to innovation: How to unlock strategy, resources and technology
PDF
Outcome Engineering 101: Five Guidelines to Delivering Products that Create I...
PDF
Outcome Engineering 101: Five Guidelines to Delivering Products that Create I...
PDF
201308 Deloitte Tech Trends 2013 - Elements of Post Digital.pdf
PDF
Us en wp_techtrends_26062013
PDF
Outcome Engineering 101: Five Guidelines to Delivering Products that Create I...
PDF
Optimizing Digital Business Outcomes
PDF
What's So Great About Embedded Analytics?
PDF
Engineering Construction 4.0 Revolution
PDF
Best Practices for an Effective Innovation Process
PPTX
5 Steps To Measure ROI On Your Data Science Initiatives - Webinar
PDF
RD2S_algorithm
PDF
Five Guidelines to Delivering Products that Create Impact in Communications, ...
Measuring Return on Research and Innovation
The global innovation 1000 strategy-business winter-2013
Sentient Services (Ubiquity Marketing Un Summit 2009) V1
Outcome Engineering 101: Five Guidelines to Delivering Products that Create I...
Successful Implementations Report
UX STRAT Europe 2019: Zachary Jean Paradis, Publicis Sapient
The Invention Of An Invention
Google's guide to innovation: How to unlock strategy, resources and technology
Outcome Engineering 101: Five Guidelines to Delivering Products that Create I...
Outcome Engineering 101: Five Guidelines to Delivering Products that Create I...
201308 Deloitte Tech Trends 2013 - Elements of Post Digital.pdf
Us en wp_techtrends_26062013
Outcome Engineering 101: Five Guidelines to Delivering Products that Create I...
Optimizing Digital Business Outcomes
What's So Great About Embedded Analytics?
Engineering Construction 4.0 Revolution
Best Practices for an Effective Innovation Process
5 Steps To Measure ROI On Your Data Science Initiatives - Webinar
RD2S_algorithm
Five Guidelines to Delivering Products that Create Impact in Communications, ...

More from Stefan Lindegaard (20)

PPTX
Stefan Lindegaard - November 2019
PPTX
PPTX
The Digital Age for Corporate Innovation
PPTX
Artificial Intelligence for Corporate Innovation
PPTX
The (gloomy) picture of robots and jobs!
PPTX
Leadership in the Era of Innovation - A Case Based Presentation
PPTX
Transform - or Die! - New York and Chicago
PPTX
Rethink Innovation and Transform Your Company!
PPTX
Rethink Innovation! - My webinar with Hype, May 12
PPTX
Rethink Innovation!
PPTX
Stop talking about innovation!
PPTX
A Benchmark for Open Innovation: How Good is Your Company?
PPTX
Innovation is Everyone´s Responsibility and Why Innovation Matters
PDF
Open Innovation at Electrolux
PPTX
A Presentation on Innovation
PPTX
A Presentation on Innovation
PPTX
What is Innovation? Why is Innovation Important? and Other Good Questions
PPTX
The People Side of Innovation
PPTX
Open Innovation: New Challenges, New Opportunities
PPTX
7 Steps for Open Innovation by @Lindegaard: Grading Your Company’s Open Innov...
Stefan Lindegaard - November 2019
The Digital Age for Corporate Innovation
Artificial Intelligence for Corporate Innovation
The (gloomy) picture of robots and jobs!
Leadership in the Era of Innovation - A Case Based Presentation
Transform - or Die! - New York and Chicago
Rethink Innovation and Transform Your Company!
Rethink Innovation! - My webinar with Hype, May 12
Rethink Innovation!
Stop talking about innovation!
A Benchmark for Open Innovation: How Good is Your Company?
Innovation is Everyone´s Responsibility and Why Innovation Matters
Open Innovation at Electrolux
A Presentation on Innovation
A Presentation on Innovation
What is Innovation? Why is Innovation Important? and Other Good Questions
The People Side of Innovation
Open Innovation: New Challenges, New Opportunities
7 Steps for Open Innovation by @Lindegaard: Grading Your Company’s Open Innov...

Recently uploaded (20)

PPTX
Dragon_Fruit_Cultivation_in Nepal ppt.pptx
PDF
SIMNET Inc – 2023’s Most Trusted IT Services & Solution Provider
PPTX
CkgxkgxydkydyldylydlydyldlyddolydyoyyU2.pptx
PDF
Katrina Stoneking: Shaking Up the Alcohol Beverage Industry
PDF
Roadmap Map-digital Banking feature MB,IB,AB
PDF
Outsourced Audit & Assurance in USA Why Globus Finanza is Your Trusted Choice
PPTX
Lecture (1)-Introduction.pptx business communication
DOCX
unit 2 cost accounting- Tender and Quotation & Reconciliation Statement
PDF
Chapter 5_Foreign Exchange Market in .pdf
PDF
Ôn tập tiếng anh trong kinh doanh nâng cao
PDF
COST SHEET- Tender and Quotation unit 2.pdf
PDF
pdfcoffee.com-opt-b1plus-sb-answers.pdfvi
PDF
How to Get Funding for Your Trucking Business
PPTX
New Microsoft PowerPoint Presentation - Copy.pptx
PDF
NISM Series V-A MFD Workbook v December 2024.khhhjtgvwevoypdnew one must use ...
PPTX
HR Introduction Slide (1).pptx on hr intro
PPTX
Principles of Marketing, Industrial, Consumers,
PDF
NewBase 12 August 2025 Energy News issue - 1812 by Khaled Al Awadi_compresse...
PDF
How to Get Business Funding for Small Business Fast
PDF
Cours de Système d'information about ERP.pdf
Dragon_Fruit_Cultivation_in Nepal ppt.pptx
SIMNET Inc – 2023’s Most Trusted IT Services & Solution Provider
CkgxkgxydkydyldylydlydyldlyddolydyoyyU2.pptx
Katrina Stoneking: Shaking Up the Alcohol Beverage Industry
Roadmap Map-digital Banking feature MB,IB,AB
Outsourced Audit & Assurance in USA Why Globus Finanza is Your Trusted Choice
Lecture (1)-Introduction.pptx business communication
unit 2 cost accounting- Tender and Quotation & Reconciliation Statement
Chapter 5_Foreign Exchange Market in .pdf
Ôn tập tiếng anh trong kinh doanh nâng cao
COST SHEET- Tender and Quotation unit 2.pdf
pdfcoffee.com-opt-b1plus-sb-answers.pdfvi
How to Get Funding for Your Trucking Business
New Microsoft PowerPoint Presentation - Copy.pptx
NISM Series V-A MFD Workbook v December 2024.khhhjtgvwevoypdnew one must use ...
HR Introduction Slide (1).pptx on hr intro
Principles of Marketing, Industrial, Consumers,
NewBase 12 August 2025 Energy News issue - 1812 by Khaled Al Awadi_compresse...
How to Get Business Funding for Small Business Fast
Cours de Système d'information about ERP.pdf

Using Metrics for R&D and Innovation - Innovation MasterClass May 5

  • 1. www.15inno.com 15inno by Stefan Lindegaard at LinkedIn Groups stefanlindegaard@me.com Twitter: @lindegaard Hey! Free books on 15inno.com! Using Metrics for R&D and Innovation
  • 2. What should we measure? How should we do it?
  • 4. Common understanding on input, process and output Top 5 metrics (Goldsense Group, 2013): 1. R&D spending 2. R&D headcount Both are input metrics, the next three are output metrics
  • 5. “Headcount is a key metric for R&D. In operations, the unit of production capacity is generally “a piece of equipment assisted by people.” In R&D, however, the unit of production capacity is generally “people assisted by a piece of equipment.” An R&D organization’s capacity is best measured by its people. Appropriately, these are the top two metrics.” Bradford Goldsense Is spending, headcount really that important? The power of the ecosystems can change this.
  • 6. Common understanding on input, process and output Top 5 metrics (Goldsense Group, 2013): 3. % of current sales due to new products/services launched in x years 4. Patent production 5. New products released Too little focus on process metrics?
  • 7. Common understanding on input, process and output Much focus on leading versus lagging indicators
  • 8. Lagging indicators: Historic, can’t be changed (patents granted, expenses, new revenue) Input, output is fairly easy to identify. Processes are more difficult, but could be more rewarding. Leading indicators: Predictive, can be changed (patents filed, development time spent, # of ideas and ongoing projects) Jimm Feldborg, Director Global Projects
  • 9. Leading indicators let you know what to expect. Have two leading indicators for each one lagging. (Doug Wick)
  • 11. Number of innovation-related rewards and recognitions Numbers from various feedback mechanisms, showing employee acceptance and understanding of the initiative Results from the innovation self assessment capability maturity framework (survey measuring five levels of maturity related to innovation behavior) Percentage of our budget dedicated to innovation, research, and exploration of emerging technologies Shareholder value created from innovation activities. (Shareholder Value = IT Efficiencies + Business Value provided to the IT customers) # of ideas generated in specific innovation harvesting campaigns # of ideas harvested from campaigns, turned into implementable projects # of Intel patent submissions #Number of white papers published
  • 12. 1) Focus on engagement, training and participation of individuals. Get critical mass 2) Shift / add focus on innovation pipeline (active projects by stage, flow of projects, development, launch and kill) 3) Shift / add focus on end goals (ROI, successful products/services, revenue/savings from new launches, optimized processes) Hundreds of potential metrics, but not more than 8-10 Jeff Murphy, former Executive Director
  • 13. What should we measure? How should we do it? Why you should NOT pay too much attention to this?
  • 15. Faster pace, shrinking window of opportunity, less time for cash cows Driven by global megatrends: faster, more open, more transparent and more connected The future of innovation is open and holistic (go beyond technology and products = business models and services)
  • 16. A new paradigm for innovation changes the perspectives and approaches for metrics on research and innovation
  • 19. What are good metrics for or good ways to quantify foundational activities / enablers (i.e. databases or knowledge system or proprietary devices that accelerate the development of products for a customer)? Today, we measure usage, users, # of projects it was used in. Klaus Gassenmeier, Givaudan Experimentation is key due to many unknowns
  • 20. Ask yourself at management team level: What are our company objectives and how do we best measure them? If you change your company's objectives or measurements later, that's fine. In fact, I would argue that if you're producing charts that nobody is reading or acting on, you're probably measuring the wrong stuff. And if you're not meeting as a team to discuss these metrics and have a regular debate about how you're doing and what needs to change, then I can assure you that you'll never reach your destination. You'll have no idea when you're off course. Mark Suster, GRP Partners
  • 21. Using the metrics for R&D is a critical subject. Importantly from the point of view on how the project is doing - "no-go" - "pivot or not pivot" etc. Additionally, as we use these metrics, how is the best way in the evaluation of employees during performance appraisal or bonus purposes? Jim French, Panasonic Reward behaviors as well as outcomes; what metrics can be applied to “smartfailing”?
  • 22. How to track the R&D impact during a multi-year time cycle? How to quantify the impact of an R&D activity when the output takes a different form than the original idea but was influenced by it? Both qualitative and quantitative metrics seem to be needed and more importantly assessing R&D based on an indicator of change that R&D brings to the company that needs to innovate continuously could be an idea. Jean-Claude Junqua, Panasonic Change is key - don’t get stuck with fixed metrics; measure impact on overall innovation capabilities in each project?
  • 23. Get in touch! www.15inno.com 15inno by Stefan Lindegaard at LinkedIn Groups stefanlindegaard@me.com Twitter: @lindegaard Hey! Free books on 15inno.com! A recent comment on 15inno.com KPI = Kill Potential Innovation