SlideShare a Scribd company logo
Innovating at Speed with Devops 
Eric Cattoir 
IBM Rational Client Technical Professional
Bold Idea 
• Innovation can only happen in an environment 
where it is safe to fail 
© 2014 International Business Machines Corporation 2
Bold Idea 
• Innovation can only happen in an environment 
where it is safe to fail 
•A well implemented Devops solution can provide 
such an environment in an IT environment 
© 2014 International Business Machines Corporation 3
Scientific Innovation 
© 2014 International Business Machines Corporation 4
Innovation and failure 
Icarus 
© 2014 International Business Machines Corporation 5
Innovation and failure 
Le Bris – Albatros II 
1868 
Otto Lilienthal 
1895 
Antonov An-2 
1947 
Leonardo Da Vinci 
1485 
Concorde A - 380 
1969 
Wright Brothers 
1902 
2005 
© 2014 International Business Machines Corporation 6
What has changed in society? 
© 2014 International Business Machines Corporation 7
What has changed in society? 
• Dependend on Software often Business and/or Safety Critical 
© 2014 International Business Machines Corporation 8
What has changed in society? 
• Mobile Computing - Connected all the time 
© 2014 International Business Machines Corporation 9
What has changed in society? 
• Internet of Things 
© 2014 International Business Machines Corporation 10
Cloud 
Demand for apps requires fast, 
scalable environments for dev 
and test, as well as production 
Instrumented Products 
Industry requirements demand 
faster response to regulations 
and standards, with traceability 
and quality 
Software 
delivery Intelligent/ 
Connected Systems 
Software component in 
smart products driving 
increased value and 
differentiation 
Challenges 
Big Data 
Insights on new products by 
more efficiently interpreting 
massive quantities of data 
Social Business 
Broader set of 
stakeholders collaborates 
to deliver continuous 
innovation 
and value 
Mobile 
Modern workforce 
expects constantly 
updated software to 
connect to enterprise 
systems 
© 2014 International Business Machines Corporation 11
What is needed to achieve this in Software 
Development 
•Version control of all 
software, automation, 
and configuration 
• Automated Deployments 
• Architecture 
• Automated Testing 
• Production-Like 
Environments 
© 2014 International Business Machines Corporation 12
What is needed to achieve this in Software 
Development 
Version control of all software, automation, and 
configuration 
IBM UrbanCode Deploy 
with Patterns 
IBM PureApplication System 
SmartCloud Orchestrator 
© 2014 International Business Machines Corporation 13
What is needed to achieve this in Software 
Development 
Automated Deployments 
SSCCMM BBuuiilldd AAuuttoommaattiioonn 
QQAA PRO 
D 
Pull 
changes 
IBM UrbanCode 
Deploy 
Execute 
application 
deployment and 
manage settings 
across 
environments 
Publish build 
DDDDDDEEDDEEVVEEEEVVVVVV 
© 2014 International Business Machines Corporation 14
What is needed to achieve this in Software 
Development 
Architecture 
© 2014 International Business Machines Corporation 15
What is needed to achieve this in Software 
Development 
Automated Testing 
© 2014 International Business Machines Corporation 16
What is needed to achieve this in Software 
Development 
Production-Like Environments 
Infrastructure 
as a Service 
Applications 
Data 
Mid Config 
Middleware 
O/S 
Virtualization 
Servers 
Storage 
Networking 
UrbanCode 
Deploy 
Platform 
as a Service 
Applications 
Data 
Mid Config 
Middleware 
O/S 
Virtualization 
Servers 
Storage 
Networking 
IBM 
Bluemix 
IBM Patterns 
PureApplication 
System 
SmartCloud 
Orchestrator 
SoftLayer 
IBM 
DevOps 
Services 
UrbanCode 
Deploy 
with 
Patterns 
© 2014 International Business Machines Corporation 17
Conclusion 
DevOps Lifecycle 
Customers Business Owners Development/Test Operations/Production 
Continuous Innovation, Feedback and Improvements 
Develop and Test Release and Deploy 
Monitor and Optimize 
DevOps Foundation 
Plan and 
Measure 
Open Lifecycle and Service Management Integration Platform 
Ecosystem 
Best Practices 
© 2014 International Business Machines Corporation 18
Conclusion 
DevOps Lifecycle 
Customers Business Owners Development/Test Operations/Production 
Continuous Innovation, Feedback and Improvements 
Develop and Test Release and Deploy 
Monitor and Optimize 
DevOps Foundation 
Plan and 
Measure 
Open Lifecycle and Service Management Integration Platform 
Ecosystem 
Best Practices 
© 2014 International Business Machines Corporation 19
Conclusion 
DevOps Lifecycle 
Customers Business Owners Development/Test Operations/Production 
Continuous Innovation, Feedback and Improvements 
Develop and Test Release and Deploy 
Monitor and Optimize 
DevOps Foundation 
Plan and 
Measure 
Open Lifecycle and Service Management Integration Platform 
Ecosystem 
Best Practices 
© 2014 International Business Machines Corporation 20

More Related Content

PDF
IVI Software Update - Challenges and Strategies - Webinar Presentation
PPTX
ALM for Developing Engineered Systems - Michael Azoff (Ovum) - 14 May 2019
PDF
App Platforms Integral as User Experience a Growing Priority
PPTX
Leveraging Ignition Quick Start to Rapidly Build Real Projects
PDF
Webinar Presentation: Validation of “next-gen" in-Vehicle Displays.
PDF
Wodify Technologies Automates Crossfit Gym Experience Using OutSystems
PPTX
Embedding a Shift Left Culture in your Enterprise
PDF
Webinar Presentation- Typical Challenges Faced by Tier 1s in AUTOSAR Tooling
IVI Software Update - Challenges and Strategies - Webinar Presentation
ALM for Developing Engineered Systems - Michael Azoff (Ovum) - 14 May 2019
App Platforms Integral as User Experience a Growing Priority
Leveraging Ignition Quick Start to Rapidly Build Real Projects
Webinar Presentation: Validation of “next-gen" in-Vehicle Displays.
Wodify Technologies Automates Crossfit Gym Experience Using OutSystems
Embedding a Shift Left Culture in your Enterprise
Webinar Presentation- Typical Challenges Faced by Tier 1s in AUTOSAR Tooling

What's hot (20)

PPTX
13 Nov 2019 - Experts Talk: Balancing Innovation, Risks, and Compliance in Me...
PDF
IVI Software Update - Challenges and Strategies - Webinar Presentation (updated)
PPTX
OpenTechSummit InterConnect2015 DevOps
PPTX
Competing with Software: It Takes a Platform -- Devops @ EMC World
PDF
Success Story: Developing an Automatic Seat Control System for a Leading Tier1
PDF
Accelerate Your Digital Transformation: How to Achieve Business Agility with ...
PDF
OSMC 2015: End to End Monitoring mit Alyvix-Jürgen Vigna
PDF
How Oceanwide Accelerated its DevOps Adoption Journey with AppDynamics - AppS...
PPTX
Key criteria for choosing APM solutions for the next normal: analysis of surv...
PPTX
Advanced System Engineering in the Automotive Industry - Dr Alain Pfouga (pro...
PDF
Webinar Presentation: Diagnostic Flash Application with OTX
PDF
icaria Lean Factory
PPTX
The Journey to DevOps
PDF
IBM i and Your IT Strategy - Trevor Perry
PPTX
Five Steps to DevOps Success - Avoiding the High Cost of Downtime
PDF
Agile Certainty, bringing predictability in Agile engagements
PDF
Cloud summit 2019 - Scania
PPTX
The Cloud Journey in an Enterprise - CoDe-Conf - Copenhagen October 11, 2018
PDF
Shift Remote: DevOps: An (Un)expected Journey - Zeljko Margeta (RBA)
PDF
Infrastructure as Code in Large Scale Organizations
13 Nov 2019 - Experts Talk: Balancing Innovation, Risks, and Compliance in Me...
IVI Software Update - Challenges and Strategies - Webinar Presentation (updated)
OpenTechSummit InterConnect2015 DevOps
Competing with Software: It Takes a Platform -- Devops @ EMC World
Success Story: Developing an Automatic Seat Control System for a Leading Tier1
Accelerate Your Digital Transformation: How to Achieve Business Agility with ...
OSMC 2015: End to End Monitoring mit Alyvix-Jürgen Vigna
How Oceanwide Accelerated its DevOps Adoption Journey with AppDynamics - AppS...
Key criteria for choosing APM solutions for the next normal: analysis of surv...
Advanced System Engineering in the Automotive Industry - Dr Alain Pfouga (pro...
Webinar Presentation: Diagnostic Flash Application with OTX
icaria Lean Factory
The Journey to DevOps
IBM i and Your IT Strategy - Trevor Perry
Five Steps to DevOps Success - Avoiding the High Cost of Downtime
Agile Certainty, bringing predictability in Agile engagements
Cloud summit 2019 - Scania
The Cloud Journey in an Enterprise - CoDe-Conf - Copenhagen October 11, 2018
Shift Remote: DevOps: An (Un)expected Journey - Zeljko Margeta (RBA)
Infrastructure as Code in Large Scale Organizations
Ad

Viewers also liked (14)

PDF
Blockchain Technology Book Vernisage
PPT
Agile at scale
ODP
Devoxx 2014 presentation
PPT
IBM Rational Solution for mobile
PPT
Cloudant Overview Bluemix Meetup from Lisa Neddam
PPT
The new developer experience
PDF
Apache SystemML - Declarative Large-Scale Machine Learning
ODP
2449 rapid prototyping of innovative io t solutions
PDF
IBM Middle East Data Science Connect 2016 - Doha, Qatar
PDF
Geo Python16 keynote
ODP
Bluemix overview with Internet of Things
PDF
Love & Innovative technology presented by a technology pioneer and an AI expe...
PPT
Cloud scale predictive DevOps automation using Apache Spark: Velocity in Amst...
PDF
DeepLearning and Advanced Machine Learning on IoT
Blockchain Technology Book Vernisage
Agile at scale
Devoxx 2014 presentation
IBM Rational Solution for mobile
Cloudant Overview Bluemix Meetup from Lisa Neddam
The new developer experience
Apache SystemML - Declarative Large-Scale Machine Learning
2449 rapid prototyping of innovative io t solutions
IBM Middle East Data Science Connect 2016 - Doha, Qatar
Geo Python16 keynote
Bluemix overview with Internet of Things
Love & Innovative technology presented by a technology pioneer and an AI expe...
Cloud scale predictive DevOps automation using Apache Spark: Velocity in Amst...
DeepLearning and Advanced Machine Learning on IoT
Ad

Similar to Innovate at speed with Devops (20)

PDF
[IBM Pulse 2014] #1579 DevOps Technical Strategy and Roadmap
PDF
DBD 2414 - Iterative Web-Based Designer for Software Defined Environments (In...
PDF
DevOps for Enterprise Systems : Innovate like a Startup
PDF
Industry Perspective: DevOps - What it Means for the Average Business
PPT
Innovate 2014 - DevOps Technical Strategy
PPTX
Devops transformation in the Rational Collaborative Lifecycle Organization
PPTX
CA Technologies Survive and Thrive in the Application Economy- August 2014
PDF
Team directions at Innovate 2013
PDF
Adopting DevOps for 2-Speed IT
PPT
IBM MobileFirst DevOps IEG DC Event
PPT
Ibmmobilefirstdevopsdc 140311164526-phpapp02
PPT
Webcast Automação Implantação de Aplicações (DevOps)
PDF
Digital Disruption with DevOps - Reference Architecture Overview
PPTX
Charles Slicer-Watkinson - Subject Matter Expert, Seerene
PDF
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
PPTX
Cloud With DevOps Enabling Rapid Business Development
PDF
DevOps adoption in the enterprise
PPTX
Urban code - DevOps - cost reduction
PDF
DevOps for Enterprise Systems Overview
PDF
News to Development Environments and for RDz for z/VSE
 
[IBM Pulse 2014] #1579 DevOps Technical Strategy and Roadmap
DBD 2414 - Iterative Web-Based Designer for Software Defined Environments (In...
DevOps for Enterprise Systems : Innovate like a Startup
Industry Perspective: DevOps - What it Means for the Average Business
Innovate 2014 - DevOps Technical Strategy
Devops transformation in the Rational Collaborative Lifecycle Organization
CA Technologies Survive and Thrive in the Application Economy- August 2014
Team directions at Innovate 2013
Adopting DevOps for 2-Speed IT
IBM MobileFirst DevOps IEG DC Event
Ibmmobilefirstdevopsdc 140311164526-phpapp02
Webcast Automação Implantação de Aplicações (DevOps)
Digital Disruption with DevOps - Reference Architecture Overview
Charles Slicer-Watkinson - Subject Matter Expert, Seerene
Deployment Automation for Hybrid Cloud and Multi-Platform Environments
Cloud With DevOps Enabling Rapid Business Development
DevOps adoption in the enterprise
Urban code - DevOps - cost reduction
DevOps for Enterprise Systems Overview
News to Development Environments and for RDz for z/VSE
 

More from Eric Cattoir (6)

PDF
Ibm edge computing meetup
PPTX
Kubernetes solutions
PDF
You always dreamt of your own quantum computer. now you can have it in the cloud
PPTX
Anatomy of a hyperledger application
PPT
Ibm iot overview
PPT
Mobile application development
Ibm edge computing meetup
Kubernetes solutions
You always dreamt of your own quantum computer. now you can have it in the cloud
Anatomy of a hyperledger application
Ibm iot overview
Mobile application development

Recently uploaded (20)

PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
sap open course for s4hana steps from ECC to s4
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Electronic commerce courselecture one. Pdf
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
Encapsulation theory and applications.pdf
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
Spectroscopy.pptx food analysis technology
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
Spectral efficient network and resource selection model in 5G networks
sap open course for s4hana steps from ECC to s4
MIND Revenue Release Quarter 2 2025 Press Release
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Review of recent advances in non-invasive hemoglobin estimation
MYSQL Presentation for SQL database connectivity
Electronic commerce courselecture one. Pdf
Programs and apps: productivity, graphics, security and other tools
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
The Rise and Fall of 3GPP – Time for a Sabbatical?
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Encapsulation theory and applications.pdf
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Reach Out and Touch Someone: Haptics and Empathic Computing
Spectroscopy.pptx food analysis technology
The AUB Centre for AI in Media Proposal.docx
Diabetes mellitus diagnosis method based random forest with bat algorithm

Innovate at speed with Devops

  • 1. Innovating at Speed with Devops Eric Cattoir IBM Rational Client Technical Professional
  • 2. Bold Idea • Innovation can only happen in an environment where it is safe to fail © 2014 International Business Machines Corporation 2
  • 3. Bold Idea • Innovation can only happen in an environment where it is safe to fail •A well implemented Devops solution can provide such an environment in an IT environment © 2014 International Business Machines Corporation 3
  • 4. Scientific Innovation © 2014 International Business Machines Corporation 4
  • 5. Innovation and failure Icarus © 2014 International Business Machines Corporation 5
  • 6. Innovation and failure Le Bris – Albatros II 1868 Otto Lilienthal 1895 Antonov An-2 1947 Leonardo Da Vinci 1485 Concorde A - 380 1969 Wright Brothers 1902 2005 © 2014 International Business Machines Corporation 6
  • 7. What has changed in society? © 2014 International Business Machines Corporation 7
  • 8. What has changed in society? • Dependend on Software often Business and/or Safety Critical © 2014 International Business Machines Corporation 8
  • 9. What has changed in society? • Mobile Computing - Connected all the time © 2014 International Business Machines Corporation 9
  • 10. What has changed in society? • Internet of Things © 2014 International Business Machines Corporation 10
  • 11. Cloud Demand for apps requires fast, scalable environments for dev and test, as well as production Instrumented Products Industry requirements demand faster response to regulations and standards, with traceability and quality Software delivery Intelligent/ Connected Systems Software component in smart products driving increased value and differentiation Challenges Big Data Insights on new products by more efficiently interpreting massive quantities of data Social Business Broader set of stakeholders collaborates to deliver continuous innovation and value Mobile Modern workforce expects constantly updated software to connect to enterprise systems © 2014 International Business Machines Corporation 11
  • 12. What is needed to achieve this in Software Development •Version control of all software, automation, and configuration • Automated Deployments • Architecture • Automated Testing • Production-Like Environments © 2014 International Business Machines Corporation 12
  • 13. What is needed to achieve this in Software Development Version control of all software, automation, and configuration IBM UrbanCode Deploy with Patterns IBM PureApplication System SmartCloud Orchestrator © 2014 International Business Machines Corporation 13
  • 14. What is needed to achieve this in Software Development Automated Deployments SSCCMM BBuuiilldd AAuuttoommaattiioonn QQAA PRO D Pull changes IBM UrbanCode Deploy Execute application deployment and manage settings across environments Publish build DDDDDDEEDDEEVVEEEEVVVVVV © 2014 International Business Machines Corporation 14
  • 15. What is needed to achieve this in Software Development Architecture © 2014 International Business Machines Corporation 15
  • 16. What is needed to achieve this in Software Development Automated Testing © 2014 International Business Machines Corporation 16
  • 17. What is needed to achieve this in Software Development Production-Like Environments Infrastructure as a Service Applications Data Mid Config Middleware O/S Virtualization Servers Storage Networking UrbanCode Deploy Platform as a Service Applications Data Mid Config Middleware O/S Virtualization Servers Storage Networking IBM Bluemix IBM Patterns PureApplication System SmartCloud Orchestrator SoftLayer IBM DevOps Services UrbanCode Deploy with Patterns © 2014 International Business Machines Corporation 17
  • 18. Conclusion DevOps Lifecycle Customers Business Owners Development/Test Operations/Production Continuous Innovation, Feedback and Improvements Develop and Test Release and Deploy Monitor and Optimize DevOps Foundation Plan and Measure Open Lifecycle and Service Management Integration Platform Ecosystem Best Practices © 2014 International Business Machines Corporation 18
  • 19. Conclusion DevOps Lifecycle Customers Business Owners Development/Test Operations/Production Continuous Innovation, Feedback and Improvements Develop and Test Release and Deploy Monitor and Optimize DevOps Foundation Plan and Measure Open Lifecycle and Service Management Integration Platform Ecosystem Best Practices © 2014 International Business Machines Corporation 19
  • 20. Conclusion DevOps Lifecycle Customers Business Owners Development/Test Operations/Production Continuous Innovation, Feedback and Improvements Develop and Test Release and Deploy Monitor and Optimize DevOps Foundation Plan and Measure Open Lifecycle and Service Management Integration Platform Ecosystem Best Practices © 2014 International Business Machines Corporation 20

Editor's Notes

  • #2: I am Eric Cattoir working as a technical professional at IBM in the Rational Brand. In this presentation we try to show how Devops is an enabler for Innovation in an IT environment.
  • #3: By using examples from science and technology we will illustrate that innovation can only happen in an environment were some failures can be absorbed. On the contrary an environment where the slightest mistake leads to a disaster will make behaviour very conservative and will kill all possibilities to innovate.
  • #4: Looking at many IT shops there is little room for failure. As a result very little innovation happens. How many times did you hear the statement “we can't introduce these new things as our environment contains years of effort and it is impossible to change it. In our opinion a well implemented Devops solution can overcome this problem and provide for an environment where failure can be handled in test environments that mimic the real world.
  • #5: Let start to look at some innovations in science an how they cam along. You might wonder what is this guy with all his petri dishes doing in a devops presentation. This is Alexander Fleming inventor of the penicillin. In romanticized stories it is told that he more or less discovered this by accident. Of course this is far from the truth. He could only discover this by a well thought search process in an environment where there was room for experimentation.
  • #6: Let's take yet another example from technological evolution. Looking at the history of flying many books start out with the flight of Icarus. Unfortunately for this mythological figure there was little room for failure and as the story goes he flew to close to the sun which made wings of wax melt, which costed him his life.
  • #7: Fortunately for us the history took a much different turn. Who could imagine that once we would build planes like a Concorde or an Airbus 380 when looking at the first kind of glider experiments of Lebris, Lillienthal or the Wright brothers. However it is due to these experiments which often lead to failure, but in most cases with little consequences that we realized the innovations leading to the modern planes.
  • #8: Recently a lot of changes have happened which increased the importance of Software. Due to this we see an increased focus on Software failures. The slightest event can lead to bad press and huge losses.
  • #9: We have become more and more dependent on software and in many cases it is business or safety critical. Just look at the example of the self driving Audi S7 at 350 km/h on the Hockenheim ring. It should be clear that this was not achieved in one shot and a lot of trials in test environments and at much lower speeds where performed before achieving this.
  • #10: Another important change is the advent of mobile technology. In the past systems could be taken down for a maintenance weekend. These days people expect them to be available 24/7 and the slightest hickup is noticed. Again not an environment favouring experimentation.
  • #11: And this evolution is being amplified by the internet of things, where massive amounts of sensors and devices are continuously spawning data, which needs to be stored and handled.
  • #12: As a result a modern IT shop has to deal with a lot of new challenges. Luckily these also offer a lot capabilities with regards to innovation. Some of these factors like the usage of Cloud technology might pose a lot of challenges at first, but when these can be handled it will also deliver a wealth of oportunities.
  • #13: At IBM we are convinced that a mature Devops implementation can provide us with a failsafe environment which can cope with these challenges. Although deployment automation is a key factor in such a devops solution we think there is much more needed to make this work. What good is it to be able to deploy swiftly, when there is no way to validate the deployments?
  • #14: Everyone should already be convinced that version control of code is a prerequisite for a devops solution. However to make it really efficient it is also needed that all automation is also versioned. The ultimate goal is to have software defined environments and to version also these definitions. Various cloud based solutions both from IBM and others start to offer these capabilities
  • #15: Of course a core needed capability is deployment automation and controlled management of the environment chain. IBM is providing these through its UrbanCode Deploy product.
  • #16: Key to a good devops implementation is an architecture which enables it. In many cases legacy monolithic systems are making the implementation of a mature devops solution very difficult or impossible. Newer principles like service oriented architecture or an architecture based micro services are enablers for an easy devops implementation.
  • #17: Testing manually like many organizations still do nowadays will no longer work in a fully automated deployment chain. What good is it to be able to deploy automatically if there is not the bandwidth to test. So testing needs to be automated as much as possible to be able to prove non regression. Automated testing is key in providing an environment where failure can be detected and handled. It is key to an environment where is safe to innovate.
  • #18: A key inhibitor to automated testing is the non availability of realistic production like test environments which are affordable. Today's cloud based solutions can provide infrastructure or platforms as a service, which allow you to put in place a production like test environment at an affordable cost.
  • #19: We are convinced that a mature devops solution is a basis for innovation. However such a solution is based on much more than just deployment automation. The whole lifecycle of the applications from the business till the deployment has to have the necessary capabilities.
  • #20: Growing into a devops solution requires you to improve in various domains. At IBM we have developed a devops maturity model based on 4 large capability groups. This can be used to measure where you stand today and then use this to grow.
  • #21: As a final thought we see that the combination of a mature devops solution with Cloud based environments provide you this environment where failure can be handled in a graceful way. This can provide you with a fruitful basis for Innovation.