SlideShare a Scribd company logo
 ; IT Application Development ResearchPini CohenEVPpini@stki.info
AgendaMajor Trends and IssuesDevelopment and SOAESM BSM CMDBDBMS and DATAPlatforms – ServersClientsStorage Source: http://astonguild.org.uk/files/NEW_MENU_FRONT_RGB%5B1%5D.jpg
STKI IT Development SurveyThe first IT development survey in Israel!Covering:Development vs. Maintenance budget Level of effort in development (requirements, design, code, testing, etc.)Level of effort in maintenance (bugs, new enhancements, infra. upgrades) Development internally, outsourced and package modificationRegulation vs. planned vs. unplannedDevelopment  metricsQA organization, etc.Methodologies used in development process3
STKI IT Development surveyHow should you use this data:Look at the fine print – not all graphs are the same – including or excluding specific data according to the industry If you do not have all data as stated look at the ratios4
New Initiatives (“development”) vs. Running (“maintenance) SystemsIsraeli IT AverageSource: STKI SurveyThe actual question was: Which part from your development budget is directed to “development vs. maintenance”
About Development vs. MaintenanceDifferent companies has different takes. Example:“Development – 7 days or more with features that contribute to company profitability (not regulation)” “Everything is development except bugs correction or training support. Updating tables is development”Up to two months works is considered maintenance.
Development vs. Maintenance definitionSource: STKI Survey
Spending from IT budget on developing new SW projects All Data  Package customization not included8Source: STKI Survey
STKI IT Development Survey9Spending from IT Budget
Testing including acceptance testing  (effort by IT)
Development -  means developers effort and not  necessarily just development (might include unit testing and other testing)Source: STKI Survey
Per sectorSource: STKI Survey
STKI IT Development Report11Public \ Government Spending more on the requirement stageTesting looks is much less mature.Therefore developers are dealing with testingSeveral organization are on the building stage of their testing  units\proceduresHealth: more effort on design.  Less effort on TestingTelecom: heavy investment in testing without specific budget to User Acceptance testingFinance (not banking): Heavy Management cost. Lots of investment in Design
Requirement Mgmt. AttentionSource: STKI Survey
Testing FocusFactors Influencing QA:Internal SW development
SW is an integral part of the org. services to customers
Regulation
Established methodologies (CMMI, ISO) (Insurance & Credit Cards)Source: STKI Survey
What “contributes” to Software maintenance:Not all “minor improvements” are the same:One company might put all improvement in “development budget” while the other will put all “new development that is less than two weeks” “Infra” is SW adjustment to infrastructure changes – Win7, Oracle 11G, etc.14Source: STKI Survey
Who and what is developed?15Public\HealthAll including Public\HealthSource: STKI Survey
Development Budget DistributionSource: STKI Survey
Metrics usedSource: STKI SurveyEach respondent could add several metrics17
Metrics used – what is missing?Deployment  \ Hatmaa metrics are missing! 18
Selected Project Management metricsResource, Time, Features. And keeping track of it.LOC – line of codeNumber of mission accomplished in a month\period (normalized on mission size)Plan vs. actual in total effort spent per customer, project Net resources vs. overhead (courses, safety, illness-out of work)19
Selected Quality (bug\fault related) metrics. All per severity level# of bugs in testing and per man year, per K LOC# of escaping bugs (limited time in production) and per man year, per K LOC# of escaping bugs per # of bugs found in testingFirst time quality – in testing and in production20
Selected Quality (bug\fault related) metrics. All per severity level# of critical bugs per total bugs found in testing and in production# of requiring bugs (bugs that were not fixed at after first time)# of false positive bugs – bugs that were reported but actually did not exist21
Selected testing breath metricsPercent of code testedPercent of code with automatic tests22
Selected dev.\production process metricsHow many changes were introduced to a project while being developed (not relevant to Agile)Did the project followed all procedures How many times the project was put to production (if more than once- something went wrong…) # of LOC developed per specific feature (comparing two developing environment\supporting tools)23
Other development metricsISO metricsMaturity of reporting systems –how well people report to the activity\bug system (is reporting accurate, how often the reporting takes place, what is the delay between activity and the reporting).  24
Organization Position of QASource: STKI Survey

More Related Content

PPTX
Agile software development
PPTX
A Study of the Quality-Impacting Practices of Modern Code Review at Sony Mobile
PDF
Jean Paul Varwijk - Discussing the Future of Software Testing - EuroSTAR 2013
PDF
Perintis Mobiliti Success Story: eParlimen Software Process Governance and Co...
PDF
Defect Prediction: Accomplishments and Future Challenges
PPTX
Testing Throughout the Software Life Cycle (Chapter 2)
PPTX
Software testing
PPTX
system development life cycle
Agile software development
A Study of the Quality-Impacting Practices of Modern Code Review at Sony Mobile
Jean Paul Varwijk - Discussing the Future of Software Testing - EuroSTAR 2013
Perintis Mobiliti Success Story: eParlimen Software Process Governance and Co...
Defect Prediction: Accomplishments and Future Challenges
Testing Throughout the Software Life Cycle (Chapter 2)
Software testing
system development life cycle

What's hot (18)

DOC
5WCSQ(CFP) - Quality Improvement by the Real-Time Detection of the Problems
PPTX
Software Development Models by Graham et al
PPTX
Software Development Models
PPTX
Software Development And Delivery Metrics That Matter
PPTX
Sdlc process
DOC
Software testing objective_types
PPTX
Lessons Learned in Software Quality 1
PPT
system development life cycle SDLC
PPTX
Why Any Application Development Needs Incessant Excellence?
PPTX
Software Quality Assurance
PPT
Software testing lecture 10
PPT
A Financial Justification For Instituting A Software Methodology
PPT
Six cigma AJAL
PPTX
System Development Life Cycle (SDLC) - Part II
PDF
Ijcet 06 06_001
PDF
Agile Development And Medtech
PPTX
System Development Life Cycle
PPTX
Postmortem Analysis
5WCSQ(CFP) - Quality Improvement by the Real-Time Detection of the Problems
Software Development Models by Graham et al
Software Development Models
Software Development And Delivery Metrics That Matter
Sdlc process
Software testing objective_types
Lessons Learned in Software Quality 1
system development life cycle SDLC
Why Any Application Development Needs Incessant Excellence?
Software Quality Assurance
Software testing lecture 10
A Financial Justification For Instituting A Software Methodology
Six cigma AJAL
System Development Life Cycle (SDLC) - Part II
Ijcet 06 06_001
Agile Development And Medtech
System Development Life Cycle
Postmortem Analysis
Ad

Similar to From stki application development_research sending (20)

PPTX
QA Trends 2010
PPTX
Software Project Health Check: Best Practices and Techniques for Your Product...
PPT
Software Measurement: Lecture 3. Metrics in Organization
PDF
Software Testing Process, Testing Automation and Software Testing Trends
PDF
Handbook of Software Quality Assurance 4th ed Edition G. Gordon Schulmeyer
PDF
Handbook of Software Quality Assurance 4th ed Edition G. Gordon Schulmeyer
PPTX
Test Strategy-The real silver bullet in testing by Matthew Eakin
PPT
Software Project Management lecture 10
PPT
chap06.ppthistory of conputers in positioning pointing and drawing
PDF
Big Apple Scrum Day 2015 - Advanced Scrum Metrics Reference Sheet
PPT
1 sqa and testing concepts
PPT
TesTrek Notes
PDF
Making a Quantum Leap with Continuous Analytics-Based QA
PPT
software-quality-assurance.pptQuality assurance consists of those procedures,...
PDF
IT Metrics in Real Life
PDF
Software Quality Dashboard Benchmarking Study
PDF
Handbook of Software Quality Assurance 4th ed Edition G. Gordon Schulmeyer
PPTX
Software Quality.pptx
PDF
Measuring Quality: Testing Metrics and Trends in Practice
PDF
Handbook of Software Quality Assurance 4th ed Edition G. Gordon Schulmeyer
QA Trends 2010
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Measurement: Lecture 3. Metrics in Organization
Software Testing Process, Testing Automation and Software Testing Trends
Handbook of Software Quality Assurance 4th ed Edition G. Gordon Schulmeyer
Handbook of Software Quality Assurance 4th ed Edition G. Gordon Schulmeyer
Test Strategy-The real silver bullet in testing by Matthew Eakin
Software Project Management lecture 10
chap06.ppthistory of conputers in positioning pointing and drawing
Big Apple Scrum Day 2015 - Advanced Scrum Metrics Reference Sheet
1 sqa and testing concepts
TesTrek Notes
Making a Quantum Leap with Continuous Analytics-Based QA
software-quality-assurance.pptQuality assurance consists of those procedures,...
IT Metrics in Real Life
Software Quality Dashboard Benchmarking Study
Handbook of Software Quality Assurance 4th ed Edition G. Gordon Schulmeyer
Software Quality.pptx
Measuring Quality: Testing Metrics and Trends in Practice
Handbook of Software Quality Assurance 4th ed Edition G. Gordon Schulmeyer
Ad

More from Perfecto Mobile (20)

PPTX
QA or the Highway 2022.pptx
PPTX
Maturing your path toward DevOps with Continuous Testing
PPTX
Proven strategy for testing pw as aus-agile_testers
PPTX
Shorten Business Life Cycle Using DevOps
PDF
Selenium conf india pwa 2018
PDF
Online testconf event rwd and pwa 2018
PPTX
Optimizing Test Coverage throughout the DevOps Pipeline
PPTX
Cross browser testing
PDF
Quest2018 erank optimize test automation
PDF
Mastering BDD - Eran Kinsbruner Workshop Quest 2018
PDF
Mapping mobileandweblandscape motb
PPTX
5 Stages of Digital Quality Maturity
PDF
Testing Next Generation Digital Interfaces
PPTX
Raleigh User Forum Presentation
PDF
Automation challenges - 121 Test Automation Event boston
PDF
Boston meetup blaze_meter_feb2017
PDF
7 Keys for Unattended Test AUtomation webinar deck
PDF
iOS9 Launch - Mobile Dev & Test Implications
PDF
Continuous Quality For a 5 Star Mobile Apps Delivery
POT
Mobile Test Coverage- Israel 4th meetup
QA or the Highway 2022.pptx
Maturing your path toward DevOps with Continuous Testing
Proven strategy for testing pw as aus-agile_testers
Shorten Business Life Cycle Using DevOps
Selenium conf india pwa 2018
Online testconf event rwd and pwa 2018
Optimizing Test Coverage throughout the DevOps Pipeline
Cross browser testing
Quest2018 erank optimize test automation
Mastering BDD - Eran Kinsbruner Workshop Quest 2018
Mapping mobileandweblandscape motb
5 Stages of Digital Quality Maturity
Testing Next Generation Digital Interfaces
Raleigh User Forum Presentation
Automation challenges - 121 Test Automation Event boston
Boston meetup blaze_meter_feb2017
7 Keys for Unattended Test AUtomation webinar deck
iOS9 Launch - Mobile Dev & Test Implications
Continuous Quality For a 5 Star Mobile Apps Delivery
Mobile Test Coverage- Israel 4th meetup

Recently uploaded (20)

PPT
Teaching material agriculture food technology
PDF
Machine learning based COVID-19 study performance prediction
PDF
Encapsulation theory and applications.pdf
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PDF
NewMind AI Weekly Chronicles - August'25 Week I
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
PDF
Modernizing your data center with Dell and AMD
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PPTX
A Presentation on Artificial Intelligence
Teaching material agriculture food technology
Machine learning based COVID-19 study performance prediction
Encapsulation theory and applications.pdf
The Rise and Fall of 3GPP – Time for a Sabbatical?
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
NewMind AI Weekly Chronicles - August'25 Week I
Digital-Transformation-Roadmap-for-Companies.pptx
CIFDAQ's Market Insight: SEC Turns Pro Crypto
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Dropbox Q2 2025 Financial Results & Investor Presentation
PA Analog/Digital System: The Backbone of Modern Surveillance and Communication
Modernizing your data center with Dell and AMD
Diabetes mellitus diagnosis method based random forest with bat algorithm
“AI and Expert System Decision Support & Business Intelligence Systems”
Spectral efficient network and resource selection model in 5G networks
Review of recent advances in non-invasive hemoglobin estimation
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Understanding_Digital_Forensics_Presentation.pptx
A Presentation on Artificial Intelligence

From stki application development_research sending

  • 1. ; IT Application Development ResearchPini CohenEVPpini@stki.info
  • 2. AgendaMajor Trends and IssuesDevelopment and SOAESM BSM CMDBDBMS and DATAPlatforms – ServersClientsStorage Source: http://astonguild.org.uk/files/NEW_MENU_FRONT_RGB%5B1%5D.jpg
  • 3. STKI IT Development SurveyThe first IT development survey in Israel!Covering:Development vs. Maintenance budget Level of effort in development (requirements, design, code, testing, etc.)Level of effort in maintenance (bugs, new enhancements, infra. upgrades) Development internally, outsourced and package modificationRegulation vs. planned vs. unplannedDevelopment metricsQA organization, etc.Methodologies used in development process3
  • 4. STKI IT Development surveyHow should you use this data:Look at the fine print – not all graphs are the same – including or excluding specific data according to the industry If you do not have all data as stated look at the ratios4
  • 5. New Initiatives (“development”) vs. Running (“maintenance) SystemsIsraeli IT AverageSource: STKI SurveyThe actual question was: Which part from your development budget is directed to “development vs. maintenance”
  • 6. About Development vs. MaintenanceDifferent companies has different takes. Example:“Development – 7 days or more with features that contribute to company profitability (not regulation)” “Everything is development except bugs correction or training support. Updating tables is development”Up to two months works is considered maintenance.
  • 7. Development vs. Maintenance definitionSource: STKI Survey
  • 8. Spending from IT budget on developing new SW projects All Data Package customization not included8Source: STKI Survey
  • 9. STKI IT Development Survey9Spending from IT Budget
  • 10. Testing including acceptance testing (effort by IT)
  • 11. Development - means developers effort and not necessarily just development (might include unit testing and other testing)Source: STKI Survey
  • 13. STKI IT Development Report11Public \ Government Spending more on the requirement stageTesting looks is much less mature.Therefore developers are dealing with testingSeveral organization are on the building stage of their testing units\proceduresHealth: more effort on design. Less effort on TestingTelecom: heavy investment in testing without specific budget to User Acceptance testingFinance (not banking): Heavy Management cost. Lots of investment in Design
  • 15. Testing FocusFactors Influencing QA:Internal SW development
  • 16. SW is an integral part of the org. services to customers
  • 18. Established methodologies (CMMI, ISO) (Insurance & Credit Cards)Source: STKI Survey
  • 19. What “contributes” to Software maintenance:Not all “minor improvements” are the same:One company might put all improvement in “development budget” while the other will put all “new development that is less than two weeks” “Infra” is SW adjustment to infrastructure changes – Win7, Oracle 11G, etc.14Source: STKI Survey
  • 20. Who and what is developed?15Public\HealthAll including Public\HealthSource: STKI Survey
  • 22. Metrics usedSource: STKI SurveyEach respondent could add several metrics17
  • 23. Metrics used – what is missing?Deployment \ Hatmaa metrics are missing! 18
  • 24. Selected Project Management metricsResource, Time, Features. And keeping track of it.LOC – line of codeNumber of mission accomplished in a month\period (normalized on mission size)Plan vs. actual in total effort spent per customer, project Net resources vs. overhead (courses, safety, illness-out of work)19
  • 25. Selected Quality (bug\fault related) metrics. All per severity level# of bugs in testing and per man year, per K LOC# of escaping bugs (limited time in production) and per man year, per K LOC# of escaping bugs per # of bugs found in testingFirst time quality – in testing and in production20
  • 26. Selected Quality (bug\fault related) metrics. All per severity level# of critical bugs per total bugs found in testing and in production# of requiring bugs (bugs that were not fixed at after first time)# of false positive bugs – bugs that were reported but actually did not exist21
  • 27. Selected testing breath metricsPercent of code testedPercent of code with automatic tests22
  • 28. Selected dev.\production process metricsHow many changes were introduced to a project while being developed (not relevant to Agile)Did the project followed all procedures How many times the project was put to production (if more than once- something went wrong…) # of LOC developed per specific feature (comparing two developing environment\supporting tools)23
  • 29. Other development metricsISO metricsMaturity of reporting systems –how well people report to the activity\bug system (is reporting accurate, how often the reporting takes place, what is the delay between activity and the reporting). 24
  • 30. Organization Position of QASource: STKI Survey
  • 31. Show me the QA money!When QA is part of development the testing budget is lower – 38% difference! (at average)26Source: STKI Survey
  • 32. Profile of your testing personnelRising interest in Israeli Nearshore due to their subsidization by the Gov. Source: STKI Survey
  • 33. Which Methodology is usedCounted even if used in few projects or experimenting (for example “using iterative only in Internet projects” or “experimenting agile in small projects” CMMI is more common in BankingISO certifications used are ISO9001:2008 and 9002. 28
  • 34. Methodologies in use Source: STKI Survey