SlideShare a Scribd company logo
Unit 8
Software Quality and Matrices
Preeti Mishra
Course Instructor
Software Quality
Software Quality Defined
• Definition:
Conformance to explicitly stated functional and performance requirements, explicitly documented
development standards, and implicit characteristics that are expected of all professionally developed
software
• Three important points in this definition
– Explicit software requirements are the foundation from which quality is measured. Lack of conformance to
requirements is lack of quality
– Specific standards define a set of development criteria that guide the manner in which software is
engineered. If the criteria are not followed, lack of quality will most surely result
– There is a set of implicit requirements that often goes unmentioned (e.g., ease of use). If software conforms
to its explicit requirements but fails to meet implicit requirements, software quality is suspect
ISO 9126 Software Quality Factors
• Functionality
– The degree to which the software satisfies stated needs
• Reliability
– The amount of time that the software is available for use
• Usability
– The degree to which the software is easy to use
• Efficiency
– The degree to which the software makes optimal use of system resources
• Maintainability
– The ease with which repair and enhancement may be made to the software
• Portability
– The ease with which the software can be transposed from one environment to another
5
Five Views of Software Quality
• Transcendental view
• User view
• Manufacturing view
• Product view
• Value-based view
6
Five Views of Software Quality
• Transcendental view
– Quality is something that can be recognized through experience, but not defined in some tractable form.
– A good quality object stands out, and it is easily recognized.
• User view
– Quality concerns the extent to which a product meets user needs and expectations.
– Is a product fit for use?
– This view is highly personalized.
• A product is of good quality if it satisfies a large number of users.
• It is useful to identify the product attributes which the users consider to be important.
– This view may encompass many subject elements, such as usability, reliability, and efficiency.
7
Five Views of Software Quality
• Manufacturing view
– This view has its genesis in the manufacturing industry – auto and electronics.
– Key idea: Does a product satisfy the requirements?
• Any deviation from the requirements is seen as reducing the quality of the product.
• Product view
– Hypothesis: If a product is manufactured with good internal properties, then it will have good external properties.
– One can explore the causal relationship between internal properties and external qualities.
– Example: Modularity enables testability.
• Value-based view
– This represents the merger of two concepts: excellence and worth.
– Quality is a measure of excellence, and value is a measure of worth.
– Central idea
• How much a customer is willing to pay for a certain level of quality.
• Quality is meaningless if a product does not make economic sense.
• The value-based view makes a trade-off between cost and quality.
• Process
Measure the efficacy of processes. What works, what doesn't.
• Project
Assess the status of projects. Track risk. Identify problem areas. Adjust work flow.
• Product
Measure predefined product attributes (generally related to ISO9126 Software Characteristics)
What to measure
 Three kinds of Software Quality Metrics
◦ Product Metrics - describe the characteristics of product
 size, complexity, design features, performance, and quality level
◦ Process Metrics - used for improving software development/maintenance process
 effectiveness of defect removal, pattern of testing defect arrival, and response time of fixes
◦ Project Metrics - describe the project characteristics and execution
 number of developers, cost, schedule, productivity, etc.
 fairly straight forward
Software Quality Metrics
Desired attributes of Metrics (Ejiogu, 1991)
– Simple and computable
– Empirical and intuitively persuasive
– Consistent and objective
– Consistent in the use of units and dimensions
– Independent of programming language, so directed at models (analysis, design, test, etc.)
or structure of program
– Effective mechanism for quality feedback
Software Quality Metrics
Classification of software requirements into software quality
factors
• The classic model of software quality factors suggest by :
– McCall (consist of 11 factors, 1977)
– Deutsch and Willis (consist of 12 to 15, factors,1988)
– Evans and Marciniak (1987)
McCall’s Factor Model
• Classifies all software
requirement into 11software
quality factors, grouped into three
categories :
1. Product operation factors :
Correctness, Reliability, Efficiency,
Integrity,usability.
2. Product revision factors :
Maintainability, Flexibility, Testability.
3. Product transition factors :
Portability, Reusability, Interoperability.
Software Product Metrics
Why have Software Product Metrics?
• Help software engineers to better understand the attributes of models and assess the quality of the
software
• Help software engineers to gain insight into the design and construction of the software
• Focus on specific attributes of software engineering work products resulting from analysis, design,
coding, and testing
• Provide a systematic way to assess quality based on a set of clearly defined rules
• Provide an “on-the-spot” rather than “after-the-fact” insight into the software development
A Framework for Product Metrics
Measures, Metrics, and Indicators
• These three terms are often used interchangeably, but they can have subtle differences
• Measure
– Provides a quantitative indication of the extent, amount, dimension, capacity, or size of some attribute of a
product or process
• Measurement
– The act of determining a measure
• Metric
– (IEEE) A quantitative measure of the degree to which a system, component, or process possesses a
given attribute
• Indicator
– A metric or combination of metrics that provides insight into the software process, a software project, or
the product itself
Purpose of Product Metrics
• Aid in the evaluation of analysis and design models
• Provide an indication of the complexity of procedural designs and source code
• Facilitate the design of more effective testing techniques
• Assess the stability of a fielded software product
Activities of a Measurement Process
• Formulation
– The derivation (i.e., identification) of software measures and metrics appropriate for the representation of
the software that is being considered
• Collection
– The mechanism used to accumulate data required to derive the formulated metrics
• Analysis
– The computation of metrics and the application of mathematical tools
• Interpretation
– The evaluation of metrics in an effort to gain insight into the quality of the representation
• Feedback
– Recommendations derived from the interpretation of product metrics and passed on to the software
development team
Characterizing and Validating Metrics
• A metric should have desirable mathematical properties
– It should have a meaningful range (e.g., zero to ten)
– It should not be set on a rational scale if it is composed of components measured on an ordinal scale
• If a metric represents a software characteristic that increases when positive traits occur or
decreases when undesirable traits are encountered, the value of the metric should increase or
decrease in the same manner
• Each metric should be validated empirically in a wide variety of contexts before being published or
used to make decisions
– It should measure the factor of interest independently of other factors
– It should scale up to large systems
– It should work in a variety of programming languages and system domains
Collection and Analysis Guidelines
• Whenever possible, data collection and analysis should be automated
• Valid statistical techniques should be applied to establish relationships between internal
product attributes and external quality characteristics
• Interpretative guidelines and recommendations should be established for each metric
A Product Metrics Taxonomy
Metrics for various software development activities
Analysis Model • Design Model Source Code • Testing
• Functionality delivered
• Provides an indirect
measure of the
functionality that is
packaged within the
software
• System size
• Measures the overall size
of the system defined in
terms of information
available as part of the
analysis model
• Specification quality
• Provides an indication of
the specificity and
completeness of a
requirements specification
• Architectural metrics
• Provide an indication of
the quality of the
architectural design
• Component-level metrics
• Measure the complexity of
software components and
other characteristics that
have a bearing on quality
• Interface design metrics
• Focus primarily on
usability
• Specialized object-oriented
design metrics
• Measure characteristics of
classes and their
communication and
collaboration
characteristics
• Complexity metrics
• Measure the
logical
complexity of
source code (can
also be applied
to component-
level design)
• Length metrics
• Provide an
indication of the
size of the
software
• Statement and branch
coverage metrics
• Lead to the design of test
cases that provide
program coverage
• Defect-related metrics
• Focus on defects (i.e.,
bugs) found, rather than
on the tests themselves
• Testing effectiveness
metrics
• Provide a real-time
indication of the
effectiveness of tests that
have been conducted
• In-process metrics
• Process related metrics
that can be determined as
testing is conducted
Function Based Matrices
Function Points
Introduction to Function Points
• First proposed by Albrecht in 1979;
• Can be used effectively as a means for measuring the functionality delivered by a system
• Using historical data, function points can be used to
– Estimate the cost or effort required to design, code, and test the software
– Predict the number of errors that will be encountered during testing
– Forecast the number of components and/or the number of projected source code lines in the implemented
system
• Derived using an empirical relationship based on
1) Countable (direct) measures of the software’s information domain
2) Assessments of the software’s complexity
Information Domain Values
• Number of external inputs
– Each external input originates from a user or is transmitted from another application
– They provide distinct application-oriented data or control information
– They are often used to update internal logical files
– They are not inquiries (those are counted under another category)
• Number of external outputs
– Each external output is derived within the application and provides information to the user
– This refers to reports, screens, error messages, etc.
– Individual data items within a report or screen are not counted separately
• Number of external inquiries
– An external inquiry is defined as an online input that results in the generation of some immediate software response
– The response is in the form of an on-line output
• Number of internal logical files
– Each internal logical file is a logical grouping of data that resides within the application’s boundary and is maintained via
external inputs
• Number of external interface files
– Each external interface file is a logical grouping of data that resides external to the application but provides data that may
be of use to the application
26
Function Point Computation
1) Identify/collect the information domain values
2) Complete the table shown below to get the count total
• Associate a weighting factor (i.e., complexity value) with each count based on criteria established by the
software development organization
3) Evaluate and sum up the adjustment factors (see the next two slides)
• “Fi” refers to 14 value adjustment factors, with each ranging in value from 0 (not important) to 5 (absolutely
essential)
4) Compute the number of function points (FP)
FP = count total * [0.65 + 0.01 * sum(Fi)]
Information Weighting Factor
Domain Value Count Simple Average Complex
External Inputs _____ x 3 4 6 = _____
External Outputs _____ x 4 5 7 = _____
External Inquiries _____ x 3 4 6 = _____
Internal Logical Files _____ x 7 10 15 = _____
External Interface Files _____ x 5 7 10 = _____
Count total ________
Function Point Example
• FP = count total * [0.65 + 0.01 * sum(Fi)]
• FP = 50 * [0.65 + (0.01 * 46)]
• FP = 55.5 (rounded up to 56)
Information Weighting Factor
Domain Value Count Simple Average Complex
External Inputs 3 x 3 4 6 = 9
External Outputs 2 x 4 5 7 = 8
External Inquiries 2 x 3 4 6 = 6
Internal Logical Files 1 x 7 10 15 = 7
External Interface Files 4 x 5 7 10 = 20
Count total 50
Architectural Design Metrics
Architectural Design Metrics
• These metrics place emphasis on the architectural structure and effectiveness of
modules or components within the architecture
• They are “black box” in that they do not require any knowledge of the inner workings of
a particular software component
Hierarchical Architecture Metrics
• Fan out: the number of modules immediately subordinate to the module i, that is, the number of modules directly
invoked by module i
• Structural complexity
– S(i) = f2
out(i), where fout(i) is the “fan out” of module i
• Data complexity
– D(i) = v(i)/[fout(i) + 1], where v(i) is the number of input and output variables that are passed to and from module i
• System complexity
– C(i) = S(i) + D(i)
• As each of these complexity values increases, the overall architectural complexity of the system also increases
• This leads to greater likelihood that the integration and testing effort will also increase
• Shape complexity
– size = n + a, where n is the number of nodes and a is the number of arcs
– Allows different program software architectures to be compared in a straightforward manner
• Connectivity density (i.e., the arc-to-node ratio)
– r = a/n
– May provide a simple indication of the coupling in the software architecture
Process and Project Based Matrices
Process and Project Indicators
Process indicators enable software project managers to:
– assess project status
– track potential risks
– detect problem areas early
– adjust workflow or tasks
– evaluate team ability to control product quality
Process metrics
• Private process metrics
– (e.g. defect rates by individual or module) are known only to the individual or team
concerned.
• Public process metrics
– enable organizations to make strategic changes to improve the software process.
• Metrics should not be used to evaluate the performance of individuals.
• Statistical software process improvement helps an organization to
discover its strengths and weaknesses.
Project Metrics
• Software project metrics are used by the software team to adapt project workflow and
technical activities.
• Project metrics are used to avoid development schedule delays, to mitigate potential
risks, and to assess product quality on an on-going basis.
• Every project should measure its inputs (resources), outputs (deliverables), and results
(effectiveness of deliverables).
Size Oriented Matrices
Size-Oriented Metrics
• Derived by normalizing (dividing) any direct measure (e.g. defects or
human effort) associated with the product or project by LOC.
• Size oriented metrics are widely used but their validity and applicability is
widely debated.
Software Quality Assurance ( SQA)
In respective stages of software development
• The degree to which a system, component, or process meets specified
requirements.
• The degree to which a system, component or process meets customer
or user needs or expectations.
What is SQA?
SQA encompasses the entire software development process
• software requirements
• software design
• coding
• source code control
• code reviews
• change management
• configuration management
• release management
SQA
• 1. Purpose
• 2. Reference documents
• 3. Management
• 4. Documentation
• 5. Standards, practices, convention, and metrics
• 6. Software Reviews
• 7. Tests
• 8. Problem reporting and corrective actions
• 9. Tools, techniques, and methodologies
• 10. Media control
• 11. Supplier control
• 12. Records collection, maintenance, and retention
• 13. Training
• 14. Risk management
• 15. Glossary
• 16. SQAP change procedure and history
1) Underlined sections will be included in our project’s SQAP
Content of SQAP - Software Quality Assurance Plan1)

More Related Content

PPTX
Software Quality Assurance
PPTX
Software testing
PPTX
Software Quality Assurance
PPT
Software Testing Strategies
PPT
Agile development, software engineering
PPTX
Software Engineering Process Models
PPT
Software process and project metrics
PPTX
Lect5 improving software economics
Software Quality Assurance
Software testing
Software Quality Assurance
Software Testing Strategies
Agile development, software engineering
Software Engineering Process Models
Software process and project metrics
Lect5 improving software economics

What's hot (20)

PPT
software characteristics
PDF
Software Engineering - Ch1
PPT
Chapter 5 Software Quality Assurance-Finalised_BW.ppt
PPTX
waterfall model
PPTX
Software Development Life Cycle
PPTX
Ch 3 software quality factor
PDF
Software Process Models
PPTX
Software maintenance Unit5
PPTX
Software quality assurance
PPTX
Unified process,agile process,process assesment ppt
PPTX
Software development process models
PPTX
Testing strategies
PPTX
Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...
PPT
CASE tools and their effects on software quality
PPT
Software Testing Fundamentals
PPTX
Software development life cycle
PPT
Formal Specifications in Formal Methods
PPTX
Software Process Models
PPT
Software Development Life Cycle (SDLC)
PPTX
software characteristics
Software Engineering - Ch1
Chapter 5 Software Quality Assurance-Finalised_BW.ppt
waterfall model
Software Development Life Cycle
Ch 3 software quality factor
Software Process Models
Software maintenance Unit5
Software quality assurance
Unified process,agile process,process assesment ppt
Software development process models
Testing strategies
Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...
CASE tools and their effects on software quality
Software Testing Fundamentals
Software development life cycle
Formal Specifications in Formal Methods
Software Process Models
Software Development Life Cycle (SDLC)
Ad

Viewers also liked (20)

PPTX
Software testing metrics
PPT
Architecture design in software engineering
PDF
An Experimental Study into Objective Quality Assessment of Watermarked Images
PPTX
Unit 5 design engineering ssad
PPTX
Overview of Software QA and What is Software Quality
PPTX
Object modeling
PPTX
Oo concepts and class modeling
PPTX
No silver bullet
PPTX
No silver bullet essence and accidents of software engineering
PPT
architectural design
PPTX
Unit 7 performing user interface design
PPT
Software Quality
PPTX
Ch24 quality management
PPTX
Software quality
PPTX
Component level design
PPT
Software quality
PDF
software development, process model, requirement engineering, srs, structured...
PPT
Software cost estimation
DOCX
Concept of Failure, error, fault and defect
Software testing metrics
Architecture design in software engineering
An Experimental Study into Objective Quality Assessment of Watermarked Images
Unit 5 design engineering ssad
Overview of Software QA and What is Software Quality
Object modeling
Oo concepts and class modeling
No silver bullet
No silver bullet essence and accidents of software engineering
architectural design
Unit 7 performing user interface design
Software Quality
Ch24 quality management
Software quality
Component level design
Software quality
software development, process model, requirement engineering, srs, structured...
Software cost estimation
Concept of Failure, error, fault and defect
Ad

Similar to Unit 8 software quality and matrices (20)

PPT
Chapter 15 software product metrics
PPTX
Software Engineering Software Engineering
PPTX
UNIT4(2) OB UNIT II NOTESOB UNIT II NOTES
PPTX
STQA 1.pptx
PPT
05_SQA_Overview.ppt
PPTX
Software engineering
PPTX
Software Productivity Measurement
PDF
productmetrics-111021073430-phpapp01.pdf
PPT
SQA presenatation made by krishna ballabh gupta
PPT
PPT
PDF
Softwarequalityassurance with Abu ul hassan Sahadvi
PPTX
Software quality assurance
PPTX
Process and Project Metrics-1
PPTX
SOFTWARE QUALITY ASSURANCE .pptx
PPTX
Designer engineering on the Data Science student
PDF
POLITEKNIK MALAYSIA
PPT
Software quality assurance
PPT
1 sqa and testing concepts
PPT
Pressman ch-22-process-and-project-metrics
Chapter 15 software product metrics
Software Engineering Software Engineering
UNIT4(2) OB UNIT II NOTESOB UNIT II NOTES
STQA 1.pptx
05_SQA_Overview.ppt
Software engineering
Software Productivity Measurement
productmetrics-111021073430-phpapp01.pdf
SQA presenatation made by krishna ballabh gupta
Softwarequalityassurance with Abu ul hassan Sahadvi
Software quality assurance
Process and Project Metrics-1
SOFTWARE QUALITY ASSURANCE .pptx
Designer engineering on the Data Science student
POLITEKNIK MALAYSIA
Software quality assurance
1 sqa and testing concepts
Pressman ch-22-process-and-project-metrics

More from Preeti Mishra (20)

PDF
Effective Ways to Conduct Programming labs
PDF
Uml intro
PDF
Component diagram
PDF
Activity diag
PDF
Object diagram
PDF
Sequence diagrams
PDF
State chart diagram
PPT
Use case Diagram
PPT
testing strategies and tactics
PPT
requirements analysis and design
PPTX
Design process interaction design basics
PPTX
Design process design rules
PPTX
Design process evaluating interactive_designs
PPTX
Foundations understanding users and interactions
PPTX
IntrIntroduction
PPT
Coupling coheshion tps
PPTX
Analysis
PPT
Software testing part
PPTX
Dynamic modeling
PPTX
Introduction
Effective Ways to Conduct Programming labs
Uml intro
Component diagram
Activity diag
Object diagram
Sequence diagrams
State chart diagram
Use case Diagram
testing strategies and tactics
requirements analysis and design
Design process interaction design basics
Design process design rules
Design process evaluating interactive_designs
Foundations understanding users and interactions
IntrIntroduction
Coupling coheshion tps
Analysis
Software testing part
Dynamic modeling
Introduction

Recently uploaded (20)

PPTX
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
PPTX
CH1 Production IntroductoryConcepts.pptx
PDF
PPT on Performance Review to get promotions
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
PDF
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
PPTX
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PDF
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
PDF
Automation-in-Manufacturing-Chapter-Introduction.pdf
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PDF
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
PDF
Embodied AI: Ushering in the Next Era of Intelligent Systems
PDF
R24 SURVEYING LAB MANUAL for civil enggi
PPTX
Foundation to blockchain - A guide to Blockchain Tech
PPTX
FINAL REVIEW FOR COPD DIANOSIS FOR PULMONARY DISEASE.pptx
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
PPTX
Lecture Notes Electrical Wiring System Components
PPTX
web development for engineering and engineering
PDF
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
PDF
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
CH1 Production IntroductoryConcepts.pptx
PPT on Performance Review to get promotions
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
Automation-in-Manufacturing-Chapter-Introduction.pdf
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
Evaluating the Democratization of the Turkish Armed Forces from a Normative P...
Embodied AI: Ushering in the Next Era of Intelligent Systems
R24 SURVEYING LAB MANUAL for civil enggi
Foundation to blockchain - A guide to Blockchain Tech
FINAL REVIEW FOR COPD DIANOSIS FOR PULMONARY DISEASE.pptx
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
Lecture Notes Electrical Wiring System Components
web development for engineering and engineering
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk

Unit 8 software quality and matrices

  • 1. Unit 8 Software Quality and Matrices Preeti Mishra Course Instructor
  • 3. Software Quality Defined • Definition: Conformance to explicitly stated functional and performance requirements, explicitly documented development standards, and implicit characteristics that are expected of all professionally developed software • Three important points in this definition – Explicit software requirements are the foundation from which quality is measured. Lack of conformance to requirements is lack of quality – Specific standards define a set of development criteria that guide the manner in which software is engineered. If the criteria are not followed, lack of quality will most surely result – There is a set of implicit requirements that often goes unmentioned (e.g., ease of use). If software conforms to its explicit requirements but fails to meet implicit requirements, software quality is suspect
  • 4. ISO 9126 Software Quality Factors • Functionality – The degree to which the software satisfies stated needs • Reliability – The amount of time that the software is available for use • Usability – The degree to which the software is easy to use • Efficiency – The degree to which the software makes optimal use of system resources • Maintainability – The ease with which repair and enhancement may be made to the software • Portability – The ease with which the software can be transposed from one environment to another
  • 5. 5 Five Views of Software Quality • Transcendental view • User view • Manufacturing view • Product view • Value-based view
  • 6. 6 Five Views of Software Quality • Transcendental view – Quality is something that can be recognized through experience, but not defined in some tractable form. – A good quality object stands out, and it is easily recognized. • User view – Quality concerns the extent to which a product meets user needs and expectations. – Is a product fit for use? – This view is highly personalized. • A product is of good quality if it satisfies a large number of users. • It is useful to identify the product attributes which the users consider to be important. – This view may encompass many subject elements, such as usability, reliability, and efficiency.
  • 7. 7 Five Views of Software Quality • Manufacturing view – This view has its genesis in the manufacturing industry – auto and electronics. – Key idea: Does a product satisfy the requirements? • Any deviation from the requirements is seen as reducing the quality of the product. • Product view – Hypothesis: If a product is manufactured with good internal properties, then it will have good external properties. – One can explore the causal relationship between internal properties and external qualities. – Example: Modularity enables testability. • Value-based view – This represents the merger of two concepts: excellence and worth. – Quality is a measure of excellence, and value is a measure of worth. – Central idea • How much a customer is willing to pay for a certain level of quality. • Quality is meaningless if a product does not make economic sense. • The value-based view makes a trade-off between cost and quality.
  • 8. • Process Measure the efficacy of processes. What works, what doesn't. • Project Assess the status of projects. Track risk. Identify problem areas. Adjust work flow. • Product Measure predefined product attributes (generally related to ISO9126 Software Characteristics) What to measure
  • 9.  Three kinds of Software Quality Metrics ◦ Product Metrics - describe the characteristics of product  size, complexity, design features, performance, and quality level ◦ Process Metrics - used for improving software development/maintenance process  effectiveness of defect removal, pattern of testing defect arrival, and response time of fixes ◦ Project Metrics - describe the project characteristics and execution  number of developers, cost, schedule, productivity, etc.  fairly straight forward Software Quality Metrics
  • 10. Desired attributes of Metrics (Ejiogu, 1991) – Simple and computable – Empirical and intuitively persuasive – Consistent and objective – Consistent in the use of units and dimensions – Independent of programming language, so directed at models (analysis, design, test, etc.) or structure of program – Effective mechanism for quality feedback Software Quality Metrics
  • 11. Classification of software requirements into software quality factors • The classic model of software quality factors suggest by : – McCall (consist of 11 factors, 1977) – Deutsch and Willis (consist of 12 to 15, factors,1988) – Evans and Marciniak (1987)
  • 12. McCall’s Factor Model • Classifies all software requirement into 11software quality factors, grouped into three categories : 1. Product operation factors : Correctness, Reliability, Efficiency, Integrity,usability. 2. Product revision factors : Maintainability, Flexibility, Testability. 3. Product transition factors : Portability, Reusability, Interoperability.
  • 14. Why have Software Product Metrics? • Help software engineers to better understand the attributes of models and assess the quality of the software • Help software engineers to gain insight into the design and construction of the software • Focus on specific attributes of software engineering work products resulting from analysis, design, coding, and testing • Provide a systematic way to assess quality based on a set of clearly defined rules • Provide an “on-the-spot” rather than “after-the-fact” insight into the software development
  • 15. A Framework for Product Metrics
  • 16. Measures, Metrics, and Indicators • These three terms are often used interchangeably, but they can have subtle differences • Measure – Provides a quantitative indication of the extent, amount, dimension, capacity, or size of some attribute of a product or process • Measurement – The act of determining a measure • Metric – (IEEE) A quantitative measure of the degree to which a system, component, or process possesses a given attribute • Indicator – A metric or combination of metrics that provides insight into the software process, a software project, or the product itself
  • 17. Purpose of Product Metrics • Aid in the evaluation of analysis and design models • Provide an indication of the complexity of procedural designs and source code • Facilitate the design of more effective testing techniques • Assess the stability of a fielded software product
  • 18. Activities of a Measurement Process • Formulation – The derivation (i.e., identification) of software measures and metrics appropriate for the representation of the software that is being considered • Collection – The mechanism used to accumulate data required to derive the formulated metrics • Analysis – The computation of metrics and the application of mathematical tools • Interpretation – The evaluation of metrics in an effort to gain insight into the quality of the representation • Feedback – Recommendations derived from the interpretation of product metrics and passed on to the software development team
  • 19. Characterizing and Validating Metrics • A metric should have desirable mathematical properties – It should have a meaningful range (e.g., zero to ten) – It should not be set on a rational scale if it is composed of components measured on an ordinal scale • If a metric represents a software characteristic that increases when positive traits occur or decreases when undesirable traits are encountered, the value of the metric should increase or decrease in the same manner • Each metric should be validated empirically in a wide variety of contexts before being published or used to make decisions – It should measure the factor of interest independently of other factors – It should scale up to large systems – It should work in a variety of programming languages and system domains
  • 20. Collection and Analysis Guidelines • Whenever possible, data collection and analysis should be automated • Valid statistical techniques should be applied to establish relationships between internal product attributes and external quality characteristics • Interpretative guidelines and recommendations should be established for each metric
  • 21. A Product Metrics Taxonomy
  • 22. Metrics for various software development activities Analysis Model • Design Model Source Code • Testing • Functionality delivered • Provides an indirect measure of the functionality that is packaged within the software • System size • Measures the overall size of the system defined in terms of information available as part of the analysis model • Specification quality • Provides an indication of the specificity and completeness of a requirements specification • Architectural metrics • Provide an indication of the quality of the architectural design • Component-level metrics • Measure the complexity of software components and other characteristics that have a bearing on quality • Interface design metrics • Focus primarily on usability • Specialized object-oriented design metrics • Measure characteristics of classes and their communication and collaboration characteristics • Complexity metrics • Measure the logical complexity of source code (can also be applied to component- level design) • Length metrics • Provide an indication of the size of the software • Statement and branch coverage metrics • Lead to the design of test cases that provide program coverage • Defect-related metrics • Focus on defects (i.e., bugs) found, rather than on the tests themselves • Testing effectiveness metrics • Provide a real-time indication of the effectiveness of tests that have been conducted • In-process metrics • Process related metrics that can be determined as testing is conducted
  • 24. Introduction to Function Points • First proposed by Albrecht in 1979; • Can be used effectively as a means for measuring the functionality delivered by a system • Using historical data, function points can be used to – Estimate the cost or effort required to design, code, and test the software – Predict the number of errors that will be encountered during testing – Forecast the number of components and/or the number of projected source code lines in the implemented system • Derived using an empirical relationship based on 1) Countable (direct) measures of the software’s information domain 2) Assessments of the software’s complexity
  • 25. Information Domain Values • Number of external inputs – Each external input originates from a user or is transmitted from another application – They provide distinct application-oriented data or control information – They are often used to update internal logical files – They are not inquiries (those are counted under another category) • Number of external outputs – Each external output is derived within the application and provides information to the user – This refers to reports, screens, error messages, etc. – Individual data items within a report or screen are not counted separately • Number of external inquiries – An external inquiry is defined as an online input that results in the generation of some immediate software response – The response is in the form of an on-line output • Number of internal logical files – Each internal logical file is a logical grouping of data that resides within the application’s boundary and is maintained via external inputs • Number of external interface files – Each external interface file is a logical grouping of data that resides external to the application but provides data that may be of use to the application
  • 26. 26 Function Point Computation 1) Identify/collect the information domain values 2) Complete the table shown below to get the count total • Associate a weighting factor (i.e., complexity value) with each count based on criteria established by the software development organization 3) Evaluate and sum up the adjustment factors (see the next two slides) • “Fi” refers to 14 value adjustment factors, with each ranging in value from 0 (not important) to 5 (absolutely essential) 4) Compute the number of function points (FP) FP = count total * [0.65 + 0.01 * sum(Fi)] Information Weighting Factor Domain Value Count Simple Average Complex External Inputs _____ x 3 4 6 = _____ External Outputs _____ x 4 5 7 = _____ External Inquiries _____ x 3 4 6 = _____ Internal Logical Files _____ x 7 10 15 = _____ External Interface Files _____ x 5 7 10 = _____ Count total ________
  • 27. Function Point Example • FP = count total * [0.65 + 0.01 * sum(Fi)] • FP = 50 * [0.65 + (0.01 * 46)] • FP = 55.5 (rounded up to 56) Information Weighting Factor Domain Value Count Simple Average Complex External Inputs 3 x 3 4 6 = 9 External Outputs 2 x 4 5 7 = 8 External Inquiries 2 x 3 4 6 = 6 Internal Logical Files 1 x 7 10 15 = 7 External Interface Files 4 x 5 7 10 = 20 Count total 50
  • 29. Architectural Design Metrics • These metrics place emphasis on the architectural structure and effectiveness of modules or components within the architecture • They are “black box” in that they do not require any knowledge of the inner workings of a particular software component
  • 30. Hierarchical Architecture Metrics • Fan out: the number of modules immediately subordinate to the module i, that is, the number of modules directly invoked by module i • Structural complexity – S(i) = f2 out(i), where fout(i) is the “fan out” of module i • Data complexity – D(i) = v(i)/[fout(i) + 1], where v(i) is the number of input and output variables that are passed to and from module i • System complexity – C(i) = S(i) + D(i) • As each of these complexity values increases, the overall architectural complexity of the system also increases • This leads to greater likelihood that the integration and testing effort will also increase • Shape complexity – size = n + a, where n is the number of nodes and a is the number of arcs – Allows different program software architectures to be compared in a straightforward manner • Connectivity density (i.e., the arc-to-node ratio) – r = a/n – May provide a simple indication of the coupling in the software architecture
  • 31. Process and Project Based Matrices
  • 32. Process and Project Indicators Process indicators enable software project managers to: – assess project status – track potential risks – detect problem areas early – adjust workflow or tasks – evaluate team ability to control product quality
  • 33. Process metrics • Private process metrics – (e.g. defect rates by individual or module) are known only to the individual or team concerned. • Public process metrics – enable organizations to make strategic changes to improve the software process. • Metrics should not be used to evaluate the performance of individuals. • Statistical software process improvement helps an organization to discover its strengths and weaknesses.
  • 34. Project Metrics • Software project metrics are used by the software team to adapt project workflow and technical activities. • Project metrics are used to avoid development schedule delays, to mitigate potential risks, and to assess product quality on an on-going basis. • Every project should measure its inputs (resources), outputs (deliverables), and results (effectiveness of deliverables).
  • 36. Size-Oriented Metrics • Derived by normalizing (dividing) any direct measure (e.g. defects or human effort) associated with the product or project by LOC. • Size oriented metrics are widely used but their validity and applicability is widely debated.
  • 38. In respective stages of software development • The degree to which a system, component, or process meets specified requirements. • The degree to which a system, component or process meets customer or user needs or expectations. What is SQA?
  • 39. SQA encompasses the entire software development process • software requirements • software design • coding • source code control • code reviews • change management • configuration management • release management SQA
  • 40. • 1. Purpose • 2. Reference documents • 3. Management • 4. Documentation • 5. Standards, practices, convention, and metrics • 6. Software Reviews • 7. Tests • 8. Problem reporting and corrective actions • 9. Tools, techniques, and methodologies • 10. Media control • 11. Supplier control • 12. Records collection, maintenance, and retention • 13. Training • 14. Risk management • 15. Glossary • 16. SQAP change procedure and history 1) Underlined sections will be included in our project’s SQAP Content of SQAP - Software Quality Assurance Plan1)