SlideShare a Scribd company logo
Applying Process-based Analytics
  to Audit Results for Process
Management and Improvement

John G. Surak, PhD     Jeffery L. Cawley
Surak and Associates   Northwest Analytics
Clemson, SC            Portland, OR
Operational audits and inspections play a critical role in
assuring the effectiveness of food safety system (Table 1).
To achieve maximum effectiveness of these activities,
key process indicators should be identified and plotted on
control charts. The control charts can then be assessed for
trends, so actions can be taken before a food safety
incident occurs.

                   Preoperational Audit
                       Facility Audit
                    Pest Control Audit
        Microbial Environmental Monitoring Audit
          Table 1 – Examples of Operational Inspections and Audits
The GFSI benchmarked audit schemes require that food
processors conduct an internal audit. The internal audit
should determine the conformance of the Food Safety
Management System (FSMS) to plan. It is used to answer
the following questions:
   • Is the FSMS implemented?
   • Is the FSMS effective?
   • Is the FSMS efficient?
   • Is the FSMS sustainable?
   • Is the FSMS updated?

The internal audit is not a substitute for the other audits.
The primary focus of the operational inspections and
audits is to determine if the food safety activities are being
carried out. The primary focus of the internal audit should
to determine if the FSMS is working as planned.
This will cause a shift in the types of audits that are
conducted from a checklist approach to a process
approach.
For example, a checklist for a preoperational audit may ask
the question, “Are the floors clean?” The auditor may
observe that a floor is not properly clean. Using the
process audit concept, the auditor may ask additional
questions that focus on gathering information on why the
floor is not clean.
In addition, the auditor may be also responsible for taking
microbiological environmental samples and reporting the
results to the manager responsible for cleaning and
sanitizing. Individual results of the weekly microbial
environmental monitoring audit, reported as CFUs/inch²,
will summarize the effectiveness of the cleaning program
for that week.
The auditor should also plot the microbial data over a
period of time to determine if there are any trends in
the cleaning and sanitizing program.
Control charts can be used to display the sanitation
data. Examples of these plots are shown in Figures 1
and 2. Figure 1 shows the plot of environmental
samples over a period of a half of year. The samples
were taken after cleaning and before sanitization.
The graph shows a number of signals as indicated by
the red diamonds. These signals show that there was
a change in the cleaning process.
The auditor responsible for taking and analyzing the
data should provide feedback that problems were
observed in the effectiveness of the cleaning program
so that the cleaning and sanitizing program can be
improved.
Applying Process-based Analytics to Audit Results for Process Management and Improvement
The function of the internal audit is to verify the
effectiveness of the FSMS or determine that the
organization is functioning according to plan. In the
previous example, the internal audit primary focus is to
determine if the verification system for cleaning and
sanitizing is properly working.
For example, during the planning part of an internal
audit that focuses on cleaning and sanitizing, the auditor
can review records which include control charts. The
internal auditor may conduct further analysis of the
microbial data.
Applying Process-based Analytics to Audit Results for Process Management and Improvement
Figure 2 show a second control chart of the same
microbial data. In this chart, the control limits were
calculated by each quarter. In addition to the signals that
were observed in Figure 1, the second control chart
indicates that there was an increase in the variation of
microbial levels between the first quarter and the second
quarter.
As part of this audit, the auditor should investigate what
was done with the original environmental sampling
information. Did the auditor who was responsible for
taking the environmental samples provide effective
feedback to plant management responsible for cleaning
and sanitization? Did the plant determine why the
cleaning process deteriorated? If a root cause was
identified, was this knowledge used to improve the
cleaning and sanitizing process?
Operational       Operational
                 Verification of      Internal        Management               Certification
Food Safety       Food Safety          Audits           Review                   Audits
 Activities        Activities




 Figure 3: Linkage between operational activities and the Food Safety Certification Audit
Finally the internal audit reports and findings feed into
management review, to assess the effectiveness of the
FSMS, and develop objectives and business plans to
update and improve the FSMS. Figure 3 shows the
linkage of food safety activities linkage to certification
audits.
The proper linkage and operation of the components of
the FSMS allows for successful certification audits and
gives confidence to Senior Management and other
stakeholders that the organization has a robust food
safety management system.
Contact information:
John G. Surak            Jeffery L. Cawley
Principal                Vice President Industry Leadership
Surak and Associates     Northwest Analytics
Clemson, SC              Portland, OR
864-506-2190             jcawley@nwasoft.com
jgsurak@yahoo.com        503-224-7727

More Related Content

PPTX
Controlling
PDF
FSMA Focus on Implementation 2015
PDF
Controlling
PDF
A Two-Dimension Evaluation of CSA Practices. Evaluating Practices by Indicato...
PPTX
Controlling
PPTX
Risk analysis
PPTX
Transit performance measurement system
PPTX
Pratik ppt
Controlling
FSMA Focus on Implementation 2015
Controlling
A Two-Dimension Evaluation of CSA Practices. Evaluating Practices by Indicato...
Controlling
Risk analysis
Transit performance measurement system
Pratik ppt

What's hot (18)

PPT
Global Health Council-Nyangara
PPT
Ems tool-staffawareness
PPTX
Controling en.
PPTX
M 5.4.1 ems
PPTX
Production process
PPTX
Overview on audit; A&RC
PPTX
Hazards and risk management
PPTX
Environmental Audit
PPT
Strategy of Implementing Plans
PDF
Green supply chain management paper
PPTX
Controlling
PPT
Monitoring&evaluation best practices
PPTX
engineer industrial
PDF
Pharma Quality Metrics
PPTX
01. quantification
PPTX
Enviromental audit final
Global Health Council-Nyangara
Ems tool-staffawareness
Controling en.
M 5.4.1 ems
Production process
Overview on audit; A&RC
Hazards and risk management
Environmental Audit
Strategy of Implementing Plans
Green supply chain management paper
Controlling
Monitoring&evaluation best practices
engineer industrial
Pharma Quality Metrics
01. quantification
Enviromental audit final
Ad

Viewers also liked (20)

PPTX
NSQF - A Perspective
PPT
PPTX
Finance and Audit Predictive Analytics
PDF
The Future of Internal Audit through data analytics
PPTX
Non-Performing Assets (NPA)
PPTX
12. npa & recovery management
PDF
Gamification in Enterprise Technology
PPTX
How to Perfect Your Personal Marketing
PPTX
2014 sep-27 skills to employment
PPTX
Skill, Competencies and Values
PPTX
Skills to employment
PPTX
10 surprising facts about gamification app2improve
PPTX
Internal Audit with Data Analytics
PPTX
The Value of Distance Education: Burden or Blessing?
PPT
Data ppt on npa
PDF
Atmospheric water generator
PDF
MOOCs, Myths and Misconseptions
DOCX
Questionnaire on npa
PPTX
Nfpa Process Safety Management and osha 6 8 2013
PPTX
Let's level up with gamification
NSQF - A Perspective
Finance and Audit Predictive Analytics
The Future of Internal Audit through data analytics
Non-Performing Assets (NPA)
12. npa & recovery management
Gamification in Enterprise Technology
How to Perfect Your Personal Marketing
2014 sep-27 skills to employment
Skill, Competencies and Values
Skills to employment
10 surprising facts about gamification app2improve
Internal Audit with Data Analytics
The Value of Distance Education: Burden or Blessing?
Data ppt on npa
Atmospheric water generator
MOOCs, Myths and Misconseptions
Questionnaire on npa
Nfpa Process Safety Management and osha 6 8 2013
Let's level up with gamification
Ad

Similar to Applying Process-based Analytics to Audit Results for Process Management and Improvement (20)

PDF
How to assess your FSMS (Food Safety Management System)
PDF
Food Saftey Audits 1.pdf
PDF
Developing Effective Checklists to Support the Internal Audit Function - Webinar
PPTX
Audit Efficiency and Effectiveness
PDF
Food Safety Audit and Assessment
PDF
IFC+Guidelines+for+Coaching+on+Food+Safety_ENG.pdf
PPTX
So You Think You Can Pass? A Guide for Food Retail Audits
PDF
Inside the Mind of a Food Safety Auditor
PDF
Food safety audit results
PDF
Building an Auditable, Measurable Food Safety Culture | FSMA Fridays
PPTX
AUDIT
PPTX
FSMA Friday Bonus - Completing Effective GFSI Internal Audits
PPT
Challenging Aspects of SQF Implementation: A CB’s Perspective
DOC
Introduction to Internal Auditing FSMS
PPTX
Confusing Validation with Verification: The Risks and Best Practices
PDF
Multisite Project Management
PPTX
Operational Effectiveness: Uncovering the Hidden Dollars in Your Food Facility
PPTX
For hospitals
PPTX
Aib presentation
PDF
Food Safety KPIs - Are They Driving the Right Behaviors?
How to assess your FSMS (Food Safety Management System)
Food Saftey Audits 1.pdf
Developing Effective Checklists to Support the Internal Audit Function - Webinar
Audit Efficiency and Effectiveness
Food Safety Audit and Assessment
IFC+Guidelines+for+Coaching+on+Food+Safety_ENG.pdf
So You Think You Can Pass? A Guide for Food Retail Audits
Inside the Mind of a Food Safety Auditor
Food safety audit results
Building an Auditable, Measurable Food Safety Culture | FSMA Fridays
AUDIT
FSMA Friday Bonus - Completing Effective GFSI Internal Audits
Challenging Aspects of SQF Implementation: A CB’s Perspective
Introduction to Internal Auditing FSMS
Confusing Validation with Verification: The Risks and Best Practices
Multisite Project Management
Operational Effectiveness: Uncovering the Hidden Dollars in Your Food Facility
For hospitals
Aib presentation
Food Safety KPIs - Are They Driving the Right Behaviors?

Recently uploaded (20)

PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPT
Teaching material agriculture food technology
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
PPTX
MYSQL Presentation for SQL database connectivity
PDF
A comparative analysis of optical character recognition models for extracting...
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
PDF
Encapsulation theory and applications.pdf
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
Mobile App Security Testing_ A Comprehensive Guide.pdf
Teaching material agriculture food technology
Reach Out and Touch Someone: Haptics and Empathic Computing
Dropbox Q2 2025 Financial Results & Investor Presentation
Spectral efficient network and resource selection model in 5G networks
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
MYSQL Presentation for SQL database connectivity
A comparative analysis of optical character recognition models for extracting...
Diabetes mellitus diagnosis method based random forest with bat algorithm
Encapsulation theory and applications.pdf
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
The AUB Centre for AI in Media Proposal.docx
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Review of recent advances in non-invasive hemoglobin estimation
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Programs and apps: productivity, graphics, security and other tools
20250228 LYD VKU AI Blended-Learning.pptx
The Rise and Fall of 3GPP – Time for a Sabbatical?

Applying Process-based Analytics to Audit Results for Process Management and Improvement

  • 1. Applying Process-based Analytics to Audit Results for Process Management and Improvement John G. Surak, PhD Jeffery L. Cawley Surak and Associates Northwest Analytics Clemson, SC Portland, OR
  • 2. Operational audits and inspections play a critical role in assuring the effectiveness of food safety system (Table 1). To achieve maximum effectiveness of these activities, key process indicators should be identified and plotted on control charts. The control charts can then be assessed for trends, so actions can be taken before a food safety incident occurs. Preoperational Audit Facility Audit Pest Control Audit Microbial Environmental Monitoring Audit Table 1 – Examples of Operational Inspections and Audits
  • 3. The GFSI benchmarked audit schemes require that food processors conduct an internal audit. The internal audit should determine the conformance of the Food Safety Management System (FSMS) to plan. It is used to answer the following questions: • Is the FSMS implemented? • Is the FSMS effective? • Is the FSMS efficient? • Is the FSMS sustainable? • Is the FSMS updated? The internal audit is not a substitute for the other audits. The primary focus of the operational inspections and audits is to determine if the food safety activities are being carried out. The primary focus of the internal audit should to determine if the FSMS is working as planned.
  • 4. This will cause a shift in the types of audits that are conducted from a checklist approach to a process approach. For example, a checklist for a preoperational audit may ask the question, “Are the floors clean?” The auditor may observe that a floor is not properly clean. Using the process audit concept, the auditor may ask additional questions that focus on gathering information on why the floor is not clean. In addition, the auditor may be also responsible for taking microbiological environmental samples and reporting the results to the manager responsible for cleaning and sanitizing. Individual results of the weekly microbial environmental monitoring audit, reported as CFUs/inch², will summarize the effectiveness of the cleaning program for that week.
  • 5. The auditor should also plot the microbial data over a period of time to determine if there are any trends in the cleaning and sanitizing program.
  • 6. Control charts can be used to display the sanitation data. Examples of these plots are shown in Figures 1 and 2. Figure 1 shows the plot of environmental samples over a period of a half of year. The samples were taken after cleaning and before sanitization. The graph shows a number of signals as indicated by the red diamonds. These signals show that there was a change in the cleaning process. The auditor responsible for taking and analyzing the data should provide feedback that problems were observed in the effectiveness of the cleaning program so that the cleaning and sanitizing program can be improved.
  • 8. The function of the internal audit is to verify the effectiveness of the FSMS or determine that the organization is functioning according to plan. In the previous example, the internal audit primary focus is to determine if the verification system for cleaning and sanitizing is properly working. For example, during the planning part of an internal audit that focuses on cleaning and sanitizing, the auditor can review records which include control charts. The internal auditor may conduct further analysis of the microbial data.
  • 10. Figure 2 show a second control chart of the same microbial data. In this chart, the control limits were calculated by each quarter. In addition to the signals that were observed in Figure 1, the second control chart indicates that there was an increase in the variation of microbial levels between the first quarter and the second quarter. As part of this audit, the auditor should investigate what was done with the original environmental sampling information. Did the auditor who was responsible for taking the environmental samples provide effective feedback to plant management responsible for cleaning and sanitization? Did the plant determine why the cleaning process deteriorated? If a root cause was identified, was this knowledge used to improve the cleaning and sanitizing process?
  • 11. Operational Operational Verification of Internal Management Certification Food Safety Food Safety Audits Review Audits Activities Activities Figure 3: Linkage between operational activities and the Food Safety Certification Audit
  • 12. Finally the internal audit reports and findings feed into management review, to assess the effectiveness of the FSMS, and develop objectives and business plans to update and improve the FSMS. Figure 3 shows the linkage of food safety activities linkage to certification audits. The proper linkage and operation of the components of the FSMS allows for successful certification audits and gives confidence to Senior Management and other stakeholders that the organization has a robust food safety management system. Contact information: John G. Surak Jeffery L. Cawley Principal Vice President Industry Leadership Surak and Associates Northwest Analytics Clemson, SC Portland, OR 864-506-2190 jcawley@nwasoft.com jgsurak@yahoo.com 503-224-7727