SlideShare a Scribd company logo
2
Most read
4
Most read
6
Most read
How should the effectiveness of additional
risk minimisation activities be measured?
Look before you leap!
Tony Choy
Risk Management Plan Evaluation
Post-market Surveillance Branch
TGA
ARCS & TGA Workshop
March 2015
• The sponsor is responsible for monitoring and evaluating the effectiveness of additional risk minimisation
activities.
• The proposed risk minimisation activities should be dependent on an assessment of the risk, the population,
and how the risk changes during the course of the post-market period.
• Guidance on the measurement of additional risk minimisation activities can be found in the EU Guideline on
good pharmacovigilance practices (GVP) Module XVI– Risk minimisation measures: selection of tools and
effectiveness indicators.
1How should the effectiveness of additional
risk minimisation activities be measured?
RMP Questions & Answers (Version 2.0, March 2015)
• Risk minimisation measures are public health interventions intended to prevent or reduce the probability of
the occurrence of adverse reactions associated with exposure to a medicinal product, or to reduce their
severity/impact on the patient should the adverse reactions occur.
• The success of risk minimisation activities in delivering these objectives needs to be evaluated throughout the
lifecycle of a product to ensure that the burden of adverse reactions is minimised and hence the overall risk-
benefit balance is optimised.
• All risk minimisation measures should be reviewed at regular intervals and their effectiveness assessed.
More extensive guidance on monitoring the effectiveness of risk minimisation activities is included in Module
XVI.
• Any educational material should be non-promotional.
2How should the effectiveness of additional
risk minimisation activities be measured?
EU Guideline on GVP: Module V – Risk management systems (Rev 1) April 2014
• The risk minimisation plan, an integral part of the RMP (see Module V), should give appropriate consideration
to the following points:
– Rationale for additional risk minimisation measure (linked to specific safety concerns)
– Description of additional risk minimisation measure(s)
– Implementation plan
– Evaluation plan
3How should the effectiveness of additional
risk minimisation activities be measured?
Module XVI – Risk minimisation measures: selection of tools and effectiveness indicators
Module XVI.B.1. General principles
• Evaluating the effectiveness of risk minimisation measures is necessary to establish whether an intervention
has been effective or not, and if not then why the intervention was not successful and whether corrective
actions are necessary.
• To evaluate the effectiveness of risk minimisation measures two indicators should be considered:
– process indicators
– outcome indicators
• The conclusion of the evaluation
• Has the risk minimisation intervention had unintended (negative) consequences?
4How should the effectiveness of additional
risk minimisation activities be measured?
Module XVI.B.4. Effectiveness of risk minimisation measures
• Process indicators should complement but not replace outcome indicators.
• Reaching the target population
• Assessing clinical knowledge
• Assessing clinical actions
5How should the effectiveness of additional
risk minimisation activities be measured?
Module XVI.B.4.1. Process indicators
• The ultimate measures of success of a risk minimisation program are the safety outcomes, i.e. the frequency
and/or severity of adverse reactions in relation to patients’ exposure to the medicine outside of an
interventional study setting (i.e. non-interventional setting).
• Such an evaluation should involve the comparison of epidemiologic measures of outcome frequency such as
incidence rate or cumulative incidence of an adverse reaction, obtained in the context of post-authorisation
safety studies.
• As a general rule, spontaneous reporting rates (i.e. number of suspected adverse reaction reports over a
fixed time period) should not be considered as an acceptable estimate of the frequency of adverse events in
the treated population, as the well known biases that affects reporting of suspected adverse reaction may
provide misleading results.
6How should the effectiveness of additional
risk minimisation activities be measured?
Module XVI.B.4.2. Outcome indicators
• Section 3.3 - How risk minimisation activities will be evaluated in Australia:
– Provide detail about how and when evaluation of additional risk minimisation activities, including
educational activities, will be undertaken and reported to the TGA.
– Sponsors must demonstrate that the measures they are using to mitigate risk are working and if not what
actions they will take to ensure effectiveness.
7How should the effectiveness of additional
risk minimisation activities be measured?
Consolidated ASA Template
How should the effectiveness of additional risk minimisation activities be measured?
• If the EMA has not requested additional risk minimisation activities for specific safety concerns, how is it that
the TGA considers this necessary in a local market, if the demographics of the patient population are
considered to be similar?
• How do we report on effectiveness of risk minimization activities? i.e. do we update the ASA and submit to
TGA without an application (i.e. no Cat 1) – what is the evaluation process/application type? How long?
Should we expect questions?
• How do we remove risk minimization activities? What is the process/application type? i.e. do we update the
ASA and submit to TGA without an application (i.e. no Cat 1) – what is the evaluation process? How long?
Should we expect questions?
9How should the effectiveness of additional
risk minimisation activities be measured?
Pre-submitted Questions
• Do changes to additional RMinA require pre-approval from TGA e.g. if text changes are made to an
educational material?
• What is your definition of an 'effectiveness measure' and in what circumstances would it be reasonable not to
implement effectiveness measures?
• Effectiveness measures often involve questionnaires sent out to HCPs. For many bio-similar products, the
same effectiveness measures are expected which means the same HCPs can be receiving multiple
questionnaires for a number of products, meaning response rate and feeling towards the industry is being
damaged. How do you propose addressing this problem?
10How should the effectiveness of additional
risk minimisation activities be measured?
Pre-submitted Questions

More Related Content

PDF
Safety Reports: PBRER / PSUR
PPTX
Introduction to clinical trial
PDF
Risk minimisation activities - measuring effectiveness
PPTX
Presentation: Risk Minimisation
PDF
Safety reports rmp risk management plan pharmacovigilance
PPTX
Automated data system CPK TDM chapter.pptx
PPTX
Analyzing the randomised control trial (rct)
PPTX
Orphan Drugs
Safety Reports: PBRER / PSUR
Introduction to clinical trial
Risk minimisation activities - measuring effectiveness
Presentation: Risk Minimisation
Safety reports rmp risk management plan pharmacovigilance
Automated data system CPK TDM chapter.pptx
Analyzing the randomised control trial (rct)
Orphan Drugs

What's hot (20)

PDF
Pharmacoepidemiology
PPTX
Evidence Based Medicine
PPTX
Risk management plan
PPTX
Health Related Quality of Life (HRQoL)
PPT
Clinical trial design
PPTX
Risk management plans - an overview
PPTX
Hospital Pharmaco-epidemiology
PPTX
Biovigilance
PPTX
Observational descriptive study: case report, case series & ecological study
PPTX
Signal Detection in Pharmacovigilance
PPT
PPT
Clinical study and gcp
PDF
Efficacy endpoints in Oncology
PPT
Pharmacovigilance overview
PPT
Reporting Methods _ Global Pharmacovigilance1
PPTX
Patient narrative preparation by barka binmazi
PPTX
Rheumatoid arthritis
PPTX
Pharmacovigilance - a regulator's perspective
PPT
Challenges In Pharmacovigilance Dr Vishwas, by Dr. Vishwas Sovani MD ,VP P...
PPTX
Signifcance of pharmacovigilance & risk management plan
Pharmacoepidemiology
Evidence Based Medicine
Risk management plan
Health Related Quality of Life (HRQoL)
Clinical trial design
Risk management plans - an overview
Hospital Pharmaco-epidemiology
Biovigilance
Observational descriptive study: case report, case series & ecological study
Signal Detection in Pharmacovigilance
Clinical study and gcp
Efficacy endpoints in Oncology
Pharmacovigilance overview
Reporting Methods _ Global Pharmacovigilance1
Patient narrative preparation by barka binmazi
Rheumatoid arthritis
Pharmacovigilance - a regulator's perspective
Challenges In Pharmacovigilance Dr Vishwas, by Dr. Vishwas Sovani MD ,VP P...
Signifcance of pharmacovigilance & risk management plan
Ad

Viewers also liked (8)

PPTX
Risk minimisation activities associated with risk management plans
PPTX
The Australian Specific Annex document
PPTX
Risk management plan (RMP) requirements: When and why is an RMP required
PPTX
Presentation: Release for supply, packaging - in house and contract
PPTX
International regulatory cooperation: more important than ever
PPTX
The regulation of complementary medicines
PPTX
Latest trends in manufacturing quality
PPTX
The world of Regulatory convergence: an Australian reflection
Risk minimisation activities associated with risk management plans
The Australian Specific Annex document
Risk management plan (RMP) requirements: When and why is an RMP required
Presentation: Release for supply, packaging - in house and contract
International regulatory cooperation: more important than ever
The regulation of complementary medicines
Latest trends in manufacturing quality
The world of Regulatory convergence: an Australian reflection
Ad

Similar to How should the effectiveness of additional risk minimisation activities be measured? (15)

PPTX
Evaluating risk minimisation effectiveness: Where are we now?
PPTX
Presentation: Risk Management Plan compliance monitoring
PPTX
Presentation: Risk minimisation in the Australian context
PDF
Risk minimisation activities - identification and application
PDF
Postmarket monitoring of therapeutic goods in Australia
PPTX
TGA presentation: Postmarket Monitoring
PPTX
Principles-of-Risk-Management in business.pptx
PPTX
An update on risk management plans - an evaluator's perspective
PDF
Signal management & Eudravigilance. .pdf
PDF
FDA Guidance for risk evaluation and mitigation strategies - Professor Peiva...
PDF
Presentation: Pharmacovigilance requirements inspected and example findings
PPTX
Pharmacoepidemiology and risk management
PDF
Pharmacovigilance at the Intersection of Healthcare and Life Sciences
PPTX
Presentation: What’s new in the 2019 RMP guidance update?
PPT
Enabling Risk Management: From Safety Signal to Risk/Benefit Management
Evaluating risk minimisation effectiveness: Where are we now?
Presentation: Risk Management Plan compliance monitoring
Presentation: Risk minimisation in the Australian context
Risk minimisation activities - identification and application
Postmarket monitoring of therapeutic goods in Australia
TGA presentation: Postmarket Monitoring
Principles-of-Risk-Management in business.pptx
An update on risk management plans - an evaluator's perspective
Signal management & Eudravigilance. .pdf
FDA Guidance for risk evaluation and mitigation strategies - Professor Peiva...
Presentation: Pharmacovigilance requirements inspected and example findings
Pharmacoepidemiology and risk management
Pharmacovigilance at the Intersection of Healthcare and Life Sciences
Presentation: What’s new in the 2019 RMP guidance update?
Enabling Risk Management: From Safety Signal to Risk/Benefit Management

More from TGA Australia (20)

PPTX
Pharmacovigilance and complementary medicines - Regulatory requirements
PPTX
The challenges of regulating direct to consumer digital medical devices
PPTX
Updates from the Pharmacovigilance and Special Access Branch
PPTX
Consumer Medicine Information - Improving the CMI template
PPTX
Regulatory updates from the Complementary and OTC Medicines Branch - Listed m...
PPTX
Improved electronic submission methodologies - Challenges and future state
PPTX
Regulation, ethics and reimbursement of novel biological therapies in Austral...
PPTX
Updates to Good Manufacturing Practices - Recent, current and future changes
PPTX
Good Clinical Practice Inspections - Consultation to introduce a pilot progra...
PPTX
Manufacturing Investigational Medicinal Products - Legislative and GMP requir...
PPTX
Update on regulatory reforms from the Scientific Evaluation Branch
PPTX
Update on regulatory reforms from the Scientific Evaluation Branch
PPTX
Reporting of Medicine Shortages
PPTX
Regulatory updates from the TGA Medical Devices Branch - Part 1
PPTX
Regulatory updates from the TGA Medical Devices Branch - Part 2
PPTX
SME Assist: Help to navigate the regulatory maze
PPTX
TGA webinar: The Good Manufacturing Practice (GMP) Clearance Framework – an o...
PPTX
Presentation: Updates from the Pharmacovigilance and Special Access Branch
PPTX
Presentation: The challenges of regulating direct to consumer digital medical...
PPTX
TGA Presentation: Therapeutic Goods Advertising Code (No. 2) 2018
Pharmacovigilance and complementary medicines - Regulatory requirements
The challenges of regulating direct to consumer digital medical devices
Updates from the Pharmacovigilance and Special Access Branch
Consumer Medicine Information - Improving the CMI template
Regulatory updates from the Complementary and OTC Medicines Branch - Listed m...
Improved electronic submission methodologies - Challenges and future state
Regulation, ethics and reimbursement of novel biological therapies in Austral...
Updates to Good Manufacturing Practices - Recent, current and future changes
Good Clinical Practice Inspections - Consultation to introduce a pilot progra...
Manufacturing Investigational Medicinal Products - Legislative and GMP requir...
Update on regulatory reforms from the Scientific Evaluation Branch
Update on regulatory reforms from the Scientific Evaluation Branch
Reporting of Medicine Shortages
Regulatory updates from the TGA Medical Devices Branch - Part 1
Regulatory updates from the TGA Medical Devices Branch - Part 2
SME Assist: Help to navigate the regulatory maze
TGA webinar: The Good Manufacturing Practice (GMP) Clearance Framework – an o...
Presentation: Updates from the Pharmacovigilance and Special Access Branch
Presentation: The challenges of regulating direct to consumer digital medical...
TGA Presentation: Therapeutic Goods Advertising Code (No. 2) 2018

Recently uploaded (20)

PPTX
JUVENILE NASOPHARYNGEAL ANGIOFIBROMA.pptx
PDF
Oral Aspect of Metabolic Disease_20250717_192438_0000.pdf
PPTX
regulatory aspects for Bulk manufacturing
PPTX
Human Reproduction: Anatomy, Physiology & Clinical Insights.pptx
PPT
genitourinary-cancers_1.ppt Nursing care of clients with GU cancer
PPTX
anaemia in PGJKKKKKKKKKKKKKKKKHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH...
PPTX
Transforming Regulatory Affairs with ChatGPT-5.pptx
PPTX
Electrolyte Disturbance in Paediatric - Nitthi.pptx
PPTX
surgery guide for USMLE step 2-part 1.pptx
PDF
Handout_ NURS 220 Topic 10-Abnormal Pregnancy.pdf
PPTX
NRPchitwan6ab2802f9.pptxnepalindiaindiaindiapakistan
PPT
HIV lecture final - student.pptfghjjkkejjhhge
PPTX
Important Obstetric Emergency that must be recognised
PPTX
History and examination of abdomen, & pelvis .pptx
PPTX
vertigo topics for undergraduate ,mbbs/md/fcps
PPTX
obstructive neonatal jaundice.pptx yes it is
PDF
Cardiology Pearls for Primary Care Providers
PPT
MENTAL HEALTH - NOTES.ppt for nursing students
PPTX
Chapter-1-The-Human-Body-Orientation-Edited-55-slides.pptx
PPTX
NASO ALVEOLAR MOULDNIG IN CLEFT LIP AND PALATE PATIENT
JUVENILE NASOPHARYNGEAL ANGIOFIBROMA.pptx
Oral Aspect of Metabolic Disease_20250717_192438_0000.pdf
regulatory aspects for Bulk manufacturing
Human Reproduction: Anatomy, Physiology & Clinical Insights.pptx
genitourinary-cancers_1.ppt Nursing care of clients with GU cancer
anaemia in PGJKKKKKKKKKKKKKKKKHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH...
Transforming Regulatory Affairs with ChatGPT-5.pptx
Electrolyte Disturbance in Paediatric - Nitthi.pptx
surgery guide for USMLE step 2-part 1.pptx
Handout_ NURS 220 Topic 10-Abnormal Pregnancy.pdf
NRPchitwan6ab2802f9.pptxnepalindiaindiaindiapakistan
HIV lecture final - student.pptfghjjkkejjhhge
Important Obstetric Emergency that must be recognised
History and examination of abdomen, & pelvis .pptx
vertigo topics for undergraduate ,mbbs/md/fcps
obstructive neonatal jaundice.pptx yes it is
Cardiology Pearls for Primary Care Providers
MENTAL HEALTH - NOTES.ppt for nursing students
Chapter-1-The-Human-Body-Orientation-Edited-55-slides.pptx
NASO ALVEOLAR MOULDNIG IN CLEFT LIP AND PALATE PATIENT

How should the effectiveness of additional risk minimisation activities be measured?

  • 1. How should the effectiveness of additional risk minimisation activities be measured? Look before you leap! Tony Choy Risk Management Plan Evaluation Post-market Surveillance Branch TGA ARCS & TGA Workshop March 2015
  • 2. • The sponsor is responsible for monitoring and evaluating the effectiveness of additional risk minimisation activities. • The proposed risk minimisation activities should be dependent on an assessment of the risk, the population, and how the risk changes during the course of the post-market period. • Guidance on the measurement of additional risk minimisation activities can be found in the EU Guideline on good pharmacovigilance practices (GVP) Module XVI– Risk minimisation measures: selection of tools and effectiveness indicators. 1How should the effectiveness of additional risk minimisation activities be measured? RMP Questions & Answers (Version 2.0, March 2015)
  • 3. • Risk minimisation measures are public health interventions intended to prevent or reduce the probability of the occurrence of adverse reactions associated with exposure to a medicinal product, or to reduce their severity/impact on the patient should the adverse reactions occur. • The success of risk minimisation activities in delivering these objectives needs to be evaluated throughout the lifecycle of a product to ensure that the burden of adverse reactions is minimised and hence the overall risk- benefit balance is optimised. • All risk minimisation measures should be reviewed at regular intervals and their effectiveness assessed. More extensive guidance on monitoring the effectiveness of risk minimisation activities is included in Module XVI. • Any educational material should be non-promotional. 2How should the effectiveness of additional risk minimisation activities be measured? EU Guideline on GVP: Module V – Risk management systems (Rev 1) April 2014
  • 4. • The risk minimisation plan, an integral part of the RMP (see Module V), should give appropriate consideration to the following points: – Rationale for additional risk minimisation measure (linked to specific safety concerns) – Description of additional risk minimisation measure(s) – Implementation plan – Evaluation plan 3How should the effectiveness of additional risk minimisation activities be measured? Module XVI – Risk minimisation measures: selection of tools and effectiveness indicators Module XVI.B.1. General principles
  • 5. • Evaluating the effectiveness of risk minimisation measures is necessary to establish whether an intervention has been effective or not, and if not then why the intervention was not successful and whether corrective actions are necessary. • To evaluate the effectiveness of risk minimisation measures two indicators should be considered: – process indicators – outcome indicators • The conclusion of the evaluation • Has the risk minimisation intervention had unintended (negative) consequences? 4How should the effectiveness of additional risk minimisation activities be measured? Module XVI.B.4. Effectiveness of risk minimisation measures
  • 6. • Process indicators should complement but not replace outcome indicators. • Reaching the target population • Assessing clinical knowledge • Assessing clinical actions 5How should the effectiveness of additional risk minimisation activities be measured? Module XVI.B.4.1. Process indicators
  • 7. • The ultimate measures of success of a risk minimisation program are the safety outcomes, i.e. the frequency and/or severity of adverse reactions in relation to patients’ exposure to the medicine outside of an interventional study setting (i.e. non-interventional setting). • Such an evaluation should involve the comparison of epidemiologic measures of outcome frequency such as incidence rate or cumulative incidence of an adverse reaction, obtained in the context of post-authorisation safety studies. • As a general rule, spontaneous reporting rates (i.e. number of suspected adverse reaction reports over a fixed time period) should not be considered as an acceptable estimate of the frequency of adverse events in the treated population, as the well known biases that affects reporting of suspected adverse reaction may provide misleading results. 6How should the effectiveness of additional risk minimisation activities be measured? Module XVI.B.4.2. Outcome indicators
  • 8. • Section 3.3 - How risk minimisation activities will be evaluated in Australia: – Provide detail about how and when evaluation of additional risk minimisation activities, including educational activities, will be undertaken and reported to the TGA. – Sponsors must demonstrate that the measures they are using to mitigate risk are working and if not what actions they will take to ensure effectiveness. 7How should the effectiveness of additional risk minimisation activities be measured? Consolidated ASA Template
  • 10. • If the EMA has not requested additional risk minimisation activities for specific safety concerns, how is it that the TGA considers this necessary in a local market, if the demographics of the patient population are considered to be similar? • How do we report on effectiveness of risk minimization activities? i.e. do we update the ASA and submit to TGA without an application (i.e. no Cat 1) – what is the evaluation process/application type? How long? Should we expect questions? • How do we remove risk minimization activities? What is the process/application type? i.e. do we update the ASA and submit to TGA without an application (i.e. no Cat 1) – what is the evaluation process? How long? Should we expect questions? 9How should the effectiveness of additional risk minimisation activities be measured? Pre-submitted Questions
  • 11. • Do changes to additional RMinA require pre-approval from TGA e.g. if text changes are made to an educational material? • What is your definition of an 'effectiveness measure' and in what circumstances would it be reasonable not to implement effectiveness measures? • Effectiveness measures often involve questionnaires sent out to HCPs. For many bio-similar products, the same effectiveness measures are expected which means the same HCPs can be receiving multiple questionnaires for a number of products, meaning response rate and feeling towards the industry is being damaged. How do you propose addressing this problem? 10How should the effectiveness of additional risk minimisation activities be measured? Pre-submitted Questions