5 Tips on How to Select a Patient Reported Outcome
                    Measure for your Study

                            Presentation Notes

                          Keith Meadows
                   DHP Research & Consultancy Ltd




In this brief audio presentation, we provide five key tips to help you select the
right PROM for your study so as to maximise the possibility of finding a potential
treatment benefit where one exists.
Tip 1: Always have a hypothesis




A PROM should be selected on the basis of a clear rationale as to why it is being
used and formulating a hypothesis will help you to get clear in your mind what it
is you want to measure and why.

A hypothesis is a prediction as to what you think will happen and will be linked to
the objectives of the study, patient population, disease and any intervention
under evaluation.

The point is that formulating a hypothesis helps you define just what it is you
want to measure, from which you can then identify what would be the most
appropriate patient outcome measure to choose.
Tip 2: Ensure the content of the PROM is relevant




PROMs measure a wide range of health concepts including, health status,
health-related quality of life, QoL, well-being, treatment satisfaction, symptoms
and functioning.

Often however, PROMs are chosen on the basis of their popularity or because
their name seems to be appropriate to what is going to be measured and with
little attention being paid to the content of the individual items within the
measure. Both these approaches should be avoided.

PROMs can be generally categorised as generic and disease or condition-
specific, with each having their own strengths and weaknesses.

The generic PROM measures health concepts that are of relevance to a wide
range of patient groups and the general population and as such can be used for
comparison across different conditions as well as with healthy populations.

Due however, to the generic nature of their content, they will most likely
include items that are not particularly relevant to many patient groups.

Also generic measures are more likely to exclude content that is of particular
relevance to a specific disease group.

In contrast, disease-specific or condition-specific measures have been
developed to capture those elements of health and QoL of relevance to a
specific patient group.

Examination of the measure’s content by looking at the individual items and
response options will also give a good idea as to how relevant the measure is
but, most importantly the measure’s content should be based on an explicit
theoretical or conceptual framework.

From this you should be able to identify which items are linked to the particular
health concepts that are purported to be measured.
Tip 3: Ensure the selected measure is acceptable

                         to your patient group




In addition to establishing the relevance of the measure’s content, it’s important
that the selected PROM does not pose a significant burden on the participant
when completing it, resulting in the possibility of a lowered response rate.

Length is of course important, the longer the measure the more likely
participants will fail to complete it, however, there is evidence that participants
will answer a long questionnaire if the content is perceived as being relevant to
them.

Synonymous with length is the time taken to complete the measure. Measures
need to be completed in the shortest time and expecting participants to take
half an hour or more to complete it is unreasonable and can result in lower item
response and return rates.

Design of the PROM can also have a significant impact on acceptability.
Instruction need to be simple and clear as does the language, avoiding the use
of technical jargon. Layout should not be cramped with a clear differentiation
between instructions, question items and response categories.
Tip 4: Ensure the measure has been developed

                         with scientific rigour




When selecting a PROM, it’s essential that there is evidence that its
development has been carried out using appropriate methodologies and meets
recognised scientific criteria in terms of reliability and validity.

the PROM should be reliable in so much that it produce the same results on
repeated occasions when administered to the same participants, assuming there
has been no change in the measured concept?

We should also look for the ability of the PROM to discriminate between
patients, for example, with varying levels of health, depression and anxiety etc.

When using a PROM to evaluate for example, a clinical intervention, an
important requirement is its ability to detect change as a result. For example
the PROM is able to demonstrate changes in score for groups of patients whose
health is known to have changed as a consequence of some form of
intervention.
Tip 5: Make sure you can interpret your PROM

                             data correctly




The interpretation of PROMS data - in terms of what does a score tell us, poses a
number of difficulties. For example, the concepts that PROMs are purported to
assess, can mean different things to different people at different times and
contexts. Also understanding the meaning of what a change or difference in a
score means clinically can be problematic.

You need to consider whether you have the expertise and confidence in
undertaking the data analysis and interpreting just what the score might mean. If
not, you might find it more beneficial to collaborate with someone who does.
DHP Research & Consultancy Ltd

     www.dhpresearch.com

Email: consulting@dhpresearch.com

More Related Content

PDF
5 tips for_selecting_prom
PPTX
The picot method lo
PPT
Making evidence accessible to clinicians
PPTX
Screening2
PPT
The drug effectiveness review project: governments collaborating to use syste...
PPTX
Introduction to critical appraisal
PPTX
Using the Communication Assessment Tool (CAT) to Assess Communication Skills ...
5 tips for_selecting_prom
The picot method lo
Making evidence accessible to clinicians
Screening2
The drug effectiveness review project: governments collaborating to use syste...
Introduction to critical appraisal
Using the Communication Assessment Tool (CAT) to Assess Communication Skills ...

What's hot (17)

DOCX
Model for Dealing with Ruptures in the Therapeutic Alliance via Session by Se...
PPTX
ASE_C_POP APSA poster final
PPSX
Introduction to critical appraisal
PDF
The Carlat Psychiatry Report (Interview with Scott Miller, April 2015)
PDF
The Therapeutic Alliance, Ruptures, and Session-by-Session Feedback
PDF
Excellence in therapy: An Interview with Scott D. Miller, Ph.D.
PPTX
LSU Presentation 2004
PDF
How to double client outcomes in 18 seconds (Lambert, 2014)
PPT
Module 2: Evidence-Based Dental Public Health
PPTX
Critical appraisal of published article
PPTX
Deliberate Practice at Stangehjelp
PDF
Evidence based practice for nurses, diabetics, and learning institutions
PDF
Article from the National Psychologist about Scott Miller's speech at Evoluti...
DOCX
Do therapists improve (preprint)
DOCX
Beyond measures and monitoring
PDF
Introduction to Evidence Based Medicine (EBM)
PPT
Developing a Quality Audit Report for General Practice Prescribing for Hypert...
Model for Dealing with Ruptures in the Therapeutic Alliance via Session by Se...
ASE_C_POP APSA poster final
Introduction to critical appraisal
The Carlat Psychiatry Report (Interview with Scott Miller, April 2015)
The Therapeutic Alliance, Ruptures, and Session-by-Session Feedback
Excellence in therapy: An Interview with Scott D. Miller, Ph.D.
LSU Presentation 2004
How to double client outcomes in 18 seconds (Lambert, 2014)
Module 2: Evidence-Based Dental Public Health
Critical appraisal of published article
Deliberate Practice at Stangehjelp
Evidence based practice for nurses, diabetics, and learning institutions
Article from the National Psychologist about Scott Miller's speech at Evoluti...
Do therapists improve (preprint)
Beyond measures and monitoring
Introduction to Evidence Based Medicine (EBM)
Developing a Quality Audit Report for General Practice Prescribing for Hypert...
Ad

Viewers also liked (6)

PDF
PHP Documentation APIs on the fly
PPT
PRO Workshop - Selecting the appropriate PRO for your clinical study
KEY
What is that beautiful house?
POTX
Why Community Managers Won't Exist in 5 Years (and why that's a good thing)
PDF
JAX-WS e JAX-RS
PDF
Succession “Losers”: What Happens to Executives Passed Over for the CEO Job?
PHP Documentation APIs on the fly
PRO Workshop - Selecting the appropriate PRO for your clinical study
What is that beautiful house?
Why Community Managers Won't Exist in 5 Years (and why that's a good thing)
JAX-WS e JAX-RS
Succession “Losers”: What Happens to Executives Passed Over for the CEO Job?
Ad

Similar to 5 tips on how to select a prom for your study presentation notes (20)

PDF
5 things you need to know about patient reported outcome (pro) measures
PDF
This week will see the launch of Health Outcomes Insights (Formerly DHP Resea...
PPTX
DHP Research Patient Reported Outcome (PRO) Measures Workshop
PDF
White paper 5 things you need to know about patient reported outcome (pro) ...
PDF
Duncan & Sparks Ch 5 of Cooper & Dryden
PDF
Enhancing Rheumatoid Arthritis Patient Retention
PPTX
Evidence based medicine
PPTX
Chapter 8 personality assessment
PPTX
Ebd jc part 5
PPTX
ch11 evidence based_daf920fe89962b4f3195c4c5fcd670f7.pptx
PPTX
Health measurements power point presentation on epidemiology
PPTX
APPRAISING EVIDENCE ABOUT PROGNOSTIC (RISK) FACTORS.pptx
PDF
Tricks of the Trade: Patient Recruitment & Retention for Different Study Types
PDF
Estimands in Clinical Trials | Innovaderm Research
PPT
CLOSING THE GAP FROM EVIDENCE TO ACTION
PPTX
Psychological testing, meaning, advantages and limitations
PPTX
CONCEPTUALIZATION AND PLANNING RESEARCH.pptx
PPT
Validity of Evidence
PPT
Study Eligibility Criteria
5 things you need to know about patient reported outcome (pro) measures
This week will see the launch of Health Outcomes Insights (Formerly DHP Resea...
DHP Research Patient Reported Outcome (PRO) Measures Workshop
White paper 5 things you need to know about patient reported outcome (pro) ...
Duncan & Sparks Ch 5 of Cooper & Dryden
Enhancing Rheumatoid Arthritis Patient Retention
Evidence based medicine
Chapter 8 personality assessment
Ebd jc part 5
ch11 evidence based_daf920fe89962b4f3195c4c5fcd670f7.pptx
Health measurements power point presentation on epidemiology
APPRAISING EVIDENCE ABOUT PROGNOSTIC (RISK) FACTORS.pptx
Tricks of the Trade: Patient Recruitment & Retention for Different Study Types
Estimands in Clinical Trials | Innovaderm Research
CLOSING THE GAP FROM EVIDENCE TO ACTION
Psychological testing, meaning, advantages and limitations
CONCEPTUALIZATION AND PLANNING RESEARCH.pptx
Validity of Evidence
Study Eligibility Criteria

More from Keith Meadows (20)

PDF
Sample pages diabetes health profile e book development & applications 2018
ODP
Gamification for Better Survey Design and Higher ROI in Healthcare Research?
PDF
Can Gamification Increase Respondent Engagement and Provide Higher Quality Da...
PDF
How to get the most from your clinical outcome assessment (COA) measure - Tes...
PDF
YOUR QUESTIONNAIRE DESIGN CHECKLIST
PDF
The eBOOK - A practical guide on how to get the most from your next survey qu...
PDF
Measuring the patient’s perspective of the benefits of diabetes interventions
PDF
How you can get the best out of your next survey questionnaire
PPTX
Turning numbers into data. workshop sample slides
PPTX
Patient and Public Engagement - Training for Peer Interviewers workshop - Sam...
PPTX
We test the quality of your health survey
PPTX
Developing implementing patient reported outcome measures for dietetics pr...
PDF
Dhp manual sample pages 02.11.12
PDF
Diabetes health profile e book development & applications 2015 v.2
PPTX
Sep 26-2013-webinar-diabetes-final-a
PPTX
Using PROs to measure secondary endpoints
PDF
Key stages in developing a diabetes patient reported experience measure (prem)
PDF
Our story of understanding of what its like living with diabetes
PDF
A selection of slides from our cognitive interview training workshop
PDF
The diabetes health profile ebook
Sample pages diabetes health profile e book development & applications 2018
Gamification for Better Survey Design and Higher ROI in Healthcare Research?
Can Gamification Increase Respondent Engagement and Provide Higher Quality Da...
How to get the most from your clinical outcome assessment (COA) measure - Tes...
YOUR QUESTIONNAIRE DESIGN CHECKLIST
The eBOOK - A practical guide on how to get the most from your next survey qu...
Measuring the patient’s perspective of the benefits of diabetes interventions
How you can get the best out of your next survey questionnaire
Turning numbers into data. workshop sample slides
Patient and Public Engagement - Training for Peer Interviewers workshop - Sam...
We test the quality of your health survey
Developing implementing patient reported outcome measures for dietetics pr...
Dhp manual sample pages 02.11.12
Diabetes health profile e book development & applications 2015 v.2
Sep 26-2013-webinar-diabetes-final-a
Using PROs to measure secondary endpoints
Key stages in developing a diabetes patient reported experience measure (prem)
Our story of understanding of what its like living with diabetes
A selection of slides from our cognitive interview training workshop
The diabetes health profile ebook

5 tips on how to select a prom for your study presentation notes

  • 1. 5 Tips on How to Select a Patient Reported Outcome Measure for your Study Presentation Notes Keith Meadows DHP Research & Consultancy Ltd In this brief audio presentation, we provide five key tips to help you select the right PROM for your study so as to maximise the possibility of finding a potential treatment benefit where one exists.
  • 2. Tip 1: Always have a hypothesis A PROM should be selected on the basis of a clear rationale as to why it is being used and formulating a hypothesis will help you to get clear in your mind what it is you want to measure and why. A hypothesis is a prediction as to what you think will happen and will be linked to the objectives of the study, patient population, disease and any intervention under evaluation. The point is that formulating a hypothesis helps you define just what it is you want to measure, from which you can then identify what would be the most appropriate patient outcome measure to choose.
  • 3. Tip 2: Ensure the content of the PROM is relevant PROMs measure a wide range of health concepts including, health status, health-related quality of life, QoL, well-being, treatment satisfaction, symptoms and functioning. Often however, PROMs are chosen on the basis of their popularity or because their name seems to be appropriate to what is going to be measured and with little attention being paid to the content of the individual items within the measure. Both these approaches should be avoided. PROMs can be generally categorised as generic and disease or condition- specific, with each having their own strengths and weaknesses. The generic PROM measures health concepts that are of relevance to a wide range of patient groups and the general population and as such can be used for comparison across different conditions as well as with healthy populations. Due however, to the generic nature of their content, they will most likely include items that are not particularly relevant to many patient groups. Also generic measures are more likely to exclude content that is of particular relevance to a specific disease group. In contrast, disease-specific or condition-specific measures have been developed to capture those elements of health and QoL of relevance to a specific patient group. Examination of the measure’s content by looking at the individual items and response options will also give a good idea as to how relevant the measure is but, most importantly the measure’s content should be based on an explicit theoretical or conceptual framework. From this you should be able to identify which items are linked to the particular health concepts that are purported to be measured.
  • 4. Tip 3: Ensure the selected measure is acceptable to your patient group In addition to establishing the relevance of the measure’s content, it’s important that the selected PROM does not pose a significant burden on the participant when completing it, resulting in the possibility of a lowered response rate. Length is of course important, the longer the measure the more likely participants will fail to complete it, however, there is evidence that participants will answer a long questionnaire if the content is perceived as being relevant to them. Synonymous with length is the time taken to complete the measure. Measures need to be completed in the shortest time and expecting participants to take half an hour or more to complete it is unreasonable and can result in lower item response and return rates. Design of the PROM can also have a significant impact on acceptability. Instruction need to be simple and clear as does the language, avoiding the use of technical jargon. Layout should not be cramped with a clear differentiation between instructions, question items and response categories.
  • 5. Tip 4: Ensure the measure has been developed with scientific rigour When selecting a PROM, it’s essential that there is evidence that its development has been carried out using appropriate methodologies and meets recognised scientific criteria in terms of reliability and validity. the PROM should be reliable in so much that it produce the same results on repeated occasions when administered to the same participants, assuming there has been no change in the measured concept? We should also look for the ability of the PROM to discriminate between patients, for example, with varying levels of health, depression and anxiety etc. When using a PROM to evaluate for example, a clinical intervention, an important requirement is its ability to detect change as a result. For example the PROM is able to demonstrate changes in score for groups of patients whose health is known to have changed as a consequence of some form of intervention.
  • 6. Tip 5: Make sure you can interpret your PROM data correctly The interpretation of PROMS data - in terms of what does a score tell us, poses a number of difficulties. For example, the concepts that PROMs are purported to assess, can mean different things to different people at different times and contexts. Also understanding the meaning of what a change or difference in a score means clinically can be problematic. You need to consider whether you have the expertise and confidence in undertaking the data analysis and interpreting just what the score might mean. If not, you might find it more beneficial to collaborate with someone who does.
  • 7. DHP Research & Consultancy Ltd www.dhpresearch.com Email: consulting@dhpresearch.com