Framing Questions for
Research with Minimal
Risks
A Psychometric Approach,
Sean Cubero, RPm
References
Creswell, J. W. (2014). Research Design: Qualitative, Quantitative and Mixed Methods Approaches (4th ed.)
Cohen−Swerdlik: Psychological Testing and Assessment: An Introduction to Tests and
Measurement, 7th edition
Kaplan - Sacuzzo Psychological Testing: Principles, Applications, and Issues 9th
Henry, David. (2012). Human Subjects Research with Vulnerable Populations with Vulnerable Populations. IHRP Human S
Training. University of Illinois at Chicago
ETHICAL
FOUNDATIONS
Ethics Defined
ETHICS: principles for guiding decision making and
reconciling conflicting values;
Ethics: process of examining moral
standards and looking at how we should
interpret and apply such standards in real
world situations; “philosophy of life”
Major approaches to Ethics
Deontology This approach states that we should identify and use
a Universal Code when making ethical decisions. An
action is either ethical or not ethical, without
exception
Deontological ethics holds that at least some acts
are morally obligatory regardless of their
consequences for human welfare
Nothing can be called good without the
qualification of Good Will- the will to do one’s
duty
Ethical Skepticism
This is the relativist viewpoint, stating that ethical
standards are not universal but are relative to one's
particular culture and time
There is no objective moral values
instead people construct their values
What is right is not universally applied to everyone,
but depends on your participant’s world view
Teleological Ethics
(Consequentialism/Utilitarianism)
A theory that the aim of action should be the largest possible balance
of pleasure over pain or the greatest happiness of the greatest
number
CORE IDEA = whether actions are morally right or wrong
depends on their effects; Morality of action is contingent on the
outcome
This is a very practical viewpoint, stating that decisions about the
ethics of a study should depend on the balance of the consequences
and benefits for the research participants and the larger society
Do the potential benefits outweigh the risks associated with this
research?
Basic Ethical
Principles
Respect for Persons (Rights & Dignity)
1.
Individual autonomy; Protection of individuals with reduced
autonomy
2. Beneficence & Non-Malificence
Maximize benefits and minimize harm;
3. Justice
Equitable distribution of research risks and benefits
4. Integrity
Maintaining competence; honest and accurate reporting
Treat individuals as autonomous agents
Do not use people as a means to an end
Allow people to make choices for themselves
Provide extra protection to those with limited
Voluntary Participation
Informed Consent
Protection of Privacy & Confidentiality
Right to Withdraw without Penalty
Respect for Persons
1.
2.
3.
4.
autonomy
Beneficence
• Acts of kindness or charity that go beyond duty
• Obligations derived from beneficence
– Do no harm
– Prevent harm
– Prevent evil
– Promote good
• Risks are justified by the benefits
• Risks are minimized
• Conflicts of interest are managed to avoid bias
• Treat people fairly
• Fair sharing of burdens and benefits of research
• Distinguish procedural justice from distributive justice
– Vulnerable subjects are not targeted for convenience
– People are not selected as subjects because of their
ease of availability or compromised position
– People who are likely to benefit are not excluded
Justice
Practical Applications
PSYCHOMETRIC
Approach
Framing Questions for Research with Minimal Risk
Biases
Unnessary and irrelevant questions
Disorganization of questions
Harm or insensitive probing
It prevents:
Begin by clearly defining the purpose of
the test and what you aim to measure.
Having a well-defined purpose will help
you create relevant and appropriate test
items
Clearly Define the Purpose of the
Questionnaire
1.
Framing Questions for Research with Minimal Risk
Framing Questions for Research with Minimal Risk
2. The Questionnaire should be Technically
Sound or Statistically Sound
VALIDITY
How well a questionnaire measures what it purports
to measure in a particular context
Involve subject matter experts (SMEs) to
validate the test's
content and relevance
3 validators usually prescribed to test it’s
technical soundness, a research expert, field
expert and a professional in the discipline.
Lawshe’s Method
Cohen−Swerdlik: Psychological Testing and Assessment: An Introduction to Tests and
Measurement, 7th edition
Rater’s responds are treated with statiscal analysis - Cronbach alpha -
inter rater reliablity
3. Ethical Approval:
If your study involves human subjects, it's crucial to obtain ethical approval
from an institutional review board (IRB) or ethics committee. This ensures
that your study adheres to ethical standards and safeguards the rights and
well-being of participants.
GATE KEEPERS ARE IMPORTANT!!
THESE COULD BE PUROK LEADERS, FIELD EXPERTS AND ETC.
4. Prioritize Informed Consent:
Ensure that participants fully understand the purpose of the study, their role,
and any potential risks or benefits. Use clear and straightforward language in
your questions.
5. Maintain Transparency:
Be transparent about the study's methodology, including
how data will be collected, analyzed, and reported.
Provide participants with a way to contact you with any
concerns or questions.
6 . Document Your Ethical Considerations:
Keep detailed records of your ethical considerations, including the steps you've
taken to minimize risks and protect participants. This documentation can be
crucial if questions or concerns arise.
Pre briefing and post briefing - in sensitive cases such as VAW - Psychologist and
Mental Experts might be Required to close the psychological wounds you might
have opened during your data gathering session.
7. Avoid Sensitive or Intrusive Questions:
Steer clear of questions that could be seen as sensitive,
personal, or invasive. Respect the privacy and dignity of
participants.
8. Minimize Potential Harm or Discomfort:
Assess the potential for physical or psychological harm or
discomfort caused by your questions. Ensure that
questions do not cause undue stress or anxiety.
Active Listening:
Empathy:
Non-Verbal Communication:, body language,
posture etc.
Reflective Listening:
Establishing Rapport: Open-Ended Questions:
Paraphrasing:
9 . Develop Clear and Concise Test Items:
Write test items that are clear, concise, and free from
ambiguity. Avoid using jargon or language that could be
confusing to test takers.
10. Consider Cultural Sensitivity:
If your test is intended for a diverse population, ensure that
test items are culturally sensitive and free from bias. Avoid
using stereotypes or culturally loaded language.
11. Pilot Test the Entire Test:
After item development, pilot test the entire test
with a representative sample to assess
12. Assess Item Difficulty and Discrimination:
Analyze item difficulty and discrimination statistics to
ensure that test items effectively differentiate between
individuals with varying levels of the construct being
measured.
Framing Questions for Research with Minimal Risk
13. Address Test Anxiety:
Minimize test anxiety by creating a comfortable
and low-stress testing environment. Consider
providing practice items to familiarize test
takers with the format.
14. Monitor and Respond to Participant Feedback:
Throughout the study, pay attention to participant
feedback and be prepared to make adjustments to
your questions or procedures if necessary.
15. Anonymize and Protect Data:
Ensure that any data collected is anonymized and
stored securely to protect the privacy of participants.
Assure participants that their responses will be kept
confidential.
Other considerations;
References
Creswell, J. W. (2014). Research Design: Qualitative, Quantitative and Mixed Methods Approaches (4th ed.)
Cohen−Swerdlik: Psychological Testing and Assessment: An Introduction to Tests and
Measurement, 7th edition
Kaplan - Sacuzzo Psychological Testing: Principles, Applications, and Issues 9th
Henry, David. (2012). Human Subjects Research with Vulnerable Populations with Vulnerable Populations. IHRP Human S
Training. University of Illinois at Chicago
Be a positive change.

More Related Content

PPTX
Ethical Standards in Testing
PPS
Lesson 19
PDF
Ethical (1).pdf
PPTX
Ethics in Assessment.pptx
PPTX
Chapter2_Psychological Science Charles Stangor
PPTX
ETHICAL STANDARDS IN TESTING.
PPTX
psychological assessment for college students
PPTX
Different kinds of test & Basic Communication and helping skills in Psycholog...
Ethical Standards in Testing
Lesson 19
Ethical (1).pdf
Ethics in Assessment.pptx
Chapter2_Psychological Science Charles Stangor
ETHICAL STANDARDS IN TESTING.
psychological assessment for college students
Different kinds of test & Basic Communication and helping skills in Psycholog...

Similar to Framing Questions for Research with Minimal Risk (20)

PDF
Psychological Testing And Assessment 10th Edition Ronald Jay Cohen
PPTX
Psych Ass Chap 6- Testing and Tests.pptx
PDF
Ise Psychological Testing And Assessment 10th Edition Mark E Swerdlik
DOCX
Running head ASSESSING A CLIENT .docx
PPT
Research ethics
PPTX
SEMINAR ON- TOOLS AND TECHNIQUES OF ASSESSMENT-Sibi (1).pptx
PPT
Chapter 2
PPTX
Ethical Issues in Assessment
PDF
HISTORICAL, CULTURAL, AND LEGAL or ETHICAL CONSIDERATIONS.pdf
PPTX
ETHICAL ISSUES IN THE CONDUCT OF RESEARCH.pptx
PPTX
The Cultural Legal and Ethical Considerations Presentation
PPT
Ethics[1]
PPTX
Materi Psikometri secara garis besar.pptx
PPTX
Testing in various areas
PPT
Chapters 3 4 5
PPTX
ethical principles in psych testing-PAP.pptx
PPTX
ethical principles in psych testing.pptx
PPTX
Ethical principles in psychological research
PPTX
Research Ethics while collecting data in the field
DOCX
I did it
Psychological Testing And Assessment 10th Edition Ronald Jay Cohen
Psych Ass Chap 6- Testing and Tests.pptx
Ise Psychological Testing And Assessment 10th Edition Mark E Swerdlik
Running head ASSESSING A CLIENT .docx
Research ethics
SEMINAR ON- TOOLS AND TECHNIQUES OF ASSESSMENT-Sibi (1).pptx
Chapter 2
Ethical Issues in Assessment
HISTORICAL, CULTURAL, AND LEGAL or ETHICAL CONSIDERATIONS.pdf
ETHICAL ISSUES IN THE CONDUCT OF RESEARCH.pptx
The Cultural Legal and Ethical Considerations Presentation
Ethics[1]
Materi Psikometri secara garis besar.pptx
Testing in various areas
Chapters 3 4 5
ethical principles in psych testing-PAP.pptx
ethical principles in psych testing.pptx
Ethical principles in psychological research
Research Ethics while collecting data in the field
I did it

Recently uploaded (20)

PDF
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PDF
International_Financial_Reporting_Standa.pdf
PDF
Weekly quiz Compilation Jan -July 25.pdf
PDF
Complications of Minimal Access-Surgery.pdf
PDF
My India Quiz Book_20210205121199924.pdf
PPTX
TNA_Presentation-1-Final(SAVE)) (1).pptx
PDF
advance database management system book.pdf
PPTX
B.Sc. DS Unit 2 Software Engineering.pptx
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
PPTX
Introduction to pro and eukaryotes and differences.pptx
PDF
Hazard Identification & Risk Assessment .pdf
PDF
Paper A Mock Exam 9_ Attempt review.pdf.
PDF
AI-driven educational solutions for real-life interventions in the Philippine...
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PPTX
History, Philosophy and sociology of education (1).pptx
PPTX
Computer Architecture Input Output Memory.pptx
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PPTX
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
PDF
FORM 1 BIOLOGY MIND MAPS and their schemes
FOISHS ANNUAL IMPLEMENTATION PLAN 2025.pdf
202450812 BayCHI UCSC-SV 20250812 v17.pptx
International_Financial_Reporting_Standa.pdf
Weekly quiz Compilation Jan -July 25.pdf
Complications of Minimal Access-Surgery.pdf
My India Quiz Book_20210205121199924.pdf
TNA_Presentation-1-Final(SAVE)) (1).pptx
advance database management system book.pdf
B.Sc. DS Unit 2 Software Engineering.pptx
Practical Manual AGRO-233 Principles and Practices of Natural Farming
Introduction to pro and eukaryotes and differences.pptx
Hazard Identification & Risk Assessment .pdf
Paper A Mock Exam 9_ Attempt review.pdf.
AI-driven educational solutions for real-life interventions in the Philippine...
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
History, Philosophy and sociology of education (1).pptx
Computer Architecture Input Output Memory.pptx
A powerpoint presentation on the Revised K-10 Science Shaping Paper
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
FORM 1 BIOLOGY MIND MAPS and their schemes

Framing Questions for Research with Minimal Risk

  • 1. Framing Questions for Research with Minimal Risks A Psychometric Approach, Sean Cubero, RPm
  • 2. References Creswell, J. W. (2014). Research Design: Qualitative, Quantitative and Mixed Methods Approaches (4th ed.) Cohen−Swerdlik: Psychological Testing and Assessment: An Introduction to Tests and Measurement, 7th edition Kaplan - Sacuzzo Psychological Testing: Principles, Applications, and Issues 9th Henry, David. (2012). Human Subjects Research with Vulnerable Populations with Vulnerable Populations. IHRP Human S Training. University of Illinois at Chicago
  • 4. Ethics Defined ETHICS: principles for guiding decision making and reconciling conflicting values; Ethics: process of examining moral standards and looking at how we should interpret and apply such standards in real world situations; “philosophy of life”
  • 5. Major approaches to Ethics Deontology This approach states that we should identify and use a Universal Code when making ethical decisions. An action is either ethical or not ethical, without exception Deontological ethics holds that at least some acts are morally obligatory regardless of their consequences for human welfare Nothing can be called good without the qualification of Good Will- the will to do one’s duty
  • 6. Ethical Skepticism This is the relativist viewpoint, stating that ethical standards are not universal but are relative to one's particular culture and time There is no objective moral values instead people construct their values What is right is not universally applied to everyone, but depends on your participant’s world view
  • 7. Teleological Ethics (Consequentialism/Utilitarianism) A theory that the aim of action should be the largest possible balance of pleasure over pain or the greatest happiness of the greatest number CORE IDEA = whether actions are morally right or wrong depends on their effects; Morality of action is contingent on the outcome This is a very practical viewpoint, stating that decisions about the ethics of a study should depend on the balance of the consequences and benefits for the research participants and the larger society Do the potential benefits outweigh the risks associated with this research?
  • 9. Respect for Persons (Rights & Dignity) 1. Individual autonomy; Protection of individuals with reduced autonomy 2. Beneficence & Non-Malificence Maximize benefits and minimize harm; 3. Justice Equitable distribution of research risks and benefits 4. Integrity Maintaining competence; honest and accurate reporting
  • 10. Treat individuals as autonomous agents Do not use people as a means to an end Allow people to make choices for themselves Provide extra protection to those with limited Voluntary Participation Informed Consent Protection of Privacy & Confidentiality Right to Withdraw without Penalty Respect for Persons 1. 2. 3. 4. autonomy
  • 11. Beneficence • Acts of kindness or charity that go beyond duty • Obligations derived from beneficence – Do no harm – Prevent harm – Prevent evil – Promote good • Risks are justified by the benefits • Risks are minimized • Conflicts of interest are managed to avoid bias
  • 12. • Treat people fairly • Fair sharing of burdens and benefits of research • Distinguish procedural justice from distributive justice – Vulnerable subjects are not targeted for convenience – People are not selected as subjects because of their ease of availability or compromised position – People who are likely to benefit are not excluded Justice
  • 15. Biases Unnessary and irrelevant questions Disorganization of questions Harm or insensitive probing It prevents: Begin by clearly defining the purpose of the test and what you aim to measure. Having a well-defined purpose will help you create relevant and appropriate test items Clearly Define the Purpose of the Questionnaire 1.
  • 18. 2. The Questionnaire should be Technically Sound or Statistically Sound VALIDITY How well a questionnaire measures what it purports to measure in a particular context Involve subject matter experts (SMEs) to validate the test's content and relevance 3 validators usually prescribed to test it’s technical soundness, a research expert, field expert and a professional in the discipline.
  • 19. Lawshe’s Method Cohen−Swerdlik: Psychological Testing and Assessment: An Introduction to Tests and Measurement, 7th edition Rater’s responds are treated with statiscal analysis - Cronbach alpha - inter rater reliablity
  • 20. 3. Ethical Approval: If your study involves human subjects, it's crucial to obtain ethical approval from an institutional review board (IRB) or ethics committee. This ensures that your study adheres to ethical standards and safeguards the rights and well-being of participants. GATE KEEPERS ARE IMPORTANT!! THESE COULD BE PUROK LEADERS, FIELD EXPERTS AND ETC.
  • 21. 4. Prioritize Informed Consent: Ensure that participants fully understand the purpose of the study, their role, and any potential risks or benefits. Use clear and straightforward language in your questions.
  • 22. 5. Maintain Transparency: Be transparent about the study's methodology, including how data will be collected, analyzed, and reported. Provide participants with a way to contact you with any concerns or questions.
  • 23. 6 . Document Your Ethical Considerations: Keep detailed records of your ethical considerations, including the steps you've taken to minimize risks and protect participants. This documentation can be crucial if questions or concerns arise. Pre briefing and post briefing - in sensitive cases such as VAW - Psychologist and Mental Experts might be Required to close the psychological wounds you might have opened during your data gathering session.
  • 24. 7. Avoid Sensitive or Intrusive Questions: Steer clear of questions that could be seen as sensitive, personal, or invasive. Respect the privacy and dignity of participants.
  • 25. 8. Minimize Potential Harm or Discomfort: Assess the potential for physical or psychological harm or discomfort caused by your questions. Ensure that questions do not cause undue stress or anxiety. Active Listening: Empathy: Non-Verbal Communication:, body language, posture etc. Reflective Listening: Establishing Rapport: Open-Ended Questions: Paraphrasing:
  • 26. 9 . Develop Clear and Concise Test Items: Write test items that are clear, concise, and free from ambiguity. Avoid using jargon or language that could be confusing to test takers.
  • 27. 10. Consider Cultural Sensitivity: If your test is intended for a diverse population, ensure that test items are culturally sensitive and free from bias. Avoid using stereotypes or culturally loaded language.
  • 28. 11. Pilot Test the Entire Test: After item development, pilot test the entire test with a representative sample to assess
  • 29. 12. Assess Item Difficulty and Discrimination: Analyze item difficulty and discrimination statistics to ensure that test items effectively differentiate between individuals with varying levels of the construct being measured.
  • 31. 13. Address Test Anxiety: Minimize test anxiety by creating a comfortable and low-stress testing environment. Consider providing practice items to familiarize test takers with the format.
  • 32. 14. Monitor and Respond to Participant Feedback: Throughout the study, pay attention to participant feedback and be prepared to make adjustments to your questions or procedures if necessary.
  • 33. 15. Anonymize and Protect Data: Ensure that any data collected is anonymized and stored securely to protect the privacy of participants. Assure participants that their responses will be kept confidential.
  • 35. References Creswell, J. W. (2014). Research Design: Qualitative, Quantitative and Mixed Methods Approaches (4th ed.) Cohen−Swerdlik: Psychological Testing and Assessment: An Introduction to Tests and Measurement, 7th edition Kaplan - Sacuzzo Psychological Testing: Principles, Applications, and Issues 9th Henry, David. (2012). Human Subjects Research with Vulnerable Populations with Vulnerable Populations. IHRP Human S Training. University of Illinois at Chicago
  • 36. Be a positive change.