Week 5 Assignment: Analyze Observations,
Interviews, Focus Groups, and Document Reviews
log Teaching and Learning
Orlanda Haynes
North Central University
School of Education
Ed. D Student
EDR8204-5 - summer 2018
Copyright Note: All images used in this presentation have been confirmed to be either in the
public domain, of expired copyright status, licensed under the GNU Free Documentation
License, or using creative commons license
Qualitative Research
Common methods include:
• Direct observation,
• Individual interviews,
• Focus group interviews, and
• Document analysis
Qualitative Research
A Direct Observation
• Captures participants’ routines in
real-time and in natural settings
• Excludes preconceived notions,
therefore raw data are objectives
• Provides insights about elusive
phenomena not readily noticeable
or identifiable (e.g. unconscious
behaviors)
An Individual Interview
• Structured
• Semi-structured
• Unstructured
A Focus Group Interview
Interviewing Best Practices
• Create broad, grounded structured
or semi-structured questions
• Control for appropriate verbal and
nonverbal communication
including tones
• Be conscientious of sensitive
subject matters and gender related
issues
Document Analysis
Document Analysis: Common Issues and Challenges
•Locating and obtaining
relevant materials
•Journaling problems (e.g.,
data errors, legibility)
•Controls for anonymity
•Sharing of personal
information, and
•Ethical issues
Mertin (2014)
Direct
Observation
Hibbert et al. (2014)
An Individual
Interview
Guest et al. (2017)
Focus Group Interviews
Suto (2014)
Document
Analysis
Week 5 Assignment: Analyze Observations, Interviews, Focus
Groups, and Document Reviews
Questions /Thoughts/ Comments
References
Creswell, J. W. (2013). Qualitative inquiry and research design: Choosing
among five approaches. Thousand Oaks, CA: Sage Publications.
Creswell, J.W. (2012). Educational research: planning, conducting and
evaluating quantitative and qualitative research (4th Ed.). Boston, MA: Pearson
Education Inc.
Curran, J., Cassidy, C., McNeil, K., & Osmond, M. (2014). Comparing
individual interviews and focus groups as qualitative data collection methods.
International Journal of Qualitative Methods, 13500-501.
References
• Dyson, J. & Mills, D. (Academic). (2017). David Mills and Jane Dyson
discuss ethnography [Streaming video]. Retrieved from SAGE Research
Methods.
• Guest, G., Namey, E., Taylor, J., Eley, N., & McKenna, K. (2017). Comparing
focus groups and individual interviews: findings from a randomized study,
International Journal of Social Research Methodology, (20)6, 693-708.
doi:10.1080/13645579.2017.1281601
References
Hibbert, K., Lingard, L., Vanstone, M., Kinsella, E. A., McKenzie, P., Pitman,
A., & Wilson, T. D. (2014). The quest for effective interdisciplinary graduate
supervision: A critical narrative analysis. Canadian Journal of Higher
Education, 44(2), 85-104.
Lodico, M., Spaulding, D., & Voegtle, K. (2010). Methods in educational
research: From theory to practice (Laureate Education, Inc., custom ed.). San
Francisco: John Wiley &Sons.
References
Mertin, P. A. (2014). The role of the culture of Japanese students in acquisition of
academic English: An ethnographic study. Retrieved from
http://journals.sagepub.com.proxy1.ncu.edu/doi/pdf/10.1177/1475240914553388
Guest, G., Namey, E., Taylor, J., Eley, N., & McKenna, K. (2017) Comparing
focus groups and individual interviews: findings from a randomized study,
International Journal of Social Research Methodology, 20:6, 693-708, DOI:
10.1080/13645579.2017.1281601
References
Suto, I. (2012). A critical review of some qualitative research methods used to
explore rater cognition. Educational Measurement: Issues & Practice, 31(3),
21-30. doi:10.1111/j.1745-3992.2012.00240.x

More Related Content

PPTX
Dissertation defense ppt
PPT
Proposal defense
PPTX
ASHE 2010 - Course Evaluation Nonresponse
PPTX
Formative assessment and increased student involvement increases grades in Bi...
PPTX
EDR 8204 Week 1 Assignment: Analyze Case Study Designs
PPT
Online course evaluations: Nonresponse and ClassEval in Fall 2009
PPTX
Linder.so me classrooms.sacsa
PPT
Oral defense presentation_Ennis Brinson
Dissertation defense ppt
Proposal defense
ASHE 2010 - Course Evaluation Nonresponse
Formative assessment and increased student involvement increases grades in Bi...
EDR 8204 Week 1 Assignment: Analyze Case Study Designs
Online course evaluations: Nonresponse and ClassEval in Fall 2009
Linder.so me classrooms.sacsa
Oral defense presentation_Ennis Brinson

What's hot (20)

PDF
Daniels Presentation
PPTX
TSL3133 Topic 12 Quantitative Data Analysis
PPT
Denduang 606 Final Pp Ready
PPTX
Developing assessment patterns that work through TESTA
PPT
Claudia Adams, Neda Zdravkovic, Josta Heyligers EBLIP 8 presentation July 2015
PPTX
Feedback for self-regulation
DOC
Updated_CURRICULUM_VITAE2015
PPTX
Push back Sisyphus! Connecting feedback to learning
PPTX
Does Participation in a Post-secondary Honors Program Result in a Penalty?
PPTX
Why a programme view? Why TESTA?
PPT
Undergrad Learning Style Preferences
PPT
HKBU Peer Feedback May 2017
PPT
Peer feedback dialogues
PPTX
TSL3133 Topic 8 Data Collection Methods
PPT
Thesis.ballew
PPTX
TSL3133 Topic 11 Qualitative Data Analysis
PPTX
Making history in the digital age apt2014 presentation v3
PPTX
Action research proposal ppt
PPT
Implementing peer feedback
PPT
Excellence in University Assessment
Daniels Presentation
TSL3133 Topic 12 Quantitative Data Analysis
Denduang 606 Final Pp Ready
Developing assessment patterns that work through TESTA
Claudia Adams, Neda Zdravkovic, Josta Heyligers EBLIP 8 presentation July 2015
Feedback for self-regulation
Updated_CURRICULUM_VITAE2015
Push back Sisyphus! Connecting feedback to learning
Does Participation in a Post-secondary Honors Program Result in a Penalty?
Why a programme view? Why TESTA?
Undergrad Learning Style Preferences
HKBU Peer Feedback May 2017
Peer feedback dialogues
TSL3133 Topic 8 Data Collection Methods
Thesis.ballew
TSL3133 Topic 11 Qualitative Data Analysis
Making history in the digital age apt2014 presentation v3
Action research proposal ppt
Implementing peer feedback
Excellence in University Assessment
Ad

Similar to EDR 8204 Week 5 Assignment (20)

PPTX
S2. research design
PPTX
S2. research design
PPTX
Methods of Data Collection for Qualitative Research.pptx
PPTX
1Data Collection and Analysis Procedures .pptx
PDF
Unit 2 Qualitative Method.pdf
DOCX
EED 20
PDF
Qualitative Research 001.pdf
PPTX
Qualitative research
PPTX
research.pptx
PPTX
Qualitative Research Designs.pptx
PPTX
Qualitative researcghhghghghguyyguuyh.pptx
PPTX
Qualitative research, types, data collection and analysis
PPTX
Scientific Approaches in Qualitative Research.pptx
DOCX
Qualitative Research.docx
PPTX
Qualitative research
PDF
qualitative research final.pdf
PDF
Research in stenden masters 2014
PPTX
Rsi 26 5-solooooooo
PPTX
Introduction to Qualitative Research: An Overview
PPTX
Qualitative Research
S2. research design
S2. research design
Methods of Data Collection for Qualitative Research.pptx
1Data Collection and Analysis Procedures .pptx
Unit 2 Qualitative Method.pdf
EED 20
Qualitative Research 001.pdf
Qualitative research
research.pptx
Qualitative Research Designs.pptx
Qualitative researcghhghghghguyyguuyh.pptx
Qualitative research, types, data collection and analysis
Scientific Approaches in Qualitative Research.pptx
Qualitative Research.docx
Qualitative research
qualitative research final.pdf
Research in stenden masters 2014
Rsi 26 5-solooooooo
Introduction to Qualitative Research: An Overview
Qualitative Research
Ad

More from eckchela (20)

PDF
Aspen University EDD830 Module 5 Discussion Question
PDF
EDD830-Leadership Theory: Module 3 Assignment
PDF
Why is leadership a key issue in management?
PDF
DPSY-6215-2 and PSYC-6215-2: Week 10 Discussion
DOCX
Walden University DPSY 6215/8215
PDF
DPSY 8215/ PSY Week 5 Discussion: Infancy and Childhood
PDF
DPSY 6215-2/ PSYC 6215-2 Week 2: Social and Cognitive Development
PDF
DPSY 6121/8121 Week 11 Dscussion
PDF
DPSY 6121-8121 Week 10 Final Project: Mitigation Plan
PDF
DPSY Week-9 Discussion 2: Generational Differences
PDF
DPSY 6121/8121 Discussion Week 7: Cyber-Victimization
PDF
DPSY 5111 6121-8121 Week 6 Discussion
PDF
DPSY 6121-8121-5121 Week 5 Discussion 1
PPTX
EL-7010 Week 1 Assignment: Online Learning for the K-12 Students
PDF
DPSY 5111-6111 Week 3 Assignment: Final Project: Mitigation Plan
PPTX
EDR 8204 Week 3 Assignment: Analyze Action Research
DOCX
DPSY 8111/6112 Week 5 Assignment
PDF
DPSY-8111-DPSY 6111 Week 10 Project: Retirement Issues
PDF
Thread: Discussion - Week 8 – DPSY-6111-1/DPSY-5111-1
PDF
Thread: Discussion 1 - Week 7 – DPSY-6111-1/DPSY-5111-1
Aspen University EDD830 Module 5 Discussion Question
EDD830-Leadership Theory: Module 3 Assignment
Why is leadership a key issue in management?
DPSY-6215-2 and PSYC-6215-2: Week 10 Discussion
Walden University DPSY 6215/8215
DPSY 8215/ PSY Week 5 Discussion: Infancy and Childhood
DPSY 6215-2/ PSYC 6215-2 Week 2: Social and Cognitive Development
DPSY 6121/8121 Week 11 Dscussion
DPSY 6121-8121 Week 10 Final Project: Mitigation Plan
DPSY Week-9 Discussion 2: Generational Differences
DPSY 6121/8121 Discussion Week 7: Cyber-Victimization
DPSY 5111 6121-8121 Week 6 Discussion
DPSY 6121-8121-5121 Week 5 Discussion 1
EL-7010 Week 1 Assignment: Online Learning for the K-12 Students
DPSY 5111-6111 Week 3 Assignment: Final Project: Mitigation Plan
EDR 8204 Week 3 Assignment: Analyze Action Research
DPSY 8111/6112 Week 5 Assignment
DPSY-8111-DPSY 6111 Week 10 Project: Retirement Issues
Thread: Discussion - Week 8 – DPSY-6111-1/DPSY-5111-1
Thread: Discussion 1 - Week 7 – DPSY-6111-1/DPSY-5111-1

Recently uploaded (20)

PPTX
20th Century Theater, Methods, History.pptx
PDF
Environmental Education MCQ BD2EE - Share Source.pdf
PDF
Complications of Minimal Access-Surgery.pdf
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
International_Financial_Reporting_Standa.pdf
PDF
Uderstanding digital marketing and marketing stratergie for engaging the digi...
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PDF
FORM 1 BIOLOGY MIND MAPS and their schemes
PDF
My India Quiz Book_20210205121199924.pdf
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PDF
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
PDF
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PPTX
Unit 4 Computer Architecture Multicore Processor.pptx
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 2).pdf
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
20th Century Theater, Methods, History.pptx
Environmental Education MCQ BD2EE - Share Source.pdf
Complications of Minimal Access-Surgery.pdf
LDMMIA Reiki Yoga Finals Review Spring Summer
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
Chinmaya Tiranga quiz Grand Finale.pdf
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
International_Financial_Reporting_Standa.pdf
Uderstanding digital marketing and marketing stratergie for engaging the digi...
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
FORM 1 BIOLOGY MIND MAPS and their schemes
My India Quiz Book_20210205121199924.pdf
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
A powerpoint presentation on the Revised K-10 Science Shaping Paper
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
Unit 4 Computer Architecture Multicore Processor.pptx
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 2).pdf
Practical Manual AGRO-233 Principles and Practices of Natural Farming

EDR 8204 Week 5 Assignment

  • 1. Week 5 Assignment: Analyze Observations, Interviews, Focus Groups, and Document Reviews log Teaching and Learning Orlanda Haynes North Central University School of Education Ed. D Student EDR8204-5 - summer 2018 Copyright Note: All images used in this presentation have been confirmed to be either in the public domain, of expired copyright status, licensed under the GNU Free Documentation License, or using creative commons license
  • 2. Qualitative Research Common methods include: • Direct observation, • Individual interviews, • Focus group interviews, and • Document analysis
  • 4. A Direct Observation • Captures participants’ routines in real-time and in natural settings • Excludes preconceived notions, therefore raw data are objectives • Provides insights about elusive phenomena not readily noticeable or identifiable (e.g. unconscious behaviors)
  • 5. An Individual Interview • Structured • Semi-structured • Unstructured
  • 6. A Focus Group Interview
  • 7. Interviewing Best Practices • Create broad, grounded structured or semi-structured questions • Control for appropriate verbal and nonverbal communication including tones • Be conscientious of sensitive subject matters and gender related issues
  • 9. Document Analysis: Common Issues and Challenges •Locating and obtaining relevant materials •Journaling problems (e.g., data errors, legibility) •Controls for anonymity •Sharing of personal information, and •Ethical issues
  • 11. Hibbert et al. (2014) An Individual Interview
  • 12. Guest et al. (2017) Focus Group Interviews
  • 14. Week 5 Assignment: Analyze Observations, Interviews, Focus Groups, and Document Reviews Questions /Thoughts/ Comments
  • 15. References Creswell, J. W. (2013). Qualitative inquiry and research design: Choosing among five approaches. Thousand Oaks, CA: Sage Publications. Creswell, J.W. (2012). Educational research: planning, conducting and evaluating quantitative and qualitative research (4th Ed.). Boston, MA: Pearson Education Inc. Curran, J., Cassidy, C., McNeil, K., & Osmond, M. (2014). Comparing individual interviews and focus groups as qualitative data collection methods. International Journal of Qualitative Methods, 13500-501.
  • 16. References • Dyson, J. & Mills, D. (Academic). (2017). David Mills and Jane Dyson discuss ethnography [Streaming video]. Retrieved from SAGE Research Methods. • Guest, G., Namey, E., Taylor, J., Eley, N., & McKenna, K. (2017). Comparing focus groups and individual interviews: findings from a randomized study, International Journal of Social Research Methodology, (20)6, 693-708. doi:10.1080/13645579.2017.1281601
  • 17. References Hibbert, K., Lingard, L., Vanstone, M., Kinsella, E. A., McKenzie, P., Pitman, A., & Wilson, T. D. (2014). The quest for effective interdisciplinary graduate supervision: A critical narrative analysis. Canadian Journal of Higher Education, 44(2), 85-104. Lodico, M., Spaulding, D., & Voegtle, K. (2010). Methods in educational research: From theory to practice (Laureate Education, Inc., custom ed.). San Francisco: John Wiley &Sons.
  • 18. References Mertin, P. A. (2014). The role of the culture of Japanese students in acquisition of academic English: An ethnographic study. Retrieved from http://journals.sagepub.com.proxy1.ncu.edu/doi/pdf/10.1177/1475240914553388 Guest, G., Namey, E., Taylor, J., Eley, N., & McKenna, K. (2017) Comparing focus groups and individual interviews: findings from a randomized study, International Journal of Social Research Methodology, 20:6, 693-708, DOI: 10.1080/13645579.2017.1281601
  • 19. References Suto, I. (2012). A critical review of some qualitative research methods used to explore rater cognition. Educational Measurement: Issues & Practice, 31(3), 21-30. doi:10.1111/j.1745-3992.2012.00240.x

Editor's Notes

  • #2: [Read out-loud]. Hello, everyone! I am Orlanda Haynes. This presentation is an introduction to four qualitative data collection methods: Observations, interviews, focus groups, and document analysis. To show how researchers, use these tools, articles by Mertin (2014); Hibbert, Lingard, Vanstone, Kinsella, McKenzie, Pitman, and Wilson, (2014); Guest, Namey, Taylor, Eley, and McKenna, (2017); and Suto (2012) will serve as illustrations. Literature includes qualitative research: Data collection; qualitative research: Types of observations; direct observation; an individual interview; a focus group interview; Interviewing best practice; document analysis; document analysis: Common issues and challenges; and a data collection analysis of Mertin (2014), Hibbert et al. (2014), Guest et al (2017), and Suto (2012) articles. A session for questions, thoughts, and comments will follow the discussion, and brochures, which include a references list, are at the refreshment booth. Now, let us begin.
  • #3: [ Read out-loud]. Data collection refers to methods researchers deploy to seek answers to research issues or problems. To begin the process, they define specific research questions that guide the inquiry; then, they select data collection tools most suitable for gathering information about the phenomena (Creswell, 2013). In qualitative designs, direct observation, individual and focus group interviews, and document analysis are common data collection tools (Lodico, Spaulding, & Voegtle, 2010). 
  • #4: [Read out-loud]. Although there are several types of observation, this discussion includes literature on direct observation, as noted in the next slide.
  • #5: [Read out-loud]. However, a key factor to consider is, the interconnected relationships between researchers and participants could pose bias issues (e.g., researchers’ influence), and the approach is more expensive than other qualitative methods (Creswell, 2013; (Lodico, Spaulding, & Voegtle, 2010). 
  • #6: [Read speaker notes and slide out-loud]. When the nature of a phenomenon cannot be explored through observations or document analysis, individual interviews are common qualitative strategies (Creswell, 2013). They help researchers gain knowledge about humans’ perceived perceptions and ideologies to name a few. Interview formats range from structured, semi-structured, to unstructured. Researchers can conduct an interview one or more times, and settings can be formal or informal and include an individual or a small group (Creswell, 2013). Interviewers use the first approach (primarily close-ended questions) to obtain highly relevant information. Semi-structured strategies include closed and open-ended questions, which allow for a balance between receipt of necessary information and a discussion about unexpected feelings and thoughts. On the other hand, the latter format allows for an in-depth, free flow of information about the phenomenon or problem. The primary limitation is that the approach relies on human perceptions, which is subjective and therefore data is not generalizable (Lodico, Spaulding, & Voegtle, 2010).
  • #7: [Read out-loud]. Focus groups are small, usually consist of less than 10 people, and use a moderator (Guest, Namey, Taylor, Eley & McKenna, 2017). Their primary purpose is to gauge opinions, gather ideals and information about products and services prior to and doing the development cycle, and to identify audiences for products and services (Creswell, 2013). However, a major limitation is the potential for “group think.” A situation in which one or more members feel pressured by others in the group to conform to a group opinion (Curran, Cassidy, McNeil, & Osmond, 2014; Guest, Namey, Taylor, Eley & McKenna, 2017)
  • #8: [Read slide and speaker note out-loud]. Moreover, researchers should (a) Be active listeners, (b) Protect participants’ identity and personal information, and (c) Develop a secure, data storage system (Creswell, 2013; Lodico, Spaulding, & Voegtle, 2010). 
  • #9: [Read out-loud]. The collection of data from written artifacts refers to document analysis or document reviews. In ethnography and case study inquiries, researchers have other document options, such as blogs, photos, web-based contents, artworks, and crafts, as well as graffiti (Creswell, 2013). A primary advantage is that these tools give insights that would, in most instances, be unavailable to researchers, make available information that researchers and participants may not be aware of, and they allow for historical insights and perspectives (Creswell, 2013; Lodico, Spaulding, & Voegtle, 2010).   
  • #10: (Read out-loud speaker notes [first] and then slide content). In most instance, document analysis provides researchers with rich, in-depth sources of data that they cannot obtain through other means. However, problems common to this method include: (read slide content) (Creswell, 2013; Lodico, Spaulding, & Voegtle, 2010). 
  • #11: [Read out-loud]. Appropriateness of the Data Collection Strategy to the Research Design Using an ethnographic design to explore how Japanese culture affects students’ ability to readily grasp English language skills, Mertin (2014) data collection method included direct observation. An ethnography framework is based on best practices principles for studying cultures—groups with shared beliefs and cultural values (Creswell, 2012; Dyson, & Mills, 2017). Data Collection Strategy and the Research Question(s) The aim of the research was to discover if social/cultural constructs negatively affected Japanese students’ ability to readily grasp English language skills. Direct observation data collection strategy was appropriate for the research design (Creswell, 2012; Dyson, & Mills, 2017).
  • #12: [Read out-loud]. Appropriateness of the Data Collection Strategy to the Research Design According to Hibbert et al., “. . . a critical narrative approach positions us to organize and explore multiple perspectives . . . between student and supervisor within institutional and sociocultural contexts” (p.4). Individual interviews are common data collection methods used in narrative research designs (Lodico, Spaulding, & Voegtle, 2010).  Data Collection Strategy and the Research Question(s) The following questions guided Hibbert et al. (2014) research inquiry and interview format: How are those of us working in ID supervisory contexts faring in our efforts to raise a new generation of ID knowledge builders? How do interdisciplinary supervisory relationships unfold in this context? How are epistemological and paradigmatic borders negotiated? What structures or discourses support and constrain the practice of interdisciplinary graduate supervision? (p.3). How did you become involved in interdisciplinary search? Tell me about your experiences working (as a graduate student/supervisor) in your graduate program in an ID context. What went well? What could have gone better? How was it different from your disciplinary graduate experiences? (p. 6). As shown, the nature of these questions involves human perceptions, beliefs, and opinions. Therefore, interviews are proper data collection tools (Creswell, 2012).  
  • #13: [Read out-loud]. Appropriateness of the Data Collection Strategy to the Research Design Guest, Namey, Taylor, Eley, and McKenna (2017) deployed a focus group to explore its ability to generate unique information and personally sensitive disclosures in brainstorming activities. Data Collection Strategy and the Research Question (s) The researchers used 13 research questions; four of which are: How long have you lived in Durham, and have you seen a physician in the past year? (Warm-up question) What do you think are the most common health problems in the African American community in Durham? (Free-listing question) Let’s imagine that I’m new to this country and have never interacted with the medical system here. Describe for me what a typical doctor visit is like. How do you feel about the typical doctor visit here, as you’ve described it? (p.8). The nature of focus groups is to gather information (including customer opinions) about products and services prior to and doing the development process (Curran, Cassidy, McNeil, & Osmond, 2014; Guest, Namey, Taylor, Eley & McKenna, 2017).
  • #14: [Read out-loud]. Appropriateness of the Data Collection Strategy to the Research Design Suto (2012) deployed qualitative data collection methods including document analysis to explore rater cognition (people who score/rate students’ work). Document analysis allows researchers to give insights that would, in most instances, be unavailable to researchers, make available information that researchers and participants may not be aware of, and they allow for historical insights and perspectives (Creswell, 2013; Lodico, Spaulding, & Voegtle, 2010).  Data Collection Strategy To get insights on what qualitative data collection methods researchers have previously used to explore rater cognition, Suto’s research team analyzed an array of research documents including primary and secondary studies.  
  • #15: [Read out-loud]. This concludes the presentation. Let’s take a few moments for questions, thoughts, or comments.