Refining research question2010
- 1. Refining Your Research Question
- 2. In this session, we will… Discuss guidelines for creating a ‘good’ research question Provide time to revisit and revise your research questions and plans Consider appropriate methods for investigating your research question(s)
- 3. Guiding Principles for Scientific Research in Education Question : pose significant question that can be investigated empirically Theory : link research to relevant theory Methods : use methods that permit direct investigation of the question Reasoning : provide coherent, explicit chain of reasoning Replicate and generalize across studies Disclose research to encourage professional scrutiny and critique National Research Council, 2002
- 4. Why are research questions important? “ Well-crafted questions guide the systematic planning of research. Formulating your questions precisely enables you to design a study with a good chance of answering them.” -- Light, Singer, Willett, By Design (1990)
- 5. A good research question will… be clearly linked to overall project goal allow the target population to be identified guide the appropriate level of aggregation (e.g. class, course, curriculum, institution)
- 6. A good research question will… identify the outcome variables and key predictors of those variables determine what type of study is needed (e.g. descriptive, relational, experimental) identify background characteristics that might influence outcomes
- 7. A good research question will… raise questions about how to best collect data influence the number of participants in the study
- 8. Writing a good question… What do you want to learn about? Draft and redraft with increasing specificity using the 8 guidelines listed earlier Ask for feedback from colleagues Build on the work of others by conducting a systematic literature review
- 9. What is the question? What research and instructional designs? What data collection methods? How to analyze and interpret data? Are findings valid and generalizable? What are the next questions? WHO? What evidence will we accept?
- 10. Causation vs. Correlation Correlation – association between independent and dependent variables Causation – relationship between independent and dependent variables such that a change in an independent variable (predictor) will change the dependent variable (outcome) in a known way
- 11. An Example Many studies have established a direct relationship between student height in elementary school and reading level Correlation? Causal effect? look for factors not included in the correlation
- 12. Research Methods
- 14. Theoretical Framework • Ausubel 1968; meaningful learning • Novak 1998; visual representations • King and Kitchner 1994; reflective judgment • National Research Council 1999; theoretical frameworks for assessment Multiple Choice … … Concept Maps … … Essay … … Interview high Ease of Assessment low low Potential for Assessment of Learning high Assessment Gradient
- 15. “ Few faculty members have any awareness of the expanding knowledge about learning from psychology and cognitive science. Almost no one in the academy has mastered or used this knowledge base. One of my colleagues observed that if doctors used science the way college teachers do, they would still be trying to heal with leeches." J.J. Duderstadt (2001), president emeritus of the University of Michigan, in "A University for the 21st Century."
- 16. Exercise Individually, for each of the research questions in the handout, determine: if the question meets the 8 guidelines discussed earlier suggestions for improving the question Share your results with a neighbor Be prepared to report to the full group
Editor's Notes
- #17: RREE workshop -- 2004