Research challenges

Editor's Notes

• #2: Thank you for inviting for me for interview. As asked I’m going to present on what I believe are the main challenges in undertaking educational research and training evaluation. This presentation will last no more than ten minutes however I do have more to say on the topic, drawn from my wide experience in research so I hope we can explore that more in follow up questions.
• #3: To outline the presentation I’m going to speak about what I believe are the three central challenges in undertaking educational research and explain how each of these can be overcome, or a least, be well managed. First I will explain the challenge posed by lacking clarity on the aims and the central questions of the research. Secondly I will address the challenge of using the appropriate research methods to actually answer your central research question. Finally I will speak about the challenges of effective data analysis and presentation.
• #4: A critical challenge for any research project is setting a clear and achievable aim, which then can be fulfilled by specific and answerable questions. This is particularly important for education research and trainingevaluation, where determining which aspects to asses or evaluate will very likely mean that assessing other aspects is not possible. Even simple projects will have multiple stakeholders and can easily suffer from too many or over ambitions research questions, loading the project with conflicting expectations. The second aspect to consider is how achievable and answerable each research question is. For example a project might try to determine the impact of a training programme on learners. However impacts of a training course are very difficult to determine in isolation, and disentangle from other effects away from the course. Within training evaluations it would very unusual to have a comparison group who did not attend the training or large scale quantitative data to determine differences. Therefore some compromise on what and how can be credibly ascertained is to be expected. For example within my prior research work I was involved on a project to determine the impact of a soft skills training course for work place learners. The project accepted that given the elusive nature of this impact it would have to be evaluated via the views of the learners themselves and their line mangers, rather than any objective measure. Challenges around central project aims can be managed by a few strategies. Firstly to set a central research question that can actually be answered it is best to remain limited and specific. attempting to answering large questions or too many questions stretches credibility. This focussed approach requires that discussions take place with stakeholders' agreeing with what you are going to do but also what you are not going to be exploring in the project. This dovetails into a careful consideration of the time, methods and resources available to you. For example within my most recent research project to evaluating the soft skills course, it was possible to conduct interviews with learners after their course, with a follow up interview at six months, but not at 12 months due to the timescale of the project.
• #5: The second challenge I want to highlight is the appropriate selection of methods. Fundamentally the methods selected should be those that answer the research questions. However many researchers fall into the trap of using methods they have used before and are comfortable with and therefore struggle to adapt the data they gather to be relevant to their research project. Some methods may discourage participation in the project due to the time required or do not capture the data within those who do participate as they are inappropriate for a particular topic.For example long form one on one interviews are suitable for personal and sensitive topics. However they may not be the best match for evaluating a training course, which is a more everyday experience and which people may not have reflected upon. in my last project I found some interview participants could speak about their biography and career at length but did not have much to say about their recent training course. For these participants I would have liked to organised a focus group or a group interview where participants could share, compare and contrast experiences, and generating discussion between themselves which they could not in isolation. To manage these problems researchers should ask whether methods can truly answer the question posed. The design should come out of the study, rather than being imposed on the study.Matching methods to aims may require imagination , the creatively to use a new method, or the flexibility to adapt an existing one. Also researchers should consider the practical aspects of participation, what the experience of this participation would be and what data it will generate.
• #6: The final challenge I present here is that of the analysis and presentation of findings.Often within quantitative methods there is a danger of using overly complex analysis, for which the collected datais unsuitable. Also with qualitative data, researchers might find that they have too much data to review and summarise into concise findings.Also there is a possibility that the presented research does not communicate to its intended audience, either by being too long, too confusing or inaccessible. To move quantitative analysis away from overly complex methods the project may need to refocus upon its aims and perform only the analysis that will meet these. Also remember that complex analysis performed poorly is weaker compared to simple analysis performed well.To manage large amounts of qualitative data researchers should be analysing data as its collected so that this is a continuing process which is much more manageable.To ensure succesfil dissemination, researchers should presentfindings in different avenues,supplementing long reports, with shorter versions, videos posted on you tube, presentations and slideshows and short leaflets that speak simply to targeted audiences.
• #7: To conclude research challenges in educational research can be overcome by Clear aims, matched with appropriate research methodsPractical and focussed approach to methods , including consideration of what participation involvesAnalysis continually centred on the research questions, with findings presented to communicate
• #9: Classic trap of reserachers using the methods they are most comfortable, have used before.
• #10: NES Patient Safteyinitative ; measure reduction in adverse eventsSignificant event analysis training or patietn data trainingPerson centred care, persuation and negoationaitng skillsChecklists
• #23: To outline the presentation I’m going to speak about what I believe are the three central challenges in undertaking educational research and explain how each of these can be overcome, or a least be well managed. First I will explain the challenge posed by lacking clarity on the aims and the central questions of the research. Second I will argue that matching the appropriate research method to your central question is critical to success particularly in enabling the best type of participation and data capture and how this is particularly important for educational research. Finally I will speak about the challenges of making the most of research by effective data analysis and presention