Miw Slides Week 3 Real Eval (Versie 7)
Download as PPTX, PDF0 likes285 views
1. Realistic evaluation takes a theory-driven approach to understanding what works for whom in what circumstances by examining the inner workings of programs and policies within the complex social systems they are embedded in. 2. When evaluating the use of CCTV surveillance in car parks, a realistic evaluation would develop hypotheses about the contexts, mechanisms, and outcomes, and test them empirically rather than just comparing crime rates before and after implementation. 3. The evaluation would hypothesize about the contexts like criminal clustering, alternative targets, and surveillance culture as well as mechanisms like being caught in the act, publicity, and appealing to be cautious to understand how and why CCTV may influence behavior in certain situations.
Miw Slides Week 3 Real Eval (Versie 7)
- 1. Evaluation of the Intervention!\orRealisticEvaluationafteryourtakingaction in the problemsituation
- 2. TwoperspectivesonrealityPoliticianPrisonsWork!EvaluatorWhat is it in the infinite complex social system of prisonsthatmakepeoplechangetheirbehaviour
- 3. Fallacies of Experimental EvaluationWhatcausessomething to happen has nothing to do with the number of timesit happens (Sayer, 1992, p.165)Sayer, A.R., ‘Method in social science, a realist approach’, Routledge, London, 1992
- 5. Trivial?ICIS, December 2007MISQ, December 2004
- 6. Why Realist EvaluationDeparture: Social problems are embedded in a stratified realityRationale: Not repeating programs as a craft, but evaluating program theories as epistemic devicesGenerative causality: Knowing what works for whom in what circumstances (resources and reasoning)Realistic: Don’t study the program, study the inner workings
- 7. Theory-drivenEvaluationCMxyRGenerativeRegularityPawson, R. and Tilley, N., ‘RealisticEvaluation’, Sage, ThousandOaks, California, 1997
- 8. PrisonWorkings!CM Prison education (x) leads a reduction in recidivism (y) Reasoning or Resources M1: self-realization • M2: last chance M3: second chance M4: social acceptability • M5: moral or civic responsibility M6: cognitive change ‘Certain type of prisoner’ C1: Disadvantaged • C2: The crime committed (pedophilia, pyromania) C3: First Offenders C4: Youth prisons, Isolation Cells, Federal Prisons, Death sentenced• mediocre hypothesisxyRPawson, R. and Tilley, N., ‘RealisticEvaluation’, Sage, ThousandOaks, California, 1997
- 9. Another Wicked Problem: Multiple ExplanationsMaking sense of it:Theory adjudication weeding out rival explanations, with focus on improvementConfigurational application in practiceMiddle-range transferability; patterns of repeat victimizationProvisional tested but not proven; soft system and wicked problemsPawson, R. and Tilley, N., ‘Realist Evaluation’, in S Mathison (ed.), Encyclopedia of Evaluation, Sage, Thousand Oaks, California, 2004
- 10. Fitness for MIWThe upside of Realistic EvaluationDealing with real or wicked problems
- 11. Design needs EvaluationDid the intended outcome actually materialize?The downsideNo clear-cut recipe
- 12. Difficult language and conceptsCamera-surveillance in Car ParksA form of situational crime preventionVisual surveillance technology monitoring variety of environments/activitiesGrowth estimated at 15-20% per year (Davies, 1996)In car parks CCTV is used to prevent and reduce crime
- 13. OpdrachtExperimenteleEvaluatieCamera’s werken!RealistischeEvaluatie (opdracht): Wat is het in cameratoezichtwaardoormensenhungedragaanpassenBedenk de mechanismesBedenk de contexten
- 15. Style of usage
- 16. Lie of the land
- 18. Resources
- 19. Surveillance CultureMechanismenCaught in the actYou’ve been framedNosyparkerEffectivedeploymentPublicitymechanismTime for crimeMemory joggingAppeal to becautious
- 20. Do youbelievethatHypothesizingaboutcontexts, mechanisms and outcomes and testing these empirically Is more valuablethanComparing the rates of crime before and afterCCTVThen we succeeded