Impacting Perceptions of Practitioners for a Refined Understanding of Educational Systemic Change through a Practitioner Focused On-line Presence
Download as PPTX, PDF1 like2,845 views
This document summarizes a usability study conducted on a website about educational systemic change. The study involved surveying 57 practitioners about their experience using the website. Key findings include that practitioners found the website content to be useful and relevant for understanding systemic change. However, some suggested improvements like adding more examples, strategies and success stories. Overall, participants expressed interest in learning more about systemic change and many said they would recommend the website to colleagues. The conclusions indicate the website generates interest in systemic change but that some design and content changes may further improve its usefulness.
Impacting Perceptions of Practitioners for a Refined Understanding of Educational Systemic Change through a Practitioner Focused On-line Presence
- 1. Educational Systemic Change Beth Rajan Sockman, Ph.D. East Stroudsburg University Anthony Chow, Ph.D. University of North Carolina at Greensboro Sinem Aslan, Ph. D. Principal Investigator, Intel Corporation Kurt Richter, Ph.D. UNC Charlotte Ashley Scott M.Ed. Syracuse University Impacting Perceptions of Practitioners for a Refined Understanding of Educational Systemic Change through a Practitioner Focused On-line Presence Innovate Integrate Communicate AECT International Conference 2013Anaheim, CA November 2, 2013
- 2. What if…. What would it be like if practitioners and community members had an understanding of educational systemic change?
- 4. Objectives View of educational systemic change Value of Usability Study Evaluate the research of a study Identify what practitioners say about a Systemic Change Website: http://systemicchange.wordpress.com/
- 5. It is all about being fair… Picture from http://weknowmemes.com/tag/please-climb-that-tree/
- 6. Personalizing learning experiences is a key to be fair! Picture from http://personalizedlearningsd8.yolasite.com/view.php
- 7. Technology as enabler for new paradigm of education
- 8. The Need is Nationally Recognized!
- 9. Some Highlights The USA Race to the Top initiatives and reports University programs School Official Certifications The International Society for Technology in Education (ISTE) Backlash to No Child Left Behind Voices of Vision Multiple authors/researchers
- 10. What can we do about it? The national movement towards understanding change provides a ripe time for the AECT division. Creating an accessible repository of material may bridge a divide between practitioners and academics/researchers for understanding systemic change.
- 11. Usability Study - Context 7 Point Scale Fall 2012 17-item usability survey 11 graduate students Website5.6 Video 5.6 Overall Satisfaction 5.9
- 12. Background to Project Goal Bridge gap between practitioners and researchers of educational systemic change Begin a conversation Researchers Practitioners Increase profile on the web and become a Viable Resource Center for Practitioners Division of Systemic Change Strategic Plan Strategic Goal 2.5. This goal is about extending the reach of our division and expanding the promise of systemic change into leadership preparation programs.
- 13. 2012 Recommendations Providing concrete examples of how systemic change works in public education Opportunities Recommendations Videos were effective – More?
- 14. Usability Access to what you are looking for fast and conveniently Efficiency, Effectiveness, and Satisfaction (ISO9241) UX or User Experience is becoming more important in our “information overload” world. 25-35 seconds to convince a user to stay (Nielsen & Loranger, 2006). Usability provides precise way of measuring and improving websites in a systematic fashion.
- 15. Research Questions 1.) How do practitioners perceive the overall usability of the website? 2.) Does the practitioner find the website’s content useful for understanding systemic change in K-12 schools? 3.) After time spent on the website, do practitioners perceive that they would like to learn more about systemic change for the benefit of leading change efforts? 4.) What suggestions do practitioners give for the improvement of the on-line delivery and conversation systems to connect practitioners with researchers of educational systemic change?
- 16. Method Social Networks, Emails, 1 Graduate class 41 Participants Solicitations-Online Survey- 23 Item study Completed
- 17. Participants 20 K-12 Education 57 Multiple Choice + 16 Higher Education + 5 Other = 41 Participants
- 18. Findings
- 19. Question 1 How do practitioners perceive the overall usability? 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Find looking for.. Highly Satisfied Graphics Videos
- 20. Open Comments Positive Negative Design - Clean Mechanics- Some links didn’t work Architecture - Efficient Navigation - Easy Content - Not in-depth Reliability – Can verify who completed
- 21. Question 2 Does the practitioner find the website’s content understanding systemic change in K-12 schools? useful for Perceptions in representing systemic change 100 95 90 85 80 75 High Quality Useful Videos Efficient Efficient overall
- 22. Open Comments - Positive CONTENT: 3 Positive Comments on video learning and organization - Home page and Individual “I felt that the site facilitated learning at both a surface or deep level. I loved how the video names were meaningful and spoke to the section heading.”
- 23. Question 3 After time spent on the website, do practitioners perceive that they would like to learn more about systemic change for the benefit of leading change efforts? Corresponds with Survey Question: Why are you interested in Systemic Change? Answered Characterized by the following: Dissatisfaction Informed Leadership
- 24. Dissatisfaction – 9 Comments Schools need it & how is important No child left behind failed I feel like it's constantly the same old song playing on the record player...children aren't getting the education the need or deserve. It's frustrating. But it's great to know people are still out there trying to help fight this system of standardization
- 25. Informed – 14 Comments I am an educator I’m a librarian any change to education will change what the library should offer it's patrons. I'm an educator. I want to prepare my students for their futures as best I can.
- 26. Leadership– 2 Comments know how to lead it The organization I work for, Curriculum Leadership Institute prides itself on help school districts achieve positive systemic change.
- 27. Question 4 What suggestions do practitioners give for the improvement of the on-line delivery and conversation systems to connect practitioners with researchers of educational systemic change? 2 Mechanics– Links 4 Design of information – Graphics & Brighter colors 1 Architecture – Videos tab 3 Content – Specific Strategies, Tools, Examples of working, more personal, Success stories 3 Reliability of information
- 28. Conclusions
- 29. Usability Study – CONTENT 7 Point Scale Fall 2013 23-item usability survey 57 practitioner Relevant & Useful 5.5 Website 5.7 Video 5.7 Overall Satisfaction 5.7
- 30. Overall Participants felt… 59% Use website in future 82% Recommend to a colleague 14 Supplied Email
- 31. Conclusion Interest with Practitioners Why interested? Dissatisfaction & want to be informed Limitations Usability study – short survey & not an in-depth understanding Does generate interest? Maybe Question: Is it worth it? Changes to website to consider: Design/graphic/link
- 32. References Aslan, S., & Reigeluth, C. M. (2012). A Trip to the past and future of educational computing: Understanding its evolution. Contemporary Educational Technology, 2(1), 1-17. Banathy, B. H. (1996). Conversation as a medium for change in education. Educational Technology, 36(1), 39-41. Duffy, F. M. (2010). Dream! Create! Sustain! Mastering the Art and Science of Tranforming School Systems. Lanham, MD: Rowman & Littlefield Education. Fullan, M. G. (2010). All systems go. Thousand Oaks, CA: Corwin Press. Reigeluth, C. M., & Duffy, F. M. (2008). The AECT FutureMinds Initiative: Transforming America's School Systems. Educational Technology, 48(3), 45-49. Reigeluth, C. M., & Karnopp, J. R. (2013). Reinventing Schools: It's Time to Break the Mold. Lanham, MD: Rowman & Littlefield Education.
- 33. Contact Info Website: http://systemicchange.wordpress.com/ Beth Sockman: bsockman@esu.edu Anthony Chow: aschow@uncg.edu.
Editor's Notes
- #3: http://savvycomsoftware.com/wp-content/uploads/2013/09/123631397_640.jpg
- #10: The need for change is nationally recognized. The USA Race to the Top initiatives and reports (http://www2.ed.gov/programs/racetothetop/performance.html) provide national recognition of a educational desire to change. In addition, university programs preparing technology leaders are encouraged to train change leaders. The International Society for Technology in Education (ISTE) program review, supplies standards that point to a need for visionary leaders and change agents (ISTE-NETS, 2011). The national movement towards understanding change provides a ripe time for the AECT division. Creating an accessible repository of material may bridge a divide between practitioners and academics/researchers for understanding systemic change.
- #11: Anthony
- #12: 17 item survey
- #16: Without asking the users directly – and having them identify the usability – and not take a test.
- #17: Add Item numbers to survey
- #18: Most were Tech SupportBook SellerSpecial services clerk2 ProfessorsLibrary85% Did business on the computer 86% Felt Technology made you more efficient90% Inspiring and new professional ideas
- #20: Likert Scale for 1 Disagree to 7 AgreeStatements … I can find what I am looking for…Content was high quality..Fourteen items of ratingLittle Efforts.75%-61% - was positive 71% agree, “It has high quality content.”66% agree, “I find what I’m looking for without many errors or false starts,” while 71% believe “I find what I’m looking for quickly with little wasted effort” and 75% responded positively to “I am able to use it with little mental effort or energy” thus implying that perhaps errors and false starts are not major deterrents to use. 72% responded that they are highly satisfied with the website81% liked the graphic design of the website67% liked the graphic design of the videos
- #21: Positive Feedback:Easy to navigateI have only sampled the website and will use it in the futureSelf-explanatory, I could navigate easilyThe design made it easy to read and understand infoVery clean and simple website….Very clear labelsWebsite is nicely laid outNavigation is efficient…The website has clear navigation links…The website is very organized. The tabs make it easy for users to find what they are looking forIt was quite intuitive…. Negative Feedback:Many of the links did not workSome of the videos are a bit “too much” – “too much” on the same web page…Not overly in-depth information thoughIt is not exciting to the eye, and I have to sift through the info on the page rather than being able to pinpoint specific information via bullet points or subjects in bold letteringI cannot verify if I would use it, or if it is reliable because I do not know who the creator of the website ishttp://farm5.staticflickr.com/4125/4832959065_056cab873b_b.jpg
- #22: Likert Scale for 1 Disagree to 7 AgreeStatements … Website is effective in representing systemic changeEfficient in learning about systemic changeVideos were effective in representing systemic changeVideos were efficient in learning about systemic change87% responded that the content is high quality90% responded that the content is useful93% believe that this site is effective in representing systemic change, while only 86% believe that the videos are effective in representing systemic change.90% responded that the site is efficient in learning about systemic change, while 87% responded that the videos are an efficient way of representing systemic change.
- #23: I like the “systematic change is-is not” section. The organization flows in a sensible mannerI was very impressed with the introductory videoUseful information; very plain designVideos helpfulThe videos were interesting, but I did have a bit of a sound issue at one point…I like the overall clean look of the site and the multiple navigational linksThere is a lot of wording on the site, which is great for explaining exactly what systemic change is. I felt that the site facilitated learning at both a surface or deep level. I loved how the video names were meaningful and spoke to the section heading.I found the video on the home page very engaging and informative about the importance of this topic
- #25: http://www.research-live.com/pictures/458xAny/7/1/1/1007711_customer_satisfaction.jpg
- #26: Why are you interested in Systemic Change? http://www.bighappyfunhouse.com/archives/supermegacuteoverload.jpg
- #27: Why are you interested in Systemic Change? http://farm3.staticflickr.com/2070/2137729430_a0c1f4070e_o.jpg
- #28: http://farm9.staticflickr.com/8332/8130059675_10ea6ccb69_o.jpg
- #30: #8 The Site was relevant & usefulThis site was effective in representing SCVideos are effective representing SCSite Satisfaction
- #31: TOOK from where? - Map
- #32: https://upload.wikimedia.org/wikipedia/commons/0/01/Protein_CSDA_PDB_1h95.png
- #33: Banathy, B. H. (1996). Conversation as a medium for change in education. Educational Technology, 36(1), 39-41.Braverman, B. (2010). Video shooter: Storytelling with HD camera (2 ed.). Boston: Focal Press.Coburn, C. (2003). Rethinking scale: Moving beyond numbers to deep lasting change. Educational Researcher, 32(6), 3-12.Duffy, F. M. (2003). Courage, passion, and vision: A guide to leading systemic school improvement. Lanham, Md.: Scarecrow Press.Duffy, F., & Reigeluth, C. M. (2008). Strategic Communication during Times of Great Change. School Administrator, 65(4), 22-25.Fullan, M. G. (2010). All systems go. Thousand Oaks, CA: Corwin Press.Goodman, J. (1995). Change without Difference. Harvard Educational Review, 65(1), 1-32.Gotto, K., & Colter, M. (2004). Web redesign 2.0: Workflow that works (2 ed.). San Jose, CA: Peachpit.Hargreaves, A. (2006). The sustainability of innovative schools as learning organizations and professional leaning communities during standardized reform. Educational Administration Quarterly, 42(1), 124-156.Hurbis-Cherrier, M. (2012). Voice and vision: A creative approach to narrative film & DV production (2 ed.). Boston: Elsevier.Jenlink, P. M., Reigeluth, C. M., Carr, A. A., & Nelson, L. (1996). An expedition for change: Facilitating the systemic change process in school districts. Tech Trends, 21-30.Joseph, R., & Reigeluth, C. M. (2010). The Systemic Change Process in Education: A Conceptual Framework. Contemporary Educational Technology, 1(2), 97-117.Osgood, R. J., & Hinshaw, M. J. (2009). Video storytelling: Videography and post production in the digital age. Boston: Wadworth.Peck, K. L., & Carr, A. A. (1997). Restoring public confidence in school through systems thinking. International Journal of Educational Reform, 6(3), 316-323.Reigeluth, C. M., Banathy, B. H., & Olson, J. R. (1993). Comprehensive systems design: A new educational technology (Vol. 95). Berlin Heidelberg, Germany: Springer-Verlag.Reigeluth, C. M. (1995). A Conversation on Guidelines for the Process of Facilitating Systemic Change in Education.Unpublished manuscript.Reigeluth, C. M., & Duffy, F. M. (2008). The AECT Future Minds Initiative: Transforming America's School Systems. Educational Technology, 48(3), 45-49.Richter, K., & Reigeluth, C. M. (2006). A systemic change experience in Decatur Township. Tech Trends, 50 (2), 35-36.Rogers, E. (1995). Diffusions of innovations (4 ed.). NY: Free Press.Senge, P. (1990). The fifth discipline: The art & practice of the learning organization. NY: Bantam Double Day Dell Publishing.Squire, K.D., & Reigeluth, C.M. (2000). The many faces of systemic change. Educational Horizons, 78 (3), 143-152.Stringer, E. (2007). Action research Thousand Oaks, CA: Sage Publications.Watson, W. R., Watson, S. L., & Reigeluth, C. M. (2012). A Systemic Integration of Technology for New-Paradigm Education. Educational Technology, 52(5), 25-29.