2013 NDSA Web Archiving Survey Report Highlights
- 1. Content Working Group 2013 NDSA Web Archiving Survey Report Highlights Nicholas Taylor (@nullhandle) Web Archiving Service Manager Stanford University Libraries SAA Annual Meeting: Web Archiving Roundtable August 13, 2014
- 2. Content Working Group NDSA Web Archiving Survey Working Group Jefferson Bailey Internet Archive / Archive-It Kristine Hanna Internet Archive / Archive-It Edward McCain University of Missouri Cathy Hartman University of North Texas Abbie Grotke Library of Congress Christie Moffatt National Library of Medicine Nicholas Taylor Stanford University
- 3. Content Working Group NDSA Web Archiving survey background 2011 β’ 78 respondents β’ program info β’ tools and services β’ access β’ policies 2013 β’ 92 respondents β’ program info β’ staff time, metrics, skills, content concerns β’ tools and services β’ access and discovery β’ new discovery options β’ policies β’ embargo, social media, robots.txt, resources
- 4. Content Working Group Respondent Characteristics βLego Peopleβ by Scoobay under CC BY-NC-SA 2.0
- 5. Content Working Group universities still make up most programs College or University 47% Archive 13% State Gov 13% Other 12% Fed Gov 8% Commercial 2% Public Library 2% Museum 3% 2011 College or University 52% Archive 15% State Gov 13% Other 8% Fed Gov 5% Commercial 4% Public Library 2% Museum 1% 2013
- 6. Content Working Group SAA WebArch RT tops group affiliations group 2011 2013 8% 7% 31% 33% 45%
- 7. Content Working Group most programs are fractionally staffed less than 25% FTE 25% FTE 40-50% FTE 1 FTE 1 to 3 FTE 3.5 to 15 FTE
- 8. Content Working Group Maturity and Progress βApple Mouse Evolutionβ by raneko under CC BY 2.0
- 9. Content Working Group programs have matured slightly since 2011 64% 16% 17% 4% 72% 14% 9% 2% 0% 10% 20% 30% 40% 50% 60% 70% 80% Active Testing Planning No longer collecting 2011 2013
- 10. Content Working Group strong perceptions of progress since 2011 Significant progress 40% Some progress 36% About the same 20% Slightly worse off 2% Much worse off 2%
- 11. Content Working Group many new programs since 2011 1 0 3 0 2 1 2 0 2 3 8 6 5 4 6 7 12 19 0 2 4 6 8 10 12 14 16 18 20 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 Number of organizations
- 12. Content Working Group Archiving Focus βAnt Farm Media Van v.08 (Time Capsule) in Bellewether at Southern Exposureβ by Steve Rhodes under CC BY-NC-SA 2.0
- 13. Content Working Group more programs are only self-archiving 31% 49% 20% 15% 48% 37% 0% 10% 20% 30% 40% 50% 60% Archive other sites only Archive both Archive own site only 2011 2013
- 14. Content Working Group concern about social media, databases, video 69 65 64 49 40 32 16 0 10 20 30 40 50 60 70 80 Social Media Databases Video Interactive Media Audio Blogs Art Number of organizations
- 15. Content Working Group untapped interest in collaboration 21% 72% 7% 17% 47% 33% 2% 0% 10% 20% 30% 40% 50% 60% 70% 80% Yes No Not yet, but interested Don't know 2011 2013
- 16. Content Working Group βPhotocopierβ by Joriel "Joz" Jimenez under CC BY-NC-ND 2.0 Tools and Services
- 17. Content Working Group web archiving as a service still most popular 60% 25% 14% 63% 20% 16% 0% 10% 20% 30% 40% 50% 60% 70% External In-house Both 2011 2013
- 18. Content Working Group data not transferred from service provider 19% 81% 20% 80% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% Transferred Haven't transferred 2011 2013
- 19. Content Working Group increased use of tools supporting W/ARC 24% 76% 38% 62% 0% 10% 20% 30% 40% 50% 60% 70% 80% Supports W/ARC Doesn't support W/ARC 2011 2013
- 20. Content Working Group less granular descriptive metadata 62% 66% 47% 55% 30% 36% 54% 60% 43% 50% 22% 18% 20% 5% 20% 0% 10% 20% 30% 40% 50% 60% 70% 2011 2013
- 21. Content Working Group Archiving Policies βHandle With Careβ by ServInt under CC BY-NC-ND 2.0
- 22. Content Working Group most donβt notify or seek permission 42 42 45 17 7 11 14 13 15 0 5 10 15 20 25 30 35 40 45 50 Capture Provide restricted access Provide public access No action Notify Request permission
- 23. Content Working Group more conditional handling of robots.txt 38% 33% 8% 21%22% 55% 8% 16% 0% 10% 20% 30% 40% 50% 60% Always respect robots.txt Sometimes/conditionally respect robots.txt Never respect robots.txt Don't know 2011 2013
- 24. Content Working Group social media archiving policies are uncommon Has social media archiving policy 24% Lacks social media archiving policy 76%
- 25. Content Working Group policies based on community practices Other organizations 36% ARL Code of Best Practices 27% Section 108 Study Group 17% Counsel or service provider 7% Oakland Archive Policy 4% Statute 4% Don't know 5%
- 26. Content Working Group takeaways and questions for SAA WebArch RT β’ for individual organizations: β’ if youβre only self-archiving, whatβs on your roadmap? β’ how are you preserving your web archive data? β’ how do you describe and enable discovery of web archives? β’ how do you handle robots.txt? β’ what are your plans for social media archiving policy? β’ for the group: β’ what is this group (vs. IIPC, NDSA) best equipped to do? β’ what kind of collaboration are you interested in?
- 27. Content Working Group Nicholas Taylor @nullhandle βThank Youβ by vistamommy under CC BY 2.0