CSPA: The Future of Statistical Production
- 1. United Nations Economic Commission for Europe Statistical Division United Nations Economic Commission for Europe Statistical Division CSPA: The Future of Statistical Production Steven Vale UNECE steven.vale@unece.org
- 3. What is the CSPA? • A template architecture for official statistics • A set of standard specifications for new statistical components (services) that can be used in a modular way • A new way of developing statistical tools, with sharability as a design feature, not an afterthought
- 4. Problem statement: Specialised business processes, methods and IT systems for each survey / output
- 6. ... but if each statistical organisation works by themselves ...
- 7. ... we get this ...
- 8. .. which makes it hard to share and reuse!
- 9. … but if statistical organisations work together to define a common statistical production architecture ...
- 10. ... sharing is easier!
- 11. CSPA development Architecture Proof of Concept
- 12. The first proof of concept 5 countries built CSPA services 3 countries implemented them
- 13. Proof of concept outcomes The CSPA approach works It promises increased: • sharing • interoperability • collaboration opportunities
- 14. United Kingdom 5 Build teams 42 individuals 2 Sprints 3 Assemble teams 1 Working Group FAO
- 16. Services built in 2014 1. Seasonal adjustment – France, Australia, New Zealand 2. Confidentiality on the fly – Canada, Australia 3. SVG generator – OECD 4. SDMX transform – OECD 5. Sample selection – Netherlands 6. Linear error localisation – Netherlands 7. Linear rule checking – Netherlands 8. Error correction – Italy
- 17. New Services in 2015 Classification retrieval service Probabilistic record linkage service Testing Confidentialised analysis of microdata service Web dissemination service
- 18. Candidate services for 2016 Service name Designer / Builder Structured Validation Service Eurostat Transformation Service Eurostat Content Validation Eurostat Time Series ESSnet Questionnaire Generation ESSnet Metadata Dissemination ESSnet
- 19. 50 task team members 7 task teams CSPA 2015 project
- 20. Some features of CSPA v1.5
- 21. Technology Architecture Business Architecture Information Architecture Application Architecture Levels of architecture
- 22. "covers all the activities undertaken by a statistical organization, including those undertaken to conceptualize, design, build and maintain information and application assets used in the production of statistical outputs. Business Architecture drives the Information, Application and Technology architectures for a statistical organization." Business architecture = What an organisation does
- 23. “classifies the information and knowledge assets gathered, produced and used within the Business Architecture. It also describes the information standards and frameworks that underpin the statistical information. IA facilitates discoverability and accessibility, leading to greater reuse and sharing.” Information architecture = How we manage our information
- 25. “Application architecture is a description of the major logical grouping of capabilities that manage the data objects necessary to process the data and support the business - it details the structure of components, their inter-relationships, and the principles and guidelines governing their design and evolution over time.” Application architecture = How we do things
- 26. "describes the IT infrastructure required to support the deployment of business services, data services and applications services, including hardware, middleware, networks, platforms, etc." Technology architecture = The technology we need
- 28. Roles in CSPA
- 29. CSPA Governance • Owner = HLG-MOS • Maintenance agency = CSPA Implementation Group (representatives of national / international statistical organisations) • Governance processes for: • CSPA itself – updates and supporting material • Candidate services – quality and fit for purpose
- 31. Templates • Standard templates agreed for: • Service Definition – conceptual level overview of what the service is and what it does – understandable by users • Service Specification – logical level description of service capabilities, inputs and outputs • Service Implementation Description – physical level description of how to implement the service
- 34. Knowledge Base Investment Catalogue Capability Catalogue CSPA Service Catalogue Built in 2015 Focus on future sharing opportunities Built in 2015 Focus on existing sharing opportunities Technical Repository Built in 2013-15 On UNECE wiki platform Several options e.g. GitHub
- 35. Investment Catalogue • We need to share investment plans where we are willing to collaborate
- 36. Strategic Investment Planning •Sharing plans between organisations •Finding partners with similar priorities •Trialing an Investment Comparison Tool Investment Catalogue
- 37. “The survey will be repeated on a larger scale in 2016 to identify emerging priorities and common areas of interest” – CES 2016 Report
- 38. Investment Catalogue What we are investing in? – Results from 2015
- 39. CSPA Service Catalogue • Hosted by • Wiki-based for now • New version with easier access and better structure in preparation • https://webgate.ec.europa.eu/fpfis/mwikis/cspa
- 40. A gradual transition to CSPA Phase 0: Before transition
- 41. Phase 1: Establish new components in local environment Interface Platform for Service Communication Establishing an integration layer Construct NEW systems using the new architecture
- 42. Phase 2: Re-engineer old systems Interface Platform for Service Communication Connect old systems to the integration layer
- 43. Phase 3: Progressively replace old systems Interface Platform for Service Communication Replace old systems with new services as reengineering occurs Connect more old systems to the integration layerOld system, and connections are removed or reworked
- 44. Alternative: Use CSPA services without changing architecture CSPA Service
- 45. Are we ready for CSPA? Are our organisations sufficiently mature? • Maturity has several dimensions (Just like capabilities!) • How can we measure maturity? The answer: We are working on a Modernisation Maturity Model
- 46. MMM for CSPA Draft prepared • Standard levels and dimensions Currently being tested Final version – end of year Initial Pre- implementation Early implementation Corporate implementation Mature implementation Business Methods Information Applications Technology
- 47. CSPA: Just for Services? Can we apply CSPA principles to other capability dimensions? • Methods – e.g. Algorithmia • People – e.g. generic skills profiles • ….. To be confirmed!
- 48. We all have to modernise our statistical production systems The marginal cost of doing this in a way that supports collaboration and complies with CSPA is relatively low, but the potential savings from such a standard approach are high Key Message
Editor's Notes
- #3: The Generic Statistical Business Process Model (GSBPM) was released in 2009 and revised in 2013. The Generic Statistical Information Model (GSIM) was released in 2012 and revised in 2013 Between them, they provide the basis for the Common Statistical Production Architecture, also released in 2013.
- #17: By the end of the year we will have several CSPA-compliant services (or components) in use. There are 8 currently being developed. Some in collaboration between organisations, others within individual organisations, but the important point is that they will share common specifications.
- #18: In 2015, there were 3 services built in 2015. In addition, 4 countries implemented and tested a service built in 2015
- #49: Statistical organizations already participate in many international engagement activities that facilitate sharing. Spontaneous, relationship driven engagements between statistical organisations, unable to articulate how efficient we have been The main opportunities that we can focus on: greater sharing of each statistical organisation's ICT portfolio investment and management plans finding and exploiting opportunities to align engagements with some vendors earlier collaboration on innovative and transformative approaches leverage modern technology development practices and tools to support physically dispersed teams What does CSPA offer to sharing? It broadens the types of sharing to smaller parts of IT solutions rather than the large grained, complex pieces that have historically been shared It builds on and enhances sharing of non-ICT dimensions of a capability Sharing of any dimension of a capability can occur with different degrees of maturity. With more maturity in sharing comes: more confidence in the sustainability of things being shared more clarity in roles of providers and consumers of the thing being shared greater visibility of the status of things being shared.