e-government and open
              government-
       how measurements can help
                   Mikael Snaprud, Morten Goodwin
                             Tingtun AS

               Verdikt, Oslo, Norway, Nov. 1-2, 2010
This work is licensed under the Creative
Commons Attribution-ShareAlike License.    Project no.: Verdikt 183392/S10
Building on open results
                                                           www.egovmon.no


                                •   Supported by Research Council of Norway, Verdikt.
                                •   User driven project, over three years, end oct. 2011.
                Tools
                                •   21 municipalities and 12 research partners.
                                •   Open source tools to measure eGovernment.
                                     Accessibility and Transparency.


                                                           www.egovmonet.eu
• EC, FP6
• 3 years
                Methodologies




• 10 partners
                                • Supported by European Commission, CIP.
                                • Well over 300 members in ePractice.
                                • Phase 1: ended May 2010, methods on eGov user
                                   satisfaction and impact, draft measure handbook.
                                • Phase 2: European network on eGov measurement
                                   methods.
Measurements in
                           Improvement cycles
                           for web sites


              Policy
              making
                                                     CMS
eGovMon                                              vendors
 crawler
           Benchmarks
              No 1
                                               Editors and
              No 2                             web masters
              No 3
               …



               ●
                 Check based on UWEM, WCAG 1.0
               ●
                 20% of defined tests automated
                    Lower cost, more frequent possible,
                    can direct manual testing
               ●
                   Manual and automated - correlation
Project partners
   Pilot                    Research
Municipalities          and policy support




Associate partners invitation opened now
                                             4
Use of measurement results

  Policy making        Status and development

                   eGov
                  measure-
                   ments

Method improvement           Practical retrofitting


                                                      5
Policy making        Status and development

                               eGov
                              measure-
                               ments

           Method improvement            Practical retrofitting


●Measurement of web site barriers in public and
private sector
●   Used to estimate cost of retrofitting
●Basis for decisions on regulation coverage and
implementation schedule
●Report on societal impact for Difi (Norwegian
Agency for Public Management and eGovernment)
                                                                  6
Policy making                                             Status and development
        Policy making
                                                 eGov
                                                measure-
                                                 ments

   Method improvement                                                         Practical retrofitting
                         9.1.HTML.01
                        12.3.HTML.04
                         7.4.HTML.01
                         7.2.HTML.01
                          7.2.CSS.02
                         7.3.HTML.01
                        12.3.HTML.01
                         1.1.HTML.06
                         7.5.HTML.01
                         3.6.HTML.03
                        12.1.HTML.01
                        12.4.HTML.01
           UWEM tests




                         3.5.HTML.03
                         6.4.HTML.01
                         1.1.HTML.01
                         3.2.HTML.01
                        11.2.HTML.01
                        12.4.HTML.02
                        13.1.HTML.01
                          3.2.CSS.01
                         3.2.HTML.02
                        11.2.HTML.02
                        11.1.HTML.01
                                       0   10   20   30              40             50       60   70   80   90   100




                                                          Percantage of pages with barrier

Used in the eGovernment Benchmark Survey 2009, presented by Capgemini.
Municipalities compare neighbor performance.                       7
Benchmarking results
  Policy making        Status and development

                   eGov
                  measure-
                   ments

Method improvement           Practical retrofitting




                                                                                             Generated
                                                                                           PDF report with
                                                                                           overview of the
                                                                                            21 test results

                                                                                         And full list of tested
                                                                                        web pages and barriers

                                                      http://accessibility.egovmon.no
                                                                                                                   8
Policy making          Status and development
                Status and development
                                             eGov
                                            measure-
                                             ments

                          Method improvement           Practical retrofitting

●   Monthly checks of the municipality web sites
●   On demand check of
       ●   Web site
       ●   Web page
       ●   PDF document




●Help to locate and fix
many barriers
●   Site checks, for discussion with the leading CMS vendors
                                                                                9
Policy making        Status and development

                   eGov




                               Web page accessibility
                        PRACTICAL RETROFITTING
                  measure-
                   ments

Method improvement           Practical retrofitting




                                                      http://accessibility.egovmon.no
                                                                                        10
Policy making        Status and development

                   eGov




                                                         Web site accessibility
                  measure-
                   ments

Method improvement           Practical retrofitting




                                                                                             Generated
                                                                                           PDF report with
                                                                                           overview of the
                                                                                            21 test results

                                                                                         And full list of tested
                                                                                        web pages and barriers

                                                      http://accessibility.egovmon.no
                                                                                                                   11
Policy making        Status and development




Method improvement
                   eGov
                  measure-
                   ments

                             Practical retrofitting
                                                                     PDF accessibility




                                                      http://accessibility.egovmon.no    12
Policy making           Status and development

                         Policy making eGov
                                      measure-
                                       ments

               Method improvement                Practical retrofitting
EU                                                                                             UN




eGovMoNet phase 2 pending to work on              United Nations Department of Economic and
                                                   Social Affairs (UNDESA)
●
    Methodology matrix
                                                  "2012 E-Government Survey: Towards a more
●
    Recommendations on eGov measurement             Citizen-Centric Approach”
    methods.                                          back office management,
                                                  ●

●
    Transparency measurement                      ●   citizen usage of e-gov services,
    methodologies                                     integration of government websites towards
                                                  ●

●
    Open Source tools                                  the single portal,
                                                  ●   inclusiveness and availability of environment
●
    Impact and cost benefit of eGov                    related information and services
    measurements

                                                                                                      13
Main current issues
●
    Migration of UWEM to WCAG 2.0
●
    Transparency method and implementation
●
    Reporting tool improvements
●
    User collaboration
●
    eGov efficiency analysis
●
    Obtain data for accessibility models
●
    Portal requirements for procurement


                                             14
Conclusions
●   Open method, software and results to
      ●   Facilitate method Improvements
      ●   Share the cost and the improvements
      ●   Build awareness and skills
●   Automatic measurements provide
      ●   Good repeatability
      ●   Limited scope - Manual evaluations needed for full coverage
      ●   Information to direct manual (and more costly) evaluations
●   Measurements on demand are helpful to
      ●   Give immediate feedback on adjustments
      ●   Maintain awareness between annual benchmarks
      ●   Facilitate a dialogue between customer and portal vendor

                                                                        15
www.egovmon.no

         Contact:
        www.uia.no
     www.tingtun.no
Mikael.snaprud@tingtun.no




                            16
Implemented automatic tests
Test ID        Brief description
1.1_HTML_01    check that non-text content has a text equivalent.
1.1_HTML_06    nontext content embedded with the non-standard embed element, such as wrong use videos
3.2_HTML_01    check that the document contains a valid document type declaration.
3.2_HTML_02    find violations against the formal schema for HTML 4.x or XHTML 1.0.
3.5_HTML_03    check that no levels are skipped in the heading hierarchy.
3.6_HTML_03    find paragraphs, line breaks and numbers that are used to simulate numbered lists and which can be replaced with the
               old element
6.4_HTML_01    check that mouse-specific event handlers have a keyboard specific (or device independent) version.
7.2_HTML_01    find any blink elements.
7.3_HTML_01    find marquee elements. (Will cause blinking)
7.4_HTML_01    find elements that can cause page refreshing.
7.5_HTML_01    find elements that can cause page redirecting.
9.1_HTML_01    find server-side image maps.
11.1_HTML_01   find out whether the latest versions of W3C technologies for HTML and XHTML have been used.
11.2_HTML_01   find deprecated HTML elements.
11.2_HTML_02   find deprecated HTML attributes.
12.1_HTML_01   find frames without description.
12.3_HTML_01   find fieldsets without legend.
12.3_HTML_04   find optgroup elements without label. Optgroups are often used in menus.
12.4_HTML_01   find form control elements without id.
12.4_HTML_02   find form control elements without label element.
13.1_HTML_01   find a elements with the same title and text with different different link target (href). If no title attribute is provided, only
               the element text is checked.
3.2_CSS_01     find violations against the formal grammar for CSS 1.0 or CSS 2.x.
7.2_CSS_02     find CSS rules that cause content to blink.



                                                                                                                                                   17

More Related Content

PDF
Posri report 201207111
PDF
Web 2.0 Measurement: Open Government Innovations Conference
PDF
Smart cities - Transformation of City portals
PDF
Egovmonet: benchmarking gov20
PDF
Osimo crossover md
PDF
Top cited article in Software Engineering Research Field - IJSEA
PDF
Smart Cities - Learning from Intel Cities - The Community of Practice as a vi...
PDF
Egov Benchmark 2009
Posri report 201207111
Web 2.0 Measurement: Open Government Innovations Conference
Smart cities - Transformation of City portals
Egovmonet: benchmarking gov20
Osimo crossover md
Top cited article in Software Engineering Research Field - IJSEA
Smart Cities - Learning from Intel Cities - The Community of Practice as a vi...
Egov Benchmark 2009

Similar to e-government and open government - how open measurements can help, Mikael Snaprud, Tingtun AS (20)

PPT
Tim Willoughby Presentation on web 2.0
PPTX
Osimo crossover-undp
PPT
George Garlick, Transparency and Productivity
PDF
How advanced are Italian regions in terms of public eServices
PDF
Egovmon
PPTX
Ossiannilsson130315 sverd
PPTX
When Too Many is Just Enough: Citizen Engagement and Federal Government Websites
PPT
e-Government introduction
PPTX
GOV-IT OEF's Governance Network (to be)
PDF
Workshop: Managing top tasks #BPCW11
PPT
Fairfax County Web Metrics Presentation
PDF
Web2 0 for eGovernment: why and how?
PPTX
NE League of Municipalities Sept. 2012
PPTX
NE League of Municipalities Sept. 2012
PPTX
Ne League of Municipalities Sept. 2012
PPTX
NE League of Municipalities Sept. 2012
PDF
Prototyping and Scrum
PPT
Measuring government websites
PPTX
Ossiannilsson130321 dalarna bm_trends
PDF
Future-Ready Government — Powered by the Social, Mobile & Cloud Revolutions o...
Tim Willoughby Presentation on web 2.0
Osimo crossover-undp
George Garlick, Transparency and Productivity
How advanced are Italian regions in terms of public eServices
Egovmon
Ossiannilsson130315 sverd
When Too Many is Just Enough: Citizen Engagement and Federal Government Websites
e-Government introduction
GOV-IT OEF's Governance Network (to be)
Workshop: Managing top tasks #BPCW11
Fairfax County Web Metrics Presentation
Web2 0 for eGovernment: why and how?
NE League of Municipalities Sept. 2012
NE League of Municipalities Sept. 2012
Ne League of Municipalities Sept. 2012
NE League of Municipalities Sept. 2012
Prototyping and Scrum
Measuring government websites
Ossiannilsson130321 dalarna bm_trends
Future-Ready Government — Powered by the Social, Mobile & Cloud Revolutions o...
Ad

More from The Research Council of Norway, IKTPLUSS (20)

PPTX
14 arne eriksen emeistring
PPTX
12 thomas jakobsen neckgraph mai2015
PPTX
09 bjørn skjellaug sintef
PPTX
10 eric mandeville capgemini
PPTX
06 per olav vandvik magic
PPTX
05 øivind riis sph østfold
PPTX
PPTX
PPTX
PPTX
21 tor dokken pasient tilpassede implantater .... ikt pluss presentasjon 7. m...
PPT
PPTX
19 iffat sms-ikt-fyrtårn-7mai2015
PPTX
PDF
Blopp!; Ole Andreas Alsos, NTNU og Bekk Consulting
14 arne eriksen emeistring
12 thomas jakobsen neckgraph mai2015
09 bjørn skjellaug sintef
10 eric mandeville capgemini
06 per olav vandvik magic
05 øivind riis sph østfold
21 tor dokken pasient tilpassede implantater .... ikt pluss presentasjon 7. m...
19 iffat sms-ikt-fyrtårn-7mai2015
Blopp!; Ole Andreas Alsos, NTNU og Bekk Consulting
Ad

Recently uploaded (20)

DOCX
80 DE ÔN VÀO 10 NĂM 2023vhkkkjjhhhhjjjj
PDF
Tortilla Mexican Grill 发射点犯得上发射点发生发射点犯得上发生
PPTX
Transportation in Logistics management.pptx
PDF
Satish NS: Fostering Innovation and Sustainability: Haier India’s Customer-Ce...
PDF
533158074-Saudi-Arabia-Companies-List-Contact.pdf
DOCX
Hand book of Entrepreneurship 4 Chapters.docx
PPTX
IMM marketing mix of four ps give fjcb jjb
PDF
Kishore Vora - Best CFO in India to watch in 2025.pdf
PDF
Vinod Bhatt - Most Inspiring Supply Chain Leader in India 2025.pdf
PDF
Business Communication for MBA Students.
PDF
Cross-Cultural Leadership Practices in Education (www.kiu.ac.ug)
PDF
Middle East's Most Impactful Business Leaders to Follow in 2025
PDF
Second Hand Fashion Call to Action March 2025
PDF
Stacey L Stevens - Canada's Most Influential Women Lawyers Revolutionizing Th...
PPTX
df0ee68f89e1a869be4bff9b80a7 business 79f0.pptx
PDF
#1 Safe and Secure Verified Cash App Accounts for Purchase.pdf
PPTX
TRAINNING, DEVELOPMENT AND APPRAISAL.pptx
PPTX
operations management : demand supply ch
PDF
Engaging Stakeholders in Policy Discussions: A Legal Framework (www.kiu.ac.ug)
PDF
Immigration Law and Communication: Challenges and Solutions {www.kiu.ac.ug)
80 DE ÔN VÀO 10 NĂM 2023vhkkkjjhhhhjjjj
Tortilla Mexican Grill 发射点犯得上发射点发生发射点犯得上发生
Transportation in Logistics management.pptx
Satish NS: Fostering Innovation and Sustainability: Haier India’s Customer-Ce...
533158074-Saudi-Arabia-Companies-List-Contact.pdf
Hand book of Entrepreneurship 4 Chapters.docx
IMM marketing mix of four ps give fjcb jjb
Kishore Vora - Best CFO in India to watch in 2025.pdf
Vinod Bhatt - Most Inspiring Supply Chain Leader in India 2025.pdf
Business Communication for MBA Students.
Cross-Cultural Leadership Practices in Education (www.kiu.ac.ug)
Middle East's Most Impactful Business Leaders to Follow in 2025
Second Hand Fashion Call to Action March 2025
Stacey L Stevens - Canada's Most Influential Women Lawyers Revolutionizing Th...
df0ee68f89e1a869be4bff9b80a7 business 79f0.pptx
#1 Safe and Secure Verified Cash App Accounts for Purchase.pdf
TRAINNING, DEVELOPMENT AND APPRAISAL.pptx
operations management : demand supply ch
Engaging Stakeholders in Policy Discussions: A Legal Framework (www.kiu.ac.ug)
Immigration Law and Communication: Challenges and Solutions {www.kiu.ac.ug)

e-government and open government - how open measurements can help, Mikael Snaprud, Tingtun AS

  • 1. e-government and open government- how measurements can help Mikael Snaprud, Morten Goodwin Tingtun AS Verdikt, Oslo, Norway, Nov. 1-2, 2010 This work is licensed under the Creative Commons Attribution-ShareAlike License. Project no.: Verdikt 183392/S10
  • 2. Building on open results www.egovmon.no • Supported by Research Council of Norway, Verdikt. • User driven project, over three years, end oct. 2011. Tools • 21 municipalities and 12 research partners. • Open source tools to measure eGovernment. Accessibility and Transparency. www.egovmonet.eu • EC, FP6 • 3 years Methodologies • 10 partners • Supported by European Commission, CIP. • Well over 300 members in ePractice. • Phase 1: ended May 2010, methods on eGov user satisfaction and impact, draft measure handbook. • Phase 2: European network on eGov measurement methods.
  • 3. Measurements in Improvement cycles for web sites Policy making CMS eGovMon vendors crawler Benchmarks No 1 Editors and No 2 web masters No 3 … ● Check based on UWEM, WCAG 1.0 ● 20% of defined tests automated Lower cost, more frequent possible, can direct manual testing ● Manual and automated - correlation
  • 4. Project partners Pilot Research Municipalities and policy support Associate partners invitation opened now 4
  • 5. Use of measurement results Policy making Status and development eGov measure- ments Method improvement Practical retrofitting 5
  • 6. Policy making Status and development eGov measure- ments Method improvement Practical retrofitting ●Measurement of web site barriers in public and private sector ● Used to estimate cost of retrofitting ●Basis for decisions on regulation coverage and implementation schedule ●Report on societal impact for Difi (Norwegian Agency for Public Management and eGovernment) 6
  • 7. Policy making Status and development Policy making eGov measure- ments Method improvement Practical retrofitting 9.1.HTML.01 12.3.HTML.04 7.4.HTML.01 7.2.HTML.01 7.2.CSS.02 7.3.HTML.01 12.3.HTML.01 1.1.HTML.06 7.5.HTML.01 3.6.HTML.03 12.1.HTML.01 12.4.HTML.01 UWEM tests 3.5.HTML.03 6.4.HTML.01 1.1.HTML.01 3.2.HTML.01 11.2.HTML.01 12.4.HTML.02 13.1.HTML.01 3.2.CSS.01 3.2.HTML.02 11.2.HTML.02 11.1.HTML.01 0 10 20 30 40 50 60 70 80 90 100 Percantage of pages with barrier Used in the eGovernment Benchmark Survey 2009, presented by Capgemini. Municipalities compare neighbor performance. 7
  • 8. Benchmarking results Policy making Status and development eGov measure- ments Method improvement Practical retrofitting Generated PDF report with overview of the 21 test results And full list of tested web pages and barriers http://accessibility.egovmon.no 8
  • 9. Policy making Status and development Status and development eGov measure- ments Method improvement Practical retrofitting ● Monthly checks of the municipality web sites ● On demand check of ● Web site ● Web page ● PDF document ●Help to locate and fix many barriers ● Site checks, for discussion with the leading CMS vendors 9
  • 10. Policy making Status and development eGov Web page accessibility PRACTICAL RETROFITTING measure- ments Method improvement Practical retrofitting http://accessibility.egovmon.no 10
  • 11. Policy making Status and development eGov Web site accessibility measure- ments Method improvement Practical retrofitting Generated PDF report with overview of the 21 test results And full list of tested web pages and barriers http://accessibility.egovmon.no 11
  • 12. Policy making Status and development Method improvement eGov measure- ments Practical retrofitting PDF accessibility http://accessibility.egovmon.no 12
  • 13. Policy making Status and development Policy making eGov measure- ments Method improvement Practical retrofitting EU UN eGovMoNet phase 2 pending to work on United Nations Department of Economic and Social Affairs (UNDESA) ● Methodology matrix "2012 E-Government Survey: Towards a more ● Recommendations on eGov measurement Citizen-Centric Approach” methods. back office management, ● ● Transparency measurement ● citizen usage of e-gov services, methodologies integration of government websites towards ● ● Open Source tools the single portal, ● inclusiveness and availability of environment ● Impact and cost benefit of eGov related information and services measurements 13
  • 14. Main current issues ● Migration of UWEM to WCAG 2.0 ● Transparency method and implementation ● Reporting tool improvements ● User collaboration ● eGov efficiency analysis ● Obtain data for accessibility models ● Portal requirements for procurement 14
  • 15. Conclusions ● Open method, software and results to ● Facilitate method Improvements ● Share the cost and the improvements ● Build awareness and skills ● Automatic measurements provide ● Good repeatability ● Limited scope - Manual evaluations needed for full coverage ● Information to direct manual (and more costly) evaluations ● Measurements on demand are helpful to ● Give immediate feedback on adjustments ● Maintain awareness between annual benchmarks ● Facilitate a dialogue between customer and portal vendor 15
  • 16. www.egovmon.no Contact: www.uia.no www.tingtun.no Mikael.snaprud@tingtun.no 16
  • 17. Implemented automatic tests Test ID Brief description 1.1_HTML_01 check that non-text content has a text equivalent. 1.1_HTML_06 nontext content embedded with the non-standard embed element, such as wrong use videos 3.2_HTML_01 check that the document contains a valid document type declaration. 3.2_HTML_02 find violations against the formal schema for HTML 4.x or XHTML 1.0. 3.5_HTML_03 check that no levels are skipped in the heading hierarchy. 3.6_HTML_03 find paragraphs, line breaks and numbers that are used to simulate numbered lists and which can be replaced with the old element 6.4_HTML_01 check that mouse-specific event handlers have a keyboard specific (or device independent) version. 7.2_HTML_01 find any blink elements. 7.3_HTML_01 find marquee elements. (Will cause blinking) 7.4_HTML_01 find elements that can cause page refreshing. 7.5_HTML_01 find elements that can cause page redirecting. 9.1_HTML_01 find server-side image maps. 11.1_HTML_01 find out whether the latest versions of W3C technologies for HTML and XHTML have been used. 11.2_HTML_01 find deprecated HTML elements. 11.2_HTML_02 find deprecated HTML attributes. 12.1_HTML_01 find frames without description. 12.3_HTML_01 find fieldsets without legend. 12.3_HTML_04 find optgroup elements without label. Optgroups are often used in menus. 12.4_HTML_01 find form control elements without id. 12.4_HTML_02 find form control elements without label element. 13.1_HTML_01 find a elements with the same title and text with different different link target (href). If no title attribute is provided, only the element text is checked. 3.2_CSS_01 find violations against the formal grammar for CSS 1.0 or CSS 2.x. 7.2_CSS_02 find CSS rules that cause content to blink. 17