SlideShare a Scribd company logo
BSD Certification Group: A
   Case Study in Open Source
          Certification


Dru Lavigne
Chair, BSD Certification Group Inc.

MNN, October 9, 2009
Outline
Certification 101

Bridging the Open Source / Certification /
Academic Gap

BSD Certification Group (BSDCG)

BSDA (BSD Associate)

BSDP (BSD Professional)

Works in Progress

How You Can Help
Certification 101


Popularized in mid-90s by Novell, Microsoft, Cisco

Associated with braindumps, paper MCSEs

Very expensive to launch—domain of large,
established companies with alternate revenue
streams who can afford to wait ~2 yrs before
certification program starts making money
Certification 101
Traditional exam delivery costs: $75,000 USD
annually to participate, extra fees for changing
exam

Monopoly on exam delivery (VUE/Prometric) --this
is just starting to change

Exam delivery software is proprietary, currently no
open source solutions exist
Certification 101
LPI started out as commercial/community based,
current focus is commercial

Other Certification bodies: Zend for PHP,
EnterpriseDB for PostgreSQL, Canonical for
Ubuntu

Other open source communities (Apache,
Gnome) have expressed interest

Cost, time, and expertise are huge barriers
Gap: Open Source
Strengths: if you take away the “code”, what are
you left with?

Built-in mentorship opportunities for learning real-
world skills

Community of like-minded individuals

Networking with others of differing skill-levels from
across the globe in area of interest
Gap: Open Source
Weaknesses: provide a good measurement of a
community's maturity level

Focus is on code and developers, while other
community skills and resources are ignored

Processes and culture vary widely between
communities

Documentation is not considered important,
written processes and training materials are
virtually non-existent
Gap: Certification
Strengths: provide a good measure of the
quality/goals of a certification program

Assist employers by assessing a published set of
skills

Increase the recognition and use of a software
product

Provide job seekers with an advantage over other
applicants
Gap: Certification
Weaknesses: too many to fit on one slide :-)

Cost: to exam taker and certifying organization

Monopoly on exam delivery solutions (all
proprietary)

Rarely available in languages other than English

Difficult to keep exam content secure

Training is often boot-camp style to pass the
exam, not learn real-world skills or understanding
Gap: Academia
Strengths:

Time to learn understanding and skills in a larger
context

Institution must follow established guidelines for
student assessment

Institution provides reputation
Gap: Academia

Weaknesses: depend on type of program on type
of institution

Knowledge may be more theoretical than practical

Program may not include networking/placements
with potential employers

Institution may not have a global reputation
Bridging the Gap


Benefits to Open Source Community:

Increased exposure and reputation

New contributing members with varied skillsets

Reason to document processes and how to use
the software
Bridging the Gap
Benefits to Academic Institution: for both
undergraduate and thesis programs

Increased global exposure and reputation

Introduces students to potential employers and
colleagues

Provides students with hard and soft skills in a
non-artificial environment

Opens research and commercialization
opportunities
BSDCG
Registered non-profit incorporated in the state of
New Jersey in 2005

Mission is to create and maintain certifications to
assess skills of BSD system administrators

Community based with a legal governance
infrastructure

Relies on open source methodologies and
volunteer contributions of time and money
BSDCG
Internal Structure:

5 Board of Directors (voted in for a term)

21 BSDCG members with voting rights (volunteer
to join)

5 Advisory Board members (invited)

9 SMEs (subject matter experts)

1 (paid) psychometrician

Network of trusted exam proctors
BSDCG
Community Structure:

~700 subscribers to 2 mailing lists

147 members of 2 Linkedin groups

~90 translators for 22 languages

Donated hardware, bandwidth, system
administration, and web development

Ongoing relationships with other certification
bodies and educational institutions
BSDCG
Community Based:

Remains separate from, but supports the other
BSD projects and Foundations

Works closely with employers and sysadmins to
keep exam current and “real”

Advocates the integraton of exam objectives into
existing diploma programs (rather than bootcamp
style learning)
BSDCG
Psychometrically Valid:

Ensures exam is fair, unbiased, and
understandable, even if English is not your first
language

SMEs who are working sysadmins keep the exam
practical

Use of ongoing metrics keeps questions current
and spots anomalies
BSDCG

Exam goals:
Globally affordable ($75 USD)        √
Available in local community, and where
warranted, in local language

Encourage local study groups and creation of
training materials (both open and commercial)
BSDA
Process:

Job Task Analysis (JTA): April - July 2005

Exam Requirements published: October 2005

Beta Period: May - August 2007

Angoff Session: January 2008

Available Since: February 2008
BSDA
Exam:

Target audience is junior sysadmin with 6 months
experience

Covers 7 knowledge domains

Scored for 100 questions

Passing score is 500 of scale between 200 and
700
BSDA

Venue:

Community based: exam events hosted by
conferences, user groups, employers, and
schools

Slowly building a network of trusted testing
centers who promote BSD (FreeBSD Brasil,
Systemics Poland)
BSDA

BSDA Candidates:

~1300 BSDCG IDs issued (residing in 104
countries)

121 have taken exam (residing in 16 countries)

78 have passed exam (some not scored yet)

average score: 68%
BSDP

Process:

JTA currently open (and waiting your input)

Expected time frame between Exam
Requirements through Beta Period to Angoff
Session is 9-12 months

Exam delivery expected to be virtualized lab-
based environment
Works in Progress


Improved Availability:

Building network of trusted testing centers

Working towards an online solution in a proctored
environment (preferably open source)
Works in Progress
Study Materials:

Wiki is available for user generated content

Exam objectives translated to more languages
(currently English, Russian, Spanish)

Creation of study labs

Formation of study groups
Works in Progress
Sponsorship Suggestions:

Fund to assist proctors' travel expenses

Purchase of DVD helps to fund creation of BSDP
($9,400 in psychometric costs)

Fund to assist exam candidates who can't afford
exam or travel costs to exam

Startup costs for an online test delivery solution
How You Can Help
Take the JTA!

Spread the word—tell your school, employer, user
group, write an article, blog, twitter, etc.

Read our publications

Take the exam

Donate time (assist with study materials,
marketing, etc.)

Donate $ (e.g. purchase study DVD)
How You Can Help


Host or proctor an exam event

Become an SME

Help us develop an open source exam delivery
solution
Additional Information

JTA:
http://surveys.bsdcertification.org/phpESP/public/
survey.php?name=BSDP01_en

http://www.bsdcertification.org

https://register.bsdcertification.org//register/events

chair@bsdcertification.org

More Related Content

PDF
Meetbsd12
PDF
Lisa2011
ODP
BSD Certification: Using Open Source and Education to Accelerate Technology T...
PDF
Meetbsd Poland 2010
PDF
BSD Certification: A Case Study in Open Source Community
PPT
ace2003-h323-prof-devel.ppt
PPTX
"Elluminating" Technology: Virtual Outreach Strategies for Recruiting on a Bu...
PDF
Brown bsdmag june11
Meetbsd12
Lisa2011
BSD Certification: Using Open Source and Education to Accelerate Technology T...
Meetbsd Poland 2010
BSD Certification: A Case Study in Open Source Community
ace2003-h323-prof-devel.ppt
"Elluminating" Technology: Virtual Outreach Strategies for Recruiting on a Bu...
Brown bsdmag june11

What's hot (6)

DOCX
Colige 2014 5 activity template
PPT
TWT2003.ppt
PPTX
Digital Literacies Webinar RSC Scotland
PDF
Dr KOI Education Technology Management
PPTX
Assessment and Feedback start-up meeting Oct 2011
PPT
The Both/And of Faculty/Undergraduate Scholarship
Colige 2014 5 activity template
TWT2003.ppt
Digital Literacies Webinar RSC Scotland
Dr KOI Education Technology Management
Assessment and Feedback start-up meeting Oct 2011
The Both/And of Faculty/Undergraduate Scholarship
Ad

Viewers also liked (8)

PDF
Lavigne bsdmag dec2012
PDF
Tlf2013
PDF
Nelf2013
PDF
PDF
Dru lavigne oss-sysadmin
PDF
BSD for Linux Users
PDF
Bbb nycbug
PDF
Fsoss12
Lavigne bsdmag dec2012
Tlf2013
Nelf2013
Dru lavigne oss-sysadmin
BSD for Linux Users
Bbb nycbug
Fsoss12
Ad

Similar to BSD Certification Group: A Case Study in Open Source Certification (20)

PDF
Eurobsdcon 2010
PDF
Q and A for BSDMag
PPTX
Open Badges MOOC Session 12: James Willis
PPT
Electronic Portfolio Technology Options
PPT
LMS: Selecting the Right Tool
PDF
Lavigne bsdmag-april2012
PPTX
Adhyyan presentation.pptx
PPT
Washington university
PPT
Trends in Agile Testing by Lisa Crispin
PPTX
Open Badges Sandbox Introduction - Ryerson
PPTX
2024 Solution Challenge_ Info Session Presentation.pptx
PDF
BUILD YOUR BLUEPRINT FOR DIGITAL LEARNING: HOW TO TRANSFORM YOUR LEARNING ORG...
PPT
Open Source Maturity and Suitability
PPT
Kiwanis presentation 06-07-2011
PPT
Kiwanis Presentation 06-07-2011
PDF
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
PPTX
Developing World MOOCs
DOCX
QA_Resume
PPTX
Online pd web conferencing
PPTX
Open Badges for Higher Education
Eurobsdcon 2010
Q and A for BSDMag
Open Badges MOOC Session 12: James Willis
Electronic Portfolio Technology Options
LMS: Selecting the Right Tool
Lavigne bsdmag-april2012
Adhyyan presentation.pptx
Washington university
Trends in Agile Testing by Lisa Crispin
Open Badges Sandbox Introduction - Ryerson
2024 Solution Challenge_ Info Session Presentation.pptx
BUILD YOUR BLUEPRINT FOR DIGITAL LEARNING: HOW TO TRANSFORM YOUR LEARNING ORG...
Open Source Maturity and Suitability
Kiwanis presentation 06-07-2011
Kiwanis Presentation 06-07-2011
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
Developing World MOOCs
QA_Resume
Online pd web conferencing
Open Badges for Higher Education

More from Dru Lavigne (20)

PDF
Olf2018
PDF
Olf2017
PDF
FreeBSD System Administration Using SysAdm
PDF
Asiabsdcon2017
PDF
Olf2016
PDF
Tlf2016
PDF
Knoxbug2016
PDF
Lfnw2016
PDF
Flourish16
PDF
Scale2016
PDF
Fossetcon15
PDF
Lfnw15
PDF
Asiabsdcon15
PDF
Scale2015
PDF
Olf2014
PDF
PDF
Fossetcon14
PDF
Tlf2014
PDF
Asiabsdcon14 lavigne
PDF
Asiabsdcon14
Olf2018
Olf2017
FreeBSD System Administration Using SysAdm
Asiabsdcon2017
Olf2016
Tlf2016
Knoxbug2016
Lfnw2016
Flourish16
Scale2016
Fossetcon15
Lfnw15
Asiabsdcon15
Scale2015
Olf2014
Fossetcon14
Tlf2014
Asiabsdcon14 lavigne
Asiabsdcon14

Recently uploaded (20)

PDF
WOOl fibre morphology and structure.pdf for textiles
PDF
Architecture types and enterprise applications.pdf
PDF
project resource management chapter-09.pdf
PDF
Web App vs Mobile App What Should You Build First.pdf
PPTX
Chapter 5: Probability Theory and Statistics
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Hybrid model detection and classification of lung cancer
PDF
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PDF
August Patch Tuesday
PPTX
TLE Review Electricity (Electricity).pptx
PPTX
O2C Customer Invoices to Receipt V15A.pptx
PDF
Hindi spoken digit analysis for native and non-native speakers
PPTX
Tartificialntelligence_presentation.pptx
PDF
NewMind AI Weekly Chronicles – August ’25 Week III
PDF
Enhancing emotion recognition model for a student engagement use case through...
PPT
Module 1.ppt Iot fundamentals and Architecture
PDF
STKI Israel Market Study 2025 version august
PPTX
observCloud-Native Containerability and monitoring.pptx
WOOl fibre morphology and structure.pdf for textiles
Architecture types and enterprise applications.pdf
project resource management chapter-09.pdf
Web App vs Mobile App What Should You Build First.pdf
Chapter 5: Probability Theory and Statistics
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
Programs and apps: productivity, graphics, security and other tools
Hybrid model detection and classification of lung cancer
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
Assigned Numbers - 2025 - Bluetooth® Document
August Patch Tuesday
TLE Review Electricity (Electricity).pptx
O2C Customer Invoices to Receipt V15A.pptx
Hindi spoken digit analysis for native and non-native speakers
Tartificialntelligence_presentation.pptx
NewMind AI Weekly Chronicles – August ’25 Week III
Enhancing emotion recognition model for a student engagement use case through...
Module 1.ppt Iot fundamentals and Architecture
STKI Israel Market Study 2025 version august
observCloud-Native Containerability and monitoring.pptx

BSD Certification Group: A Case Study in Open Source Certification

  • 1. BSD Certification Group: A Case Study in Open Source Certification Dru Lavigne Chair, BSD Certification Group Inc. MNN, October 9, 2009
  • 2. Outline Certification 101 Bridging the Open Source / Certification / Academic Gap BSD Certification Group (BSDCG) BSDA (BSD Associate) BSDP (BSD Professional) Works in Progress How You Can Help
  • 3. Certification 101 Popularized in mid-90s by Novell, Microsoft, Cisco Associated with braindumps, paper MCSEs Very expensive to launch—domain of large, established companies with alternate revenue streams who can afford to wait ~2 yrs before certification program starts making money
  • 4. Certification 101 Traditional exam delivery costs: $75,000 USD annually to participate, extra fees for changing exam Monopoly on exam delivery (VUE/Prometric) --this is just starting to change Exam delivery software is proprietary, currently no open source solutions exist
  • 5. Certification 101 LPI started out as commercial/community based, current focus is commercial Other Certification bodies: Zend for PHP, EnterpriseDB for PostgreSQL, Canonical for Ubuntu Other open source communities (Apache, Gnome) have expressed interest Cost, time, and expertise are huge barriers
  • 6. Gap: Open Source Strengths: if you take away the “code”, what are you left with? Built-in mentorship opportunities for learning real- world skills Community of like-minded individuals Networking with others of differing skill-levels from across the globe in area of interest
  • 7. Gap: Open Source Weaknesses: provide a good measurement of a community's maturity level Focus is on code and developers, while other community skills and resources are ignored Processes and culture vary widely between communities Documentation is not considered important, written processes and training materials are virtually non-existent
  • 8. Gap: Certification Strengths: provide a good measure of the quality/goals of a certification program Assist employers by assessing a published set of skills Increase the recognition and use of a software product Provide job seekers with an advantage over other applicants
  • 9. Gap: Certification Weaknesses: too many to fit on one slide :-) Cost: to exam taker and certifying organization Monopoly on exam delivery solutions (all proprietary) Rarely available in languages other than English Difficult to keep exam content secure Training is often boot-camp style to pass the exam, not learn real-world skills or understanding
  • 10. Gap: Academia Strengths: Time to learn understanding and skills in a larger context Institution must follow established guidelines for student assessment Institution provides reputation
  • 11. Gap: Academia Weaknesses: depend on type of program on type of institution Knowledge may be more theoretical than practical Program may not include networking/placements with potential employers Institution may not have a global reputation
  • 12. Bridging the Gap Benefits to Open Source Community: Increased exposure and reputation New contributing members with varied skillsets Reason to document processes and how to use the software
  • 13. Bridging the Gap Benefits to Academic Institution: for both undergraduate and thesis programs Increased global exposure and reputation Introduces students to potential employers and colleagues Provides students with hard and soft skills in a non-artificial environment Opens research and commercialization opportunities
  • 14. BSDCG Registered non-profit incorporated in the state of New Jersey in 2005 Mission is to create and maintain certifications to assess skills of BSD system administrators Community based with a legal governance infrastructure Relies on open source methodologies and volunteer contributions of time and money
  • 15. BSDCG Internal Structure: 5 Board of Directors (voted in for a term) 21 BSDCG members with voting rights (volunteer to join) 5 Advisory Board members (invited) 9 SMEs (subject matter experts) 1 (paid) psychometrician Network of trusted exam proctors
  • 16. BSDCG Community Structure: ~700 subscribers to 2 mailing lists 147 members of 2 Linkedin groups ~90 translators for 22 languages Donated hardware, bandwidth, system administration, and web development Ongoing relationships with other certification bodies and educational institutions
  • 17. BSDCG Community Based: Remains separate from, but supports the other BSD projects and Foundations Works closely with employers and sysadmins to keep exam current and “real” Advocates the integraton of exam objectives into existing diploma programs (rather than bootcamp style learning)
  • 18. BSDCG Psychometrically Valid: Ensures exam is fair, unbiased, and understandable, even if English is not your first language SMEs who are working sysadmins keep the exam practical Use of ongoing metrics keeps questions current and spots anomalies
  • 19. BSDCG Exam goals: Globally affordable ($75 USD) √ Available in local community, and where warranted, in local language Encourage local study groups and creation of training materials (both open and commercial)
  • 20. BSDA Process: Job Task Analysis (JTA): April - July 2005 Exam Requirements published: October 2005 Beta Period: May - August 2007 Angoff Session: January 2008 Available Since: February 2008
  • 21. BSDA Exam: Target audience is junior sysadmin with 6 months experience Covers 7 knowledge domains Scored for 100 questions Passing score is 500 of scale between 200 and 700
  • 22. BSDA Venue: Community based: exam events hosted by conferences, user groups, employers, and schools Slowly building a network of trusted testing centers who promote BSD (FreeBSD Brasil, Systemics Poland)
  • 23. BSDA BSDA Candidates: ~1300 BSDCG IDs issued (residing in 104 countries) 121 have taken exam (residing in 16 countries) 78 have passed exam (some not scored yet) average score: 68%
  • 24. BSDP Process: JTA currently open (and waiting your input) Expected time frame between Exam Requirements through Beta Period to Angoff Session is 9-12 months Exam delivery expected to be virtualized lab- based environment
  • 25. Works in Progress Improved Availability: Building network of trusted testing centers Working towards an online solution in a proctored environment (preferably open source)
  • 26. Works in Progress Study Materials: Wiki is available for user generated content Exam objectives translated to more languages (currently English, Russian, Spanish) Creation of study labs Formation of study groups
  • 27. Works in Progress Sponsorship Suggestions: Fund to assist proctors' travel expenses Purchase of DVD helps to fund creation of BSDP ($9,400 in psychometric costs) Fund to assist exam candidates who can't afford exam or travel costs to exam Startup costs for an online test delivery solution
  • 28. How You Can Help Take the JTA! Spread the word—tell your school, employer, user group, write an article, blog, twitter, etc. Read our publications Take the exam Donate time (assist with study materials, marketing, etc.) Donate $ (e.g. purchase study DVD)
  • 29. How You Can Help Host or proctor an exam event Become an SME Help us develop an open source exam delivery solution