SlideShare a Scribd company logo
What Placement Means,
How to Claim it with Integrity,
and Build Metrics to
Support Your Work
September 13, 2013
Valparasio, Indiana

Linda Gross, Ph.D
© 2013
A little self assessment
1. Data
a.
b.
c.
d.

Downer
Dread
Distress
Delight

2. Placement
a.
b.
c.
d.

Panic
Phobia
Paranoia
Pleasure

3. Statistics
a.
b.
c.
d.

Stress
Suffering
Sweat
Sensational

4. Annual Report
a.
b.
c.
d.

Angst
Anxiety
Apprehension
Amusement
An Ostrich Lesson
Contexts & Challenges
Complaints about college ROI rise
as a YouTube genre
What is driving the
placement data obsession?
• Return on investment (ROI) concerns
– How can we measure the value of a college education?

• Economic pressures
–
–
–
–

Rapid tuition and fee inflation
Erosion of public funding for state institutions
Rising institutional costs (health care)
Market competitiveness

• Increased need for public accountability
–
–
–
–

Student debt load and loan default
Completion rates
Gainful employment
High profile scandals both public, private and for profit
Are college graduates more likely to be
unemployed?

New York Times, May 3, 2013
Is placement data Voodoo Science?
What may begin as an
honest error, however, has a
way of evolving through
almost imperceptible steps
from self-delusion to fraud.
The line between foolishness
and fraud is thin. Because it
is not always easy to tell
when that line is crossed, I
use the term voodoo
science to cover them all…
(Page 10)
The Problems with “Placement”
• Antiquated Terminology
• Methodology
– Contrived formulas designed to yield the highest placement
rate
– No consistency between institutions
– Even the NCES has been reluctant to define a universal
methodology

• Fraud
– Career Education Corporation $10.3 million fraud settlement
for inflating job placement data
– ATI Enterprises (a career training company) will pay the federal
government $3.7 million to resolve compliance issues with
federal aid and job placement data
Toward a Better Paradigm
The Power of Transparency
• Methodology
• Clear definition of the
survey population
• Response rates
• Practicality
– data mining and ethical
judgment

• Timing
• Clear definition of terms
– What is placed?
– What is unplaced?
– What about those we can’t
resolve
A Case Example

Michigan State University
Destination Survey
Owning our knowledge
What goes into a student’s
post-graduation destination?
What counts with employers?

Internships
Leadership in
a professional
organization

Study
Abroad
Supervised
civic
engagement

Leadership in a
nonprofessional
organization

Scholarly
research
with
faculty

Internationa
Internship

Faculty
supervised
applied
research
project with
company

Gardner, P. (2011) Recruiting Trends, Collegiate Employment Research Institute, Michigan State University
Student Activities
Academics

Internships

Service
Work

Family

Study Abroad

Daily
living
stuff

Finances

Social life
Reflective Learning Model

• Academic courses
• Internships, co-ops,
practica, service
• Leadership experiences
• Study abroad
• Life events &
relationships

LEARNING
CATALYSTS

REFLECTION
• Self awareness
• Skill identification
• Critical thinking
• Decision-making
• Learning

• Articulating growth &
skill development
• Boundary spanning
problem solving
• Ability to contribute
• Transition awareness

INTEGRATION

Gross, L. (2000) Michigan State University
We are stewards of student experiences
Passionate people take risks.
Spanning boundaries with purpose and integrity
We have unique assets to integrate,
innovate and advance higher education
• Insight into what
students find meaningful

• Working knowledge of
employer expectations
for new graduates
• Ability to identify gaps in
student preparation for
their destination upon
graduation
Harnessing the Power of Big Data
What kind of data are you sitting on?
• Student usage of career
services
–
–
–
–
–
–

Counseling
Workshops
Career fair attendance
Interviews
Information sessions
Job applications

• Student employment data
–
–
–
–
–

Hours worked
Level of responsibility
Pay rates
Work study
Internships

• Student destination data
Practical Accountability – Real Time
College or
Department
Arts
Business
Education
Engineering
Health
Sciences
Social
Sciences

Career
Counseling

Career
Assessment

Workshops

Career Fairs

Job Listings

Job
Applications

Interviews
What data do you have/need access to?
• Institutional student
information systems
–
–
–
–
–

Student demographics
Academic data
Retention data
Financial need
Academic internship
courses
– Civic engagement
participation
– Study abroad
participation
– Undergraduate research
A Model for Multidimensional Measures
Student Interactions
Counseling, Workshops, Career
Fairs, Interviews, Career
Assessments

Student Experiences
Student Employment,
Leadership, Civic Engagement,
Research, Internships, Co-ops,
Study Abroad

Aggregate
Student Data Warehouse
Multidimensional Measures
for College Outcomes

Student Learning Outcomes
Curricular , Co-Curricular and
support services

Student Destination Data
Follow up Alumni Data

Student Academic and
Demographic Data
(Institutional Student
Information Systems)

© Gross, L. (2013)
ADVOCATE!
Colleges and universities MUST be
more explicit about co-curricular
learning expectations
The Ostrich Revisited
Discussion
Linda Gross, Ph.D.
Career Services Network
Michigan State University
GrossL@msu.edu
Resources
• MSU Destination Survey online:
– http://careernetwork.msu.edu/exploringoptions/destination-survey.html
– Includes latest full report as .pdf and links to sections of
the report including methodology, survey pool, timing,
and terms definitions.

• MSU Collegiate Employment Research Institute
– http://www.ceri.msu.edu/
– Publications include the “high states internship” and
“unpacking” http://www.ceri.msu.edu/ceri-publications/

More Related Content

PDF
Fall 2013 Conference Keynote Presentation-Dr. Linda Gross
PPTX
Measuring Adult Student Gains and Satisfaction After Earning an Undergraduate...
PPTX
GradSTAT: Where Are They Now?
PPTX
Zeine et al. Customer Service Focus and Mission Articulation in HEd., Oxford ...
PDF
Adult Student Gains Degree, Demographic, and Motivational Insights
PDF
1710 track1 bagirov
PDF
College Admissions: What Do Admissions Directors Consider? [Infographic]
PPTX
Culture and learning organisations
Fall 2013 Conference Keynote Presentation-Dr. Linda Gross
Measuring Adult Student Gains and Satisfaction After Earning an Undergraduate...
GradSTAT: Where Are They Now?
Zeine et al. Customer Service Focus and Mission Articulation in HEd., Oxford ...
Adult Student Gains Degree, Demographic, and Motivational Insights
1710 track1 bagirov
College Admissions: What Do Admissions Directors Consider? [Infographic]
Culture and learning organisations

What's hot (19)

PDF
An insight into Educational Data Mining at Muğla Sıtkı Koçman University, Turkey
PPTX
Measuring What Matters; Noncognitive Skills - Webinar Hosted by NUTN
PPTX
Ellen Wagner: Putting Data to Work
PPTX
Visix engaging students at the college of charleston digital signage case s...
PDF
GEMEnA update for COPAFS Quarterly Meeting June 2015
PPTX
From Reporting to Insight to Action
PDF
Key Findings from Focus Groups with College Students
PDF
De hoyos murillo_topham_siop_2013_poster
PDF
Further disadvantages for disadvantaged learners in England
PPTX
Learning Analytics in Education: Using Student’s Big Data to Improve Teaching
PDF
Aiming Higher Education at Great Jobs & Great Lives
PDF
Naviance Class of 2015 [Infographic]
PPTX
Student return on investment
PPT
IES Grant Writing Workshop for HBCUs 071210
PPT
Grant Writing Workshop for HBCUs 071210
PPTX
The Role of Non-Cognitive Indicators in Predictive and Proactive Analytics: T...
PPTX
What data can deliver: A new way of operating
PDF
Traditional Large Scale Educational Assessment and the Incorporation of Digit...
PPTX
What happens after graduating from university? Alison Head
An insight into Educational Data Mining at Muğla Sıtkı Koçman University, Turkey
Measuring What Matters; Noncognitive Skills - Webinar Hosted by NUTN
Ellen Wagner: Putting Data to Work
Visix engaging students at the college of charleston digital signage case s...
GEMEnA update for COPAFS Quarterly Meeting June 2015
From Reporting to Insight to Action
Key Findings from Focus Groups with College Students
De hoyos murillo_topham_siop_2013_poster
Further disadvantages for disadvantaged learners in England
Learning Analytics in Education: Using Student’s Big Data to Improve Teaching
Aiming Higher Education at Great Jobs & Great Lives
Naviance Class of 2015 [Infographic]
Student return on investment
IES Grant Writing Workshop for HBCUs 071210
Grant Writing Workshop for HBCUs 071210
The Role of Non-Cognitive Indicators in Predictive and Proactive Analytics: T...
What data can deliver: A new way of operating
Traditional Large Scale Educational Assessment and the Incorporation of Digit...
What happens after graduating from university? Alison Head
Ad

Viewers also liked (9)

PPTX
Handcrafting the senior survey public
PPTX
Painting the Picture of Graduate Employment: Detailing the Process of Collect...
PPT
Indiana inter nnet presentation
PPTX
Moving toward a better understanding
PPTX
Working in social media
PDF
Iwis presentation
PPTX
Professional development session cdpi fall 2010 conf
PDF
Placement Gone Wild: Lessons Learned in Law School Career Development
PPTX
Stories from across the pond how uk career services collect and use destinat...
Handcrafting the senior survey public
Painting the Picture of Graduate Employment: Detailing the Process of Collect...
Indiana inter nnet presentation
Moving toward a better understanding
Working in social media
Iwis presentation
Professional development session cdpi fall 2010 conf
Placement Gone Wild: Lessons Learned in Law School Career Development
Stories from across the pond how uk career services collect and use destinat...
Ad

Similar to Cdpi keynote (20)

PPTX
Why Careeer Outcomes Data are Important
PDF
All Hands on Deck: An Integrated Approach to Career Development- Part I
PPTX
Naspa career summit presentation public
PPTX
Dennis Pruitt: Student Affairs in the 21st Century
PPTX
Career Pathways: Five Ways to Connect College and Careers
PDF
Revisioning career services
PDF
Millennial survey report final914
PPTX
Career-Development-in-Higher-Education.pptx
PPTX
Redefining Work: Career Services and Recruiting for Traditional, Virtual and ...
PDF
True North: Basing brand strategy on market data
PDF
Back to School: The ABCs of Campus Recruiting Metrics
PPTX
Career services department update
PPTX
2014 05-14 brewster
PPTX
Context, customers, and strategic enrollment management today
PPTX
Citadel Career Center - Leading the way
PDF
Changing Practices to Meet Changing Expectations
PDF
2015 First Destination Report
PPT
"CMC Moving Ahead": Assessment In-Service 2010
 
PPTX
Presentation for task force 2012
DOCX
Career Center PLAN BOOK
Why Careeer Outcomes Data are Important
All Hands on Deck: An Integrated Approach to Career Development- Part I
Naspa career summit presentation public
Dennis Pruitt: Student Affairs in the 21st Century
Career Pathways: Five Ways to Connect College and Careers
Revisioning career services
Millennial survey report final914
Career-Development-in-Higher-Education.pptx
Redefining Work: Career Services and Recruiting for Traditional, Virtual and ...
True North: Basing brand strategy on market data
Back to School: The ABCs of Campus Recruiting Metrics
Career services department update
2014 05-14 brewster
Context, customers, and strategic enrollment management today
Citadel Career Center - Leading the way
Changing Practices to Meet Changing Expectations
2015 First Destination Report
"CMC Moving Ahead": Assessment In-Service 2010
 
Presentation for task force 2012
Career Center PLAN BOOK

More from cdpindiana (14)

PPTX
Moving Toward a Better Understanding of what Employers 'Want' from College Gr...
PDF
Indiana Workforce Intelligence Systems
PPT
Increasing Internships , Increasing Placement: Focusing on the Student with F...
PPTX
Handcrafting the Senior Survey
PPTX
Stories from Across the Pond: How UK Career Services Collect & Use Destinatio...
PPT
Career exploration trip presentation for cdpi (1)
PPT
Career development through the lens of positive youth development
PPTX
Gerry dick keynote
PPTX
Indiana's college and career pathways
PPTX
Ready for work 2011
PPTX
Your students are certifiable
PPTX
Sheila curran powerpoint
PPTX
Career centers and libraries leading together
PPT
Harness the power of the web
Moving Toward a Better Understanding of what Employers 'Want' from College Gr...
Indiana Workforce Intelligence Systems
Increasing Internships , Increasing Placement: Focusing on the Student with F...
Handcrafting the Senior Survey
Stories from Across the Pond: How UK Career Services Collect & Use Destinatio...
Career exploration trip presentation for cdpi (1)
Career development through the lens of positive youth development
Gerry dick keynote
Indiana's college and career pathways
Ready for work 2011
Your students are certifiable
Sheila curran powerpoint
Career centers and libraries leading together
Harness the power of the web

Recently uploaded (20)

PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PPTX
Introduction to pro and eukaryotes and differences.pptx
PPTX
Unit 4 Computer Architecture Multicore Processor.pptx
PDF
Computing-Curriculum for Schools in Ghana
PPTX
Share_Module_2_Power_conflict_and_negotiation.pptx
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PDF
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PDF
Weekly quiz Compilation Jan -July 25.pdf
PDF
AI-driven educational solutions for real-life interventions in the Philippine...
PPTX
History, Philosophy and sociology of education (1).pptx
PDF
Hazard Identification & Risk Assessment .pdf
PDF
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
advance database management system book.pdf
PPTX
TNA_Presentation-1-Final(SAVE)) (1).pptx
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Introduction to pro and eukaryotes and differences.pptx
Unit 4 Computer Architecture Multicore Processor.pptx
Computing-Curriculum for Schools in Ghana
Share_Module_2_Power_conflict_and_negotiation.pptx
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
Chinmaya Tiranga quiz Grand Finale.pdf
LDMMIA Reiki Yoga Finals Review Spring Summer
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
Weekly quiz Compilation Jan -July 25.pdf
AI-driven educational solutions for real-life interventions in the Philippine...
History, Philosophy and sociology of education (1).pptx
Hazard Identification & Risk Assessment .pdf
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
advance database management system book.pdf
TNA_Presentation-1-Final(SAVE)) (1).pptx
A powerpoint presentation on the Revised K-10 Science Shaping Paper

Cdpi keynote

  • 1. What Placement Means, How to Claim it with Integrity, and Build Metrics to Support Your Work September 13, 2013 Valparasio, Indiana Linda Gross, Ph.D © 2013
  • 2. A little self assessment 1. Data a. b. c. d. Downer Dread Distress Delight 2. Placement a. b. c. d. Panic Phobia Paranoia Pleasure 3. Statistics a. b. c. d. Stress Suffering Sweat Sensational 4. Annual Report a. b. c. d. Angst Anxiety Apprehension Amusement
  • 5. Complaints about college ROI rise as a YouTube genre
  • 6. What is driving the placement data obsession? • Return on investment (ROI) concerns – How can we measure the value of a college education? • Economic pressures – – – – Rapid tuition and fee inflation Erosion of public funding for state institutions Rising institutional costs (health care) Market competitiveness • Increased need for public accountability – – – – Student debt load and loan default Completion rates Gainful employment High profile scandals both public, private and for profit
  • 7. Are college graduates more likely to be unemployed? New York Times, May 3, 2013
  • 8. Is placement data Voodoo Science? What may begin as an honest error, however, has a way of evolving through almost imperceptible steps from self-delusion to fraud. The line between foolishness and fraud is thin. Because it is not always easy to tell when that line is crossed, I use the term voodoo science to cover them all… (Page 10)
  • 9. The Problems with “Placement” • Antiquated Terminology • Methodology – Contrived formulas designed to yield the highest placement rate – No consistency between institutions – Even the NCES has been reluctant to define a universal methodology • Fraud – Career Education Corporation $10.3 million fraud settlement for inflating job placement data – ATI Enterprises (a career training company) will pay the federal government $3.7 million to resolve compliance issues with federal aid and job placement data
  • 10. Toward a Better Paradigm
  • 11. The Power of Transparency • Methodology • Clear definition of the survey population • Response rates • Practicality – data mining and ethical judgment • Timing • Clear definition of terms – What is placed? – What is unplaced? – What about those we can’t resolve
  • 12. A Case Example Michigan State University Destination Survey
  • 13. Owning our knowledge What goes into a student’s post-graduation destination?
  • 14. What counts with employers? Internships Leadership in a professional organization Study Abroad Supervised civic engagement Leadership in a nonprofessional organization Scholarly research with faculty Internationa Internship Faculty supervised applied research project with company Gardner, P. (2011) Recruiting Trends, Collegiate Employment Research Institute, Michigan State University
  • 16. Reflective Learning Model • Academic courses • Internships, co-ops, practica, service • Leadership experiences • Study abroad • Life events & relationships LEARNING CATALYSTS REFLECTION • Self awareness • Skill identification • Critical thinking • Decision-making • Learning • Articulating growth & skill development • Boundary spanning problem solving • Ability to contribute • Transition awareness INTEGRATION Gross, L. (2000) Michigan State University
  • 17. We are stewards of student experiences
  • 18. Passionate people take risks. Spanning boundaries with purpose and integrity
  • 19. We have unique assets to integrate, innovate and advance higher education • Insight into what students find meaningful • Working knowledge of employer expectations for new graduates • Ability to identify gaps in student preparation for their destination upon graduation
  • 20. Harnessing the Power of Big Data
  • 21. What kind of data are you sitting on? • Student usage of career services – – – – – – Counseling Workshops Career fair attendance Interviews Information sessions Job applications • Student employment data – – – – – Hours worked Level of responsibility Pay rates Work study Internships • Student destination data
  • 22. Practical Accountability – Real Time College or Department Arts Business Education Engineering Health Sciences Social Sciences Career Counseling Career Assessment Workshops Career Fairs Job Listings Job Applications Interviews
  • 23. What data do you have/need access to? • Institutional student information systems – – – – – Student demographics Academic data Retention data Financial need Academic internship courses – Civic engagement participation – Study abroad participation – Undergraduate research
  • 24. A Model for Multidimensional Measures Student Interactions Counseling, Workshops, Career Fairs, Interviews, Career Assessments Student Experiences Student Employment, Leadership, Civic Engagement, Research, Internships, Co-ops, Study Abroad Aggregate Student Data Warehouse Multidimensional Measures for College Outcomes Student Learning Outcomes Curricular , Co-Curricular and support services Student Destination Data Follow up Alumni Data Student Academic and Demographic Data (Institutional Student Information Systems) © Gross, L. (2013)
  • 25. ADVOCATE! Colleges and universities MUST be more explicit about co-curricular learning expectations
  • 27. Discussion Linda Gross, Ph.D. Career Services Network Michigan State University GrossL@msu.edu
  • 28. Resources • MSU Destination Survey online: – http://careernetwork.msu.edu/exploringoptions/destination-survey.html – Includes latest full report as .pdf and links to sections of the report including methodology, survey pool, timing, and terms definitions. • MSU Collegiate Employment Research Institute – http://www.ceri.msu.edu/ – Publications include the “high states internship” and “unpacking” http://www.ceri.msu.edu/ceri-publications/