SlideShare a Scribd company logo
EXPLORING INNOVATIVE AND
EFFECTIVE METHODS FOR
IQA
– RESEARCH FRAMEWORK
CIES Conference, Vancouver
6-10 March 2016
MICHAELA MARTIN,
IIEP Programme Specialist
An IIEP research project
THIS PANEL
 The IIEP research project on « Exploring
innovative and effective solutions for
internal quality assurance (IQA)»
 The case of IQA at Xiamen University
 A comparative overview on the research
findings
 A commentary on the project
1. Introduction
 « Quality crisis » in higher education since
1980s
 International trend : External Quality
Assurance (EQA)
 Since 2000, EQA is a major focus of
research and capacity development at the
UNESCO/IIEP
 But without IQA, no sustainable quality
improvement
 IQA therefore is a major reform strand
 in HE worldwide
2. Variation in definition of IQA
 Internal Quality Assurance: procedures and
instruments which measure whether a higher
education institution is in line with external
standards and its own development goals in its
fields of activities (UNESCO).
 IQA refers to quality enhancement processes if
they are directly derived from measurement
procedures and instruments (ESG)
 IQA systems are an integrated whole which
together support quality policy and institutional
goals (IIEP).
3. Major Challenges
 Articulation of IQA instruments among each other
 Articulation of IQA with strategic planning,
management
 Balance between centralized and decentralized
structures
 Information systems, data management and
analytical capacities
 Human and financial resource constraints
4. Three major research
questions
 What are innovative and effective options for IQA
policy, structures, processes and instruments ?
 What are the effects of such IQA systems on
 the quality and relevance of academic programmes
(employability of graduates), and
 managerial effectiveness ?
 What internal and external factors condition the
effective functioning of IQA systems?
6. Research methodology
Case study research design
 Better understand IQA systems within
their national and institutional contexts
 Exploratory and descriptive design
 Mixed methods data collection process
to study the effects
7. IIEP’s role in the project
 IIEP set the research framework
 IIEP selected identified the universities
selected as case studies and the research
teams
 IIEP prepared the research instruments and
discussed methodology with the research
teams
 IIEP accompanied the preparation of the case
studies, organized a research validation
workshop
8. Primary Data sources
Integrated qualitative and quantitative design
 Online surveys of academic and administrative staff on
perceptions of the local IQA system, their effects and
conditioning factors
 Semi-structured interviews with key actors
 Central and middle level academic and
administrative decision-makers
 Focus group discussions
 Head of departments with selected programme
directors
 Students
9. Secondary Data sources
 Content analysis of official documents to
document effects
 EQA Reports (e.g. institutional or programme
accreditation)
 University annual reports
 University statistics
 Reports produced by IQA structure
 Triangulation of different actors’ perspectives
 Triangulation of perceptions and secondary
data sources
10. Selection of eight university
case studies
Europe:
▪ University of Duisburg-Essen, Germany
▪ Economics University of Vienna, Austria
Asia:
▪ Xiamen University, China
▪ International American
University of Bangladesh
Anglophone Africa:
▪ Daystar University, Kenya
▪ University of the Free State, South Africa
Latin America region:
▪ Talca University, Chile
Arab region:
▪ University of Bahrain
11. Scope and limitations
 Focus on IQA mainly in the domain of T&L and
management, not on research
 Actors’ perceptions only a proxy for change,
not impact assessment
 Case study design does not produce
generalizable results, however insights into the
effective functioning of IQA methods in specific
contexts

More Related Content

PPTX
Exploring Innovative and Effective Methods for IQA
PPTX
From assessment to action
PDF
Jekaterina Rogaten
PPT
Aa group overview final
PDF
Shared Responsibility in Accountability
PDF
Sunil Maher
PDF
Chris Millward
PPT
OECD Reviews of Evaluation and Assessment in Education: SWEDEN Implementing p...
Exploring Innovative and Effective Methods for IQA
From assessment to action
Jekaterina Rogaten
Aa group overview final
Shared Responsibility in Accountability
Sunil Maher
Chris Millward
OECD Reviews of Evaluation and Assessment in Education: SWEDEN Implementing p...

What's hot (20)

PDF
Sharon Smith
PPTX
HEIR conference 8-9 September 2014: Forsyth and Stubbs
PPTX
Learn@UW Executive Committee Roadmap Presentation, July 2014
PPSX
Interim report and main findings, by Lasakova, Bajzikova & Sasso
PPTX
Texas STaR Chart Presentation
PPT
Defining Excellence In Learning Resource Provision
PDF
Linq 2013 session_red_3_sarsenbayeva
PDF
Peter Chatterton
PPTX
Ossiannilsson e solve_balaton2014_final
PPTX
Learning analytics bij de Universiteit van Amsterdam en ROC Noorderpoort
PPTX
DETA Research Center Update
PPTX
Technical Advisory Group (TAG) recommendation for education
PPTX
Conducting Research on Blended and Online Education: A Research Toolkit
PPTX
Promoting student access and success through research
PPTX
Using A Research Lens To Examine Your COVID-19 Pandemic Response
PDF
Excellence rome - v03 2016
PPTX
Summary of SA Trip
PDF
Bob Gilworth
PPTX
Distance Education and Technological Advancement (DETA)
PDF
Edlw tel 2016_0ssiannilsson
Sharon Smith
HEIR conference 8-9 September 2014: Forsyth and Stubbs
Learn@UW Executive Committee Roadmap Presentation, July 2014
Interim report and main findings, by Lasakova, Bajzikova & Sasso
Texas STaR Chart Presentation
Defining Excellence In Learning Resource Provision
Linq 2013 session_red_3_sarsenbayeva
Peter Chatterton
Ossiannilsson e solve_balaton2014_final
Learning analytics bij de Universiteit van Amsterdam en ROC Noorderpoort
DETA Research Center Update
Technical Advisory Group (TAG) recommendation for education
Conducting Research on Blended and Online Education: A Research Toolkit
Promoting student access and success through research
Using A Research Lens To Examine Your COVID-19 Pandemic Response
Excellence rome - v03 2016
Summary of SA Trip
Bob Gilworth
Distance Education and Technological Advancement (DETA)
Edlw tel 2016_0ssiannilsson
Ad

Viewers also liked (16)

PPTX
Crisis sensitive planning: from education in emergencies to conflict and disa...
PPTX
CIES 2017 / Data revolution : Private funding and equity in education
PPT
School grants - from a promising to a successful policy
PPT
CIES 2017 / Learning from Ecuador's attemp to reform teacher policies
PPTX
Teacher careers
PDF
Financing the Education 2030 agenda - Key issues and challenges for national ...
PPTX
PISA: Where is real progress being made in provinding equitable education?
PPTX
Exploring the impact of career models on teacher motivation: An exploratory s...
PPTX
Crisis-sensitive planning in education: lessons learned
PDF
Associations, Networks, Alliances etc.: Making Sense of the Emerging Global H...
PPTX
Global Partnership for Education Webinar on National Education Account
PPT
Storify It!
PPTX
e-Forum Leaving no one behind: planning education for the inclusion of displa...
PPTX
Capacity development in planning for displaced populations - Ethiopia
PPT
Réseaux Sociaux 5 - Formation sur les réseaux sociaux professionnels - pour ...
PPTX
Reseaux sociaux professionnels- Curation de contenu - Scoop.it, Storify, Pape...
Crisis sensitive planning: from education in emergencies to conflict and disa...
CIES 2017 / Data revolution : Private funding and equity in education
School grants - from a promising to a successful policy
CIES 2017 / Learning from Ecuador's attemp to reform teacher policies
Teacher careers
Financing the Education 2030 agenda - Key issues and challenges for national ...
PISA: Where is real progress being made in provinding equitable education?
Exploring the impact of career models on teacher motivation: An exploratory s...
Crisis-sensitive planning in education: lessons learned
Associations, Networks, Alliances etc.: Making Sense of the Emerging Global H...
Global Partnership for Education Webinar on National Education Account
Storify It!
e-Forum Leaving no one behind: planning education for the inclusion of displa...
Capacity development in planning for displaced populations - Ethiopia
Réseaux Sociaux 5 - Formation sur les réseaux sociaux professionnels - pour ...
Reseaux sociaux professionnels- Curation de contenu - Scoop.it, Storify, Pape...
Ad

Similar to Exploring Innovative and Effective Methods for IQA - Research Framework (20)

PPT
Paper 5: Study of the Model and Methodology for Institute Evaluation (Yang)
PDF
International Journal of Engineering Research and Development
PPTX
Governing Quality Of Online Content Through Threshold Standards: Facilitating...
PPT
Assessment of Higher Education Learning Outcomes
PDF
Chelyabinsk2016 anttila
PPTX
Preparing for an inter-institutional Benchmarking activity using the ACODE Be...
PDF
Effectiveness of a proposed system design on academic management of kampala i...
PDF
Vilnius pres dianne lalancette
PDF
A Systematic Literature Review Of Research Into Career-Related Interventions ...
PDF
Ossiannilsson evaluation and accreditation for quality assurance in higher di...
PPTX
Academic and administrative audit (AAA)
PPT
תכנית קרב יחידת הערכה
PPTX
Learning Analytics – Research challenges arising from a current review of LA use
PDF
A_Proposed_Quality_Assurance_Procedure_f.pdf
PPTX
Research and Innovation Indicators and their relation to internationalization...
PPT
Prium Vienna 2008 Eval 2 * PRIUM Project : What is next ?
PPT
B08 B4pc 142 Diapo Miedes En
PPT
Attributes of quality programs
PPTX
It Governance at UJI
PPTX
Program Evaluation educational research methods
Paper 5: Study of the Model and Methodology for Institute Evaluation (Yang)
International Journal of Engineering Research and Development
Governing Quality Of Online Content Through Threshold Standards: Facilitating...
Assessment of Higher Education Learning Outcomes
Chelyabinsk2016 anttila
Preparing for an inter-institutional Benchmarking activity using the ACODE Be...
Effectiveness of a proposed system design on academic management of kampala i...
Vilnius pres dianne lalancette
A Systematic Literature Review Of Research Into Career-Related Interventions ...
Ossiannilsson evaluation and accreditation for quality assurance in higher di...
Academic and administrative audit (AAA)
תכנית קרב יחידת הערכה
Learning Analytics – Research challenges arising from a current review of LA use
A_Proposed_Quality_Assurance_Procedure_f.pdf
Research and Innovation Indicators and their relation to internationalization...
Prium Vienna 2008 Eval 2 * PRIUM Project : What is next ?
B08 B4pc 142 Diapo Miedes En
Attributes of quality programs
It Governance at UJI
Program Evaluation educational research methods

More from IIEP-UNESCO (9)

PDF
Geospatial data in educational planning
PPTX
#GlobalEducationMeeting Household Investments in education: equity concerns
PPTX
#CIES2018 Widening career opportunities available to teachers: a road to enha...
PPTX
Using networks to strengthen National Training Institutions (NTIs)
PPTX
#CIES2018 National Institute for Educational Planning, Afghanistan: From wor...
PDF
#CIES2018 The role of the National Institute of Education (NIE) in strengthen...
PDF
Debate: How does private schooling growth affect the public system and educat...
PPTX
IIEP-UNESCO Strategic Debate: the impact of inequalities on learning achievement
PPTX
Analyzing crises and planning for development: the example of South Sudan
Geospatial data in educational planning
#GlobalEducationMeeting Household Investments in education: equity concerns
#CIES2018 Widening career opportunities available to teachers: a road to enha...
Using networks to strengthen National Training Institutions (NTIs)
#CIES2018 National Institute for Educational Planning, Afghanistan: From wor...
#CIES2018 The role of the National Institute of Education (NIE) in strengthen...
Debate: How does private schooling growth affect the public system and educat...
IIEP-UNESCO Strategic Debate: the impact of inequalities on learning achievement
Analyzing crises and planning for development: the example of South Sudan

Recently uploaded (20)

PDF
How FPOs Are Reshaping Agriculture in Maharashtra?
PPTX
Introduction_to_the_Study_of_Globalization.pptx
PDF
PPT Item #s 2&3 - 934 Patterson SUP & Final Review
PDF
Item # 5 - 5307 Broadway St final review
PPTX
STG - Sarikei 2025 Coordination Meeting.pptx
PDF
Item # 2 - 934 Patterson Specific Use Permit (SUP)
PDF
26.1.2025 venugopal K Awarded with commendation certificate.pdf
PPTX
DFARS Part 249 - Termination Of Contracts
PPTX
Inferenceahaiajaoaakakakakakakakakakakakakaka
PDF
2025 Shadow report on Ukraine's progression regarding Chapter 29 of the acquis
PPTX
Omnibus rules on leave administration.pptx
PPTX
PCCR-ROTC-UNIT-ORGANIZATIONAL-STRUCTURE-pptx-Copy (1).pptx
DOCX
Alexistogel: Solusi Tepat untuk Anda yang Cari Bandar Toto Macau Resmi
PDF
The Role of FPOs in Advancing Rural Agriculture in India
PPT
generalgeologygroundwaterchapt11-181117073208.ppt
PPT
Adolescent Health Orientation and Health care
PDF
PPT Items # 6&7 - 900 Cambridge Oval Right-of-Way
PPTX
AMO Pune Complete information and work profile
PDF
PPT - Primary Rules of Interpretation (1).pdf
PDF
oil palm convergence 2024 mahabubnagar.pdf
How FPOs Are Reshaping Agriculture in Maharashtra?
Introduction_to_the_Study_of_Globalization.pptx
PPT Item #s 2&3 - 934 Patterson SUP & Final Review
Item # 5 - 5307 Broadway St final review
STG - Sarikei 2025 Coordination Meeting.pptx
Item # 2 - 934 Patterson Specific Use Permit (SUP)
26.1.2025 venugopal K Awarded with commendation certificate.pdf
DFARS Part 249 - Termination Of Contracts
Inferenceahaiajaoaakakakakakakakakakakakakaka
2025 Shadow report on Ukraine's progression regarding Chapter 29 of the acquis
Omnibus rules on leave administration.pptx
PCCR-ROTC-UNIT-ORGANIZATIONAL-STRUCTURE-pptx-Copy (1).pptx
Alexistogel: Solusi Tepat untuk Anda yang Cari Bandar Toto Macau Resmi
The Role of FPOs in Advancing Rural Agriculture in India
generalgeologygroundwaterchapt11-181117073208.ppt
Adolescent Health Orientation and Health care
PPT Items # 6&7 - 900 Cambridge Oval Right-of-Way
AMO Pune Complete information and work profile
PPT - Primary Rules of Interpretation (1).pdf
oil palm convergence 2024 mahabubnagar.pdf

Exploring Innovative and Effective Methods for IQA - Research Framework

  • 1. EXPLORING INNOVATIVE AND EFFECTIVE METHODS FOR IQA – RESEARCH FRAMEWORK CIES Conference, Vancouver 6-10 March 2016 MICHAELA MARTIN, IIEP Programme Specialist An IIEP research project
  • 2. THIS PANEL  The IIEP research project on « Exploring innovative and effective solutions for internal quality assurance (IQA)»  The case of IQA at Xiamen University  A comparative overview on the research findings  A commentary on the project
  • 3. 1. Introduction  « Quality crisis » in higher education since 1980s  International trend : External Quality Assurance (EQA)  Since 2000, EQA is a major focus of research and capacity development at the UNESCO/IIEP  But without IQA, no sustainable quality improvement  IQA therefore is a major reform strand  in HE worldwide
  • 4. 2. Variation in definition of IQA  Internal Quality Assurance: procedures and instruments which measure whether a higher education institution is in line with external standards and its own development goals in its fields of activities (UNESCO).  IQA refers to quality enhancement processes if they are directly derived from measurement procedures and instruments (ESG)  IQA systems are an integrated whole which together support quality policy and institutional goals (IIEP).
  • 5. 3. Major Challenges  Articulation of IQA instruments among each other  Articulation of IQA with strategic planning, management  Balance between centralized and decentralized structures  Information systems, data management and analytical capacities  Human and financial resource constraints
  • 6. 4. Three major research questions  What are innovative and effective options for IQA policy, structures, processes and instruments ?  What are the effects of such IQA systems on  the quality and relevance of academic programmes (employability of graduates), and  managerial effectiveness ?  What internal and external factors condition the effective functioning of IQA systems?
  • 7. 6. Research methodology Case study research design  Better understand IQA systems within their national and institutional contexts  Exploratory and descriptive design  Mixed methods data collection process to study the effects
  • 8. 7. IIEP’s role in the project  IIEP set the research framework  IIEP selected identified the universities selected as case studies and the research teams  IIEP prepared the research instruments and discussed methodology with the research teams  IIEP accompanied the preparation of the case studies, organized a research validation workshop
  • 9. 8. Primary Data sources Integrated qualitative and quantitative design  Online surveys of academic and administrative staff on perceptions of the local IQA system, their effects and conditioning factors  Semi-structured interviews with key actors  Central and middle level academic and administrative decision-makers  Focus group discussions  Head of departments with selected programme directors  Students
  • 10. 9. Secondary Data sources  Content analysis of official documents to document effects  EQA Reports (e.g. institutional or programme accreditation)  University annual reports  University statistics  Reports produced by IQA structure  Triangulation of different actors’ perspectives  Triangulation of perceptions and secondary data sources
  • 11. 10. Selection of eight university case studies Europe: ▪ University of Duisburg-Essen, Germany ▪ Economics University of Vienna, Austria Asia: ▪ Xiamen University, China ▪ International American University of Bangladesh Anglophone Africa: ▪ Daystar University, Kenya ▪ University of the Free State, South Africa Latin America region: ▪ Talca University, Chile Arab region: ▪ University of Bahrain
  • 12. 11. Scope and limitations  Focus on IQA mainly in the domain of T&L and management, not on research  Actors’ perceptions only a proxy for change, not impact assessment  Case study design does not produce generalizable results, however insights into the effective functioning of IQA methods in specific contexts