GAME RESEARCH
METHODS
AN OVERVIEW
EDITED BY PETRI LANKOSKI & STAFFAN BJÖRK
What
 Overview of game research methods
book
 Different research design
 Pluralistic perspective on research
approaches
 A bit about philosophy of science &
ethics
Research Practices
 Game research can be seen as its own
research field or a research domain
common to many research fields
 Established disciplines typically have a
core set of settled research methods
 Not so for new disciplines or those that
are interdisciplinary
A Very Short Introduction to
Philosophy of science
 Objectivity
 Critique by Hume, Popper, Devey
 Theory-laden (Kuhn)
 Science the most reliable way to form
knowledge
 Even the knowledge may be fallible and
approximate
Unit of Analysis
 What is studied
 Can be different that the data gathered
 Well-established research fields typically
have identified what is the individual
data collected and analysed
Method?
 A method is a specific systematic
procedure for handling data (of the
chosen Unit of Analysis)
 Data gathering methods (e.g., interview,
observation, questionnaire)
 Data analysis methods (e.g., T-test, discourse
analysis)
 Mixed methods
 Qualitative and quantitative mixed
Method, cont.
 Qualitative method
 Rich descriptions of a
phenomenon
 Quantitative methods
 Relations between measured
variables
 Mixed methods
approaches
 Combines qualitative and
quantitative methods in various
ways
?
Images:pixabay(CC0)
Methods, cont.
 Research question implies possible research
methods
 But, you need research to find your research
question
 Sometimes you start with other things that
research questions
 Research domains
 Research projects
 …
 Research is messy business
Overview of our forthcoming
book
For games
 Qualitative approachers
For play and players
 Quantitative approaches
 Quantitative approaches
 Mixed methods
Game development for research
 e.g., design research
What and Not
 We cover various very typical game
research methods and some more
esoteric
 Opportunistic sampling for chapters
 Does (unfortunately) not include all
feasible methods we are aware of, e.g.:
 platform studies
 historical studies methods
Preface
Frans Mäyrä
 “Finding and following a methods means
finding a way. The original etymology of
methodology conveys the same
message: meta hodos in Ancient Greek
meant following a path, as well as
finding the way or means to achieve
certain goal.”
General
Fundamentals for writing a thesis
Carl Magnus Olsson
Argument chains
General
Formal analysis of gameplay
Petri Lankoski & Staffan Björk
Formal analysis of gameplay
Language for describing various
aspects of the game systems
Primitives: components, actions,
goals
Analysis examples
Plant vs Zombies
Ico, combining formal
Qualitativemethodsforstudying
games
Time in videogames
José Zagal & Michael Mateas
Formal analysis of temporal frames
 Language for describing temporal
aspects of the games
Real-world–gameworld–
coordination–fictive
Interaction between frames
Temporal anomalies
Qualitativemethodsforstudying
games
Studying gameplay as interactions
with information
Olle Sköld, Suellen Adams, J.Tuomas Harviainen & Isto
Huvila
Games as information
 How players search and use
information in games
 Analyzing information, kinds of
information and access to information
Qualitativemethodsforstudying
games
Awkward: The importance of reflexivity in
using ethnographic methods
Ashley Brown
Ethnography for games
Focus for MMORPGs
Studying sex using
ethnomethodology
Emotions
Boundary managagement
Qualitativemethodsforstudying
playandplayers
In-Depth interviews for games research
Amanda Cote & Julia G. Raz
When to use interview
Ethical consideration
Participant selection & recruiment
Conducting interviews
Thematic analysis
Qualitativemethodsforstudying
playandplayers
Studying thoughts: Stimulated recall as a
game research method
Jori Pitkänen
Records for supporting interview
E.g., gameplay video
Possible to look at a specific event
and discuss about that
Planning
Conducting
Analyzing
Ethical issues
Qualitativemethodsforstudying
playandplayers
Focus group interviews as a way to evaluate
and understand gameplay experiences
Lina Eklund
Form of interview where people
are interviewed as a group
When to use
Planning
Conducting
How to moderate a group
Transcribing pratices
Analyzing
Qualitativemethodsforstudying
playandplayers
Quantitative methods and analyses for the
study of players and their behaviour
Richard N. Landers & Kristina N. Bauer
General introduction to
quantitative research
Reliability & validity
Correlational designs
Experiment designs
Quasi-experiment designs
Quantitativeapproaches
Sex , Violence and Learning: Doing effect
assessment for games
Andreas Lieberoth, Kaare Bro Wellnitz & Jesper Aagaard
What counts as evidence?
What can be inferred from the
results?
Effect size
P values & confidence intervals
Quantitativeapproaches
Stimulus games
Simo Järvelä, Inger Ekman, J. Matias Kivikangas & Niklas Ravaja
Using games as a stimulus in
psychophysiological studies
 Studying cognition & emotions
Advantages & challenges
Quantitativeapproaches
Audio visual analysis of player
experience
Raphaël Marczak & Gareth R. Schott
How to collected gameplay data
automatically from a game
Quantitativeapproaches
An Introduction to Gameplay Data
Visualization
Günter Wallner & Simone Kriglstein
Quantitativeapproaches
Structural equation modeling
Mattias Svahn & Richard Wahlund
Modeling technique for studying
causal relation between variables
 Directly
 Indirectly
Evaluating models
Assessing models
Case example: Agents Against
Power Waste
Quantitativeapproaches
Mixed methods in game research playing
on strengths and countering weaknesses
Andreas Lieberoth & Andreas Roepstorff
Introduction to mixed methods
designs
Why to use mixed method designs
Downsides of mixed method designs
Mixedmethodsapproaches
Systematic interviews and analysis:
Using the repertory grid technique
Carl Magnus Olsson
Basis in personal construct theory by
Kelly
Elements – constructs – links
Research designs
 Qualitative, mixed methods
Mixedmethodsapproaches
Grounded Theory
Nathan Hook
Grounded theory process
Variations
 Qualitative
 Mixed methods
Examples
Mixedmethodsapproaches
 How to use modding in experiment research
 Possible games for modding
 Best practices

Gamedevelopmentforresearch
Extensive modding for
experimental game research
M. Rohangis Mohseni, Benny Liebold & Daniel
Pietschmann
Experimental Game Design
Annika Waern &Jon Back
When is game design experimental?
Focus on qualitative design research
Example case Codename Heroes
Gamedevelopmentforresearch
Summary
 The Book
 Overview of different methods
 How to use them
 Something about research in general
 Possible advantages
 Toolbox of methods
 Understanding of different methods, which fit your research,
and how to apply them
 Help reflecting on your research
 What is your research question?
 What is your unit of analysis?
Aims and Perspective
 Confusion reigning in game research
 What should be studied? (games, gamers,
gaming, platforms, texts, etc.)
 What are the legitimate methods?
 What does legitimate mean in this context?
 We don’t believe there is one correct
answer, i.e., we see game research as an
interdisciplinary field
 Method selection should be motivated
 This requires awareness of different approaches
Aims and Perspective, cont.
 To advance game research as a field,
research approaches needs to be more
explicit
 This puts demands on researchers to discipline
themselves about being explicit about what they
are doing and why (not why others are wrong)
 Descriptions of approaches to provide a
common source where the approaches can
be compared
 Research methods is one aspect of this
Petri Lankoski
 petri.lankoski@sh.se
Staffan Björk
 staffan.bjork@ait.gu.se
The book at ETC Press
 http://press.etc.cmu.edu/content/game-research-
methods-overview

More Related Content

PPTX
Summer school keynote
PPT
Messy Research: How to Make Qualitative Data Quantifiable and Make Messy Data...
PDF
Coding in Deductive Qualitative Analysis
PPTX
Analyzing qualitative data 4 13-17
PPTX
Descriptive and interpretive approaches to qualitative research
ODP
Qualitative research, lab report overview, and review of lectures 1 to 7
PPTX
Strategies on How to Infer & Explain Patterns and Themes from Data
PPT
11 - qualitative research data analysis ( Dr. Abdullah Al-Beraidi - Dr. Ibrah...
Summer school keynote
Messy Research: How to Make Qualitative Data Quantifiable and Make Messy Data...
Coding in Deductive Qualitative Analysis
Analyzing qualitative data 4 13-17
Descriptive and interpretive approaches to qualitative research
Qualitative research, lab report overview, and review of lectures 1 to 7
Strategies on How to Infer & Explain Patterns and Themes from Data
11 - qualitative research data analysis ( Dr. Abdullah Al-Beraidi - Dr. Ibrah...

What's hot (20)

PDF
Qualitative Research Questions and Methodology
PPSX
Chapter 4 common features of qualitative data analysis
PDF
Presenting qualitative data
PPT
Research process models
PPT
05 qualitative research
PPTX
Slideshare Presentation of Qualitative Data
PDF
Method of data collection and analysis based in Grounded Theory
PDF
Qualitative data analysis - Student L
PPT
How to do qualitative analysis: In theory and practice
PPTX
Class 6 research quality in qualitative methods rev may 2014
PPTX
Quantitative and Qualitative Research
PPTX
The analysis of qualitative data 22nd Oct 2015
PPT
Abdm4064 week 05 data collection methods part 1
PPTX
Qualitative research method
PPT
Data analysis – qualitative data presentation 2
PPTX
Data and data collection in qualitative research
PPT
Mba2216 business research week 5 data collection part 1 0713
PPTX
Qualitative Data Analysis I: Text Analysis
PDF
Qualitative research
PPTX
Coding Your Results
Qualitative Research Questions and Methodology
Chapter 4 common features of qualitative data analysis
Presenting qualitative data
Research process models
05 qualitative research
Slideshare Presentation of Qualitative Data
Method of data collection and analysis based in Grounded Theory
Qualitative data analysis - Student L
How to do qualitative analysis: In theory and practice
Class 6 research quality in qualitative methods rev may 2014
Quantitative and Qualitative Research
The analysis of qualitative data 22nd Oct 2015
Abdm4064 week 05 data collection methods part 1
Qualitative research method
Data analysis – qualitative data presentation 2
Data and data collection in qualitative research
Mba2216 business research week 5 data collection part 1 0713
Qualitative Data Analysis I: Text Analysis
Qualitative research
Coding Your Results
Ad

Similar to Game research methods book introduction (20)

PDF
Qualitative methods in Psychology Research
DOCX
Method Chapter
PPT
Qualitative research
PPT
Yess4 Barbara Jaworski
PDF
The Expectable Rise, Pyrrhic Victory, and Designerly Future of Game Studies a...
PPTX
Lra co gnitiveinterviews11.29
PPT
quali-lesson-22.ppt
PPT
Qualitative Research (Senior High School Practical Reseach 2)
PPTX
Scientific Approaches in Qualitative Research.pptx
PDF
Media - quantitative and qualitative research 2012
PPTX
Research Methodology UNIT 2.pptx
PPTX
Research Design Planning
PPT
Ethnography
PPT
Game Specific Creativity Techniques
PDF
Research.pdf
PPTX
Project:Filter and the Game and Experiment Model
PPT
Methodology2
PPT
Mixed methods-research -design-and-procedures
PDF
Educatonal Research Methodology Framework
Qualitative methods in Psychology Research
Method Chapter
Qualitative research
Yess4 Barbara Jaworski
The Expectable Rise, Pyrrhic Victory, and Designerly Future of Game Studies a...
Lra co gnitiveinterviews11.29
quali-lesson-22.ppt
Qualitative Research (Senior High School Practical Reseach 2)
Scientific Approaches in Qualitative Research.pptx
Media - quantitative and qualitative research 2012
Research Methodology UNIT 2.pptx
Research Design Planning
Ethnography
Game Specific Creativity Techniques
Research.pdf
Project:Filter and the Game and Experiment Model
Methodology2
Mixed methods-research -design-and-procedures
Educatonal Research Methodology Framework
Ad

More from Petri Lankoski (20)

PPTX
Character Engagement and Embodiment: Towards Understanding the Aesthetics of ...
PPTX
Game Design Research: Reflections and Direction
PPTX
Qualitative analysis with EPP and Taguette
PPTX
Studying Games: Formal Analysis and Stimulated Recall Interiviews
PPTX
A brief introduction to quantitative analysis
PDF
Game Analysis at HEVGA PhD Summer School
PDF
Constructive Alignment in Teaching Game Research in Game Development Bachelor...
PPTX
Perforce
PPTX
Level Design Course Intro and Assingnts
PPTX
Quantitative analysis: A brief introduction
PDF
Embodiment, Game Characters and Game Design
PPTX
Escape: Level Design Exercise in Unity
PPTX
Formal analysis of gameplay
PPT
Level Design
PPTX
Game system design
PPTX
Simulations: Evaluating game system behavior
PPTX
Models for story
PPTX
Designprocesser lecture1
PPTX
Unity programming 1
KEY
Gameplay Design Workshop 1/2 (2011)
Character Engagement and Embodiment: Towards Understanding the Aesthetics of ...
Game Design Research: Reflections and Direction
Qualitative analysis with EPP and Taguette
Studying Games: Formal Analysis and Stimulated Recall Interiviews
A brief introduction to quantitative analysis
Game Analysis at HEVGA PhD Summer School
Constructive Alignment in Teaching Game Research in Game Development Bachelor...
Perforce
Level Design Course Intro and Assingnts
Quantitative analysis: A brief introduction
Embodiment, Game Characters and Game Design
Escape: Level Design Exercise in Unity
Formal analysis of gameplay
Level Design
Game system design
Simulations: Evaluating game system behavior
Models for story
Designprocesser lecture1
Unity programming 1
Gameplay Design Workshop 1/2 (2011)

Recently uploaded (20)

PDF
CHAPTER 2 The Chemical Basis of Life Lecture Outline.pdf
PPT
Enhancing Laboratory Quality Through ISO 15189 Compliance
PPTX
Presentation1 INTRODUCTION TO ENZYMES.pptx
PPTX
INTRODUCTION TO PAEDIATRICS AND PAEDIATRIC HISTORY TAKING-1.pptx
PPTX
SCIENCE 4 Q2W5 PPT.pptx Lesson About Plnts and animals and their habitat
PPTX
A powerpoint on colorectal cancer with brief background
PPT
Mutation in dna of bacteria and repairss
PDF
Is Earendel a Star Cluster?: Metal-poor Globular Cluster Progenitors at z ∼ 6
PDF
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
PDF
Wound infection.pdfWound infection.pdf123
PPTX
endocrine - management of adrenal incidentaloma.pptx
PPTX
PMR- PPT.pptx for students and doctors tt
PDF
Unit 5 Preparations, Reactions, Properties and Isomersim of Organic Compounds...
PPTX
TORCH INFECTIONS in pregnancy with toxoplasma
PDF
Science Form five needed shit SCIENEce so
PPTX
perinatal infections 2-171220190027.pptx
PPTX
POULTRY PRODUCTION AND MANAGEMENTNNN.pptx
PPTX
Probability.pptx pearl lecture first year
PDF
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
PPTX
Microbes in human welfare class 12 .pptx
CHAPTER 2 The Chemical Basis of Life Lecture Outline.pdf
Enhancing Laboratory Quality Through ISO 15189 Compliance
Presentation1 INTRODUCTION TO ENZYMES.pptx
INTRODUCTION TO PAEDIATRICS AND PAEDIATRIC HISTORY TAKING-1.pptx
SCIENCE 4 Q2W5 PPT.pptx Lesson About Plnts and animals and their habitat
A powerpoint on colorectal cancer with brief background
Mutation in dna of bacteria and repairss
Is Earendel a Star Cluster?: Metal-poor Globular Cluster Progenitors at z ∼ 6
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
Wound infection.pdfWound infection.pdf123
endocrine - management of adrenal incidentaloma.pptx
PMR- PPT.pptx for students and doctors tt
Unit 5 Preparations, Reactions, Properties and Isomersim of Organic Compounds...
TORCH INFECTIONS in pregnancy with toxoplasma
Science Form five needed shit SCIENEce so
perinatal infections 2-171220190027.pptx
POULTRY PRODUCTION AND MANAGEMENTNNN.pptx
Probability.pptx pearl lecture first year
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
Microbes in human welfare class 12 .pptx

Game research methods book introduction

  • 1. GAME RESEARCH METHODS AN OVERVIEW EDITED BY PETRI LANKOSKI & STAFFAN BJÖRK
  • 2. What  Overview of game research methods book  Different research design  Pluralistic perspective on research approaches  A bit about philosophy of science & ethics
  • 3. Research Practices  Game research can be seen as its own research field or a research domain common to many research fields  Established disciplines typically have a core set of settled research methods  Not so for new disciplines or those that are interdisciplinary
  • 4. A Very Short Introduction to Philosophy of science  Objectivity  Critique by Hume, Popper, Devey  Theory-laden (Kuhn)  Science the most reliable way to form knowledge  Even the knowledge may be fallible and approximate
  • 5. Unit of Analysis  What is studied  Can be different that the data gathered  Well-established research fields typically have identified what is the individual data collected and analysed
  • 6. Method?  A method is a specific systematic procedure for handling data (of the chosen Unit of Analysis)  Data gathering methods (e.g., interview, observation, questionnaire)  Data analysis methods (e.g., T-test, discourse analysis)  Mixed methods  Qualitative and quantitative mixed
  • 7. Method, cont.  Qualitative method  Rich descriptions of a phenomenon  Quantitative methods  Relations between measured variables  Mixed methods approaches  Combines qualitative and quantitative methods in various ways ? Images:pixabay(CC0)
  • 8. Methods, cont.  Research question implies possible research methods  But, you need research to find your research question  Sometimes you start with other things that research questions  Research domains  Research projects  …  Research is messy business
  • 9. Overview of our forthcoming book For games  Qualitative approachers For play and players  Quantitative approaches  Quantitative approaches  Mixed methods Game development for research  e.g., design research
  • 10. What and Not  We cover various very typical game research methods and some more esoteric  Opportunistic sampling for chapters  Does (unfortunately) not include all feasible methods we are aware of, e.g.:  platform studies  historical studies methods
  • 11. Preface Frans Mäyrä  “Finding and following a methods means finding a way. The original etymology of methodology conveys the same message: meta hodos in Ancient Greek meant following a path, as well as finding the way or means to achieve certain goal.” General
  • 12. Fundamentals for writing a thesis Carl Magnus Olsson Argument chains General
  • 13. Formal analysis of gameplay Petri Lankoski & Staffan Björk Formal analysis of gameplay Language for describing various aspects of the game systems Primitives: components, actions, goals Analysis examples Plant vs Zombies Ico, combining formal Qualitativemethodsforstudying games
  • 14. Time in videogames José Zagal & Michael Mateas Formal analysis of temporal frames  Language for describing temporal aspects of the games Real-world–gameworld– coordination–fictive Interaction between frames Temporal anomalies Qualitativemethodsforstudying games
  • 15. Studying gameplay as interactions with information Olle Sköld, Suellen Adams, J.Tuomas Harviainen & Isto Huvila Games as information  How players search and use information in games  Analyzing information, kinds of information and access to information Qualitativemethodsforstudying games
  • 16. Awkward: The importance of reflexivity in using ethnographic methods Ashley Brown Ethnography for games Focus for MMORPGs Studying sex using ethnomethodology Emotions Boundary managagement Qualitativemethodsforstudying playandplayers
  • 17. In-Depth interviews for games research Amanda Cote & Julia G. Raz When to use interview Ethical consideration Participant selection & recruiment Conducting interviews Thematic analysis Qualitativemethodsforstudying playandplayers
  • 18. Studying thoughts: Stimulated recall as a game research method Jori Pitkänen Records for supporting interview E.g., gameplay video Possible to look at a specific event and discuss about that Planning Conducting Analyzing Ethical issues Qualitativemethodsforstudying playandplayers
  • 19. Focus group interviews as a way to evaluate and understand gameplay experiences Lina Eklund Form of interview where people are interviewed as a group When to use Planning Conducting How to moderate a group Transcribing pratices Analyzing Qualitativemethodsforstudying playandplayers
  • 20. Quantitative methods and analyses for the study of players and their behaviour Richard N. Landers & Kristina N. Bauer General introduction to quantitative research Reliability & validity Correlational designs Experiment designs Quasi-experiment designs Quantitativeapproaches
  • 21. Sex , Violence and Learning: Doing effect assessment for games Andreas Lieberoth, Kaare Bro Wellnitz & Jesper Aagaard What counts as evidence? What can be inferred from the results? Effect size P values & confidence intervals Quantitativeapproaches
  • 22. Stimulus games Simo Järvelä, Inger Ekman, J. Matias Kivikangas & Niklas Ravaja Using games as a stimulus in psychophysiological studies  Studying cognition & emotions Advantages & challenges Quantitativeapproaches
  • 23. Audio visual analysis of player experience Raphaël Marczak & Gareth R. Schott How to collected gameplay data automatically from a game Quantitativeapproaches
  • 24. An Introduction to Gameplay Data Visualization Günter Wallner & Simone Kriglstein Quantitativeapproaches
  • 25. Structural equation modeling Mattias Svahn & Richard Wahlund Modeling technique for studying causal relation between variables  Directly  Indirectly Evaluating models Assessing models Case example: Agents Against Power Waste Quantitativeapproaches
  • 26. Mixed methods in game research playing on strengths and countering weaknesses Andreas Lieberoth & Andreas Roepstorff Introduction to mixed methods designs Why to use mixed method designs Downsides of mixed method designs Mixedmethodsapproaches
  • 27. Systematic interviews and analysis: Using the repertory grid technique Carl Magnus Olsson Basis in personal construct theory by Kelly Elements – constructs – links Research designs  Qualitative, mixed methods Mixedmethodsapproaches
  • 28. Grounded Theory Nathan Hook Grounded theory process Variations  Qualitative  Mixed methods Examples Mixedmethodsapproaches
  • 29.  How to use modding in experiment research  Possible games for modding  Best practices  Gamedevelopmentforresearch Extensive modding for experimental game research M. Rohangis Mohseni, Benny Liebold & Daniel Pietschmann
  • 30. Experimental Game Design Annika Waern &Jon Back When is game design experimental? Focus on qualitative design research Example case Codename Heroes Gamedevelopmentforresearch
  • 31. Summary  The Book  Overview of different methods  How to use them  Something about research in general  Possible advantages  Toolbox of methods  Understanding of different methods, which fit your research, and how to apply them  Help reflecting on your research  What is your research question?  What is your unit of analysis?
  • 32. Aims and Perspective  Confusion reigning in game research  What should be studied? (games, gamers, gaming, platforms, texts, etc.)  What are the legitimate methods?  What does legitimate mean in this context?  We don’t believe there is one correct answer, i.e., we see game research as an interdisciplinary field  Method selection should be motivated  This requires awareness of different approaches
  • 33. Aims and Perspective, cont.  To advance game research as a field, research approaches needs to be more explicit  This puts demands on researchers to discipline themselves about being explicit about what they are doing and why (not why others are wrong)  Descriptions of approaches to provide a common source where the approaches can be compared  Research methods is one aspect of this
  • 34. Petri Lankoski  petri.lankoski@sh.se Staffan Björk  staffan.bjork@ait.gu.se The book at ETC Press  http://press.etc.cmu.edu/content/game-research- methods-overview

Editor's Notes

  • #6: This graph needs some explaining, e.g. the whole social sciences often have non-tangible UoA rather than humans - design research doesn’t fit in here also and in addition changes things while doing research
  • #8: Everything that looks like nail is not nail If you are used to use hammer, everything looks like nail
  • #14: Methods than have focus on the games itself Games as formal systems Games as information system Not gaming In these, the player is a theoretical concept The method abstracts player e.g., as to player actions
  • #17: Methods has focus on players’ behavior or phenomenology Ethnomethodology Interview methods How to apply the method when studying games
  • #27: Mixed methods approaches combines both qualitative and quantitative methods Introduction to mixed methods research Repertory grid technique
  • #28: Mixed methods approaches combines both qualitative and quantitative methods Introduction to mixed methods research Repertory grid technique
  • #29: Mixed methods approaches combines both qualitative and quantitative methods Introduction to mixed methods research Repertory grid technique
  • #30: Modding for experimental research Developing games for experimental research Qualitative game design research Design research is a special where the created artefact is integral part of research
  • #31: Mixed methods approaches combines both qualitative and quantitative methods Introduction to mixed methods research Repertory grid technique