SlideShare a Scribd company logo
Systematic Inventive Thinking and Game Testing
This article will explore how you can use the Systematic Inventive Thinking
Method to generate tests with user behavior as a starting point.
How can you as a game tester continuously stay one step ahead of all potential
problems? How can you think about improvements that would positively impact
the user when you run your tests? It requires creativity to think about all
possible scenarios different user types can come up with, and all needs and
preferences of these users. Game testers have a unique possibility to give this
type of input to game designers and developers early in the development
process, since they have likely spent more time playing the game than anyone
else at that stage.
Some might think of creativity as a field solely for artists and designers, but this
is something each and every one of us should develop, and it should be used for a
wide variety of tasks. The alternative is stagnation.
The question that remains is “How?”. How can I be creative? Maybe I feel like I
am not a creative person. I don’t randomly come up with awesome new ideas. I
have a hard time thinking outside the box, coming up with unique new use cases
and scenarios. I don’t come up with interesting solutions to the problems that
users will face, which I see every day during my testing.
Creativity is not some magical, mysterious process reserved for designers and
artists. There are methods to make the creative process more concrete. One of
these methods, which I prefer because it is quite simple, is Systematic Inventive
Thinking [1]. By making the creative process more methodical and systematic,
and by making it relatively simple, everyone can participate. And this is what all
companies need, regardless of field. To harness to innovative capabilities of all of
their employees – not only the top 10%. When everyone is participating we are
all triggering each other to become more innovative and creative, everyone
adding their unique view to the common creative pool. It is in collaboration and
discussion that most great ideas are born.
So what is Systematic Inventive Thinking (SIT)? SIT is a thinking tool developed
for generating new ideas, and solving problems. Studies show that the main
difficulty faced by problem solvers is not coming up with a large quantity of
ideas, but coming up with original ideas. SIT, a structured approach to idea
generation, instead of just brainstorming, was created to solve this difficulty.
SIT has two major components that can be good to focus on as an introduction:
 The Closed World Principle
 Five Thinking Tools
The closed world principle focuses on “thinking inside the box”. Thinking outside
the box requires stepping outside of your normal thinking pattern, and this is
very difficult, since it is after all outside our normal thinking pattern. Thinking
inside the box requires us to find a creative solution by heavily limiting the space
of possibilities. This means that when coming up with new ideas for
improvements or for solving problems you are only allowed to use elements
already existing in the game/problem/behavior, or in the immediate
environment. This condition forces us to rely on resources already at our
disposal, rather than using new external resources for the solution. By limiting
our thinking space we have to take a closer look at the elements already
available and their dependencies, forcing us to question what we have taken for
granted, allowing us to come up with innovative and simple ideas.
The five thinking tools make this principle more practical and easier to
understand.
1. Subtraction
2. Multiplication
3. Division
4. Task Unification
5. Attribute Dependency
So what are these tools, and how can they be applied to game testing? We often
have some conceived notion of what a normal user is and the use pattern of that
person. And we probably have tests covering this use pattern. By applying the
five thinking tools on that pattern we can come up with interesting new test
cases, and perhaps also ideas for how to improve game play for users who differ
from the norm. This diverges somewhat form how Systematic Inventive Thinking
is normally used – usually you have a product, process or strategy, now we are
looking at user behavior.
We start by subtracting something important from that behavior. The ability to
see colors. Suddenly you have interesting new use cases, and also perhaps some
ideas for a feature that makes the game playable for the colorblind. Let us
subtract something else. The ability to charge the laptop, tablet or mobile device.
Suddenly you have a lot of new use cases related to resource consumption by the
game. The ability to update the gaming device OS. Now you have several
compatibility tests you need to run.
Now we instead apply multiplication to the normal user pattern. What if the user
always presses multiple times instead of once when pressing different buttons?
What if the user presses many buttons at the same time instead of just one? For
this you can add different types of stress tests to secure that multiple presses is
handled correctly.
Division is slightly harder than the two first tools. Try breaking up a certain
behavior into components and try to reconstruct the behavior in different ways.
Maybe instead of connecting your game to social media then start playing; you
start playing and the want to connect your game to media during play.
Task unification assigns a new or additional task to an existing resource. How
does this apply to our user behavior and what tests can we create using this tool?
What if the user is playing the game on a mobile device (task A) and suddenly
also starts walking (task B), perhaps dropping Wi-Fi connection from time to
time, while receiving text messages from a friend (task C)? Your existing
resource (the user) is suddenly involved in a lot of tasks, both in and outside
your game.
The final tool is attribute dependency. Creating and dissolving dependencies
between variables of a product. What does this mean for us and our user
behavior? What variables does a behavior have? Intensity, length, frequency are
some examples. What if you suddenly do something that you usually do for a
long time, with low frequency, and low intensity, but instead to it for a short
time, often and with high intensity? Maybe the user previously looked at the
game world map once every hour, studied it for a long time, and didn’t click
much on it, but now instead checks it every five minutes for a short period of
time, and interacts with the map a lot? This requires us to test the game world
map in a different way.
We have only looked at a single user in the examples above, but them same
methodology can be used on a group of users. How would a thousand users
normally behave? We probably have some understanding of that. Now we apply
the 5 thinking tools to this group of behaviors, and then we can probably come
up with a number of scenarios that diverge from this normal state, which we
then create tests for.
With an understanding of the closed world principle and these five thinking
tools, we can come up with new and creative tests for different types of user
behavior. We started with a normal user behavior and then came up with a host
of similar but diverging behaviors which we then created tests for. The more we
use this method, the better we become at systematically coming up with creative
ideas, which is valuable in every part of game development.
Of course mastering this method requires a lot of practice, and is most likely a
lifelong journey, but even for a novice like myself, it has been very valuable in
different contexts.
The Five Thinking Tools How it applies to creating tests
Subtraction Apply different constraints to user
behavior
Multiplication Multiply user behavior
Division Rearrange user behavior in time &
space
Task Unification Add additional tasks to a behavior
Attribute Dependency Change dependencies in variables of
behavior
References
[1] Systematic Inventive Thinking
http://en.wikipedia.org/wiki/Systematic_inventive_thinking

More Related Content

PDF
VIrtual Crash Course Playbook
PDF
IDEATE mixtape
PDF
EXPERIMENT mixtape
PDF
UNDERSTAND mixtape
PDF
User Experience 7: Quantitative Methods, Questionnaires, Biometrics and Data ...
PDF
UX 101: User Research methods to kickstart your project
PDF
10 Principles to Build an Addictive Product and Service
PDF
Introduction to Game Thinking (Fluxible 2018)
VIrtual Crash Course Playbook
IDEATE mixtape
EXPERIMENT mixtape
UNDERSTAND mixtape
User Experience 7: Quantitative Methods, Questionnaires, Biometrics and Data ...
UX 101: User Research methods to kickstart your project
10 Principles to Build an Addictive Product and Service
Introduction to Game Thinking (Fluxible 2018)

What's hot (10)

PDF
Hcde k 12 charrette workbook
PDF
Research Driven Design
PPTX
10 tips for a better survey at UX Bristol
PDF
User Experience 6: Qualitative Methods, Playtesting and Interviews
PDF
GAMES USER RESEARCH: Guest Lecture in UX Design Class at Wilfried Laurier Uni...
PDF
Rapid Prototyping
PPTX
Writing surveysthatwork
PDF
IxD Works Miniworkshop: Introduction
PDF
Ux paper prototyping
PDF
User Experience 2: Psychology Concepts
Hcde k 12 charrette workbook
Research Driven Design
10 tips for a better survey at UX Bristol
User Experience 6: Qualitative Methods, Playtesting and Interviews
GAMES USER RESEARCH: Guest Lecture in UX Design Class at Wilfried Laurier Uni...
Rapid Prototyping
Writing surveysthatwork
IxD Works Miniworkshop: Introduction
Ux paper prototyping
User Experience 2: Psychology Concepts
Ad

Viewers also liked (20)

DOCX
Testing in a scrum team
DOCX
How a Game Tester Adds Value
DOCX
Acceptance Criteria as Requirements and Tests
DOCX
Quality in Games
DOCX
Information artifact simplicity
DOCX
Initial thoughts on live user tests for games
DOCX
Codifying Knowledge in Tests
PPTX
Testing & Scrum
PPTX
The Value-Adding Test Strategist
PPTX
Software testing vs. Game testing
PPTX
QI, not QA
DOCX
Do we really need game testers?
PPTX
Hardware/Software Integration Testing
PPTX
How to structure testing within the Scrum Framework
PPTX
Defining Test Competence
PPTX
Giving feedback & Scrum
PPTX
Exploratory Testing for Developers
DOCX
Why all deadlines are bad for quality
PPTX
Communicated deadlines = bad quality
PPTX
Software testing and game testing
Testing in a scrum team
How a Game Tester Adds Value
Acceptance Criteria as Requirements and Tests
Quality in Games
Information artifact simplicity
Initial thoughts on live user tests for games
Codifying Knowledge in Tests
Testing & Scrum
The Value-Adding Test Strategist
Software testing vs. Game testing
QI, not QA
Do we really need game testers?
Hardware/Software Integration Testing
How to structure testing within the Scrum Framework
Defining Test Competence
Giving feedback & Scrum
Exploratory Testing for Developers
Why all deadlines are bad for quality
Communicated deadlines = bad quality
Software testing and game testing
Ad

Similar to Systematic inventive thinking and game testing (20)

PPT
Game Specific Creativity Techniques
PPT
Using Computer Game Design For Learning
PDF
Co-Creativity through Play and Game Design Thinking.pdf
PPTX
Cets 2015 glenn path to mastery serious games
PPTX
August 18, 2015 Presentation
PPTX
Presentation11 091715
PDF
An Introduction to the Systematic Inventive Thinking (SIT) Method
PDF
An Introduction to the Systematic Inventive Thinking (SIT) Method
PPTX
Using Game Design & Virtual Worlds for Creation of Interesting & Engaging Lea...
PPT
Creativity Techniques in Game Design
PDF
Game Design Tools: For When Spreadsheets and Flowcharts Aren't Enough
PDF
DEVELOPMENT OF RUBRIC TO MEASURE CHILDREN’S CREATIVITY IN GAME DESIGN
PDF
DEVELOPMENT OF RUBRIC TO MEASURE CHILDREN’S CREATIVITY IN GAME DESIGN
PDF
An Introduction to the Systematic Inventive Thinking (SIT) Method
PPTX
Experimental Game Prototyping and Play Testing using Iterative Design
PDF
The organic nature of game ideation
PDF
Melbourne Service Jam Toolkit
ODP
Finding The Fun
KEY
Learning Verses Experience
PDF
The Lens of Intrinsic Skill Atoms: A Method for Gameful Design
Game Specific Creativity Techniques
Using Computer Game Design For Learning
Co-Creativity through Play and Game Design Thinking.pdf
Cets 2015 glenn path to mastery serious games
August 18, 2015 Presentation
Presentation11 091715
An Introduction to the Systematic Inventive Thinking (SIT) Method
An Introduction to the Systematic Inventive Thinking (SIT) Method
Using Game Design & Virtual Worlds for Creation of Interesting & Engaging Lea...
Creativity Techniques in Game Design
Game Design Tools: For When Spreadsheets and Flowcharts Aren't Enough
DEVELOPMENT OF RUBRIC TO MEASURE CHILDREN’S CREATIVITY IN GAME DESIGN
DEVELOPMENT OF RUBRIC TO MEASURE CHILDREN’S CREATIVITY IN GAME DESIGN
An Introduction to the Systematic Inventive Thinking (SIT) Method
Experimental Game Prototyping and Play Testing using Iterative Design
The organic nature of game ideation
Melbourne Service Jam Toolkit
Finding The Fun
Learning Verses Experience
The Lens of Intrinsic Skill Atoms: A Method for Gameful Design

More from Johan Hoberg (20)

PDF
Deep Testing, Deep Work - How and when we should enable deep work for testers
PDF
Turning Quality Information into Quality Intelligence - A QI Concept
PDF
Quality Intelligence, Documentation & AI
PDF
How Trust Impacts Quality and Efficiency in Games Development
PDF
7 Quality Pillars of Mobile Game Development
PDF
Approaches to unraveling a complex test problem
PDF
A business case for a modern QA organization
PDF
Signing off on Quality
PDF
Quality Information Coverage - A QI Concept
PDF
The Bug Backlog - An Evergrowing Mountain
PDF
Quality Intelligence: Transparency & Visibility
PDF
Building a QA Mindset
PPTX
What is QI?
PDF
Building High Quality Software
PPTX
Testit 2017 - Exploratory Testing for Everyone
DOCX
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
DOCX
Moving from scripted regression testing to exploratory testing
PDF
Building High Quality Software
DOCX
Quality, Testing & Agile Methodologies
DOCX
QI, not QA
Deep Testing, Deep Work - How and when we should enable deep work for testers
Turning Quality Information into Quality Intelligence - A QI Concept
Quality Intelligence, Documentation & AI
How Trust Impacts Quality and Efficiency in Games Development
7 Quality Pillars of Mobile Game Development
Approaches to unraveling a complex test problem
A business case for a modern QA organization
Signing off on Quality
Quality Information Coverage - A QI Concept
The Bug Backlog - An Evergrowing Mountain
Quality Intelligence: Transparency & Visibility
Building a QA Mindset
What is QI?
Building High Quality Software
Testit 2017 - Exploratory Testing for Everyone
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Moving from scripted regression testing to exploratory testing
Building High Quality Software
Quality, Testing & Agile Methodologies
QI, not QA

Recently uploaded (20)

PPTX
UNIT 4 Total Quality Management .pptx
PPTX
CH1 Production IntroductoryConcepts.pptx
PPTX
OOP with Java - Java Introduction (Basics)
PDF
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
PPTX
Geodesy 1.pptx...............................................
PDF
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
PPTX
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
PPTX
CYBER-CRIMES AND SECURITY A guide to understanding
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPTX
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
PDF
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
DOCX
573137875-Attendance-Management-System-original
PDF
composite construction of structures.pdf
PDF
Operating System & Kernel Study Guide-1 - converted.pdf
PPTX
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
PPTX
bas. eng. economics group 4 presentation 1.pptx
PPTX
Sustainable Sites - Green Building Construction
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
PDF
Digital Logic Computer Design lecture notes
UNIT 4 Total Quality Management .pptx
CH1 Production IntroductoryConcepts.pptx
OOP with Java - Java Introduction (Basics)
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
Geodesy 1.pptx...............................................
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
CYBER-CRIMES AND SECURITY A guide to understanding
UNIT-1 - COAL BASED THERMAL POWER PLANTS
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
573137875-Attendance-Management-System-original
composite construction of structures.pdf
Operating System & Kernel Study Guide-1 - converted.pdf
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
bas. eng. economics group 4 presentation 1.pptx
Sustainable Sites - Green Building Construction
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
Digital Logic Computer Design lecture notes

Systematic inventive thinking and game testing

  • 1. Systematic Inventive Thinking and Game Testing This article will explore how you can use the Systematic Inventive Thinking Method to generate tests with user behavior as a starting point. How can you as a game tester continuously stay one step ahead of all potential problems? How can you think about improvements that would positively impact the user when you run your tests? It requires creativity to think about all possible scenarios different user types can come up with, and all needs and preferences of these users. Game testers have a unique possibility to give this type of input to game designers and developers early in the development process, since they have likely spent more time playing the game than anyone else at that stage. Some might think of creativity as a field solely for artists and designers, but this is something each and every one of us should develop, and it should be used for a wide variety of tasks. The alternative is stagnation. The question that remains is “How?”. How can I be creative? Maybe I feel like I am not a creative person. I don’t randomly come up with awesome new ideas. I have a hard time thinking outside the box, coming up with unique new use cases and scenarios. I don’t come up with interesting solutions to the problems that users will face, which I see every day during my testing. Creativity is not some magical, mysterious process reserved for designers and artists. There are methods to make the creative process more concrete. One of these methods, which I prefer because it is quite simple, is Systematic Inventive Thinking [1]. By making the creative process more methodical and systematic, and by making it relatively simple, everyone can participate. And this is what all companies need, regardless of field. To harness to innovative capabilities of all of their employees – not only the top 10%. When everyone is participating we are all triggering each other to become more innovative and creative, everyone adding their unique view to the common creative pool. It is in collaboration and discussion that most great ideas are born. So what is Systematic Inventive Thinking (SIT)? SIT is a thinking tool developed for generating new ideas, and solving problems. Studies show that the main difficulty faced by problem solvers is not coming up with a large quantity of ideas, but coming up with original ideas. SIT, a structured approach to idea generation, instead of just brainstorming, was created to solve this difficulty. SIT has two major components that can be good to focus on as an introduction:  The Closed World Principle  Five Thinking Tools The closed world principle focuses on “thinking inside the box”. Thinking outside the box requires stepping outside of your normal thinking pattern, and this is
  • 2. very difficult, since it is after all outside our normal thinking pattern. Thinking inside the box requires us to find a creative solution by heavily limiting the space of possibilities. This means that when coming up with new ideas for improvements or for solving problems you are only allowed to use elements already existing in the game/problem/behavior, or in the immediate environment. This condition forces us to rely on resources already at our disposal, rather than using new external resources for the solution. By limiting our thinking space we have to take a closer look at the elements already available and their dependencies, forcing us to question what we have taken for granted, allowing us to come up with innovative and simple ideas. The five thinking tools make this principle more practical and easier to understand. 1. Subtraction 2. Multiplication 3. Division 4. Task Unification 5. Attribute Dependency So what are these tools, and how can they be applied to game testing? We often have some conceived notion of what a normal user is and the use pattern of that person. And we probably have tests covering this use pattern. By applying the five thinking tools on that pattern we can come up with interesting new test cases, and perhaps also ideas for how to improve game play for users who differ from the norm. This diverges somewhat form how Systematic Inventive Thinking is normally used – usually you have a product, process or strategy, now we are looking at user behavior. We start by subtracting something important from that behavior. The ability to see colors. Suddenly you have interesting new use cases, and also perhaps some ideas for a feature that makes the game playable for the colorblind. Let us subtract something else. The ability to charge the laptop, tablet or mobile device. Suddenly you have a lot of new use cases related to resource consumption by the game. The ability to update the gaming device OS. Now you have several compatibility tests you need to run. Now we instead apply multiplication to the normal user pattern. What if the user always presses multiple times instead of once when pressing different buttons? What if the user presses many buttons at the same time instead of just one? For this you can add different types of stress tests to secure that multiple presses is handled correctly. Division is slightly harder than the two first tools. Try breaking up a certain behavior into components and try to reconstruct the behavior in different ways. Maybe instead of connecting your game to social media then start playing; you start playing and the want to connect your game to media during play.
  • 3. Task unification assigns a new or additional task to an existing resource. How does this apply to our user behavior and what tests can we create using this tool? What if the user is playing the game on a mobile device (task A) and suddenly also starts walking (task B), perhaps dropping Wi-Fi connection from time to time, while receiving text messages from a friend (task C)? Your existing resource (the user) is suddenly involved in a lot of tasks, both in and outside your game. The final tool is attribute dependency. Creating and dissolving dependencies between variables of a product. What does this mean for us and our user behavior? What variables does a behavior have? Intensity, length, frequency are some examples. What if you suddenly do something that you usually do for a long time, with low frequency, and low intensity, but instead to it for a short time, often and with high intensity? Maybe the user previously looked at the game world map once every hour, studied it for a long time, and didn’t click much on it, but now instead checks it every five minutes for a short period of time, and interacts with the map a lot? This requires us to test the game world map in a different way. We have only looked at a single user in the examples above, but them same methodology can be used on a group of users. How would a thousand users normally behave? We probably have some understanding of that. Now we apply the 5 thinking tools to this group of behaviors, and then we can probably come up with a number of scenarios that diverge from this normal state, which we then create tests for. With an understanding of the closed world principle and these five thinking tools, we can come up with new and creative tests for different types of user behavior. We started with a normal user behavior and then came up with a host of similar but diverging behaviors which we then created tests for. The more we use this method, the better we become at systematically coming up with creative ideas, which is valuable in every part of game development. Of course mastering this method requires a lot of practice, and is most likely a lifelong journey, but even for a novice like myself, it has been very valuable in different contexts. The Five Thinking Tools How it applies to creating tests Subtraction Apply different constraints to user behavior Multiplication Multiply user behavior Division Rearrange user behavior in time & space Task Unification Add additional tasks to a behavior Attribute Dependency Change dependencies in variables of behavior
  • 4. References [1] Systematic Inventive Thinking http://en.wikipedia.org/wiki/Systematic_inventive_thinking