Unreal conference slides

REAL GOOD UNREAL TESTING CHARLES P. SCHULTZ Author “Game Testing All In One” INDIE GAMES SUMMIT

TEST SUBJECTS WHAT CAN I TEST? UNREAL ENGINE VERSIONS, PORTS MODS LEVELS WEAPONS, VEHICLES PC, CONSOLE or MOBILE INDIE GAMES SUMMIT

TEST OBJECTIVES FIND BUGS PINPOINT CAUSES - Environment - Repeatability - Frequency ESTABLISH WHAT WORKS VERIFY FIXED BUGS GIVE DEVS FEEDBACK INDIE GAMES SUMMIT

TESTER’S WEAPONS PARAMETERS MODELS USE CASES METHODS TOOLS PLAYER STYLES - Achiever, Explorer, Killer, Socializer INDIE GAMES SUMMIT

BOUNDARY VALUES 0 MINIMUM MAXIMUM MAXIMUM + 1 SPECIAL VALUES - High Scores February 29 th Zone Boundaries: KOTOR example INDIE GAMES SUMMIT

GAME PHASES PRE-GAME ACTIVATE GAME START Initialize system components Load maps and game assets Establish network communication Game controllers detected etc. IN-GAME POST-GAME DEACTIVATE INDIE GAMES SUMMIT

DEFECT TRIGGERS NORMAL BEHAVIOR CONFIGURATION STARTUP EXCEPTIONS STRESS RESTART INDIE GAMES SUMMIT

DEFECT TRIGGERS NORMAL BEHAVIOR typically 80 to 100% of tests most costly to find relatively low cost to repair less effective as project progresses serious issues removed before ship INDIE GAMES SUMMIT

DEFECT TRIGGERS CONFIGURATION STARTUP EXCEPTIONS STRESS RESTART up to 20% of tests higher rate of defects found per test requirements may be lacking INDIE GAMES SUMMIT

TRIGGER GOALS NORMAL BEHAVIOR: 40% CONFIGURATION: 20% STARTUP : 10% EXCEPTIONS: 20% STRESS: 5% RESTART: 5% grow non-Normal test cases elicit requirements from developers INDIE GAMES SUMMIT

RESTART “ You can fast swap weapons to reload the first one to make it fire faster, for example you can shoot the sniper, quickly swap to another weapon lets say hammer, swap back and shoot the sniper again as the reload time has been wiped” BUG EXAMPLE INDIE GAMES SUMMIT

COMBINATORIAL TABLES SELECT PARAMETERS TO TEST - GUN, AMMO, RANGE SELECT TEST VALUES FOR EACH PARAMETER - AMMO: 0, 1, MAXIMUM PAIR EACH VALUE WITH ANOTHER PARAMETER’S VALUES - AMMO=1 with GUN=ROCKET, LINK GUN, SNIPER INDIE GAMES SUMMIT

COMBINATORIAL TABLES START WITH FIRST VALUE OF ONE PARAMETER GUN AMMO RANGE ROCKET ROCKET ROCKET 0 1 MAX 1 MAX MAX+1 INDIE GAMES SUMMIT

COMBINATORIAL TABLES FOR THE NEXT PARAMETER, CREATE NEW PAIRS GUN AMMO RANGE ROCKET ROCKET ROCKET 0 1 MAX 1 MAX MAX+1 LINK GUN LINK GUN LINK GUN 0 1 MAX MAX MAX+1 1 INDIE GAMES SUMMIT

COMBINATORIAL TABLES CONTINUE UNTIL ALL PAIRS ARE SATISFIED GUN AMMO RANGE ROCKET ROCKET ROCKET 0 1 MAX 1 MAX MAX+1 LINK GUN LINK GUN LINK GUN 0 1 MAX MAX MAX+1 1 SNIPER SNIPER SNIPER 0 MAX 1 MAX+1 1 MAX INDIE GAMES SUMMIT

COMBINATORIALNOMICS For our 3x3 matrix, we covered all pair combinations with only 9 tests. A set of 13 parameters with 3 values would require 1.5 million tests for all combinations, but only requires 15 tests for pairs FOR LARGE OR COMPLEX SETS OF PARAMETERS, USE A TOOL ALLPAIRS http://www.satisfice.com/tools.shtml INDIE GAMES SUMMIT

TEST FLOW DIAGRAMS Graphic model of a function or use case Take the player’s point of view Use loops Add reverse flows Can double as a design tool INDIE GAMES SUMMIT

TEST FLOW DIAGRAMS Start with an entry point and initial “state” IN AMMO FULL 1. Start INDIE GAMES SUMMIT

TEST FLOW DIAGRAMS Do something to change to another state IN AMMO FULL NO AMMO 2. Fire All Ammo 1. Start INDIE GAMES SUMMIT

TEST FLOW DIAGRAMS Can you go back to where you started? IN AMMO FULL NO AMMO 2. Fire All Ammo 3.Reload 1. Start INDIE GAMES SUMMIT

TEST FLOW DIAGRAMS Can you repeat anything? IN AMMO FULL NO AMMO 4. Fire Weapon 5.Reload 2. Fire All Ammo 3.Reload 1. Start INDIE GAMES SUMMIT

TEST FLOW DIAGRAMS Can you do something a different way? IN AMMO FULL NO AMMO 4. Fire Weapon 5.Reload 2. Fire All Ammo 3.Reload 1. Start 6. Pick up fresh weapon INDIE GAMES SUMMIT

TEST FLOW DIAGRAMS Provide an Exit point IN AMMO FULL NO AMMO 4. Fire Weapon 5.Reload 2. Fire All Ammo 3.Reload 1. Start 6. Pick up fresh weapon OUT 7. Exit INDIE GAMES SUMMIT

TEST FLOW DIAGRAMS Create tests from various paths 1,2,4,7 1,2,3,2,7 1,2,6,2,7 1,2,3,5,2,7 1,5,2,3,5,2,4,6,2,7 INDIE GAMES SUMMIT IN AMMO FULL NO AMMO 4. Fire Weapon 5.Reload 2. Fire All Ammo 3.Reload 1. Start 6. Pick up fresh weapon OUT 7. Exit

ESCAPED PROBLEMS CONFIGURATION Unreal Tournament 3 flickers after playing for some time / UT3 Flickering screen Solution A : Make sure that you are using the latest drivers. Solution B : Turn down / Turn-ff Anisotropic Filtering in UT3′s menu Unreal Tournament 3 models are the same for all players after playing the first map. Make sure that the ‘Allow custom characters’ option is checked in the options. This is because there are times that the config dont get saved or some of the items in the options menu gets randomly checked. Make sure that the UT3 config is changed after ticking the “allow custom characters” option by checking the options menu again after closing.

CONFIGURATION Unreal Tournament 3 Configs dont get saved / UT3 settings and cd-key not saved / cd-key problem Make sure that the MY DOCUMENTS or and UT3 folder is not set as read-only Cannot Play Unreal Tournament 3 Campaign Open the UTEngine.ini (My Documents\My Games\Unreal Tournament 3\UTGame\Config) and change PumpWindowMessagesWhenRenderThreadStalled=False to PumpWindowMessagesWhenRenderThreadStalled=True ESCAPED PROBLEMS

Unreal conference slides

More Related Content

Viewers also liked (20)

Similar to Unreal conference slides (20)

Recently uploaded (20)

Unreal conference slides