WHEN EXPERIMENTALAND COMPUTATIONAL
RESEARCH MEET:
THE PARTICIPATORY EXTENSION MODULE V2.0
Richard O. Legendi, Tamás Máhr, László Gulyás,
Rajmund Bocsi, Vilmos Kozma, Peter Rieger
{rlegendi, tmahr, lgulyas, rbocsi, vkozma, prieger}@aitia.ai
AITIA International, Inc.
41st World Congress of the International Institute of Sociology (IIS)
Social Interaction: Experimental and Computational Analysis
9-10 June, 2013, Uppsala, Sweden, http://www.iisoc.org/iis2013
The research leading to these results has received funding from the
European Union, Seventh Framework Programme FP7/2007-2013
under grant agreement no. CRISIS-ICT-2011-288501.
DEMO
2013.06.10. 41st IIC World Congress, Social Interaction track 2
The El Farol Bar Problem
• Agents are researchers (N=100)
• They visit a popular but small bar in Santa Fé
• If attendance > 60   (overcrowded)
• Who hasn’t come  
• If attendance <= 60  
• Who hasn’t come  
• Each day agents decide individually and in the same time
W. Brian Arthur, “Inductive Reasoning and Bounded Rationality”, American Economic Review
(Papers and Proceedings), 84,406–411, 1994.
2013.06.10. 41st IIC World Congress, Social Interaction track 3
The El Farol Bar Problem
• MASON implementation of a NetLogo variant
• Artifical agents:
• ARMA-based prediction with history
• Players have two actions: No go / go
• If   +1 Score!
• Goal: get max score
Rand, W. and Wilensky, U. (2007). NetLogo El Farol model. Center for Connected Learning and
Computer-Based Modeling, Northwestern Institute on Complex Systems, Northwestern
University, Evanston, IL. http://ccl.northwestern.edu/netlogo/models/ElFarol
2013.06.10. 41st IIC World Congress, Social Interaction track 4
Let’s play!
http://demo1.aitia.ai/
2013.06.10. 41st IIC World Congress, Social Interaction track 5
2013.06.10. 41st IIC World Congress, Social Interaction track 6
Model List
Create
Experiments
Additional Info
Admin Page (Admins are subjects too)
2013.06.10. 41st IIC World Congress, Social Interaction track 7
Subject list
(joined)
Admin tools
In-experiment Admin Page
2013.06.10. 41st IIC World Congress, Social Interaction track 8
Player status
(moved/waiting)
In-experiment Subject Page
2013.06.10. 41st IIC World Congress, Social Interaction track 9
Status messages
Post-experiment Scores
2013.06.10. 41st IIC World Congress, Social Interaction track 10
Outline
• Background
• The CRISIS project
• CRISIS Game
• PET v2.0
• Requirements
• Future works
2013.06.10. 41st IIC World Congress, Social Interaction track 11
Background: The CRISIS Project
“The CRISIS project addresses building a next generation
macroeconomic and financial system policymaking model:
a bottom-up agent-based simulation that fully accounts for the
heterogeneity of households, firms, and government actors. The
model will incorporate the latest evidence from behavioral
economics in portraying agent behavior, and the CRISIS team
will also collect new data on agent decision making using
experimental economics techniques. While any model must
make simplifying assumptions about human behavior, the
CRISIS model will be significantly more realistic in its portrayal of
relevant agent behavior than the current generation of
policymaking models.”
Crisis project description: https://www.crisis-economics.eu/
2013.06.10. 41st IIC World Congress, Social Interaction track 12
2013.06.10. 41st IIC World Congress, Social Interaction track 13
Web-based Game
(Participatory Experiments)
Economic Simulator
(Cloud-Based Parameter
Sweep Execution)
Modelling
Framework
Models
CRISIS Game
2013.06.10. 41st IIC World Congress, Social Interaction track 14
(Planned design)
http://game.crisis-economics.eu
The Model Under the CRISIS Game
2013.06.10. 41st IIC World Congress, Social Interaction track 15
Source: Domenico Delli Gatti, personal communications
(Single player mode)
Gatti, Domenico Delli, Saul Desiderio, Edoardo Gaffeo, Pasquale Cirillo, and Mauro Gallegati.
Macroeconomics from the Bottom-up. 1st ed. Springer, 2011.
Architecture
2013.06.10. 41st IIC World Congress, Social Interaction track 16
PET v2.0
• Idea came from AITIA's PET Software
• Participatory Extension
• Generalized components behind the CRISIS Game
• Modern, scalable infrastructure
• Previous version is 5+ years old
• Components may run on (several) different machines
• Software already available for any experiment
2013.06.10. 41st IIC World Congress, Social Interaction track 17
PET v2.0
• Can be used:
• Locally
• Laboratory experiments
• Policy makers (scenario analysis with a proper model)
• On any webserver to run constantly
• Gather data (scores from model and all user actions  replay)
• Dissemination
• Questionnaire module
• Verify if subjects understood the rules
• Software is already in use by Universiteit van Amsterdam
2013.06.10. 41st IIC World Congress, Social Interaction track 18
REQUIREMENTS?
2013.06.10. 41st IIC World Congress, Social Interaction track 19
What is required to use?
1. An ABM model
• PET is a generic framework
• Currently Java and MASON models are supported
2013.06.10. 41st IIC World Congress, Social Interaction track 20
What is required to use?
1. An ABM model
• PET is a generic framework
• Currently Java and MASON models are supported
2. Development of the web interface
• No restriction on tools (HTML5, GWT, ...)
• Communication to server by standardized tools (AJAX)
• Config files to map incoming messages to model actions
2013.06.10. 41st IIC World Congress, Social Interaction track 21
Future Works
• Tools to support front-end creation
• JavaScript library (WIP)
• User-friendly editor (flexible, easy to use)
• UI, questionnaire
• Tutorials, docs to be developed
• Additional platforms
• +Your ideas? 
2013.06.10. 41st IIC World Congress, Social Interaction track 22
Interested?
• „A New Set of Tools Supporting Agent-Based Economic
Modeling”, EPIA 2013 (under publication, ~Sept.)
• Statistical and Behavioral Model Analysis Tools.
• Hands-on workshop @ ESSA 2013
2013.06.10. 41st IIC World Congress, Social Interaction track 23
THANK YOU!
• Questions?
• Will be available soon from http://iaws.aitia.ai/
• Download the software:
• http://www.crisis-economics.eu/software
• Try the CRISIS Game
• http://game.crisis-economics.eu
• Take a look on the El Farol model:
• http://github.com/rlegendi/mason-examples
Richard O. Legendi
rlegendi@aitia.ai
http://people.inf.elte.hu/legendi/
June 10., 2013.
2013.06.10. 41st IIC World Congress, Social Interaction track 24
The research leading to these results has received funding from the
European Union, Seventh Framework Programme FP7/2007-2013
under grant agreement no. CRISIS-ICT-2011-288501.

More Related Content

PDF
KNVI-PLDN Solid Lezing - Solid Activities & Use Cases in NL
PPTX
Hybrid Surfaces Jessica Holt
PDF
Interaction Design
PPTX
fosscomm2013_ENGAGE_workshop_on_open_public_data
PPTX
Using DITA-wiki Hybrid Solutions For Better Knowledge Systems
PPTX
Szoftver tesztelés - Gyakorlati jó-ha-tudod
PPTX
2011 Eclipse DemoCamp Budapest, Indigo Release
KNVI-PLDN Solid Lezing - Solid Activities & Use Cases in NL
Hybrid Surfaces Jessica Holt
Interaction Design
fosscomm2013_ENGAGE_workshop_on_open_public_data
Using DITA-wiki Hybrid Solutions For Better Knowledge Systems
Szoftver tesztelés - Gyakorlati jó-ha-tudod
2011 Eclipse DemoCamp Budapest, Indigo Release

Similar to When Experimental and Computational Research Meet: The Participatory Extension Module v2.0 (20)

ODP
ECAI 2014 Tutorial on a behavioral analysis tool for agent-based simulations ...
PPTX
Tools For Statistical And Behavioral Analysis Of Mason Models
DOCX
ITS 832Chapter 6Features and Added Valueof Simulation .docx
PPTX
FACT - A New Way to Get News
DOCX
ITS 832Chapter 6Features and Added Value of Simulation .docx
DOCX
ITS 832CHAPTER6Features andAddedValue of Simulation .docx
PPT
Osimo fp7consult13072010def
PDF
Modelling and Simulation Approaches for Techno-Societal Phenomena
DOCX
ITS 832 CHAPTER 6FEATURES AND ADDED VALUE OF SIMULATION MODE
PDF
Use of Computational Tools to Support Planning & Policy by Johannes M. Bauer
PPTX
Randomised control trials: lessons for Civic Tech - Andrew Westbury (Center f...
PPTX
Randomized Controlled Trials: Insights for Civic Tech
PDF
Fiorella De Cindio isdt2010
DOCX
ITS 832Chapter 5From Building a Model to Adaptive Robust.docx
PPTX
SMART Seminar: Massively Interacting Systems
PDF
TS2-2: Shun Shiramatsu from Nagoya Institute of Technology
PDF
Rise of Crowd Computing (December 2012)
PDF
Experimental Computer Science - Approaches and Instruments
DOCX
ITS 832CHAPTER 13Management of Complex Systems Tow.docx
PDF
Fiorella De Cindio, What after protests? Design issues and software tools tow...
ECAI 2014 Tutorial on a behavioral analysis tool for agent-based simulations ...
Tools For Statistical And Behavioral Analysis Of Mason Models
ITS 832Chapter 6Features and Added Valueof Simulation .docx
FACT - A New Way to Get News
ITS 832Chapter 6Features and Added Value of Simulation .docx
ITS 832CHAPTER6Features andAddedValue of Simulation .docx
Osimo fp7consult13072010def
Modelling and Simulation Approaches for Techno-Societal Phenomena
ITS 832 CHAPTER 6FEATURES AND ADDED VALUE OF SIMULATION MODE
Use of Computational Tools to Support Planning & Policy by Johannes M. Bauer
Randomised control trials: lessons for Civic Tech - Andrew Westbury (Center f...
Randomized Controlled Trials: Insights for Civic Tech
Fiorella De Cindio isdt2010
ITS 832Chapter 5From Building a Model to Adaptive Robust.docx
SMART Seminar: Massively Interacting Systems
TS2-2: Shun Shiramatsu from Nagoya Institute of Technology
Rise of Crowd Computing (December 2012)
Experimental Computer Science - Approaches and Instruments
ITS 832CHAPTER 13Management of Complex Systems Tow.docx
Fiorella De Cindio, What after protests? Design issues and software tools tow...
Ad

More from Richard Oliver Legendi (7)

PPTX
Comparison of Elementary Dynamic Network Models Using Empirical Data
PPTX
Model Replication in the Context of Agent-based Simulation
PPTX
Replication of Macroeconomics from the Bottom-up
PPTX
ELTE VI. féléves doktori beszámoló
PPT
Fables - Funkcionális programozási nyelv ágens-alapú szimulációkhoz
PPT
FABLES IME - Agent-Based Modeling environment
PPTX
2010/04/28 IK Szakest, Ágens-alapú szimulációk
Comparison of Elementary Dynamic Network Models Using Empirical Data
Model Replication in the Context of Agent-based Simulation
Replication of Macroeconomics from the Bottom-up
ELTE VI. féléves doktori beszámoló
Fables - Funkcionális programozási nyelv ágens-alapú szimulációkhoz
FABLES IME - Agent-Based Modeling environment
2010/04/28 IK Szakest, Ágens-alapú szimulációk
Ad

Recently uploaded (20)

PDF
A contest of sentiment analysis: k-nearest neighbor versus neural network
PDF
Architecture types and enterprise applications.pdf
PPT
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
PDF
Produktkatalog für HOBO Datenlogger, Wetterstationen, Sensoren, Software und ...
PPTX
2018-HIPAA-Renewal-Training for executives
PDF
Five Habits of High-Impact Board Members
PPTX
Configure Apache Mutual Authentication
PDF
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
PDF
Flame analysis and combustion estimation using large language and vision assi...
PDF
“A New Era of 3D Sensing: Transforming Industries and Creating Opportunities,...
PPTX
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
PPTX
Benefits of Physical activity for teenagers.pptx
PDF
STKI Israel Market Study 2025 version august
PPT
Geologic Time for studying geology for geologist
PDF
sbt 2.0: go big (Scala Days 2025 edition)
PDF
Convolutional neural network based encoder-decoder for efficient real-time ob...
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
Consumable AI The What, Why & How for Small Teams.pdf
PDF
sustainability-14-14877-v2.pddhzftheheeeee
A contest of sentiment analysis: k-nearest neighbor versus neural network
Architecture types and enterprise applications.pdf
Galois Field Theory of Risk: A Perspective, Protocol, and Mathematical Backgr...
Final SEM Unit 1 for mit wpu at pune .pptx
Produktkatalog für HOBO Datenlogger, Wetterstationen, Sensoren, Software und ...
2018-HIPAA-Renewal-Training for executives
Five Habits of High-Impact Board Members
Configure Apache Mutual Authentication
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
Flame analysis and combustion estimation using large language and vision assi...
“A New Era of 3D Sensing: Transforming Industries and Creating Opportunities,...
MicrosoftCybserSecurityReferenceArchitecture-April-2025.pptx
Benefits of Physical activity for teenagers.pptx
STKI Israel Market Study 2025 version august
Geologic Time for studying geology for geologist
sbt 2.0: go big (Scala Days 2025 edition)
Convolutional neural network based encoder-decoder for efficient real-time ob...
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Consumable AI The What, Why & How for Small Teams.pdf
sustainability-14-14877-v2.pddhzftheheeeee

When Experimental and Computational Research Meet: The Participatory Extension Module v2.0

  • 1. WHEN EXPERIMENTALAND COMPUTATIONAL RESEARCH MEET: THE PARTICIPATORY EXTENSION MODULE V2.0 Richard O. Legendi, Tamás Máhr, László Gulyás, Rajmund Bocsi, Vilmos Kozma, Peter Rieger {rlegendi, tmahr, lgulyas, rbocsi, vkozma, prieger}@aitia.ai AITIA International, Inc. 41st World Congress of the International Institute of Sociology (IIS) Social Interaction: Experimental and Computational Analysis 9-10 June, 2013, Uppsala, Sweden, http://www.iisoc.org/iis2013 The research leading to these results has received funding from the European Union, Seventh Framework Programme FP7/2007-2013 under grant agreement no. CRISIS-ICT-2011-288501.
  • 2. DEMO 2013.06.10. 41st IIC World Congress, Social Interaction track 2
  • 3. The El Farol Bar Problem • Agents are researchers (N=100) • They visit a popular but small bar in Santa Fé • If attendance > 60   (overcrowded) • Who hasn’t come   • If attendance <= 60   • Who hasn’t come   • Each day agents decide individually and in the same time W. Brian Arthur, “Inductive Reasoning and Bounded Rationality”, American Economic Review (Papers and Proceedings), 84,406–411, 1994. 2013.06.10. 41st IIC World Congress, Social Interaction track 3
  • 4. The El Farol Bar Problem • MASON implementation of a NetLogo variant • Artifical agents: • ARMA-based prediction with history • Players have two actions: No go / go • If   +1 Score! • Goal: get max score Rand, W. and Wilensky, U. (2007). NetLogo El Farol model. Center for Connected Learning and Computer-Based Modeling, Northwestern Institute on Complex Systems, Northwestern University, Evanston, IL. http://ccl.northwestern.edu/netlogo/models/ElFarol 2013.06.10. 41st IIC World Congress, Social Interaction track 4
  • 5. Let’s play! http://demo1.aitia.ai/ 2013.06.10. 41st IIC World Congress, Social Interaction track 5
  • 6. 2013.06.10. 41st IIC World Congress, Social Interaction track 6 Model List Create Experiments Additional Info
  • 7. Admin Page (Admins are subjects too) 2013.06.10. 41st IIC World Congress, Social Interaction track 7 Subject list (joined) Admin tools
  • 8. In-experiment Admin Page 2013.06.10. 41st IIC World Congress, Social Interaction track 8 Player status (moved/waiting)
  • 9. In-experiment Subject Page 2013.06.10. 41st IIC World Congress, Social Interaction track 9 Status messages
  • 10. Post-experiment Scores 2013.06.10. 41st IIC World Congress, Social Interaction track 10
  • 11. Outline • Background • The CRISIS project • CRISIS Game • PET v2.0 • Requirements • Future works 2013.06.10. 41st IIC World Congress, Social Interaction track 11
  • 12. Background: The CRISIS Project “The CRISIS project addresses building a next generation macroeconomic and financial system policymaking model: a bottom-up agent-based simulation that fully accounts for the heterogeneity of households, firms, and government actors. The model will incorporate the latest evidence from behavioral economics in portraying agent behavior, and the CRISIS team will also collect new data on agent decision making using experimental economics techniques. While any model must make simplifying assumptions about human behavior, the CRISIS model will be significantly more realistic in its portrayal of relevant agent behavior than the current generation of policymaking models.” Crisis project description: https://www.crisis-economics.eu/ 2013.06.10. 41st IIC World Congress, Social Interaction track 12
  • 13. 2013.06.10. 41st IIC World Congress, Social Interaction track 13 Web-based Game (Participatory Experiments) Economic Simulator (Cloud-Based Parameter Sweep Execution) Modelling Framework Models
  • 14. CRISIS Game 2013.06.10. 41st IIC World Congress, Social Interaction track 14 (Planned design) http://game.crisis-economics.eu
  • 15. The Model Under the CRISIS Game 2013.06.10. 41st IIC World Congress, Social Interaction track 15 Source: Domenico Delli Gatti, personal communications (Single player mode) Gatti, Domenico Delli, Saul Desiderio, Edoardo Gaffeo, Pasquale Cirillo, and Mauro Gallegati. Macroeconomics from the Bottom-up. 1st ed. Springer, 2011.
  • 16. Architecture 2013.06.10. 41st IIC World Congress, Social Interaction track 16
  • 17. PET v2.0 • Idea came from AITIA's PET Software • Participatory Extension • Generalized components behind the CRISIS Game • Modern, scalable infrastructure • Previous version is 5+ years old • Components may run on (several) different machines • Software already available for any experiment 2013.06.10. 41st IIC World Congress, Social Interaction track 17
  • 18. PET v2.0 • Can be used: • Locally • Laboratory experiments • Policy makers (scenario analysis with a proper model) • On any webserver to run constantly • Gather data (scores from model and all user actions  replay) • Dissemination • Questionnaire module • Verify if subjects understood the rules • Software is already in use by Universiteit van Amsterdam 2013.06.10. 41st IIC World Congress, Social Interaction track 18
  • 19. REQUIREMENTS? 2013.06.10. 41st IIC World Congress, Social Interaction track 19
  • 20. What is required to use? 1. An ABM model • PET is a generic framework • Currently Java and MASON models are supported 2013.06.10. 41st IIC World Congress, Social Interaction track 20
  • 21. What is required to use? 1. An ABM model • PET is a generic framework • Currently Java and MASON models are supported 2. Development of the web interface • No restriction on tools (HTML5, GWT, ...) • Communication to server by standardized tools (AJAX) • Config files to map incoming messages to model actions 2013.06.10. 41st IIC World Congress, Social Interaction track 21
  • 22. Future Works • Tools to support front-end creation • JavaScript library (WIP) • User-friendly editor (flexible, easy to use) • UI, questionnaire • Tutorials, docs to be developed • Additional platforms • +Your ideas?  2013.06.10. 41st IIC World Congress, Social Interaction track 22
  • 23. Interested? • „A New Set of Tools Supporting Agent-Based Economic Modeling”, EPIA 2013 (under publication, ~Sept.) • Statistical and Behavioral Model Analysis Tools. • Hands-on workshop @ ESSA 2013 2013.06.10. 41st IIC World Congress, Social Interaction track 23
  • 24. THANK YOU! • Questions? • Will be available soon from http://iaws.aitia.ai/ • Download the software: • http://www.crisis-economics.eu/software • Try the CRISIS Game • http://game.crisis-economics.eu • Take a look on the El Farol model: • http://github.com/rlegendi/mason-examples Richard O. Legendi rlegendi@aitia.ai http://people.inf.elte.hu/legendi/ June 10., 2013. 2013.06.10. 41st IIC World Congress, Social Interaction track 24 The research leading to these results has received funding from the European Union, Seventh Framework Programme FP7/2007-2013 under grant agreement no. CRISIS-ICT-2011-288501.

Editor's Notes

  • #13: Harmonized library, Game,policymaking model