TAO DAYS - Integration of 3rd party components into TAO

Integration of Third-party
Components into TAO
The ItemBuilder Example

Overview
• History and Background Information
Heiko Rölke (roelke@dipf.de), DIPF

• Technical Information
Michel Dorochevsky (Michel.Dorochevsky@softcon.de), SOFTCON AG

• ItemBuilder Usage and Examples
Gabriele Gissler (gissler@dipf.de), DIPF

History
• Concrete Idea: 2006
– PISA 2009 – ERA
– Item Development in Luxembourg and Germany
• Prototype in Spring 2007
– HyperText Builder
• All ERA items (re)developped
– Browser
– Mail Client

History -2-
PIAAC (since 2008)
• Runtime re-factoring (+ new name)
• Emphasis on complex interaction modes
• Equating/Mode effects

Complex Problem Solving
• MicroDYN
• Finite State Machine controlled items

Main Ideas
• Empower Item Developpers
– Authoring System
– WYSIWYG
– Templates
• Separate Design from Execution
– Stand-alone Designer
– Generated Executable

CBA Item Builder Components
CBA Item Builder: standalone authoring tool with preview
CBA Item: result of authoring is deployed on delivery platform
CBA Runtime: executes the item

Test Developer PC Delivery Platform

CBA Item Builder CBA Runtime

<<generates>> <<executes>>

<<is deployed>>
CBA Item CBA Item

Many different delivery platforms available:
 CBA Server => e.g. PIAAC Translation and Test Portal
 Web Delivery Environment => Integration in other Test Platforms
(e.g. VMWare Integration with TAO)
 CBA Execution Environment => Web, Intranet, Soft Appliance, Memory Stick

CBA Item Builder
Standalone Visual Editor for building CBA Items

 Rich Text
Fields
(static/
interactive)
 InputFields
 Buttons
 Links
 CheckBox
 Images
 ImageMaps
 Video/Audio
MediaPlayer
 …

Examples of CBA Items
Typical Examples
 Simulation of an “Email / Web Scenario”
The test person receives an email and should book
cinema tickets online.

 Explore and understand a dynamic model (MicroDYN)
The test person should explore and master a dynamic
system with input (exogenous) variables influencing
output (endogenous) variables.

 Understand an automaton based on a Finite State Machine (MicroFIN)
The test person should interact with a mobile phone and set time to
summertime.

Implementation and Architecture
1. Massive re-use of existing Open Source Components/Frameworks for Development and
Runtime
 Item Development: CBA Item Builder
Java, Eclipse RCP, Eclipse GMF/EMF, openArchitectureWare, in a second step also Xtext
 Item Delivery: CBA Runtime
GUI Framework: initially Adobe Flash (asWing), now Eclipse RAP (Rich AJAX Platform)
Platform: JBoss Application Server, OSGi
Framework: Spring, EJB
Apache SCXML (for FSM engine)

2. Architecture
 model-driven
 component oriented

Integration in TAO
Example PIAAC 2011

 CBA Item integrated as a
web component (stimulus)
into the TAO test frame.
 TAO controls the test
execution and the lifecycle
of the CBA Item at runtime
 TAO communication based
on Flash/JavaScript
 TAO Adapter (cba_rte.swf)
provides API

CBA TAO Adapter

Stimulus Area (CBA Item Area) implemented using HTML Element “iframe”

API TAO Adapter

CBA TAO API (in Flash)
 StartTask(Task, X, Y, W, H, SnapshotRef)
 EndTask(TaskID)

TAO Callback Messages
 notify()
Return message
 record_trace()
Trace events record all user interactions

Task corresponds to an “inquiry” in TAO. A CBA Item may
contain several tasks e.g starting with different pages.

Snapshot represents the state of a CBA Item, allows
restoring when going back to a task.

CBA Item Life-Cycle
Life-Cycle of a “CBA Item“ at Runtime
 Loaded
CBA Item is loaded the first time a task is
called (global resource)

 Active
CBA Item is initialized for the session and
the requested task
(session state)

StartTask()
 First initialization when calling the task for the first time (no snapshot) or
 Restore last state (using snapshot) when continuing a task

EndTask()
 Saves the current state and returns a snapshot
 Computes the score “on the fly” and returns the score result (useful for adaptive testing)

Java Script API
More General Java Script API (without Flash Adapter)

Start/Restart a task of a CBA Item
function: StartTask()
callback function: extCBAEvent(logText)

Stop a running task
function: StopTask()
callback function: extCBAEndTaskResponse(itemScore, snapshotUrl)

Notify about any user interaction
callback function: extCBAEvent(logText)

Save an intermediary state
function: RequestSnapshot()
callback function: extCBASnapshotResponse(snapshotUrl)

Usage and Examples
CBA Item Builder:
– Editor with graphical user interface
– Easy to handle for non-IT-specialists
– Wide spectrum of graphical possibilities,
templates
– WYSYWYG (preview of test item)
– Short development times
– Support of test development process (translation
and adaptation of test items)

Usage and Examples
Usage: The user interface of the CBA IB
Editor for
single
graphical
Set of components
pages

Project Designer view
Toolbar Properties view
view (page editor)

Tool set for
Graphical
graphical
interface /
components
drawing
board

Usage and Examples
What types of items does the CBA IB support?
• Static / dynamic
• Simple / complex
• Text only / multimedia
• Linear structure / hypertext structure

Usage and Examples
Examples: Simple questionnaire

Usage and Examples
Examples: Simple multiple choice item

Usage and Examples
Examples: Simulation of a technology rich
environment
- Web Browser Simulation
- Simulation of a web
application including search
functionality
- Hypertext structure

Usage and Examples
Examples: Problem solving scenario

- Simulation of a
dynamic system
consisting of states,
events and transistions
- Graphical
representation of an
automaton
- Keys are linked to
events and trigger
transitions
- Display represents
states

Usage and Examples
Examples: Interaction and response modes
• Click responses (via mouse)
– Radiobuttons, Buttons, Checkboxes etc.
– Clickable image areas
– Clicking on a hyperlink
– Choosing an item from a drop down box
– Menu items
• Highlighting (via mouse)
• Numeric and textual entries (via keyboard)

Usage and Examples
Examples: Click responses
Radiobuttons Clickable
(1 out of x)
Image Area

Checkboxes (x
Button
out of y)
Link to a page
Dropdown
Trigger of event
menu
(1 out of x)

Menu items
Text link

Usage and Examples
Examples: Highlighting text

Usage and Examples
Examples: Numeric and textual entries

TAO DAYS - Integration of 3rd party components into TAO

More Related Content

Similar to TAO DAYS - Integration of 3rd party components into TAO (20)

More from Open Assessment Technologies (19)

TAO DAYS - Integration of 3rd party components into TAO