Educate 2017: Today’s Special: Item versioning and dynamic content
Download as PPTX, PDF1 like888 views
The document provides an agenda for a presentation by Rich Shupe and Andrew Morrison on Learnosity's assessment and analytical features. The presentation will cover dynamic content, item banks, the jobs service, item pools, displaying original versus edited question content, and include demonstrations. Dynamic content allows variations of questions using table data. Item banks can contain assessment items and item pools create snapshots of item bank content over time. The jobs service processes asynchronous tasks and item pools preserve content collections without direct editing. Displaying original questions helps preserve student context when questions are later edited.
![Multiple Itembank Sources
/*--------------------------------------------------
| Common Items API usage
|-------------------------------------------------*/
"items": [ "Item1", "Item2"]
/*--------------------------------------------------
| Advanced Items API usage #1 – alternate item bank
|-------------------------------------------------*/
"organisation_id": 999,
"items": [ "Item1", "Item2"]
/*--------------------------------------------------
| Advanced Items API usage #2 – multiple item banks
|-------------------------------------------------*/
"items": [
{
"id": "Item1",
"reference": "Item1"
},
{
"id": "Item1",
"reference": "Item1",
"organisation_id":999
}
]
● A typical items array contains
string references.
● To specify an alternate item
bank activity-wide, simply add
an organisation_id.*
● To use multiple itembanks,
add the organisation_id at
the item level.*
* Consumer must have permission](https://image.slidesharecdn.com/12-10todaysspecial-170521023147/85/Educate-2017-Today-s-Special-Item-versioning-and-dynamic-content-11-320.jpg)
![// This is an example response from a GET request to Data API /jobs
{
"meta": {
"status": true,
"timestamp": 1493159479,
"next": 3534,
"records": 1
},
"data": [
{
"reference": "SOME_UUID",
"type": "itempool",
"status": "completed",
"results": {},
"dt_created": "2017-05-04 12:10:41",
"dt_completed": "2017-05-04 12:10:41",
}
]
}
Long Running Jobs:
Flavor Profile
Reference (Job Reference)
This will be assigned when a job gets
created, used for id purposes only
“ORDER UP!”
Type (Job Type)
Assigned; tells the asynchronous
services what process to run - the recipe
Status
Where is the job process up to:
Queued, running, completed / halted
“Is it cooked yet?”
Results
Anything of note about the job
e.g. why it was halted
Simple, abstract notes...](https://image.slidesharecdn.com/12-10todaysspecial-170521023147/85/Educate-2017-Today-s-Special-Item-versioning-and-dynamic-content-16-320.jpg)
![Multiple Itembank Sources
Using Item Pools
/*--------------------------------------------------
| Common Items API usage
|-------------------------------------------------*/
"items": [ "Item1", "Item2"],
"item_pool_id": "january snapshot"
/*--------------------------------------------------
| Advanced Items API usage #1 – alternate item bank
|-------------------------------------------------*/
"organisation_id": 999,
"items": [ "Item1", "Item2"],
"item_pool_id": "january snapshot"
/*--------------------------------------------------
| Advanced Items API usage #2 – multiple item banks
|-------------------------------------------------*/
"items": [
{
"id": "Item1",
"reference": "Item1"
},
{
"id": "Item1",
"reference": "Item1",
"Organisation_id":999,
"item_pool_id": "january_snapshot"
}
]
● To pull content from item
pools, simply add an
item_pool_id for an item
pool that contains the relevant
item(s).
● Single and multiple itembanks
are supported.](https://image.slidesharecdn.com/12-10todaysspecial-170521023147/85/Educate-2017-Today-s-Special-Item-versioning-and-dynamic-content-26-320.jpg)
![Original versus Edited Question Forms
● When student sees
activity for the first
time, (state:initial),
use default values
(itembank form).
● When resuming/
reviewing (and for
session detail
reports) use feature
to show question
form already seen
by student.
//first time seeing assessment, current itembank content used
{
'user_id' : 'demo_student',
'session_id' : '0df55215-90de-407a-b077-7017924556d3',
'items' : ['Tut002_Item 1', 'Tut002_Item2'],
'rendering_type': 'assess',
'type' : 'submit_practice',
'activity_id' : 'demo_activity',
'name' : 'The Color Wheel',
'state' : 'initial'
};
//(excerpt)
//in resume or review mode, show form originally seen by student
...
'state' : 'initial',
'config' : {
'questions_api_init_options' : {
'render_with_captured_question': true
}
}
};](https://image.slidesharecdn.com/12-10todaysspecial-170521023147/85/Educate-2017-Today-s-Special-Item-versioning-and-dynamic-content-30-320.jpg)
Educate 2017: Today’s Special: Item versioning and dynamic content
- 1. Rich & Andrew 12:10 – 12:50pm Today's Special: Item snapshots and dynamic content
- 2. Rich Shupe Head Chef Business Development Engineer rich.shupe@learnosity.com Andrew Morrison Sous Chef Software Engineer - Internal Applications andrew.morrison@learnosity.com Presenters
- 3. Today’s Special - Coming up... A menu of assessment and analytical features, including multiple itembanks, item pools, dynamic content, and a few nuances of those flavours... ● Dynamic Content (Aperitif) ● Itembanks (Entree) ● Jobs Service (Salad) ● Item pools (Plat Principal) ● Original v. Edited Content (Dessert) ● Q & A (Coffee)
- 4. Dynamic Content ● Dynamic content is a form of smart content that allows many variations of the same question ingredients. ● This feature must be enabled within the Author API initialization settings (config > item_edit > item) or by a Learnosity chef, if you use the Learnosity author site. //config > item_edit > item object ... "item_edit": { "item": { "dynamic_content": true, ... } } ...
- 5. Dynamic Content Data may be added manually, or pasted from a CSV recipe. You can use spreadsheet apps, as well, to generate content for you.
- 6. Dynamic Content The data will then be automatically transformed into a table (with up to 1000 place settings) and used to cook questions with table variables.
- 7. Dynamic Content ● Data is entered, much like response boxes, from the enabled rich and creamy text editor. ● Data can appear in stimuli, distractors, validation values, and so on, and supports both numeric and text entries.
- 8. Dynamic Content Once enabled, data can be added at the item level, and used by any question in that item.
- 10. Multiple Itembank Sources Consumer Consumer Itembank Itembank Itembank The Items API can access one or more itembanks owned by the same consumer, or may be granted access to other itembanks.
- 11. Multiple Itembank Sources /*-------------------------------------------------- | Common Items API usage |-------------------------------------------------*/ "items": [ "Item1", "Item2"] /*-------------------------------------------------- | Advanced Items API usage #1 – alternate item bank |-------------------------------------------------*/ "organisation_id": 999, "items": [ "Item1", "Item2"] /*-------------------------------------------------- | Advanced Items API usage #2 – multiple item banks |-------------------------------------------------*/ "items": [ { "id": "Item1", "reference": "Item1" }, { "id": "Item1", "reference": "Item1", "organisation_id":999 } ] ● A typical items array contains string references. ● To specify an alternate item bank activity-wide, simply add an organisation_id.* ● To use multiple itembanks, add the organisation_id at the item level.* * Consumer must have permission
- 12. Eyes on the Prize What common base is often behind many of the world's best sauces, gravies, and stews? - Rich, “Cooking Questions” A good roux.
- 13. Long Running Jobs: After you’ve called up Data API with your ingredients list and placed your order, it then falls to the Jobs services to cook everything up according to a recipe… these cooks can be particularly finicky, and will stop cooking if the ingredients are bad… - Andrew, “Rambling Recipes”
- 14. Long Running Jobs Data API Jobs Queues Jobs Data Jobs Storage Get Jobs Set Jobs Services (Recipes) Asynchronous Data API (Includes: Item pools) Porter (Easy-bake) Adaptive Simulations (Complicated Recipe) Client RequestRequest Get Jobs Data API Jobs Data Client Get Jobs Get Jobs Some other restaurant...
- 15. Demo: Polling the Jobs Service Programming demo
- 16. // This is an example response from a GET request to Data API /jobs { "meta": { "status": true, "timestamp": 1493159479, "next": 3534, "records": 1 }, "data": [ { "reference": "SOME_UUID", "type": "itempool", "status": "completed", "results": {}, "dt_created": "2017-05-04 12:10:41", "dt_completed": "2017-05-04 12:10:41", } ] } Long Running Jobs: Flavor Profile Reference (Job Reference) This will be assigned when a job gets created, used for id purposes only “ORDER UP!” Type (Job Type) Assigned; tells the asynchronous services what process to run - the recipe Status Where is the job process up to: Queued, running, completed / halted “Is it cooked yet?” Results Anything of note about the job e.g. why it was halted Simple, abstract notes...
- 17. Long Running Jobs The Take Away ● Uses /jobs endpoints for Data API ● Cannot create a job entry directly ● Cooking process: queued -> running -> completed / halted ● Halted jobs put content / process errors in the results object ○ Accessible by polling the job ● Data API validates bad job attributes instantly
- 18. Item pools: If your Itembank content is like a sandwich, then there’s no analogy I can use for Item pools that will make any sense… Item pools are a copy of digital content - Andrew, “Rambling Recipes”
- 19. ● Cannot be edited or modified with authoring tools What IS an Item pool? ● A snapshot of defined itembank content Item pools ● Content used for the initial snapshot and any updates must always come from an Itembank
- 20. Itembank (What’s cookin’) Item: CAKE ● Semolina ● Olive Oil ● Stevia ● Tofu Blend Item: CAKE ● Flour ● Butter ● Sugar Item pool #1 (Classic Cake) Item: CAKE ● Flour ● Butter ● Sugar ● Egg Item pool #2 (Non-sellout Cake) Item: CAKE ● Flour ● Butter ● Sugar ● Egg
- 21. Item pools When to use them? ● When you need to preserve your menu ● When you want to organise your dishes as collections...
- 22. Item pools Try to avoid... ● Recreating your feast over and over again...
- 24. Eyes on the Prize How many tablespoons are in 1/4 cup? - Rich, “Cooking Questions” Four.
- 25. A consumer has access to its own and potentially other itembanks Multiple Itembank Sources Consumer Consumer Itembank It may also use item pools in the same way... Item pool Item pool Itembank
- 26. Multiple Itembank Sources Using Item Pools /*-------------------------------------------------- | Common Items API usage |-------------------------------------------------*/ "items": [ "Item1", "Item2"], "item_pool_id": "january snapshot" /*-------------------------------------------------- | Advanced Items API usage #1 – alternate item bank |-------------------------------------------------*/ "organisation_id": 999, "items": [ "Item1", "Item2"], "item_pool_id": "january snapshot" /*-------------------------------------------------- | Advanced Items API usage #2 – multiple item banks |-------------------------------------------------*/ "items": [ { "id": "Item1", "reference": "Item1" }, { "id": "Item1", "reference": "Item1", "Organisation_id":999, "item_pool_id": "january_snapshot" } ] ● To pull content from item pools, simply add an item_pool_id for an item pool that contains the relevant item(s). ● Single and multiple itembanks are supported.
- 27. Before and After: Sometimes you need to edit a question right away —which is fine for new assessments. But what do you do for context when students have already seen the original version?
- 28. Original versus Edited Question Forms Imagine this scenario: ● You have an error in a question, but it is already been reported by students in a live assessment. ● You discover that the correction will materially alter the context of the question so, you both want to correct the question for new students, and preserve the original state for reports, review modes, and tests that must be resumed. ● Introducing: render_with_captured_question
- 29. Original versus Edited Question Forms ● Saving all question data every time a student saves/submits would be unnecessarily slow. We minimize this by passively capturing the questions after authentication. ● Thereafter, only deltas (changes) to the responses data are saved, reducing bandwidth and speeding up saves/submits. ● render_with_captured_question allows you to choose when to show the original question form—as seen by the student—and when to show the current version from the itembank.
- 30. Original versus Edited Question Forms ● When student sees activity for the first time, (state:initial), use default values (itembank form). ● When resuming/ reviewing (and for session detail reports) use feature to show question form already seen by student. //first time seeing assessment, current itembank content used { 'user_id' : 'demo_student', 'session_id' : '0df55215-90de-407a-b077-7017924556d3', 'items' : ['Tut002_Item 1', 'Tut002_Item2'], 'rendering_type': 'assess', 'type' : 'submit_practice', 'activity_id' : 'demo_activity', 'name' : 'The Color Wheel', 'state' : 'initial' }; //(excerpt) //in resume or review mode, show form originally seen by student ... 'state' : 'initial', 'config' : { 'questions_api_init_options' : { 'render_with_captured_question': true } } };
- 32. Eyes on the Prize While boning a poularde demi désossée, who famously said, “Now I've done it. I’ve cut the dickens out of my finger!” Dan Aykroyd (as Julia Child, SNL 1978)
- 33. Rich & Andrew Any questions?
Editor's Notes
- #2: Demoer to cover content Nuance drawn out with banter