![AUTEUR – Humour Planner
H-Strategy 1
An action forms the most suitable subject for a joke, then an
actor, then an object, and finally a location.
H-Strategy 2
If the action portrays an intention [goal], interrupt the action
in a way that is unexpected by the character, so that the goal
cannot be fulfilled and the character's mood is downgraded
or he or she suffers in some way.
(Mischief + Schadenfreude)
H-Strategy 16
A sequence of actions that is meaningful is more preferable for
the construction of jokes than a sequence of unrelated
actions.
H-Strategy 24
A relationship between two oppositional characters should be
established in such a way that the goal of one character is to
interrupt the goal of the other in such a way, that is unexpected
by the second character. The reaction of the second character
must then be influenced by the first so that the second
character's mood is downgraded or he suffers in some
way. (Mischief + Schadenfreude).
ILPS Frank Nack nack@uva.nl KBMS 29](https://image.slidesharecdn.com/kbms-video-app-101012090540-phpapp01/85/Kbms-video-app-29-320.jpg)
![AUTEUR – Visual Designer
E-Strategy 6
If a sequence is to be established
where location of shot A ≠ location of shot B
or the sequence is the first sequence to be
established
then
create a memory structure of the spatial relations
between all characters of Shot B
Location-Memory-Structure
Start Shot-id
End Shot-id
List of structures
List_of_content_relations
List_of_used_shots
E-Strategy 9
If number of character = 3 and
camera distance of both shots ≥ medium long
then
shot A ([left | right]) with shot B ([middle]) => circle / triangle
shot A ([left | middle]) with shot B ([right]) => circle / triangle
shot A ([middle | right]) with shot B ([left]) => circle / triangle
shot A ([left]) with shot B ([middle]) with shot C ([left]) =>
line or its permutations.
ILPS Frank Nack nack@uva.nl KBMS 43](https://image.slidesharecdn.com/kbms-video-app-101012090540-phpapp01/85/Kbms-video-app-43-320.jpg)
Kbms video-app
- 1. KBMS – Video - Application Frank Nack ILPS ILPS
- 2. Outline Organisation Last lecture ForkBrowser – browsing a large video collection AUTEUR – automatic generation of slapstick video sequences Additional applications ILPS Frank Nack nack@uva.nl KBMS 2
- 3. Organisation 1st Exam Friday 29th of October 9:00 – 10:30 G2.02 Topics: communication, knowledge, text, image, video Closed book exam ILPS Frank Nack nack@uva.nl KBMS 3
- 4. Text and Image – summary Investigated Temporal visual medium Effect of time on interaction and creativity AI techniques for the representation of time, action, plan Example Video, Frames, Scripts, Conceptional Dependencies, Plans, Goals, Story Grammar, Semantic Links Findings Video, though based on common human content and thematic structures, provides its own realities of time and space which are interwoven in the narrative structure. A story is a representational system based on two main layers, structure and content, each serving two distinct purposes (form and substance). A primarily structure-oriented approach (grammar) to the temporal aspects of video with respect to generation and interaction is not appropriate. A planning approach (planner or agent) seems ILPS Frank Nack nack@uva.nl KBMS 4
- 5. ForkBrowser ILPS Frank Nack nack@uva.nl KBMS 5
- 6. ForkBrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 6
- 7. ForkBrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 7
- 8. ForkBrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 8
- 9. ForkBrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 9
- 10. ForkBrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 10
- 11. ForkBrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 11
- 12. ForkBrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 12
- 13. Forkbrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 13
- 14. Forkbrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 14
- 15. Forkbrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 15
- 16. Forkbrowser Slide courtesy of Marcel Worring, UvA, ISLA ILPS Frank Nack nack@uva.nl KBMS 16
- 17. AUTEUR ILPS Frank Nack nack@uva.nl KBMS 17
- 18. AUTEUR - Aim • Automatic composition of visual slapstick sequences. • Use an existing, arbitrary data base. • Investigate machine creativity. ILPS Frank Nack nack@uva.nl KBMS 18
- 19. AUTEUR – Generation Example I Motivation Narrative rules (joke structure) Narrative rules (continuity) Access via content representation Access via content representation Editing rules (continuity) Editing rules (continuity) ILPS Frank Nack nack@uva.nl KBMS 19
- 20. AUTEUR – Generation Example II Realisation Narrative rules (joke structure) Access via content representation Editing rules (continuity) ILPS Frank Nack nack@uva.nl KBMS 20
- 21. AUTEUR – Generation Example III Resolution Narrative rules (joke structure) Access via content representation Editing rules (continuity) ILPS Frank Nack nack@uva.nl KBMS 21
- 22. AUTEUR – Generation Example IV Result ILPS Frank Nack nack@uva.nl KBMS 22
- 23. AUTEUR - Architecture ILPS Frank Nack nack@uva.nl KBMS 23
- 24. AUTEUR - Architecture ILPS Frank Nack nack@uva.nl KBMS 24
- 25. AUTEUR - Architecture • 145 Conceptual Dependencies • 26 humour rules • 37 editing rules • 85 clips (5 sec – 9 min) ILPS Frank Nack nack@uva.nl KBMS 25
- 26. AUTEUR – Structure Planner ILPS Frank Nack nack@uva.nl KBMS 26
- 27. AUTEUR – Plot Model I The explicit transformation of moods The conflict between the expected or states of the portrayed character. and what actually occurs. The implicit upgrading of the mood of the viewer. ILPS Frank Nack nack@uva.nl KBMS 27
- 28. AUTEUR – Plot Model II ILPS Frank Nack nack@uva.nl KBMS 28
- 29. AUTEUR – Humour Planner H-Strategy 1 An action forms the most suitable subject for a joke, then an actor, then an object, and finally a location. H-Strategy 2 If the action portrays an intention [goal], interrupt the action in a way that is unexpected by the character, so that the goal cannot be fulfilled and the character's mood is downgraded or he or she suffers in some way. (Mischief + Schadenfreude) H-Strategy 16 A sequence of actions that is meaningful is more preferable for the construction of jokes than a sequence of unrelated actions. H-Strategy 24 A relationship between two oppositional characters should be established in such a way that the goal of one character is to interrupt the goal of the other in such a way, that is unexpected by the second character. The reaction of the second character must then be influenced by the first so that the second character's mood is downgraded or he suffers in some way. (Mischief + Schadenfreude). ILPS Frank Nack nack@uva.nl KBMS 29
- 30. AUTEUR – Content Planner ILPS Frank Nack nack@uva.nl KBMS 30
- 31. AUTEUR – Content Planner ILPS Frank Nack nack@uva.nl KBMS 31
- 32. AUTEUR – Semantic Descriptions - Action Frame ILPS Frank Nack nack@uva.nl KBMS 32
- 33. AUTEUR – Semantic Description – Event and Concept Script (to meet) Conceptual dependency ILPS Frank Nack nack@uva.nl KBMS 33
- 34. AUTEUR – Semantic Description – Semantic Graph ILPS Frank Nack nack@uva.nl KBMS 34
- 35. AUTEUR – Visual Designer ILPS Frank Nack nack@uva.nl KBMS 35
- 36. AUTEUR – Video Content Representation I Description Scheme (Character) ILPS Frank Nack nack@uva.nl KBMS 36
- 37. AUTEUR – Video Content Representation II Description Scheme (Denotative Video Aspects) ILPS Frank Nack nack@uva.nl KBMS 37
- 38. AUTEUR – Video Content Representation III Description Scheme (Media Dependent Aspects) ILPS Frank Nack nack@uva.nl KBMS 38
- 39. AUTEUR – Visual Designer E-Strategy 1 If sequence.kind = Motivation then Camera distance of Shot to be chosen is long => location.function = outdoor medium long or medium => location.function = indoor ILPS Frank Nack nack@uva.nl KBMS 39
- 40. AUTEUR – Video spatial relations between frames ILPS Frank Nack nack@uva.nl KBMS 40
- 41. AUTEUR – Visual Designer ILPS Frank Nack nack@uva.nl KBMS 41
- 42. AUTEUR – Video spatial relations between frames II break up into Legend: sub-groups of the kind described Symbols: shot, cut, subject to the left and then use Type of spatial relations: their configuration line, triangle or half circle, based on the decomposition (1): hierarchical knowledge square or circle, representation of subjects, the decomposition starts over cross on parts level : decomposition (2 - n): Class the content of each shot Spatial relationships in the shot and created via a cut should present the same Subclass hierarchical level within Instance the knowledge representation, e.g Parts Instance - Instance, or Subparts Parts - Parts. n subject 1 subject 2 subjects 3 subjects 4 subjects (where n > 4) number and size of characters to be portrayed and their spatial relationships involved. ILPS Frank Nack nack@uva.nl KBMS 42
- 43. AUTEUR – Visual Designer E-Strategy 6 If a sequence is to be established where location of shot A ≠ location of shot B or the sequence is the first sequence to be established then create a memory structure of the spatial relations between all characters of Shot B Location-Memory-Structure Start Shot-id End Shot-id List of structures List_of_content_relations List_of_used_shots E-Strategy 9 If number of character = 3 and camera distance of both shots ≥ medium long then shot A ([left | right]) with shot B ([middle]) => circle / triangle shot A ([left | middle]) with shot B ([right]) => circle / triangle shot A ([middle | right]) with shot B ([left]) => circle / triangle shot A ([left]) with shot B ([middle]) with shot C ([left]) => line or its permutations. ILPS Frank Nack nack@uva.nl KBMS 43
- 44. AUTEUR – Visual Designer - Action E-Strategy 12 If an action for a character is required and there is no shot available to portray that action then isolate the character in a shot retrieve the body part related to the action retrieve a suitable shot where a body part performs the required action build a bridge into or out of this sequence if necessary continue with the sequence which was interrupted by this subsequence. ILPS Frank Nack nack@uva.nl KBMS 44
- 45. AUTEUR – Visual Constructor ILPS Frank Nack nack@uva.nl KBMS 45
- 46. AUTEUR – Video shaping TIME (H:Min:Sec:Frames) Frames Stratamodel ILPS Frank Nack nack@uva.nl KBMS 46
- 47. AUTEUR – Visual Constructor E-Strategy 29 If sequence.action.tempform = contraction and action is a single action then favour decomposed forms of presentation where the camera distance of shot A ≥ camera distance shot B E-Strategy 31 If camera distance of a shot ≤ close-up and then clip it to a length ≤ 60 Frames. E-Strategy 32 If close-up < camera distance of a shot < long and sequence. kind = motivation then clip it to a length ≤ 108 Frames. ILPS Frank Nack nack@uva.nl KBMS 47
- 48. AUTEUR – Summary Planner approach (backward chaining – goal driven) Addresses continuity problem BUT incompletely Closed system Requires lots of knowledge Editing strategies are explicit BUT not final Story generation is flexible BUT presentation should be generated rather than using existing material ILPS Frank Nack nack@uva.nl KBMS 48 48
- 49. Video – Additional Applications ILPS 49 Frank Nack – HCS nack@uva.nl KBMS / CeM – winter 2009
- 50. Video – Additional Application ILPS 50 Frank Nack – HCS nack@uva.nl KBMS / CeM – winter 2009
- 51. Video – Additional Application II ILPS 51 Frank Nack – HCS nack@uva.nl KBMS / CeM – winter 2009
- 52. Video – Additional Application III ILPS 52 Frank Nack – HCS nack@uva.nl KBMS / CeM – winter 2009
- 53. Video – Additional Application VI ILPS 53 Frank Nack – HCS nack@uva.nl KBMS / CeM – winter 2009
- 54. Summary The content determines the application Content description Application dependent Complex Recourse demanding Time critical Incomplete Modular Schemata Description environment Production supportive Archive supportive ILPS 54 Frank Nack – HCS nack@uva.nl KBMS / CeM – winter 2009