Lori Landay
Professor of Cultural Studies
Berklee College of Music
SCMS13
Innovative
sound can
bridge the
gaps between
the physical
body,
represented
body, and
imagined
body in video
games.
Do you feel the wind? Where? Why?




Grand Theft Auto IV: The Battle of Gay Tony
Rockstar North, 2009
Do you feel the wind? Where? Why?




Flower, thatgamecompany, 2009
Walter Murch’s aural spectrum




                                http://transom.org/?page_id=7006
unified sound, image, action in a virtual environment




Char Davies, Osmose (1994-96)
LIMBO, Playdead, 2010
GAPS BETWEEN
the physical body of the player,


the screen body represented on the screen,
perhaps by an avatar, and


the imagined body comprised of the mental image
and nonconscious sensory-motor processes of
the physical body and also the virtual body

Sound has the potential to bridge the points of
disconnection among these embodiment perspectives in a
way that image and action cannot.
Sound effects & music in Portal 2

               sound of soaring through the air after bouncing on “Aerial
               Faith Plate,” a sound effect that can be better understood
               as a musical event than a diegetic sound




Dan Bruno http://cruiseelroy.net/2011/06/portal-2-music/
Speech as sound effects in Portal 2
Portal 2, Valve, 2011
“Technology mirrors our desires;
interactive technologies, in
particular, reflect our desire to
feel engaged.”

David Rokeby, “Transforming Mirrors:
Subjectivity and Control in Interactive
Media,” 1996
Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

More Related Content

PPT
World Of Warcraft
PDF
calendario
PPTX
Presenting . . . Digital Media
PPT
Lucy TV
PDF
Calendario
PPTX
Digital Narrative: Play!
PPTX
Digital Narrative: Player Choices, Fun, & Dilemma
PPTX
Visual Culture
World Of Warcraft
calendario
Presenting . . . Digital Media
Lucy TV
Calendario
Digital Narrative: Play!
Digital Narrative: Player Choices, Fun, & Dilemma
Visual Culture

Viewers also liked (14)

PDF
Yanai doctor final
PPT
Teaching with Digital Media: Reboot Institute 2011
PPTX
Digital Narrative Theory & Practice: Recap
PPTX
Appearance & Reality in A Virtual World
PPTX
I Love Ricky: Music & Otherness in i love Lucy
PDF
March of DImes, March for Babies – Fundraising Tips from Team Levine
DOC
Practicas parlamentarias chilenas 1981 1925
PPT
Virtual Art/Virtual Aura
PDF
Your Account Director Solution
PPT
Digital Narrative: Game Design & Player Experience
PPTX
Dramatic Construction in Film/MacKendrick Highlights
PDF
Charting the Successful Redesign of an Independent Ecommerce Small Business —...
PPT
Digital Narrative: The Monomyth
PDF
The 8 Principles of Design – How to Leverage the Power of Design and Turn Con...
Yanai doctor final
Teaching with Digital Media: Reboot Institute 2011
Digital Narrative Theory & Practice: Recap
Appearance & Reality in A Virtual World
I Love Ricky: Music & Otherness in i love Lucy
March of DImes, March for Babies – Fundraising Tips from Team Levine
Practicas parlamentarias chilenas 1981 1925
Virtual Art/Virtual Aura
Your Account Director Solution
Digital Narrative: Game Design & Player Experience
Dramatic Construction in Film/MacKendrick Highlights
Charting the Successful Redesign of an Independent Ecommerce Small Business —...
Digital Narrative: The Monomyth
The 8 Principles of Design – How to Leverage the Power of Design and Turn Con...
Ad

Similar to Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments (20)

PDF
The Myth of Interactive Audio by Andrew Smith, May 2014
PDF
Sonic Virtuality Sound As Emergent Perception 1st Edition Mark Grimshaw
PDF
Sound Pressure How Speaker Systems Influence Manipulate And Torture 1st Editi...
PPTX
In The Game
PDF
Alpan Aytekin-Game Audio Essentials
PPT
Nothing Odd about Audio
PPT
Game Audio Post-Production
PDF
Alternate Gaming Interfaces, Kieran Nolan, F.R.O.G. 2010
PDF
Adaptive Music and Interactive Audio
PDF
Echoes, Whispers, and Footsteps from the Conflux of Sonic Interaction Design ...
PDF
Displayless Interaction af Lars Bo Larsen, AAU
PDF
Wwiseプレゼンテーション GTMF2012
ODP
SOUNDS Like Fun and Games
PDF
"Cultural and Social Dimensions of Games" by Sherry Jones (August 5, 2014)
PPTX
Unlock the Future of Sound with Emotion Systems Next Gen Audio
PDF
Dissertation - Keeran Johnson
PPT
Beyond the HUD - User Interfaces for Increased Player Immersion in FPS Games
PPT
Lesson 8social video games
DOC
05. g325 contemporary media issues - videogames and postmodernism
PPTX
Online gaming culture 4
The Myth of Interactive Audio by Andrew Smith, May 2014
Sonic Virtuality Sound As Emergent Perception 1st Edition Mark Grimshaw
Sound Pressure How Speaker Systems Influence Manipulate And Torture 1st Editi...
In The Game
Alpan Aytekin-Game Audio Essentials
Nothing Odd about Audio
Game Audio Post-Production
Alternate Gaming Interfaces, Kieran Nolan, F.R.O.G. 2010
Adaptive Music and Interactive Audio
Echoes, Whispers, and Footsteps from the Conflux of Sonic Interaction Design ...
Displayless Interaction af Lars Bo Larsen, AAU
Wwiseプレゼンテーション GTMF2012
SOUNDS Like Fun and Games
"Cultural and Social Dimensions of Games" by Sherry Jones (August 5, 2014)
Unlock the Future of Sound with Emotion Systems Next Gen Audio
Dissertation - Keeran Johnson
Beyond the HUD - User Interfaces for Increased Player Immersion in FPS Games
Lesson 8social video games
05. g325 contemporary media issues - videogames and postmodernism
Online gaming culture 4
Ad

More from LoriLanday (6)

PPTX
Art & Technology, 1950 to the Present, Day 1 Introduction
PDF
Ready for Metaverse: NOTES version
PPTX
Ready for the Metaverse: Immersive and Interactive Experiences in Virtual Wo...
PPTX
Storytelling and New Media -- Lori Landay
PPTX
What Is Digital Narrative?
PPTX
Early Cinema
Art & Technology, 1950 to the Present, Day 1 Introduction
Ready for Metaverse: NOTES version
Ready for the Metaverse: Immersive and Interactive Experiences in Virtual Wo...
Storytelling and New Media -- Lori Landay
What Is Digital Narrative?
Early Cinema

Recently uploaded (20)

PPTX
Module on health assessment of CHN. pptx
PDF
Journal of Dental Science - UDMY (2022).pdf
PDF
Journal of Dental Science - UDMY (2020).pdf
PPTX
DRUGS USED FOR HORMONAL DISORDER, SUPPLIMENTATION, CONTRACEPTION, & MEDICAL T...
PDF
CRP102_SAGALASSOS_Final_Projects_2025.pdf
PPTX
Education and Perspectives of Education.pptx
PDF
My India Quiz Book_20210205121199924.pdf
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
PPTX
What’s under the hood: Parsing standardized learning content for AI
PDF
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
PDF
FORM 1 BIOLOGY MIND MAPS and their schemes
PDF
International_Financial_Reporting_Standa.pdf
PDF
BP 505 T. PHARMACEUTICAL JURISPRUDENCE (UNIT 1).pdf
PDF
Skin Care and Cosmetic Ingredients Dictionary ( PDFDrive ).pdf
PDF
BP 505 T. PHARMACEUTICAL JURISPRUDENCE (UNIT 2).pdf
PPTX
Share_Module_2_Power_conflict_and_negotiation.pptx
PDF
Hazard Identification & Risk Assessment .pdf
PDF
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
PDF
Literature_Review_methods_ BRACU_MKT426 course material
PDF
LIFE & LIVING TRILOGY- PART (1) WHO ARE WE.pdf
Module on health assessment of CHN. pptx
Journal of Dental Science - UDMY (2022).pdf
Journal of Dental Science - UDMY (2020).pdf
DRUGS USED FOR HORMONAL DISORDER, SUPPLIMENTATION, CONTRACEPTION, & MEDICAL T...
CRP102_SAGALASSOS_Final_Projects_2025.pdf
Education and Perspectives of Education.pptx
My India Quiz Book_20210205121199924.pdf
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
What’s under the hood: Parsing standardized learning content for AI
MBA _Common_ 2nd year Syllabus _2021-22_.pdf
FORM 1 BIOLOGY MIND MAPS and their schemes
International_Financial_Reporting_Standa.pdf
BP 505 T. PHARMACEUTICAL JURISPRUDENCE (UNIT 1).pdf
Skin Care and Cosmetic Ingredients Dictionary ( PDFDrive ).pdf
BP 505 T. PHARMACEUTICAL JURISPRUDENCE (UNIT 2).pdf
Share_Module_2_Power_conflict_and_negotiation.pptx
Hazard Identification & Risk Assessment .pdf
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
Literature_Review_methods_ BRACU_MKT426 course material
LIFE & LIVING TRILOGY- PART (1) WHO ARE WE.pdf

Sound, Embodiment, and the Experience of Interactivity in Video Games & Virtual Environments

  • 1. Lori Landay Professor of Cultural Studies Berklee College of Music SCMS13
  • 2. Innovative sound can bridge the gaps between the physical body, represented body, and imagined body in video games.
  • 3. Do you feel the wind? Where? Why? Grand Theft Auto IV: The Battle of Gay Tony Rockstar North, 2009
  • 4. Do you feel the wind? Where? Why? Flower, thatgamecompany, 2009
  • 5. Walter Murch’s aural spectrum http://transom.org/?page_id=7006
  • 6. unified sound, image, action in a virtual environment Char Davies, Osmose (1994-96)
  • 8. GAPS BETWEEN the physical body of the player, the screen body represented on the screen, perhaps by an avatar, and the imagined body comprised of the mental image and nonconscious sensory-motor processes of the physical body and also the virtual body Sound has the potential to bridge the points of disconnection among these embodiment perspectives in a way that image and action cannot.
  • 9. Sound effects & music in Portal 2 sound of soaring through the air after bouncing on “Aerial Faith Plate,” a sound effect that can be better understood as a musical event than a diegetic sound Dan Bruno http://cruiseelroy.net/2011/06/portal-2-music/
  • 10. Speech as sound effects in Portal 2
  • 12. “Technology mirrors our desires; interactive technologies, in particular, reflect our desire to feel engaged.” David Rokeby, “Transforming Mirrors: Subjectivity and Control in Interactive Media,” 1996