SlideShare a Scribd company logo
INTERACTION DESIGN +
‘CREATIVE CODING’
http://timstutts.com
MY BACKGROUND
• I’m

an interaction designer who has been incorporating
aspects of ‘creative coding’ into application design in the recent
years, largely through my consultancy, PushPopDesign.

• Outside

of interaction, I have done work in commercial
motion graphics, print, data visualization, and most extensively
in sound design for moving image, games, and art installations.
Many of these projects have incorporated ‘creative coding.’
INSPIRATION
• Recent

article/ list that I published to my blog, “Who works
with ‘Creative Coders?,” which showed up on Hacker News

• Related

discussions from people in the community

• Ongoing

conversations with studios that are taking notice

• Wanting

to give back to the Creative Coding community
DEFINITION
‘Creative Coding’ (original coined by the commercial world,
where a ‘creative’ is one who makes) encompasses a spectrum
of Designer/Programmer-type roles that emerge from the
unique needs of projects, where traditional design planning
and execution deliverables can no longer fully realize the ideas
made possible through newer technology, for example, specific
needs for branded generative graphics, ‘big data’ visualization,
natural user interface, and physical computing.
A DESIGN PROBLEM
• Standard

design applications are often not fully able to realize
and execute ideas within new paradigms, due to the fact that
they are unable to directly connect to the experience, and
rather can just provide planning and containing media.

• Programming

languages in the raw have too many
dependencies to be adequate ways of designing and
prototyping. The ability to connect with the experience is
there, but the rate of innovation is slowed.
A FRAMEWORK IS THE ANSWER
• openFrameworks
• Cinder

(C++)

• Processing
• Three.js
• Many

(C++)

(Java)

(JavaScript)

others!
BENEFITS OF ‘CREATIVE CODING’
• Individuals

are beneficial in the planning stages, as they
understand the possibilities / limitations of technology.

• Valuable

in the execution phase, as they are able to move
back in forth between designing and programming without
intermediate hand-offs.

• Synaptic

leaps and bounds through this process allow for new
design discoveries to be made and implemented during
software development. It’s all in the details.
TWO MAIN TYPES OF “CREATIVE
CODING” DELIVERABLES

Designing and
Programming an
application...

...that generates
Media, then
giving the client...

...the media (e.g.
film/video, 2D/
3D print)

...that controls an
experience, then
giving the client...

...an application
(e.g. installation,
platform app)
A COMMERCIAL “CREATIVE CODING” TIMELINE
( PROJECT COULD BE SHORT-FORMAT FILM/VIDEO, PRINT, INSTALLATION, TEMPORARY APPLICATION, ETC )

Planning

Executing

Committing

Submitting

Merging
First Push
Programming Explorations
Sketching
Creative Coder: Research

Delivering

Final Push
Deciding
Debugging

The Organization: Art / Creative Direction, Project Management, etc.

Sleeping!
Reflecting
The Commercial world gets it. Next question: Can the
interaction design community in the software industry warm
up to “creative coding” as more than just a play thing?

+

?
We can help...
‘CREATIVE CODING’ MEETS INTERACTION DESIGN
•

Align to deliverable expectations early (e.g. exploration, demo, full-on software).

•

Become more effective planners. Create wireframes, user-flows, etc.

•

Address usability issues at various stages, considering form and function, while still
doing aesthetically impressive work, if that is an aim of the project.

•

Use ‘creative coding’ frameworks for what they are good for and not for what they
aren’t (involve other libraries and maybe even use traditional applications at times).

•

Know when it’s time to explore and when its time to commit or even enter a
more standard, development cycle. Perhaps your role ends after prototyping and
transitioning code, or perhaps you are working on code for the final application.
I. WIREFRAMES AND PLANNING DELIVERABLES IN
PREPARATION FOR ‘CREATIVE CODING.’

source: my work from www.pushpopdesign.com, 2013
II. CREATIVE CODING IN ACTION WITHIN VARIOUS
PROGRAMMING ENVIRONMENTS

source: my work from www.pushpopdesign.com, 2013
III. FINAL PROJECTS UTILIZING INTERACTION DESIGN
AND ‘CREATIVE CODING’ ALONG THE WAY.

source: my work from
www.pushpopdesign.com, 2013
THANKS:
Arturo Castro
Gerald Kogler
openFrameworks
Zzzinc

More Related Content

PDF
Designer vs Developer - A Battle Royal v1.0
PPTX
Girl Geeks Toronto "Designers Do More Than Just Make Things Pretty"
PDF
StoryCode DIY Days Presentation - Creative Coding
PDF
Creative/UX Director cv 2016
PPT
Intro to IA/IxD/UXD in the agency world
PDF
Introduction to UX for Developers
PDF
Design Driven Development
PDF
UX/Design Thinking Prototyping Workshop
Designer vs Developer - A Battle Royal v1.0
Girl Geeks Toronto "Designers Do More Than Just Make Things Pretty"
StoryCode DIY Days Presentation - Creative Coding
Creative/UX Director cv 2016
Intro to IA/IxD/UXD in the agency world
Introduction to UX for Developers
Design Driven Development
UX/Design Thinking Prototyping Workshop

What's hot (19)

PDF
Design Driven Development
PDF
My UX Journey_bio brief
PPTX
Responsive design and Drupal, case Costume.fi
PDF
Yu-Hsiu Li Design as one UXMY
PDF
Creative Coding in Interaction Design with Tim Stutts
PPT
Design Turn - Expanding Design Consciousness
PDF
DLandis PORTFOLIO_peek_web
PDF
Mobile Design is for Mobile Users
KEY
UXD in Advertising
PDF
Future Proofing Your Portfolio
PPT
Research By Design
PDF
User Experience Best Practices
PDF
Design for services_lecture
PPTX
Introduction to User Experience Design 10/07/17
PPTX
UX for Dummies
PDF
Redesign design
PDF
Uxpin mastering the_power_of_nothing
PDF
An introduction to HCI
ODP
UI/UX - The Bigger Picture
Design Driven Development
My UX Journey_bio brief
Responsive design and Drupal, case Costume.fi
Yu-Hsiu Li Design as one UXMY
Creative Coding in Interaction Design with Tim Stutts
Design Turn - Expanding Design Consciousness
DLandis PORTFOLIO_peek_web
Mobile Design is for Mobile Users
UXD in Advertising
Future Proofing Your Portfolio
Research By Design
User Experience Best Practices
Design for services_lecture
Introduction to User Experience Design 10/07/17
UX for Dummies
Redesign design
Uxpin mastering the_power_of_nothing
An introduction to HCI
UI/UX - The Bigger Picture
Ad

Similar to Who Works with Creative Coders (20)

PDF
Application Prototyping - Pablo González - Capturing and Managing Requirements
PPTX
User centered design workshop
PDF
Intro to User Centered Design Workshop
PDF
User-Centered Design
PDF
PxS'12 - week 1 - Introduction
PPT
Owning the Interaction in Dynamic Environments
PPT
Owning the Interaction in Dynamic Environments
PPT
Designing Powerful Web Applications Using AJAX and Other RIAs
PDF
Creative Coding Lab
PPTX
Presentation on topic software design and architecture
PPTX
Introduction to Intrection design UX UI.
PDF
Designing WITH Users at Digital Summit 2011
PPT
Human-Centered Design
PPTX
Interaction Design Roadmap
PDF
EPFL - PxS, week 1 - Personal Interaction Studio 2011 introduction
PPTX
Human Computer Interaction Lecture Notes
PDF
Prototyping in code
DOCX
COMPUTER APPLICATION PROJECT ON
PDF
Product Design & Development Process By- Achia Nila
PPTX
Week 8 & 10
Application Prototyping - Pablo González - Capturing and Managing Requirements
User centered design workshop
Intro to User Centered Design Workshop
User-Centered Design
PxS'12 - week 1 - Introduction
Owning the Interaction in Dynamic Environments
Owning the Interaction in Dynamic Environments
Designing Powerful Web Applications Using AJAX and Other RIAs
Creative Coding Lab
Presentation on topic software design and architecture
Introduction to Intrection design UX UI.
Designing WITH Users at Digital Summit 2011
Human-Centered Design
Interaction Design Roadmap
EPFL - PxS, week 1 - Personal Interaction Studio 2011 introduction
Human Computer Interaction Lecture Notes
Prototyping in code
COMPUTER APPLICATION PROJECT ON
Product Design & Development Process By- Achia Nila
Week 8 & 10
Ad

Recently uploaded (20)

PPTX
HPE Aruba-master-icon-library_052722.pptx
PPTX
DOC-20250430-WA0014._20250714_235747_0000.pptx
PPTX
6- Architecture design complete (1).pptx
PPTX
Media And Information Literacy for Grade 12
PDF
Urban Design Final Project-Site Analysis
PPTX
LITERATURE CASE STUDY DESIGN SEMESTER 5.pptx
PDF
Quality Control Management for RMG, Level- 4, Certificate
PDF
Skskkxiixijsjsnwkwkaksixindndndjdjdjsjjssk
DOCX
The story of the first moon landing.docx
PPT
pump pump is a mechanism that is used to transfer a liquid from one place to ...
PPTX
12. Community Pharmacy and How to organize it
PPTX
An introduction to AI in research and reference management
PPTX
building Planning Overview for step wise design.pptx
PPTX
Complete Guide to Microsoft PowerPoint 2019 – Features, Tools, and Tips"
PDF
Emailing DDDX-MBCaEiB.pdf DDD_Europe_2022_Intro_to_Context_Mapping_pdf-165590...
PPTX
areprosthodontics and orthodonticsa text.pptx
PPTX
mahatma gandhi bus terminal in india Case Study.pptx
PDF
The Advantages of Working With a Design-Build Studio
PPTX
Fundamental Principles of Visual Graphic Design.pptx
PPTX
Special finishes, classification and types, explanation
HPE Aruba-master-icon-library_052722.pptx
DOC-20250430-WA0014._20250714_235747_0000.pptx
6- Architecture design complete (1).pptx
Media And Information Literacy for Grade 12
Urban Design Final Project-Site Analysis
LITERATURE CASE STUDY DESIGN SEMESTER 5.pptx
Quality Control Management for RMG, Level- 4, Certificate
Skskkxiixijsjsnwkwkaksixindndndjdjdjsjjssk
The story of the first moon landing.docx
pump pump is a mechanism that is used to transfer a liquid from one place to ...
12. Community Pharmacy and How to organize it
An introduction to AI in research and reference management
building Planning Overview for step wise design.pptx
Complete Guide to Microsoft PowerPoint 2019 – Features, Tools, and Tips"
Emailing DDDX-MBCaEiB.pdf DDD_Europe_2022_Intro_to_Context_Mapping_pdf-165590...
areprosthodontics and orthodonticsa text.pptx
mahatma gandhi bus terminal in india Case Study.pptx
The Advantages of Working With a Design-Build Studio
Fundamental Principles of Visual Graphic Design.pptx
Special finishes, classification and types, explanation

Who Works with Creative Coders

  • 1. INTERACTION DESIGN + ‘CREATIVE CODING’ http://timstutts.com
  • 2. MY BACKGROUND • I’m an interaction designer who has been incorporating aspects of ‘creative coding’ into application design in the recent years, largely through my consultancy, PushPopDesign. • Outside of interaction, I have done work in commercial motion graphics, print, data visualization, and most extensively in sound design for moving image, games, and art installations. Many of these projects have incorporated ‘creative coding.’
  • 3. INSPIRATION • Recent article/ list that I published to my blog, “Who works with ‘Creative Coders?,” which showed up on Hacker News • Related discussions from people in the community • Ongoing conversations with studios that are taking notice • Wanting to give back to the Creative Coding community
  • 4. DEFINITION ‘Creative Coding’ (original coined by the commercial world, where a ‘creative’ is one who makes) encompasses a spectrum of Designer/Programmer-type roles that emerge from the unique needs of projects, where traditional design planning and execution deliverables can no longer fully realize the ideas made possible through newer technology, for example, specific needs for branded generative graphics, ‘big data’ visualization, natural user interface, and physical computing.
  • 5. A DESIGN PROBLEM • Standard design applications are often not fully able to realize and execute ideas within new paradigms, due to the fact that they are unable to directly connect to the experience, and rather can just provide planning and containing media. • Programming languages in the raw have too many dependencies to be adequate ways of designing and prototyping. The ability to connect with the experience is there, but the rate of innovation is slowed.
  • 6. A FRAMEWORK IS THE ANSWER • openFrameworks • Cinder (C++) • Processing • Three.js • Many (C++) (Java) (JavaScript) others!
  • 7. BENEFITS OF ‘CREATIVE CODING’ • Individuals are beneficial in the planning stages, as they understand the possibilities / limitations of technology. • Valuable in the execution phase, as they are able to move back in forth between designing and programming without intermediate hand-offs. • Synaptic leaps and bounds through this process allow for new design discoveries to be made and implemented during software development. It’s all in the details.
  • 8. TWO MAIN TYPES OF “CREATIVE CODING” DELIVERABLES Designing and Programming an application... ...that generates Media, then giving the client... ...the media (e.g. film/video, 2D/ 3D print) ...that controls an experience, then giving the client... ...an application (e.g. installation, platform app)
  • 9. A COMMERCIAL “CREATIVE CODING” TIMELINE ( PROJECT COULD BE SHORT-FORMAT FILM/VIDEO, PRINT, INSTALLATION, TEMPORARY APPLICATION, ETC ) Planning Executing Committing Submitting Merging First Push Programming Explorations Sketching Creative Coder: Research Delivering Final Push Deciding Debugging The Organization: Art / Creative Direction, Project Management, etc. Sleeping! Reflecting
  • 10. The Commercial world gets it. Next question: Can the interaction design community in the software industry warm up to “creative coding” as more than just a play thing? + ? We can help...
  • 11. ‘CREATIVE CODING’ MEETS INTERACTION DESIGN • Align to deliverable expectations early (e.g. exploration, demo, full-on software). • Become more effective planners. Create wireframes, user-flows, etc. • Address usability issues at various stages, considering form and function, while still doing aesthetically impressive work, if that is an aim of the project. • Use ‘creative coding’ frameworks for what they are good for and not for what they aren’t (involve other libraries and maybe even use traditional applications at times). • Know when it’s time to explore and when its time to commit or even enter a more standard, development cycle. Perhaps your role ends after prototyping and transitioning code, or perhaps you are working on code for the final application.
  • 12. I. WIREFRAMES AND PLANNING DELIVERABLES IN PREPARATION FOR ‘CREATIVE CODING.’ source: my work from www.pushpopdesign.com, 2013
  • 13. II. CREATIVE CODING IN ACTION WITHIN VARIOUS PROGRAMMING ENVIRONMENTS source: my work from www.pushpopdesign.com, 2013
  • 14. III. FINAL PROJECTS UTILIZING INTERACTION DESIGN AND ‘CREATIVE CODING’ ALONG THE WAY. source: my work from www.pushpopdesign.com, 2013