Discursive Structures
of Informal Critique
in an HCI Design Studio
Colin M. Gray
June 10, 2013
Critique is central to design pedagogy
(Anthony, 1991; Hokanson, 2012)
Informal interaction between design
students has not been adequately
explored (“the hidden curriculum”)
(Dutton, 1991; Gray, in press; Willenbrock, 1991)
background
Peer
Between members of the same academic
program—in close proximity in terms of
experience and status
Informal
Not bounded by a traditional classroom
environment or professor/program
representation
background
research
questions
What role does informal critique play in a
designer’s understanding of their work?
How does informal peer critique encourage
verbalization of design decisions?
review of
literature
literature
Existing research on critique
Desk crits (Reimer & Douglas, 2003; Boling & Smith, 2010)
Formal critique (Anthony, 1991; Percy, 2004)
literature
Link of informal critique with reflection
Self-reflection as a developmental aid
(Schön, 1985; Cross, 2007)
Verbalization of reflection within the studio (Logan, 2008; Morton &
O’Brien, 2006; Dannels, Gaffney, & Martin, 2008)
context
Human-Computer Interaction design (HCI/d) program in the
School of Informatics
HCI/d Master’s students (first and second year)
context
data
Students (4—2 dyads)
Three stage data collection:
1. One hour interview about beliefs
2. One hour constructed critique dyad
3. One hour stimulated recall session
methods
methods
Naturalistic Inquiry (Lincoln & Guba, 1985)
Critical theory (Carspecken, 1996)
Intensive interview and observation strategies were used to
target beliefs and behaviors related to critique that were largely
tacit in nature
Observation of critique between study participants allowed for a
more naturalistic view into the behaviors and strategies in situ.
analysis
Coding of emergent themes
Sequence analysis of critique participants
Separate themes for critic (the person leading the critique) and
the recipient (the person being critiqued)
Discursive Structures of Informal Critique in an HCI Design Studio
findings
findings
Major discursive structures of the peer critique process
were identified:
Beginning the critique
Major setting shifts
Ending the critique
findings
“Jiao: Um, this is a workbook one, definitely on the topic of um
—death”
BEGINNING THE CRITIQUE
findings
“Emily: OK, alright. So, this is a—well you’ve already seen this in
class, but I’ll OK—this is a prototype that I made for my
capstone project. Um, I am focusing on newly diagnosed HIV+
individuals and um through a lot of research, I’ve kind of gotten
into the topic of identity development, um kind of just accepting
the fact that they are HIV+…”
BEGINNING THE CRITIQUE
findings
“Lisa: You probably know a lot about Anchor already. Um it is a
tablet application that links sailors and their loved ones um
during deployment. So during deployment when there are times
when there’s little communication, um it pulls media from a
locked box—things they have prepared for deployment, um
synthesizes a new message, even if there’s no data connection.”
BEGINNING THE CRITIQUE
findings
Limitations of the prototype
Worst case scenario
Internalizing new perspectives
MAJOR SETTING SHIFTS
findings
Limitations of the prototype
“Jiao: But I’m not sure, and uh I was curious where you guys are only
designing for American [inaudible]?
Lisa: Um, well we designed this thinking about um, well—we—we made
our target user people on deployment in the Navy or people on ships. Um
and so this—I think this could be expanded to other military branches.
Lisa: It doesn’t have to be the US, and also like people like migrant
workers, where one of the first people who like popped into our head for
ways to expand this. Um, so I don’t think it—it’s tied to an American
population. I mean, that’s what we chose to be our—our starting point.
But you can definitely—”
MAJOR SETTING SHIFTS
findings
Worst Case Scenario
“Paul: It might be a newer maybe newly diagnosed, it might be kind of jarring to like hear
these stories of like, of people who’ve been having troubles as opposed to stories of people
who have been living with it for a long time or people who’ve had like successful shared stories
Emily: Yeah
Paul: Versus like, oh crap, that was awful or something.
Emily: Yeah, well, you know, that’s definitely one of the, I think one of the biggest problems
with this is that it has potential to have really negative outcomes, too, because you know, if I
am a African American gay male and I see the story of another African American gay male who
was disclosing his status to his mother, and his mother you know called him a fag or
something, and like you know, and—and he’s like, you know, is this going to happen to me?
So I—that’s definitely something—[laughs]”
MAJOR SETTING SHIFTS
findings
Internalizing New Perspectives
“Paul: It feels like communicating the idea is kind of the same
thing.
Emily: Yeah, and this is kind of more like if you need support you
have to ask for it rather than like—
Paul: Yeah
Emily: What you said with like going there and seeing like, this
support is being offered.”
MAJOR SETTING SHIFTS
findings
“Lisa: And you could cremate the person and put them in their
real tree! [laughs] They would grow in it. Oh. Somebody posted
on Facebook this thing where like you get cremated and then it’s
essentially like, I don’t know, like a Chia pet for creation, and like
you can—you can grow out of a tree or something.
Jiao: Out of the tree [laughs]. How could it? We almost done—”
ENDING THE CRITIQUE
findings
“Paul: Not really, I mean—anxious to see where it goes.
Emily: Me too! [laughs] Awesome, thank you.”
ENDING THE CRITIQUE
discussion
Framing the problem space
“Jiao: Yeah, and you know the topic then um we sort of call—
have three or four two interviews with our participant who are
[name redacted] and—and [name redacted]. They all lost their
um relatives, especially for [name redacted]. [name redacted] lost
her father um two years ago and it’s really painful for her, but
that’s sort of a journey that we kind of—we don’t know much,
because um of course we lost our um relatives or our friends, um
so our topic was um how to—how to help people who lost their
loved one in terms of terminal illness.”
discussion
Projecting user reactions
“Lisa: OK, can the family members see what the terminally ill
person is saying, or?
Jiao: Yes, they can, but also, everyone who are going to post,
they can select whether it is private or public.
Lisa: Whenever it’s private, does that become public after you
die?
Jiao: Um, I don’t think so.”
discussion
Potential scenarios of use
“Paul: You are, this is an emotional subject—[joking] but I think that might be the thing
that—that it would offer is not necessarily like the end all be all solution of like getting
these soldiers to tell their stories. Sometimes it might just be that knowledge that
there’s something out there that people are coping with this.
Emily: Yeah
Paul: Um, whereas for other people it would be that sense of I—I need to like get
assistance with this, and I need to tell somebody, because maybe I can’t tell it to
anybody here. So what’s—
Emily: Right
Paul: I just need to put it out there.”
limitations
of the study
limitations
of the studyExploratory nature of the study
Small number of participants
A somewhat contrived critique environment
next steps
next steps
Larger-scale study exploring the emergence of informal critique
Ethnographic methods to observe critique in a truly naturalistic
context with self-selected participants
Ongoing work to identify knowledge structures embedded in
discourse and interactions
references
Anthony, K. H. (1991). Design juries on trial: The renaissance of
the design studio. New York: Van Nostrand Reinhold.
Boling, E., & Smith, K. M. (2010). Intensive studio experience in a
non-studio masters program: Student activities and thinking
across levels of design. Montréal: Design Research Society
International Conference.
Carspecken, P. F. (1996). Critical ethnography in educational
research: A theoretical and practical guide. New York: Routledge.
Cross, N. (2007). Designerly ways of knowing. Basel, Switzerland:
Birkhäuser.
Brandt, C.B., Cennamo, K., Douglas, S., Vernon, M., McGrath, M.
and Reimer, Y. (2011). A theoretical framework for the studio as a
learning environment. International Journal of Technology and
Design Education.
Cennamo, K., Brandt, C., & Scott, B. (2010). Adapting the studio
to design-based disciplines: Research-Based strategies for
effective practice. In Proceedings of the 2010 conference on
higher education pedagogy, Blacksburg, VA (pp. 14-5).
Dannels, D., Gaffney, A., & Martin, K. (2008). Beyond content,
deeper than delivery: What critique feedback reveals about
communication expectations in design education. International
Journal for the Scholarship of Teaching and Learning, 2(2).
Do, E. Y. L., & Gross, M. D. (1996). Drawing as a means to design
reasoning. In AI and design.
Lincoln, Y. S. and Guba, E. G. (1985). Naturalistic inquiry. Sage
Publications, Beverly Hills, CA.
Logan, C. (2008). Metaphor and pedagogy in the design
practicum. International Journal of Technology and Design
Education, 18(1), 1-17. doi:10.1007/s10798-006-9009-x
Morton, J., & O'Brien, D. (2006). Selling your design: Oral
communication pedagogy in design education. Communication
Education, 54(1), 6–19. doi:10.1080/03634520500076885
Percy, C. (2004). Critical absence versus critical engagement.
Problematics of the crit in design learning and teaching. Art,
Design & Communication in Higher Education, 2(3), 143-154.
Reimer, Y. J., & Douglas, S. A. (2003). Teaching HCI design with
the studio approach. Computer Science Education, 13(3),
191-205.
Schön, D. A. (1985). The design studio: An exploration of its
traditions and potentials. London: RIBA Publications Limited.
Willenbrock, L. (1991). An undergraduate voice in architectural
education. In T. A. Dutton (Ed.), Voices in architectural education:
Cultural politics and pedagogy (pp. 97-119). New York: Bergin &
Garvey.
questions?
coding scheme
Codes Applied to Critic Codes Applied to Critiquee
Association with User or
Problem Space Identification of Problem Space
Alternative Problem Space/Solution
Identification of Problem Space
Limitations of Prototype
Analyzing Potential User Reactions
Setting New Scenario (Based
on Critique)
Analyzing Potential User Reactions Support with ResearchAnalyzing Potential User Reactions
Referencing Former Critique
Replay Prototype Showing Off Prototype/Artifact
Worst Case Scenario
Response to Worst Case Scenario
Worst Case Scenario
Potential User Scenario
coding scheme
Codes Applied to Critic Codes Applied to Critiquee
Constructed Scenario Internalizing New Perspective
Clarification (Interface)
Request for Clarification
Clarification (Idea)
Request for Clarification
Unsure/Confused
Caught Off Guard/Explanation
Unsure/Confused
Conflicted/Personal
Drawing Parallels Parallels to Other Projects
How to Proceed/Next Steps Next Steps/Self Critique
Positive/Affirming
Thanks
Humor
Thanks
participantsparticipants
Participant Pseudonym Gender M.S. Year Country of Origin
Paul M 2nd USA
Emily F 2nd USA
Lisa F 1st USA
Jiao F 1st China

More Related Content

KEY
Verbalization of Design Thinking through Informal Peer Critique
PPTX
Creativity "Misrules": First Year Engineering Students’ Production and Percep...
PDF
What is the Nature and Intended Use of Design Methods?
PDF
Meaning Reconstruction as an Approach to Analyze Critical Dimensions of HCI R...
PDF
“Why are they not responding to critique?”: A student-centered construction o...
PDF
Inverting Critique: Emergent Technologically-Mediated Critique Practices of D...
PDF
Supporting Idea Generation Through Functional Decomposition: An Alternative F...
PDF
“It’s More of a Mindset Than a Method”: UX Practitioners’ Conception of Desig...
Verbalization of Design Thinking through Informal Peer Critique
Creativity "Misrules": First Year Engineering Students’ Production and Percep...
What is the Nature and Intended Use of Design Methods?
Meaning Reconstruction as an Approach to Analyze Critical Dimensions of HCI R...
“Why are they not responding to critique?”: A student-centered construction o...
Inverting Critique: Emergent Technologically-Mediated Critique Practices of D...
Supporting Idea Generation Through Functional Decomposition: An Alternative F...
“It’s More of a Mindset Than a Method”: UX Practitioners’ Conception of Desig...

Viewers also liked (20)

PDF
Storyboard
PDF
Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"
PDF
Flow of Competence in UX Design Practice
PDF
Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...
PDF
Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...
PDF
What is the Content of “Design Thinking”? Design Heuristics as Conceptual Rep...
PDF
Normativity in Design Communication: Inscribing Design Values in Designed Art...
PDF
What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...
PDF
Developing an Ethically-Aware Design Character through Problem Framing
PDF
What Happens when Creativity is Exhausted? Design Tools as an Aid for Ideation
PDF
EDET 722 Instruction
PDF
AERA2014: Instructional Design In Action: Observing the Judgments of ID Pract...
PDF
Reprioritizing the Relationship Between HCI Research and Practice: Bubble-Up ...
KEY
Embedding Social Media
PDF
Expectations of Reciprocity? An Analysis of Critique in Facebook Posts by Stu...
PDF
Studio Teaching in the Low-Precedent Context of Instructional Design
PDF
The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...
PDF
Emergent Critique in Informal Design Talk: Reflections of Surface, Pedagogic...
PDF
Building Design Knowledge: Creating and Disseminating Design Precedent
PDF
Design in the “Real World”: Situating Academic Conceptions of ID Practice
Storyboard
Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"
Flow of Competence in UX Design Practice
Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...
Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...
What is the Content of “Design Thinking”? Design Heuristics as Conceptual Rep...
Normativity in Design Communication: Inscribing Design Values in Designed Art...
What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...
Developing an Ethically-Aware Design Character through Problem Framing
What Happens when Creativity is Exhausted? Design Tools as an Aid for Ideation
EDET 722 Instruction
AERA2014: Instructional Design In Action: Observing the Judgments of ID Pract...
Reprioritizing the Relationship Between HCI Research and Practice: Bubble-Up ...
Embedding Social Media
Expectations of Reciprocity? An Analysis of Critique in Facebook Posts by Stu...
Studio Teaching in the Low-Precedent Context of Instructional Design
The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...
Emergent Critique in Informal Design Talk: Reflections of Surface, Pedagogic...
Building Design Knowledge: Creating and Disseminating Design Precedent
Design in the “Real World”: Situating Academic Conceptions of ID Practice
Ad

Similar to Discursive Structures of Informal Critique in an HCI Design Studio (20)

PDF
Informal peer critique and the negotiation of habitus in a design studio (AEC...
PDF
Overreliance On Anecdotes
DOCX
Ellingboe 3 interactiveactivitieshandout
PPTX
Chunks on the Scaffold of Child and Youth Development
PPTX
How Affordances of Digital Tool Use Foster Critical Literacy: GCLR Webinar pr...
PPTX
Braun, Clake & Hayfield Foundations of Qualitative Research 1 Part 2
PPTX
Harrison_AECT_2015_poster
PPT
Rutherford indiana agsa_2014_slideshare
PDF
Critical Essay Examples
PDF
JessicaAbel_Poster
PPTX
Tams 2012
PDF
Analytical Essay Examples. Analytical Essay Writing - Guide, Topics and Examples
PPTX
Comics co op transform bullies
PDF
Generation Me Essay
PPTX
How to Get a First LinkedIn version
PDF
H+E intro 2013
PDF
Physical Education Essay Topics
PPTX
NAEA Research2011-Aileen
Informal peer critique and the negotiation of habitus in a design studio (AEC...
Overreliance On Anecdotes
Ellingboe 3 interactiveactivitieshandout
Chunks on the Scaffold of Child and Youth Development
How Affordances of Digital Tool Use Foster Critical Literacy: GCLR Webinar pr...
Braun, Clake & Hayfield Foundations of Qualitative Research 1 Part 2
Harrison_AECT_2015_poster
Rutherford indiana agsa_2014_slideshare
Critical Essay Examples
JessicaAbel_Poster
Tams 2012
Analytical Essay Examples. Analytical Essay Writing - Guide, Topics and Examples
Comics co op transform bullies
Generation Me Essay
How to Get a First LinkedIn version
H+E intro 2013
Physical Education Essay Topics
NAEA Research2011-Aileen
Ad

More from colin gray (15)

PDF
Critical pedagogy and the pluriversal design studio
PDF
Critique Assemblages in Response to Emergency Hybrid Studio Pedagogy
PDF
Cross-Cultural UX Pedagogy: A China–US Partnership
PDF
Autono-preneurial Agents in the Community: Developing a Socially Aware API fo...
PDF
A Practice-Led Account of the Conceptual Evolution of UX Knowledge
PDF
Analyzing Value Discovery in Design Decisions Through Ethicography
PDF
Ethical Mediation in UX Practice
PDF
“What do you recommend a complete beginner like me to practice?”: Professiona...
PDF
Supporting Distributed Critique through Interpretation and Sense-Making in an...
PDF
Distinctions between the Communication of Experiential and Academic Design Kn...
PDF
Generating Mobile Application Onboarding Insights Through Minimalist Instruction
PDF
The Dark (Patterns) Side of UX Design
PDF
Forming A Design Identity in Computing Education Through Reflection and Peer ...
PDF
Breaking the Model, Breaking the “Rules:” Instructional Design in a Transdisc...
PDF
Developing a Socially-Aware Engineering Identity Through Transdisciplinary Le...
Critical pedagogy and the pluriversal design studio
Critique Assemblages in Response to Emergency Hybrid Studio Pedagogy
Cross-Cultural UX Pedagogy: A China–US Partnership
Autono-preneurial Agents in the Community: Developing a Socially Aware API fo...
A Practice-Led Account of the Conceptual Evolution of UX Knowledge
Analyzing Value Discovery in Design Decisions Through Ethicography
Ethical Mediation in UX Practice
“What do you recommend a complete beginner like me to practice?”: Professiona...
Supporting Distributed Critique through Interpretation and Sense-Making in an...
Distinctions between the Communication of Experiential and Academic Design Kn...
Generating Mobile Application Onboarding Insights Through Minimalist Instruction
The Dark (Patterns) Side of UX Design
Forming A Design Identity in Computing Education Through Reflection and Peer ...
Breaking the Model, Breaking the “Rules:” Instructional Design in a Transdisc...
Developing a Socially-Aware Engineering Identity Through Transdisciplinary Le...

Recently uploaded (20)

PDF
My India Quiz Book_20210205121199924.pdf
PPTX
A powerpoint presentation on the Revised K-10 Science Shaping Paper
PDF
Environmental Education MCQ BD2EE - Share Source.pdf
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
PPTX
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
PDF
International_Financial_Reporting_Standa.pdf
PDF
IGGE1 Understanding the Self1234567891011
PDF
What if we spent less time fighting change, and more time building what’s rig...
PPTX
History, Philosophy and sociology of education (1).pptx
PDF
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
PPTX
Computer Architecture Input Output Memory.pptx
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
PDF
Uderstanding digital marketing and marketing stratergie for engaging the digi...
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PPTX
20th Century Theater, Methods, History.pptx
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PDF
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
PDF
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
PPTX
Unit 4 Computer Architecture Multicore Processor.pptx
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
My India Quiz Book_20210205121199924.pdf
A powerpoint presentation on the Revised K-10 Science Shaping Paper
Environmental Education MCQ BD2EE - Share Source.pdf
Practical Manual AGRO-233 Principles and Practices of Natural Farming
Onco Emergencies - Spinal cord compression Superior vena cava syndrome Febr...
International_Financial_Reporting_Standa.pdf
IGGE1 Understanding the Self1234567891011
What if we spent less time fighting change, and more time building what’s rig...
History, Philosophy and sociology of education (1).pptx
CISA (Certified Information Systems Auditor) Domain-Wise Summary.pdf
Computer Architecture Input Output Memory.pptx
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
Uderstanding digital marketing and marketing stratergie for engaging the digi...
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
20th Century Theater, Methods, History.pptx
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
Vision Prelims GS PYQ Analysis 2011-2022 www.upscpdf.com.pdf
David L Page_DCI Research Study Journey_how Methodology can inform one's prac...
Unit 4 Computer Architecture Multicore Processor.pptx
Chinmaya Tiranga quiz Grand Finale.pdf

Discursive Structures of Informal Critique in an HCI Design Studio

  • 1. Discursive Structures of Informal Critique in an HCI Design Studio Colin M. Gray June 10, 2013
  • 2. Critique is central to design pedagogy (Anthony, 1991; Hokanson, 2012) Informal interaction between design students has not been adequately explored (“the hidden curriculum”) (Dutton, 1991; Gray, in press; Willenbrock, 1991) background
  • 3. Peer Between members of the same academic program—in close proximity in terms of experience and status Informal Not bounded by a traditional classroom environment or professor/program representation background
  • 4. research questions What role does informal critique play in a designer’s understanding of their work? How does informal peer critique encourage verbalization of design decisions?
  • 6. literature Existing research on critique Desk crits (Reimer & Douglas, 2003; Boling & Smith, 2010) Formal critique (Anthony, 1991; Percy, 2004)
  • 7. literature Link of informal critique with reflection Self-reflection as a developmental aid (Schön, 1985; Cross, 2007) Verbalization of reflection within the studio (Logan, 2008; Morton & O’Brien, 2006; Dannels, Gaffney, & Martin, 2008)
  • 9. Human-Computer Interaction design (HCI/d) program in the School of Informatics HCI/d Master’s students (first and second year) context
  • 10. data Students (4—2 dyads) Three stage data collection: 1. One hour interview about beliefs 2. One hour constructed critique dyad 3. One hour stimulated recall session
  • 12. methods Naturalistic Inquiry (Lincoln & Guba, 1985) Critical theory (Carspecken, 1996) Intensive interview and observation strategies were used to target beliefs and behaviors related to critique that were largely tacit in nature Observation of critique between study participants allowed for a more naturalistic view into the behaviors and strategies in situ.
  • 13. analysis Coding of emergent themes Sequence analysis of critique participants Separate themes for critic (the person leading the critique) and the recipient (the person being critiqued)
  • 16. findings Major discursive structures of the peer critique process were identified: Beginning the critique Major setting shifts Ending the critique
  • 17. findings “Jiao: Um, this is a workbook one, definitely on the topic of um —death” BEGINNING THE CRITIQUE
  • 18. findings “Emily: OK, alright. So, this is a—well you’ve already seen this in class, but I’ll OK—this is a prototype that I made for my capstone project. Um, I am focusing on newly diagnosed HIV+ individuals and um through a lot of research, I’ve kind of gotten into the topic of identity development, um kind of just accepting the fact that they are HIV+…” BEGINNING THE CRITIQUE
  • 19. findings “Lisa: You probably know a lot about Anchor already. Um it is a tablet application that links sailors and their loved ones um during deployment. So during deployment when there are times when there’s little communication, um it pulls media from a locked box—things they have prepared for deployment, um synthesizes a new message, even if there’s no data connection.” BEGINNING THE CRITIQUE
  • 20. findings Limitations of the prototype Worst case scenario Internalizing new perspectives MAJOR SETTING SHIFTS
  • 21. findings Limitations of the prototype “Jiao: But I’m not sure, and uh I was curious where you guys are only designing for American [inaudible]? Lisa: Um, well we designed this thinking about um, well—we—we made our target user people on deployment in the Navy or people on ships. Um and so this—I think this could be expanded to other military branches. Lisa: It doesn’t have to be the US, and also like people like migrant workers, where one of the first people who like popped into our head for ways to expand this. Um, so I don’t think it—it’s tied to an American population. I mean, that’s what we chose to be our—our starting point. But you can definitely—” MAJOR SETTING SHIFTS
  • 22. findings Worst Case Scenario “Paul: It might be a newer maybe newly diagnosed, it might be kind of jarring to like hear these stories of like, of people who’ve been having troubles as opposed to stories of people who have been living with it for a long time or people who’ve had like successful shared stories Emily: Yeah Paul: Versus like, oh crap, that was awful or something. Emily: Yeah, well, you know, that’s definitely one of the, I think one of the biggest problems with this is that it has potential to have really negative outcomes, too, because you know, if I am a African American gay male and I see the story of another African American gay male who was disclosing his status to his mother, and his mother you know called him a fag or something, and like you know, and—and he’s like, you know, is this going to happen to me? So I—that’s definitely something—[laughs]” MAJOR SETTING SHIFTS
  • 23. findings Internalizing New Perspectives “Paul: It feels like communicating the idea is kind of the same thing. Emily: Yeah, and this is kind of more like if you need support you have to ask for it rather than like— Paul: Yeah Emily: What you said with like going there and seeing like, this support is being offered.” MAJOR SETTING SHIFTS
  • 24. findings “Lisa: And you could cremate the person and put them in their real tree! [laughs] They would grow in it. Oh. Somebody posted on Facebook this thing where like you get cremated and then it’s essentially like, I don’t know, like a Chia pet for creation, and like you can—you can grow out of a tree or something. Jiao: Out of the tree [laughs]. How could it? We almost done—” ENDING THE CRITIQUE
  • 25. findings “Paul: Not really, I mean—anxious to see where it goes. Emily: Me too! [laughs] Awesome, thank you.” ENDING THE CRITIQUE
  • 26. discussion Framing the problem space “Jiao: Yeah, and you know the topic then um we sort of call— have three or four two interviews with our participant who are [name redacted] and—and [name redacted]. They all lost their um relatives, especially for [name redacted]. [name redacted] lost her father um two years ago and it’s really painful for her, but that’s sort of a journey that we kind of—we don’t know much, because um of course we lost our um relatives or our friends, um so our topic was um how to—how to help people who lost their loved one in terms of terminal illness.”
  • 27. discussion Projecting user reactions “Lisa: OK, can the family members see what the terminally ill person is saying, or? Jiao: Yes, they can, but also, everyone who are going to post, they can select whether it is private or public. Lisa: Whenever it’s private, does that become public after you die? Jiao: Um, I don’t think so.”
  • 28. discussion Potential scenarios of use “Paul: You are, this is an emotional subject—[joking] but I think that might be the thing that—that it would offer is not necessarily like the end all be all solution of like getting these soldiers to tell their stories. Sometimes it might just be that knowledge that there’s something out there that people are coping with this. Emily: Yeah Paul: Um, whereas for other people it would be that sense of I—I need to like get assistance with this, and I need to tell somebody, because maybe I can’t tell it to anybody here. So what’s— Emily: Right Paul: I just need to put it out there.”
  • 30. limitations of the studyExploratory nature of the study Small number of participants A somewhat contrived critique environment
  • 32. next steps Larger-scale study exploring the emergence of informal critique Ethnographic methods to observe critique in a truly naturalistic context with self-selected participants Ongoing work to identify knowledge structures embedded in discourse and interactions
  • 33. references Anthony, K. H. (1991). Design juries on trial: The renaissance of the design studio. New York: Van Nostrand Reinhold. Boling, E., & Smith, K. M. (2010). Intensive studio experience in a non-studio masters program: Student activities and thinking across levels of design. Montréal: Design Research Society International Conference. Carspecken, P. F. (1996). Critical ethnography in educational research: A theoretical and practical guide. New York: Routledge. Cross, N. (2007). Designerly ways of knowing. Basel, Switzerland: Birkhäuser. Brandt, C.B., Cennamo, K., Douglas, S., Vernon, M., McGrath, M. and Reimer, Y. (2011). A theoretical framework for the studio as a learning environment. International Journal of Technology and Design Education. Cennamo, K., Brandt, C., & Scott, B. (2010). Adapting the studio to design-based disciplines: Research-Based strategies for effective practice. In Proceedings of the 2010 conference on higher education pedagogy, Blacksburg, VA (pp. 14-5). Dannels, D., Gaffney, A., & Martin, K. (2008). Beyond content, deeper than delivery: What critique feedback reveals about communication expectations in design education. International Journal for the Scholarship of Teaching and Learning, 2(2). Do, E. Y. L., & Gross, M. D. (1996). Drawing as a means to design reasoning. In AI and design. Lincoln, Y. S. and Guba, E. G. (1985). Naturalistic inquiry. Sage Publications, Beverly Hills, CA. Logan, C. (2008). Metaphor and pedagogy in the design practicum. International Journal of Technology and Design Education, 18(1), 1-17. doi:10.1007/s10798-006-9009-x Morton, J., & O'Brien, D. (2006). Selling your design: Oral communication pedagogy in design education. Communication Education, 54(1), 6–19. doi:10.1080/03634520500076885 Percy, C. (2004). Critical absence versus critical engagement. Problematics of the crit in design learning and teaching. Art, Design & Communication in Higher Education, 2(3), 143-154. Reimer, Y. J., & Douglas, S. A. (2003). Teaching HCI design with the studio approach. Computer Science Education, 13(3), 191-205. Schön, D. A. (1985). The design studio: An exploration of its traditions and potentials. London: RIBA Publications Limited. Willenbrock, L. (1991). An undergraduate voice in architectural education. In T. A. Dutton (Ed.), Voices in architectural education: Cultural politics and pedagogy (pp. 97-119). New York: Bergin & Garvey.
  • 35. coding scheme Codes Applied to Critic Codes Applied to Critiquee Association with User or Problem Space Identification of Problem Space Alternative Problem Space/Solution Identification of Problem Space Limitations of Prototype Analyzing Potential User Reactions Setting New Scenario (Based on Critique) Analyzing Potential User Reactions Support with ResearchAnalyzing Potential User Reactions Referencing Former Critique Replay Prototype Showing Off Prototype/Artifact Worst Case Scenario Response to Worst Case Scenario Worst Case Scenario Potential User Scenario
  • 36. coding scheme Codes Applied to Critic Codes Applied to Critiquee Constructed Scenario Internalizing New Perspective Clarification (Interface) Request for Clarification Clarification (Idea) Request for Clarification Unsure/Confused Caught Off Guard/Explanation Unsure/Confused Conflicted/Personal Drawing Parallels Parallels to Other Projects How to Proceed/Next Steps Next Steps/Self Critique Positive/Affirming Thanks Humor Thanks
  • 37. participantsparticipants Participant Pseudonym Gender M.S. Year Country of Origin Paul M 2nd USA Emily F 2nd USA Lisa F 1st USA Jiao F 1st China