SlideShare a Scribd company logo
Research Methodology
  (Developing Ideas)
    Brian J. Piper, Ph.D.
Goals
• Types of Research
• Idea Generation
  – Luck
  – Theory
  – Literature
Basic (Preclinical) Research
• Addresses fundamental questions
• Laboratory based (Simple, Controlled)
• Experimental Psychology Areas
  – Cognitive Psychology
  – Social Psychology
  – Biopsychology
Applied (Clinical) Research
• Addresses “real world” questions
• Non-laboratory based (Complex, Non-
  controlled)
• Example areas:
  – Educational psychology
  – Industrial-Organizational psychology
  – Neuropsychology
Memory Island




Piper et al. (2010) Pharmacology, Biochemistry & Behavior, 98, 432-439.
Quantitative Research
•   Involves numbers & statistics
•   Majority of psychological research
•   “Top-down”
•   Example: polls
Qualitative Research
•   Non-numerical, themes (but rigorous!)
•   Minority of psychological research
•   “bottom up”
•   Example focus group
Research Methods: Idea Generation
Operational Definitions
• Concept is defined based on the operation
  used for measurement
• Height, weight, humor
• Intelligence exercise
Developing Research Ideas:
                      Serendipity
• Monoamine-Oxidase Inhibitor (iproniazid) a
  treatment for tuberculosis and later depression
• Dose response effects of prenatal nicotine




Piper & Corbett (2011). Nicotine & Tobacco Research.
Developing Ideas: Theory
• Theory: a set of logically consistent
  statements about phenomenon
• Micro-Theory: specific, e.g. monoamine &
  depression
• Macro-Theory: Skinner, Piaget, Freud
Evaluating Theories
• Productive: does this generate research?
• Falsifiable: can the theory be disproved
• Parsimonious: contains minimum assumptions
  – Lloyd Morgan’s Canon: in no case may we
    interpret an action as the outcome of an exercise
    of a higher faculty if there is a lower one
  – Example: cat and faucet
Evaluating Theories
               Evolution   Psychoanaltysis   Cognitive     Behaviorism
               (Darwin)    (Freud)           Development   (Skinner)
                                             (Piaget)

Productive
               +++         +                 ++            +++
Falsifiable
               +++         ---               +++           +++
Parsimonious
               +++         ---               ++            +++
Strong Inference
  • Programmatic Research:
       – Study 1 (Outcome A) -> Study 2 (Outcome B)
       – Used to exclude possibilities




Platt, J.R. (1964). Science, 146, 347-353.
Ideas: Literature Search
•   Wikipedia (preliminary only, variable quality)
•   Google (heavy on $)
•   Pubmed (Backward Search)
•   Psych Info (Backward Search)
•   Specialized databases (Backward Search)
•   Google Scholar (Forward Search)
•   Direct contact
Pubmed
• Developed by National Library of Medicine (NIH)
• http://www.ncbi.nlm.nih.gov/pubmed
Pubmed
Research Methods: Idea Generation
Keywords are Important
Free is For Me!
Google Scholar
Specialized Databases
• Manage to bypass copyright law (how?)
• Example: Psychedelic Bibliography
• http://www.maps.org/sys/w3pb.pl?face=simple/
All Journals Aren’t Created Equal
  Great!                                 Not Great!
  Psychological Science (5.1)            Psychological Reports (0.3)
  Science (30.1)                         Perceptual & Motor Skills (1.2 )
  Nature (29.8)                          J of Applied Communication Res (0.7)
  Psychological Bulletin (12.9)          Legal & Criminological Psych (0.4)
  J Personality Social Psych (5.2)       Psychology & Psychotherapy (0.6)
  J of Abnormal Psychology (4.5)         American J of Psychology (0.3)
  Annual Review of Psychology (22.8)     Computers in Human Behavior (0.3)
  J Amer Med Association (30.0)          Journal of Applied Social Psychology (0.7)
  Neuropsychopharmacology (6.7 )         International J of …. , SW Missouri Newsletter



Impact Factor: # citations per manuscript per year
Replication
• Repeating a study and getting similar outcomes
                         Study                                              OR (95% CI)


                         Bloss                                              4.65 (1.56, 13.87)
                         Piper                                              0.70 (0.09, 5.72)
                         Gaynor                                             1.13 (0.51, 2.48)
                         Taylor                                             0.83 (0.62, 1.11)
                         Deary                                              1.13 (0.52, 2.43)
                         Kwon                                               0.95 (0.29, 3.12)
                         Nilsson                                            0.94 (0.60, 1.46)
                         UCDADC                                             0.37 (0.14, 1.03)
                         NACC African Americans                             0.95 (0.42, 2.14)
                         NACC Caucasians                                    0.93 (0.72, 1.20)
                         Overall (I-squared = 28.6%, p = 0.181)             0.92 (0.79, 1.08)



                                              .05   .1            1   10   20




Piper et al. (2012). Laterality.
Replication Example #2: Mozart Effect

• College students (N=36)
  completed a spatial reasoning
  task after listening to Mozart,
  relaxation tape, or silence.




                                    Rauscher et al. (1993). Nature, 365, 611.
Replication Example #2: Mozart Effect

• College students (N=36)
  completed a spatial reasoning
  task after listening to Mozart,
  relaxation music, or silence.
• Governor Zell Miller (GA)
  wanted to give all kids classic
  CDs.
• Finding repeatedly not
  replicated.

                                    Rauscher et al. (1993). Nature, 365, 611.
Summary
• Types of Research
  – Preclinical & Clinical
  – Quantitative & Qualitative


• Idea Generation (luck, literature, theory)
• Replication

More Related Content

PPT
Lecture 2 generating the research idea
PDF
Scientific research in psychology
PPT
Research methods ppt 3
PPTX
Psychological Science and Research Methods
ODP
Research Methods in Psychology
PPTX
Psbe2 08 research methods 2011-2012 - week 1
PPTX
Ucc one sided coin actual
PPT
Research methology intro_ YL
Lecture 2 generating the research idea
Scientific research in psychology
Research methods ppt 3
Psychological Science and Research Methods
Research Methods in Psychology
Psbe2 08 research methods 2011-2012 - week 1
Ucc one sided coin actual
Research methology intro_ YL

Similar to Research Methods: Idea Generation (20)

PPT
Basic principles of research
DOCX
Practical applications of citation analysis-handout
PPT
Psychology, Science, and Pseudoscience: Class #18 (Qualitative Psych)
PPT
West-Vanderbilt-Talk--Revised-22March2017.ppt
PPTX
lesson 2 As of research methodology of health
PPT
Mr. Hunter Ch. 1
PPTX
Understanding the research process
PPTX
Research design, laboratory experiment
PPTX
Workshop on graduation attachment_085511.pptx
PDF
john-j-shaughnessy-eugene-b-zechmeister-jeanne-s-zechmeister-research-methods...
PPTX
Overview of Research Methodology
PPT
Chapter1
PPT
Psych Investigations Revision PowerPoint
DOC
Research Design
PPTX
INTRODUCTION to psychology.pptx
PPTX
What is a Research design and its types
PPT
Study design2 6_07
PPT
Intro to research.i
PPT
Psychology Chapter 2
PPTX
Nursing research today & tomorrow
Basic principles of research
Practical applications of citation analysis-handout
Psychology, Science, and Pseudoscience: Class #18 (Qualitative Psych)
West-Vanderbilt-Talk--Revised-22March2017.ppt
lesson 2 As of research methodology of health
Mr. Hunter Ch. 1
Understanding the research process
Research design, laboratory experiment
Workshop on graduation attachment_085511.pptx
john-j-shaughnessy-eugene-b-zechmeister-jeanne-s-zechmeister-research-methods...
Overview of Research Methodology
Chapter1
Psych Investigations Revision PowerPoint
Research Design
INTRODUCTION to psychology.pptx
What is a Research design and its types
Study design2 6_07
Intro to research.i
Psychology Chapter 2
Nursing research today & tomorrow
Ad

More from Brian Piper (20)

PPTX
Current recreational drugs: RX462 Drug Abuse & Society, Spring 2015 Class pre...
PPTX
Drug Abuse & Society (RX 462) Presentations-Spring 2014
PPTX
electronic cigarettes
PDF
Examination of Sexually Dimorphic Behavior on the Novel-Image Novel-Location ...
PPTX
Drug abuse and society drug presentations: Spring 2013
PPTX
Sedative & Hypnotic Drugs Part II
PPTX
Sedative & Hypnotic Agents Part I
PPTX
Agents for Bipolar
PPTX
Psychopharmacology of Anxiety: Part II OCD & PTSD
PPTX
Psychopharmacology of Anxiety Disorders I: GAD & SAD
PPTX
Antipsychotics Part II
PPTX
Antipsychotics I
PPTX
Anti Inflammation agents for CNS
PPTX
Antidepressants Part II
PPTX
Antidepressants Part I
PPTX
Anticonvulsants Part II
PPTX
Anticonvulsants Part I
PPTX
Agents for Brain Injury
PPTX
ADHD Drugs
PPTX
Pathophysiology: Myasthenia Gravis & Restless Leg Syndrome
Current recreational drugs: RX462 Drug Abuse & Society, Spring 2015 Class pre...
Drug Abuse & Society (RX 462) Presentations-Spring 2014
electronic cigarettes
Examination of Sexually Dimorphic Behavior on the Novel-Image Novel-Location ...
Drug abuse and society drug presentations: Spring 2013
Sedative & Hypnotic Drugs Part II
Sedative & Hypnotic Agents Part I
Agents for Bipolar
Psychopharmacology of Anxiety: Part II OCD & PTSD
Psychopharmacology of Anxiety Disorders I: GAD & SAD
Antipsychotics Part II
Antipsychotics I
Anti Inflammation agents for CNS
Antidepressants Part II
Antidepressants Part I
Anticonvulsants Part II
Anticonvulsants Part I
Agents for Brain Injury
ADHD Drugs
Pathophysiology: Myasthenia Gravis & Restless Leg Syndrome
Ad

Recently uploaded (20)

PPTX
Cell Types and Its function , kingdom of life
PDF
What if we spent less time fighting change, and more time building what’s rig...
PPTX
master seminar digital applications in india
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PPTX
Orientation - ARALprogram of Deped to the Parents.pptx
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PDF
Paper A Mock Exam 9_ Attempt review.pdf.
PPTX
Radiologic_Anatomy_of_the_Brachial_plexus [final].pptx
PPTX
Lesson notes of climatology university.
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
Weekly quiz Compilation Jan -July 25.pdf
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PDF
Microbial disease of the cardiovascular and lymphatic systems
PDF
Classroom Observation Tools for Teachers
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PPTX
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
Cell Types and Its function , kingdom of life
What if we spent less time fighting change, and more time building what’s rig...
master seminar digital applications in india
202450812 BayCHI UCSC-SV 20250812 v17.pptx
STATICS OF THE RIGID BODIES Hibbelers.pdf
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
Orientation - ARALprogram of Deped to the Parents.pptx
LDMMIA Reiki Yoga Finals Review Spring Summer
Paper A Mock Exam 9_ Attempt review.pdf.
Radiologic_Anatomy_of_the_Brachial_plexus [final].pptx
Lesson notes of climatology university.
2.FourierTransform-ShortQuestionswithAnswers.pdf
Weekly quiz Compilation Jan -July 25.pdf
Microbial diseases, their pathogenesis and prophylaxis
Microbial disease of the cardiovascular and lymphatic systems
Classroom Observation Tools for Teachers
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Chinmaya Tiranga quiz Grand Finale.pdf
UV-Visible spectroscopy..pptx UV-Visible Spectroscopy – Electronic Transition...
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS

Research Methods: Idea Generation

  • 1. Research Methodology (Developing Ideas) Brian J. Piper, Ph.D.
  • 2. Goals • Types of Research • Idea Generation – Luck – Theory – Literature
  • 3. Basic (Preclinical) Research • Addresses fundamental questions • Laboratory based (Simple, Controlled) • Experimental Psychology Areas – Cognitive Psychology – Social Psychology – Biopsychology
  • 4. Applied (Clinical) Research • Addresses “real world” questions • Non-laboratory based (Complex, Non- controlled) • Example areas: – Educational psychology – Industrial-Organizational psychology – Neuropsychology
  • 5. Memory Island Piper et al. (2010) Pharmacology, Biochemistry & Behavior, 98, 432-439.
  • 6. Quantitative Research • Involves numbers & statistics • Majority of psychological research • “Top-down” • Example: polls
  • 7. Qualitative Research • Non-numerical, themes (but rigorous!) • Minority of psychological research • “bottom up” • Example focus group
  • 9. Operational Definitions • Concept is defined based on the operation used for measurement • Height, weight, humor • Intelligence exercise
  • 10. Developing Research Ideas: Serendipity • Monoamine-Oxidase Inhibitor (iproniazid) a treatment for tuberculosis and later depression • Dose response effects of prenatal nicotine Piper & Corbett (2011). Nicotine & Tobacco Research.
  • 11. Developing Ideas: Theory • Theory: a set of logically consistent statements about phenomenon • Micro-Theory: specific, e.g. monoamine & depression • Macro-Theory: Skinner, Piaget, Freud
  • 12. Evaluating Theories • Productive: does this generate research? • Falsifiable: can the theory be disproved • Parsimonious: contains minimum assumptions – Lloyd Morgan’s Canon: in no case may we interpret an action as the outcome of an exercise of a higher faculty if there is a lower one – Example: cat and faucet
  • 13. Evaluating Theories Evolution Psychoanaltysis Cognitive Behaviorism (Darwin) (Freud) Development (Skinner) (Piaget) Productive +++ + ++ +++ Falsifiable +++ --- +++ +++ Parsimonious +++ --- ++ +++
  • 14. Strong Inference • Programmatic Research: – Study 1 (Outcome A) -> Study 2 (Outcome B) – Used to exclude possibilities Platt, J.R. (1964). Science, 146, 347-353.
  • 15. Ideas: Literature Search • Wikipedia (preliminary only, variable quality) • Google (heavy on $) • Pubmed (Backward Search) • Psych Info (Backward Search) • Specialized databases (Backward Search) • Google Scholar (Forward Search) • Direct contact
  • 16. Pubmed • Developed by National Library of Medicine (NIH) • http://www.ncbi.nlm.nih.gov/pubmed
  • 20. Free is For Me!
  • 22. Specialized Databases • Manage to bypass copyright law (how?) • Example: Psychedelic Bibliography • http://www.maps.org/sys/w3pb.pl?face=simple/
  • 23. All Journals Aren’t Created Equal Great! Not Great! Psychological Science (5.1) Psychological Reports (0.3) Science (30.1) Perceptual & Motor Skills (1.2 ) Nature (29.8) J of Applied Communication Res (0.7) Psychological Bulletin (12.9) Legal & Criminological Psych (0.4) J Personality Social Psych (5.2) Psychology & Psychotherapy (0.6) J of Abnormal Psychology (4.5) American J of Psychology (0.3) Annual Review of Psychology (22.8) Computers in Human Behavior (0.3) J Amer Med Association (30.0) Journal of Applied Social Psychology (0.7) Neuropsychopharmacology (6.7 ) International J of …. , SW Missouri Newsletter Impact Factor: # citations per manuscript per year
  • 24. Replication • Repeating a study and getting similar outcomes Study OR (95% CI) Bloss 4.65 (1.56, 13.87) Piper 0.70 (0.09, 5.72) Gaynor 1.13 (0.51, 2.48) Taylor 0.83 (0.62, 1.11) Deary 1.13 (0.52, 2.43) Kwon 0.95 (0.29, 3.12) Nilsson 0.94 (0.60, 1.46) UCDADC 0.37 (0.14, 1.03) NACC African Americans 0.95 (0.42, 2.14) NACC Caucasians 0.93 (0.72, 1.20) Overall (I-squared = 28.6%, p = 0.181) 0.92 (0.79, 1.08) .05 .1 1 10 20 Piper et al. (2012). Laterality.
  • 25. Replication Example #2: Mozart Effect • College students (N=36) completed a spatial reasoning task after listening to Mozart, relaxation tape, or silence. Rauscher et al. (1993). Nature, 365, 611.
  • 26. Replication Example #2: Mozart Effect • College students (N=36) completed a spatial reasoning task after listening to Mozart, relaxation music, or silence. • Governor Zell Miller (GA) wanted to give all kids classic CDs. • Finding repeatedly not replicated. Rauscher et al. (1993). Nature, 365, 611.
  • 27. Summary • Types of Research – Preclinical & Clinical – Quantitative & Qualitative • Idea Generation (luck, literature, theory) • Replication