SlideShare a Scribd company logo
danxoneil Flickr
Practical privacy issues
around Learning Analytics

Learning Analytics and Knowledge 2013



Abelardo Pardo (@abelardopardo)
The University of Sydney
www.slideshare.net/abelardo_pardo
horrigans Flickr
 This talk is NOT about...



    Generic analysis of privacy




    Ramifications into ethics,
    societal issues, laws,
    governments



Abelardo Pardo   Practical privacy issues around Learning Analytics   2
nevolution Flickr
This talk IS

                                                                      Review principles
                                                                      to consider

 Restricted to the
 LA context




        Based on practical
        guidelines
Abelardo Pardo   Practical privacy issues around Learning Analytics                   3
Eleaf Flickr.com
                                                   Generate more questions




                                          Where to focus the questions?




Abelardo Pardo   Practical privacy issues around Learning Analytics          4
Mark Coggins flickr.com
        Delicate issue!



Abelardo Pardo   Practical privacy issues around Learning Analytics   5
Wootpeanuts flickr.com
            Prevents reaching a practical solution



Abelardo Pardo   Practical privacy issues around Learning Analytics   6
malias flickr.com
                                                                      General
  Environment                                                         view


                                                   LA
                                                   Scenarios




Abelardo Pardo   Practical privacy issues around Learning Analytics             7
malias flickr.com
  Environment




Abelardo Pardo   Practical privacy issues around Learning Analytics   8
http://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life (last accessed March 2013)
                                                                                                      9
                                                                                                      Practical privacy issues around Learning Analytics
                                                                                                      Abelardo Pardo
10
                                                                   Is she pregnant?




                                                                                                                                 Practical privacy issues around Learning Analytics
Dailymail.co.uk/news/article-2102859/How-Target-knows-shoppers-pregnant–figured-teen-father-did.html (last accessed March 2013)




                                                                                                                                 Abelardo Pardo
http://hdguru.com/is-your-new-hdtv-watching-you/7643 (last accessed March 2013)
                                                                                  11
                                                                                  Practical privacy issues around Learning Analytics
                                                                                  Abelardo Pardo
Great Beyond flickr.com
                                                           Privacy as a currency


Abelardo Pardo   Practical privacy issues around Learning Analytics                12
http://theweek.com/article/index/229508 (last accessed March 2013)
                                                                                                                                    B2B Data Market




Abelardo Pardo   Practical privacy issues around Learning Analytics                                                                                   13
www.nytimes.com (last accessed March 2013)
                                                                                                                         Lower
                                                                                                                      premium

                                                                                                                      With GPS

                                                                                                                   Without GPS




Abelardo Pardo   Practical privacy issues around Learning Analytics                                                              14
malias flickr.com
                                                                      General
  Environment                                                         view




Abelardo Pardo   Practical privacy issues around Learning Analytics             15
https://www.privacyassociation.org/resource_center/consumer_data_privacy_in_a_networked_world (last accessed March 2013)
                                                                                                                           16
                                                                                                                           Practical privacy issues around Learning Analytics
                                                                                                                           Abelardo Pardo
http://www.csa.ca/cm/ca/en/privacy-code (last accessed March 2013)
Abelardo Pardo   Practical privacy issues around Learning Analytics   17
arstechnica.com/tech-policy/2013/02/eu-data-law-proposal-uses-language-word-for-word-from-us-eu-corporations (last accessed March 2013)
                                                                                                                                          18
                                                                     Similar legislation




                                                                                                                                          Practical privacy issues around Learning Analytics
                                                                                                                                          Abelardo Pardo
Reigh LeBlanc flickr.com
        Absolute confidentiality: undesired
        Data ownership
        Information flow


Abelardo Pardo   Practical privacy issues around Learning Analytics   19
http://www.nature.com/nm/journal/v13/n9/full/nm0907-999.html
        Uninformed consent is
        considered under special
        circumstances


Abelardo Pardo   Practical privacy issues around Learning Analytics   20
anthonylibrarian Flickr
            Internet requires new approach to privacy




Before: Limiting
surveillance, restricting
access to information,                                 Additionally: How is data
curtailing intrusions into                             captured, who owns it, how
private space.                                         is it shared?
Abelardo Pardo   Practical privacy issues around Learning Analytics             21
Small_Realm Flickr
            People act in different roles and contexts


            Applications should respect these contexts




Abelardo Pardo   Practical privacy issues around Learning Analytics   22
Context Integrity: Framework to provide
            guidance to solve privacy related conflicts.




                                                                                                                Context Travel flickr.com
                          Appropriateness & Distribution

                                     (Nissenbaum, H., 2004, Privacy as Contextual Integrity, Washington Law Review, 79(1))
Abelardo Pardo   Practical privacy issues around Learning Analytics                                                                        23
Cotton|Joe Flickr
 Appropriateness


                                                       What is collected?



                                                       What is revealed?



                                                       Valid in one context,
                                                       invalid in another


Abelardo Pardo   Practical privacy issues around Learning Analytics            24
johnthrm Flickr
 Distribution


                                                       Who sees the data?



                                                       When?



                                                       For what purpose?



Abelardo Pardo   Practical privacy issues around Learning Analytics         25
malias flickr.com
                                                                      General
  Environment                                                         view


                                                   LA
                                                   Scenarios




Abelardo Pardo   Practical privacy issues around Learning Analytics             26
27
                                                         Database with
                                                      K-12 Student data




                                                                                                                   Practical privacy issues around Learning Analytics
http://www.reuters.com/article/2013/03/03/us-education-database-idUSBRE92204W20130303 (last accessed March 2013)




                                                                                                                   Abelardo Pardo
deepwarren Flickr
                                  Observe in and out of the classroom
Abelardo Pardo   Practical privacy issues around Learning Analytics     28
Case 1: K-12 Out-of-class support
          1      Collection while doing homework in tablet

          2      Data used by teachers to personalize
                 activities.

          3      Available to all teachers in the school.

          4      Performance vs demographic factors
                 correlated.

          5      Available to platform vendors.

          6      Kept for ever.
Abelardo Pardo     Practical privacy issues around Learning Analytics   29
Case 2: University course

          1      Collected in LMS and mobile application.
          2      Available to instructors for personalization.
          3      Some data considered for assessment.
          4      Available to university-wide units:
                 counseling, recruiting, marketing.
          5      Analyzed Retention vs demographic.
          6      eTextbook access available to publishers.
          7      Kept for ever.

Abelardo Pardo     Practical privacy issues around Learning Analytics   30
Case 3: Distance education
          1      Data collected in LMS.

          2      Available to instructors for personalization
                 purposes.

          3      Analyzed performance vs demographic.

          4      Some data considered for assessment.

          5      Results used in scientific publication.

          6      Results available to funding institutions.

          7      Student right to request data removal.
Abelardo Pardo     Practical privacy issues around Learning Analytics   31
Ethical Principles
           • LA as a moral practice

           • Students as agents at the center

           • Data is temporal and dynamic

           • Student success is complex and
                 multidimensional
           • Transparency

           • Institutions obliged to use data


                   (Slade, S., Prinsloo, P. 2013, Learning Analytics: Ethical Issues and Dilemmas, American Behavioral Scientist)
Abelardo Pardo     Practical privacy issues around Learning Analytics                                                        32
Practical Principles
           • Transparency: Explicit description of how
                 data is collected, manipulated, stored and
                 accessed
           • Students as data owners: Include right to
                 consult, modify or remove data
           • Data access policies: clearly stated and
                 observed.
           • Accountability and assessment:
                 Embedded constant review and auditing of
                 the policy.
Abelardo Pardo     Practical privacy issues around Learning Analytics   33
lrargerich Flickr
Transparency
           • Means to achieve Legitimacy

           • Apply across the board

           • Easily accessible and clearly explained
                 documentation
           • How is data collected

           • Who has access to the data

           • Which calculations are performed

           • How long is the data valid and available
Abelardo Pardo    Practical privacy issues around Learning Analytics   34
Students as data owners
                                                                         • Right to access, amend,
                                                                          delete data




                                                Images of Money Flickr
                                                                         • Institutions are
                                                                          borrowing the data
                                                                         • In conflict with derived
                                                                          data
                                                                         • Affects system design

                                                                         • Consider fixed life span
                                                                          of collected data
Abelardo Pardo   Practical privacy issues around Learning Analytics                                  35
Data Access Policies
                                                                          • Clarify the roles when




                                                        Chris Cambpelll
                                                                           accessing data
                                                                          • Extend to derived data

                                                                          • Consider connection
                                                                           with research
                                                                          • Beware of
                                                                           “anonymization” or
                                                                           “deidentification”

Abelardo Pardo   Practical privacy issues around Learning Analytics                                  36
On “anonymization”



                                                 OperationPaperStorm Flickr
                                                                              • Comprehensive
                                                                               anonymized dataset of
                                                                               course participation
                                                                              • Include forum posts

                                                                              • All students introduced
                                                                               themselves in forum the
                                                                               first week
                                                                              • Student joins the course
                                                                               later.
Abelardo Pardo   Practical privacy issues around Learning Analytics                                        37
Accountability and Assessment


                                                                          • Each aspect has a




                                                        colemama Flickr
                                                                           responsible person,
                                                                           body, department.
                                                                          • Process continuously
                                                                           “under improvement”
                                                                          • Consider all
                                                                           stakeholders



Abelardo Pardo   Practical privacy issues around Learning Analytics                                38
Case 1: K-12 Out-of-class support
          1      Collection while doing homework in tablet

          2      Data used by teachers to personalize
                 activities.

          3      Available to all teachers in the school.

          4      Performance vs demographic factors
                 correlated.

          5      Available to platform vendors.

          6      Kept for ever.
Abelardo Pardo     Practical privacy issues around Learning Analytics   39
Case 2: University course

          1      Collected in LMS and mobile application.
          2      Available to instructors for personalization.
          3      Some data considered for assessment.
          4      Available to university-wide units:
                 counseling, recruiting, marketing.
          5      Analyzed Retention vs demographic.
          6      eTextbook access available to publishers.
          7      Kept for ever.

Abelardo Pardo     Practical privacy issues around Learning Analytics   40
Case 3: Distance education
          1      Data collected in LMS.

          2      Available to instructors for personalization
                 purposes.

          3      Analyzed performance vs demographic.

          4      Some data considered for assessment.

          5      Results used in scientific publication.

          6      Results available to funding institutions.

          7      Student right to request data removal.
Abelardo Pardo     Practical privacy issues around Learning Analytics   41
johnthurm Flickr
 Privacy changed in
 Internet era


                 Integrity of the Learning
                 Context



                                           Appropriateness &
                                           Distribution


                                                        Ethical and Implementation
                                                        principles
Abelardo Pardo    Practical privacy issues around Learning Analytics             42
danxoneil Flickr
Practical privacy issues
around Learning Analytics

Learning Analytics and Knowledge 2013



Abelardo Pardo (@abelardopardo)
The University of Sydney
www.slideshare.net/abelardo_pardo

More Related Content

PDF
Learning Analytics: Sensing and making sense of Learning Activities
PDF
The use of data and analytics to guide the improvement of learning experiences
PDF
Flip with care
PDF
Designing Flipped Classrooms
PDF
Connecting Pedagogical Intent with Analytics in a Flipped Classroom
PDF
2012 03 16 (uc3m) emadrid apardo uc3m dejame ver analitica entornos educativos
PDF
Let me see... Analytics in Learning Environments
PPTX
Student privacy self-management: Implications for learning analytics
Learning Analytics: Sensing and making sense of Learning Activities
The use of data and analytics to guide the improvement of learning experiences
Flip with care
Designing Flipped Classrooms
Connecting Pedagogical Intent with Analytics in a Flipped Classroom
2012 03 16 (uc3m) emadrid apardo uc3m dejame ver analitica entornos educativos
Let me see... Analytics in Learning Environments
Student privacy self-management: Implications for learning analytics

Similar to Practical privacy issues around Learning Analytics (20)

PDF
Let me intervene. . Influencing a learning environment through analytics
PDF
Ethics and Privacy in Learning Analytics
PDF
Business considerations for privacy and open data: how not to get caught out
PDF
Learning analytics and personalisation: Observe, think act
PPTX
Designing for Privacy in an Increasingly Public World — Speed Talk
PPTX
Designing for Privacy in an Increasingly Public World
PDF
Analytics to understand learning environments
PDF
Griffiths lace workshop-eden-2016
PPT
Privacy by Design Seminar - Jan 22, 2015
PPTX
Age Friendly Economy - Legislation and Ethics of Data Use
PDF
Bridging the Middle Space with Learning Analytics
PPTX
Ethical challenges for learning analytics
PDF
What the numbers tell us - Dublin Web Summit, 18 Oct 2012
PDF
Ey Lets Talk Sustainability (August 2016)
PDF
Extending Course Level Learning Analytics with Linked Data
PDF
RW privacy-technology-outlook
PDF
Over The Air 2010: Privacy for Mobile Developers
PPTX
Dreams into nightmares
PDF
Using Learning Analytics to Help Flip the Classroom
PPTX
FINAL presentationMay2016
Let me intervene. . Influencing a learning environment through analytics
Ethics and Privacy in Learning Analytics
Business considerations for privacy and open data: how not to get caught out
Learning analytics and personalisation: Observe, think act
Designing for Privacy in an Increasingly Public World — Speed Talk
Designing for Privacy in an Increasingly Public World
Analytics to understand learning environments
Griffiths lace workshop-eden-2016
Privacy by Design Seminar - Jan 22, 2015
Age Friendly Economy - Legislation and Ethics of Data Use
Bridging the Middle Space with Learning Analytics
Ethical challenges for learning analytics
What the numbers tell us - Dublin Web Summit, 18 Oct 2012
Ey Lets Talk Sustainability (August 2016)
Extending Course Level Learning Analytics with Linked Data
RW privacy-technology-outlook
Over The Air 2010: Privacy for Mobile Developers
Dreams into nightmares
Using Learning Analytics to Help Flip the Classroom
FINAL presentationMay2016
Ad

More from Abelardo Pardo (20)

PDF
Using OnTask for Student Coaching in Large Student Cohorts
PDF
Using data to provide personalised feedback at scale
PDF
Facilitating feedback processes at scale through personalised support actions
PDF
Providing personalised student support in blended learning at scale
PDF
Designing Engaging Learning Experiences in Digital Environments
PDF
Provision of personalized feedback at scale using learning analytics
PDF
Articulating the connection between Learning Design and Learning Analytics
PDF
Increasing Student Engagement with Personalised Feedback
PDF
The role of data in the provision of feedback at scale
PDF
Designing Effective Flipped Learning Experiences
PDF
The role of data in the provision of feedback at scale
PDF
Exploring hands-on multidisciplinary STEM with Arduino Esplora
PDF
What is sustained innovation anyway?
PDF
The role of institutional data in Learning Analytics
PDF
Feedback at scale with a little help of my algorithms
PDF
Generating Actionable Predictive Models of Academic Performance
PDF
Exploring the relation between Self-regulation Online Activities, and Academi...
PDF
Data2U: Scalable Real time Student Feedback in Active Learning Environments
PDF
Designing Flipped Learning Experiences
PDF
Scaling the provision of feedback from formative assessment
Using OnTask for Student Coaching in Large Student Cohorts
Using data to provide personalised feedback at scale
Facilitating feedback processes at scale through personalised support actions
Providing personalised student support in blended learning at scale
Designing Engaging Learning Experiences in Digital Environments
Provision of personalized feedback at scale using learning analytics
Articulating the connection between Learning Design and Learning Analytics
Increasing Student Engagement with Personalised Feedback
The role of data in the provision of feedback at scale
Designing Effective Flipped Learning Experiences
The role of data in the provision of feedback at scale
Exploring hands-on multidisciplinary STEM with Arduino Esplora
What is sustained innovation anyway?
The role of institutional data in Learning Analytics
Feedback at scale with a little help of my algorithms
Generating Actionable Predictive Models of Academic Performance
Exploring the relation between Self-regulation Online Activities, and Academi...
Data2U: Scalable Real time Student Feedback in Active Learning Environments
Designing Flipped Learning Experiences
Scaling the provision of feedback from formative assessment
Ad

Recently uploaded (20)

PDF
VCE English Exam - Section C Student Revision Booklet
PDF
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
PDF
Yogi Goddess Pres Conference Studio Updates
PDF
RMMM.pdf make it easy to upload and study
PDF
Module 4: Burden of Disease Tutorial Slides S2 2025
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PPTX
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
PPTX
Pharmacology of Heart Failure /Pharmacotherapy of CHF
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PPTX
Tissue processing ( HISTOPATHOLOGICAL TECHNIQUE
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PPTX
Cell Structure & Organelles in detailed.
PDF
STATICS OF THE RIGID BODIES Hibbelers.pdf
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
Weekly quiz Compilation Jan -July 25.pdf
VCE English Exam - Section C Student Revision Booklet
GENETICS IN BIOLOGY IN SECONDARY LEVEL FORM 3
Yogi Goddess Pres Conference Studio Updates
RMMM.pdf make it easy to upload and study
Module 4: Burden of Disease Tutorial Slides S2 2025
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
2.FourierTransform-ShortQuestionswithAnswers.pdf
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
Introduction-to-Literarature-and-Literary-Studies-week-Prelim-coverage.pptx
Pharmacology of Heart Failure /Pharmacotherapy of CHF
202450812 BayCHI UCSC-SV 20250812 v17.pptx
human mycosis Human fungal infections are called human mycosis..pptx
FourierSeries-QuestionsWithAnswers(Part-A).pdf
Tissue processing ( HISTOPATHOLOGICAL TECHNIQUE
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Cell Structure & Organelles in detailed.
STATICS OF THE RIGID BODIES Hibbelers.pdf
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
Weekly quiz Compilation Jan -July 25.pdf

Practical privacy issues around Learning Analytics

  • 1. danxoneil Flickr Practical privacy issues around Learning Analytics Learning Analytics and Knowledge 2013 Abelardo Pardo (@abelardopardo) The University of Sydney www.slideshare.net/abelardo_pardo
  • 2. horrigans Flickr This talk is NOT about... Generic analysis of privacy Ramifications into ethics, societal issues, laws, governments Abelardo Pardo Practical privacy issues around Learning Analytics 2
  • 3. nevolution Flickr This talk IS Review principles to consider Restricted to the LA context Based on practical guidelines Abelardo Pardo Practical privacy issues around Learning Analytics 3
  • 4. Eleaf Flickr.com Generate more questions Where to focus the questions? Abelardo Pardo Practical privacy issues around Learning Analytics 4
  • 5. Mark Coggins flickr.com Delicate issue! Abelardo Pardo Practical privacy issues around Learning Analytics 5
  • 6. Wootpeanuts flickr.com Prevents reaching a practical solution Abelardo Pardo Practical privacy issues around Learning Analytics 6
  • 7. malias flickr.com General Environment view LA Scenarios Abelardo Pardo Practical privacy issues around Learning Analytics 7
  • 8. malias flickr.com Environment Abelardo Pardo Practical privacy issues around Learning Analytics 8
  • 9. http://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life (last accessed March 2013) 9 Practical privacy issues around Learning Analytics Abelardo Pardo
  • 10. 10 Is she pregnant? Practical privacy issues around Learning Analytics Dailymail.co.uk/news/article-2102859/How-Target-knows-shoppers-pregnant–figured-teen-father-did.html (last accessed March 2013) Abelardo Pardo
  • 11. http://hdguru.com/is-your-new-hdtv-watching-you/7643 (last accessed March 2013) 11 Practical privacy issues around Learning Analytics Abelardo Pardo
  • 12. Great Beyond flickr.com Privacy as a currency Abelardo Pardo Practical privacy issues around Learning Analytics 12
  • 13. http://theweek.com/article/index/229508 (last accessed March 2013) B2B Data Market Abelardo Pardo Practical privacy issues around Learning Analytics 13
  • 14. www.nytimes.com (last accessed March 2013) Lower premium With GPS Without GPS Abelardo Pardo Practical privacy issues around Learning Analytics 14
  • 15. malias flickr.com General Environment view Abelardo Pardo Practical privacy issues around Learning Analytics 15
  • 16. https://www.privacyassociation.org/resource_center/consumer_data_privacy_in_a_networked_world (last accessed March 2013) 16 Practical privacy issues around Learning Analytics Abelardo Pardo
  • 17. http://www.csa.ca/cm/ca/en/privacy-code (last accessed March 2013) Abelardo Pardo Practical privacy issues around Learning Analytics 17
  • 18. arstechnica.com/tech-policy/2013/02/eu-data-law-proposal-uses-language-word-for-word-from-us-eu-corporations (last accessed March 2013) 18 Similar legislation Practical privacy issues around Learning Analytics Abelardo Pardo
  • 19. Reigh LeBlanc flickr.com Absolute confidentiality: undesired Data ownership Information flow Abelardo Pardo Practical privacy issues around Learning Analytics 19
  • 20. http://www.nature.com/nm/journal/v13/n9/full/nm0907-999.html Uninformed consent is considered under special circumstances Abelardo Pardo Practical privacy issues around Learning Analytics 20
  • 21. anthonylibrarian Flickr Internet requires new approach to privacy Before: Limiting surveillance, restricting access to information, Additionally: How is data curtailing intrusions into captured, who owns it, how private space. is it shared? Abelardo Pardo Practical privacy issues around Learning Analytics 21
  • 22. Small_Realm Flickr People act in different roles and contexts Applications should respect these contexts Abelardo Pardo Practical privacy issues around Learning Analytics 22
  • 23. Context Integrity: Framework to provide guidance to solve privacy related conflicts. Context Travel flickr.com Appropriateness & Distribution (Nissenbaum, H., 2004, Privacy as Contextual Integrity, Washington Law Review, 79(1)) Abelardo Pardo Practical privacy issues around Learning Analytics 23
  • 24. Cotton|Joe Flickr Appropriateness What is collected? What is revealed? Valid in one context, invalid in another Abelardo Pardo Practical privacy issues around Learning Analytics 24
  • 25. johnthrm Flickr Distribution Who sees the data? When? For what purpose? Abelardo Pardo Practical privacy issues around Learning Analytics 25
  • 26. malias flickr.com General Environment view LA Scenarios Abelardo Pardo Practical privacy issues around Learning Analytics 26
  • 27. 27 Database with K-12 Student data Practical privacy issues around Learning Analytics http://www.reuters.com/article/2013/03/03/us-education-database-idUSBRE92204W20130303 (last accessed March 2013) Abelardo Pardo
  • 28. deepwarren Flickr Observe in and out of the classroom Abelardo Pardo Practical privacy issues around Learning Analytics 28
  • 29. Case 1: K-12 Out-of-class support 1 Collection while doing homework in tablet 2 Data used by teachers to personalize activities. 3 Available to all teachers in the school. 4 Performance vs demographic factors correlated. 5 Available to platform vendors. 6 Kept for ever. Abelardo Pardo Practical privacy issues around Learning Analytics 29
  • 30. Case 2: University course 1 Collected in LMS and mobile application. 2 Available to instructors for personalization. 3 Some data considered for assessment. 4 Available to university-wide units: counseling, recruiting, marketing. 5 Analyzed Retention vs demographic. 6 eTextbook access available to publishers. 7 Kept for ever. Abelardo Pardo Practical privacy issues around Learning Analytics 30
  • 31. Case 3: Distance education 1 Data collected in LMS. 2 Available to instructors for personalization purposes. 3 Analyzed performance vs demographic. 4 Some data considered for assessment. 5 Results used in scientific publication. 6 Results available to funding institutions. 7 Student right to request data removal. Abelardo Pardo Practical privacy issues around Learning Analytics 31
  • 32. Ethical Principles • LA as a moral practice • Students as agents at the center • Data is temporal and dynamic • Student success is complex and multidimensional • Transparency • Institutions obliged to use data (Slade, S., Prinsloo, P. 2013, Learning Analytics: Ethical Issues and Dilemmas, American Behavioral Scientist) Abelardo Pardo Practical privacy issues around Learning Analytics 32
  • 33. Practical Principles • Transparency: Explicit description of how data is collected, manipulated, stored and accessed • Students as data owners: Include right to consult, modify or remove data • Data access policies: clearly stated and observed. • Accountability and assessment: Embedded constant review and auditing of the policy. Abelardo Pardo Practical privacy issues around Learning Analytics 33
  • 34. lrargerich Flickr Transparency • Means to achieve Legitimacy • Apply across the board • Easily accessible and clearly explained documentation • How is data collected • Who has access to the data • Which calculations are performed • How long is the data valid and available Abelardo Pardo Practical privacy issues around Learning Analytics 34
  • 35. Students as data owners • Right to access, amend, delete data Images of Money Flickr • Institutions are borrowing the data • In conflict with derived data • Affects system design • Consider fixed life span of collected data Abelardo Pardo Practical privacy issues around Learning Analytics 35
  • 36. Data Access Policies • Clarify the roles when Chris Cambpelll accessing data • Extend to derived data • Consider connection with research • Beware of “anonymization” or “deidentification” Abelardo Pardo Practical privacy issues around Learning Analytics 36
  • 37. On “anonymization” OperationPaperStorm Flickr • Comprehensive anonymized dataset of course participation • Include forum posts • All students introduced themselves in forum the first week • Student joins the course later. Abelardo Pardo Practical privacy issues around Learning Analytics 37
  • 38. Accountability and Assessment • Each aspect has a colemama Flickr responsible person, body, department. • Process continuously “under improvement” • Consider all stakeholders Abelardo Pardo Practical privacy issues around Learning Analytics 38
  • 39. Case 1: K-12 Out-of-class support 1 Collection while doing homework in tablet 2 Data used by teachers to personalize activities. 3 Available to all teachers in the school. 4 Performance vs demographic factors correlated. 5 Available to platform vendors. 6 Kept for ever. Abelardo Pardo Practical privacy issues around Learning Analytics 39
  • 40. Case 2: University course 1 Collected in LMS and mobile application. 2 Available to instructors for personalization. 3 Some data considered for assessment. 4 Available to university-wide units: counseling, recruiting, marketing. 5 Analyzed Retention vs demographic. 6 eTextbook access available to publishers. 7 Kept for ever. Abelardo Pardo Practical privacy issues around Learning Analytics 40
  • 41. Case 3: Distance education 1 Data collected in LMS. 2 Available to instructors for personalization purposes. 3 Analyzed performance vs demographic. 4 Some data considered for assessment. 5 Results used in scientific publication. 6 Results available to funding institutions. 7 Student right to request data removal. Abelardo Pardo Practical privacy issues around Learning Analytics 41
  • 42. johnthurm Flickr Privacy changed in Internet era Integrity of the Learning Context Appropriateness & Distribution Ethical and Implementation principles Abelardo Pardo Practical privacy issues around Learning Analytics 42
  • 43. danxoneil Flickr Practical privacy issues around Learning Analytics Learning Analytics and Knowledge 2013 Abelardo Pardo (@abelardopardo) The University of Sydney www.slideshare.net/abelardo_pardo