677-Session 11-Data Analysis-S12
Download as PPTX, PDF0 likes232 views
The document outlines a systematic approach to data analysis for interface assessment as part of a course on human dimensions in information systems. It involves examining self-report forms, setting up evaluation criteria, conducting content analysis, and recording data in a spreadsheet to compute averages and identify patterns. The goal is to analyze personal interface assessment experiences and derive insights from the gathered data.
677-Session 11-Data Analysis-S12
- 1. Nahl 2012 LIS 677 Human Dimension in Information Systems 1 DATA ANALYSIS FOR INTERFACE ASSESSMENT JOURNAL STRUCTURED SELF-REPORTS & INSTANT USABILITY TEST FORMS Spring 2012 Dr. Diane Nahl LIS 677 Human Dimension in Information System University of Hawaii LIS Program
- 2. Nahl 2012 LIS 677 Human Dimension in Information Systems 2 Self-Report Form Data Analysis ① First step: Examine one of the Forms from an activity and read all of your/the responses in each section of that Form. a. Repeat, read several Forms to become familiar with your data as a whole. b. Assign a descriptive short title to each Form and use those titles in your spreadsheet. Make it descriptive rather than Task 1, etc., e.g., T5-Boolean Pool c. Follow the same procedure for IUT Forms, title each IUT Form with a descriptive code and use the same code on the spreadsheet.
- 3. Nahl 2012 LIS 677 Human Dimension in Information Systems 3 Self-Report Form Data Analysis ② Second step: Set up your quantitative evaluation criteria. a. You may evaluate multi-part tasks or events separately to record ratings and assign scores to activities based on success, efficiency, etc. (e.g., T5a-Teleporting, T5b-finding Boolean Pool, etc.). b. You may use various approaches but must record and assign numerical scores for elements in the report. The rating scales you filled out on your interface behavior (IAJ) and on other’s interface behavior (IUT) represent numerical sets of data. You may create others by quantifying your comments via Content Analysis. c. If you are willing, share the IUT forms with those who were your subjects. You are not required to analyze data gathered on you.
- 4. Nahl 2012 LIS 677 Human Dimension in Information Systems 4 Self-Report Form Data Analysis ③ Third step: Content Analysis Parsing: identify words and phrases that indicate a particular aspect, category, theme or type of comment or explanation. a. Read through each Form again and highlight words and phrases or assign categories to responses (e.g., highlight positive and negative comments, extract urgent i-needs, or other elements of interest). b. Use color highlighters to mark phrases and words in different categories, e.g. red negative, green positive, yellow neutral, etc.
- 5. Nahl 2012 LIS 677 Human Dimension in Information Systems 5 Self-Report Form Data Analysis ④ Fourth step: Copy the Google spreadsheet to record the ratings and comments from the forms. a. Transfer the ratings on each Form to the Google spreadsheet for all of the Forms. b. Make a row for each task/Form (e.g., T1-Make Poster, T2-Media Prim, etc.) and columns for rating scales and enter the ratings in the appropriate column (see spreadsheet example).
- 6. Nahl 2012 LIS 677 Human Dimension in Information Systems 6 Self-Report Form Data Analysis ⑤ Fifth step: Sum the rows and compute the average score for each task portion, and for each task as a whole. ⑤ Sixth step: Sum the columns and compute the average for each rating scale. ⑤ Seventh step: Sum the total scores for all tasks to get a global score for the entire set of personal interface assessment experiences, compute the average.
- 7. Nahl 2012 LIS 677 Human Dimension in Information Systems 7 Self-Report Form Data Analysis ⑧ Eighth step: Examine the spreadsheet and look for numerical and narrative patterns, e.g., a. What is the range of ratings on each task (positive and negative rating averages)? b. Which tasks were most difficult you or a subject? Which were easiest? c. What other patterns do you see in your data? These findings will be part of the Report.