UNIT IV probability and standard distribution
- 1. UNIT IV Probability and Standard Distributions DR PRASANNA MOHAN PROFESSOR/RESEARCH HEAD KRUPANIDHI COLLEGE OF PHYSIOTHERAPY
- 2. Range The spread, or the distance, between the lowest and highest values of a variable. To get the range for a variable, you subtract its lowest value from its highest value. Class A--IQs of 13 Students 102 115 128 109 131 89 98 106 140 119 93 97 Class B--IQs of 13 Students 127 162 131 103 96 111 80 109 93 87 120 105 109 Class B Range = 162 - 80 = 82
- 3. Interquartile Range A quartile is the value that marks one of the divisions that breaks a series of values into four equal parts. The median is a quartile and divides the cases in half. 25th percentile is a quartile that divides the first ¼ of cases from the latter ¾. 75th percentile is a quartile that divides the first ¾ of cases from the latter ¼. The interquartile range is the distance or range between the 25th percentile and the 75th percentile. Below, what is the interquartile range? 0 250 500 750 1000 25% of cases 25% 25% 25% of cases
- 4. Variance A measure of the spread of the recorded values on a variable. A measure of dispersion. The larger the variance, the further the individual cases are from the mean. The smaller the variance, the closer the individual scores are to the mean. Mean Mean
- 5. Variance Variance is a statistical measure that indicates how spread out or dispersed the data points are in a dataset. It gives insight into the degree to which each data point deviates from the mean (average) Calculating variance starts with a “deviation.” A deviation is the distance away from the mean of a case’s score. A high variance means that the data points are spread out over a large range of values, while a low variance means they are clustered closely around the mean.
- 6. Variance The deviation of 102 from 110.54 is? Deviation of 115? Class A--IQs of 13 Students 102 115 128 109 131 89 98 106 140 119 93 97
- 7. Variance The deviation of 102 from 110.54 is? Deviation of 115? 102 - 110.54 = -8.54 115 - 110.54 = 4.46 Class A--IQs of 13 Students 102 115 128 109 131 89 98 106 140 119 93 97
- 8. Variance • We want to add these to get total deviations, but if we were to do that, we would get zero every time. Why? • We need a way to eliminate negative signs. Squaring the deviations will eliminate negative signs... A Deviation Squared: (Yi – Y-bar)2 Back to the IQ example, A deviation squared for 102 is: of 115: (102 - 110.54)2 = (-8.54)2 = 72.93 (115 - 110.54)2 = (4.46)2 = 19.89
- 9. Variance If you were to add all the squared deviations together, you’d get what we call the “Sum of Squares.” Sum of Squares (SS) = Σ (Yi – Y-bar)2 SS = (Y1 – Y-bar)2 + (Y2 – Y-bar)2 + . . . + (Yn – Y-bar)2
- 10. Variance Class A, sum of squares: (102 – 110.54)2 + (115 – 110.54)2 + (128 – 110.54)2 + (109 – 110.54)2 + (131 – 110.54)2 + (89 – 110.54)2 + (98 – 110.54)2 + (106 – 110.54)2 + (140 – 110.54)2 + (119 – 110.54)2 + (93 – 110.54)2 + (97 – 110.54)2 + (110 – 110.54)= SS = 2825.39 Class A--IQs of 13 Students 102 115 128 109 131 89 98 106 140 119 93 97 110 Y-bar = 110.54
- 11. Variance The last step… The approximate average sum of squares is the variance. SS/N = Variance for a population. SS/n-1 = Variance for a sample. Variance = Σ(Yi – Y-bar)2 / n – 1
- 12. Variance For Class A, Variance = 2825.39 / n - 1 = 2825.39 / 12 = 235.45 How helpful is that???
- 13. Standard Deviation To convert variance into something of meaning, let’s create standard deviation. The square root of the variance reveals the average deviation of the observations from the mean. s.d. = Σ(Yi – Y-bar)2 n - 1
- 14. Standard Deviation For Class A, the standard deviation is: 235.45 = 15.34 The average of persons’ deviation from the mean IQ of 110.54 is 15.34 IQ points. Review: 1. Deviation 2. Deviation squared 3. Sum of squares 4. Variance 5. Standard deviation
- 15. Standard Deviation 1. Larger s.d. = greater amounts of variation around the mean. For example: 19 25 31 13 25 37 Y = 25 Y = 25 s.d. = 3 s.d. = 6 2. s.d. = 0 only when all values are the same (only when you have a constant and not a “variable”) 3. If you were to “rescale” a variable, the s.d. would change by the same magnitude—if we changed units above so the mean equaled 250, the s.d. on the left would be 30, and on the right, 60 4. Like the mean, the s.d. will be inflated by an outlier case value.
- 17. • Skewness is a measure of symmetry, or more precisely, the lack of symmetry. A distribution, or data set, is symmetric if it looks the same to the left and right of the center point. • Kurtosis is a measure of whether the data are heavy- tailed or light-tailed relative to a normal distribution.
- 18. Skewness Skewness refers to a distortion or asymmetry that deviates from the symmetrical bell curve, or normal distribution, in a set of data. If the curve is shifted to the left or to the right, it is said to be skewed. Skewness can be quantified as a representation of the extent to which a given distribution varies from a normal distribution. A normal distribution has a skew of zero
- 19. Types of skewness Positive skewed or right- skewed Negative skewed or left- skewed
- 20. Positive skewed or right-skewed • In which most values are clustered around the left tail of the distribution while the right tail of the distribution is longer. • In positively skewed, the mean of the data is greater than the median (a large number of data-pushed on the right-hand side). • The mean, median, and mode of the distribution are positive rather than negative or zero.
- 21. Negative skewed or left-skewed • In which more values are concentrated on the right side (tail) of the distribution graph while the left tail of the distribution graph is longer. • The mean of the data is less than the median (a large number of data-pushed on the left-hand side). • The mean, median, and mode of the distribution are negative rather than positive or zero.
- 22. Calculate the skewness coefficient of the sample It truly scales the value down to a limited range of -1 to +1. • If the skewness is between -0.5 & 0.5, the data are nearly symmetrical. • If the skewness is between -1 & -0.5 (negative skewed) or between 0.5 & 1(positive skewed), the data are slightly skewed. • If the skewness is lower than -1 (negative skewed) or greater than 1 (positive skewed), the data are extremely skewed.
- 23. Kurtosis Kurtosis is a statistical measure, whether the data is heavy-tailed or light-tailed in a normal distribution. Kurtosis tell us about the peakdness or flaterness of the distribution. Kurtosis is basically statistical measure that helps to identify the data around the mean. Types of excess kurtosis 1.Leptokurtic or heavy-tailed distribution (kurtosis more than normal distribution). 2.Mesokurtic (kurtosis same as the normal distribution). 3.Platykurtic or short-tailed distribution (kurtosis less than normal distribution).
- 24. Leptokurtic (kurtosis > 3) Leptokurtic is having very long and skinny tails, which means there are more chances of outliers. Positive values of kurtosis indicate that distribution is peaked and possesses thick tails. An extreme positive kurtosis indicates a distribution where more of the numbers are located in the tails of the distribution instead of around the mean. PLATYKURTIC (KURTOSIS < 3) • Platykurtic having a lower tail and stretched around center tails means most of the data points are present in high proximity with mean. • A platykurtic distribution is flatter (less peaked) when compared with the normal distribution.
- 25. Mesokurt ic (kurtosis = 3) • Mesokurtic is the same as the normal distribution, which means kurtosis is near to 0. • In mesokurtic, distributions are moderate in breadth, and curves are a medium peaked height.
- 26. •Important Measure of Variation •Shows Variation About the Mean: •For the Population: •For the Sample: Variance N Xi 2 2 1 2 2 n x x s i For the Population: use N in the denominator. For the Sample : use n - 1 in the denominator.
- 27. •Important Measure of Variation •Shows Variation About the Mean: •For the Population: •For the Sample: Standard Deviation N Xi 2 1 2 n x x s i
- 28. Coefficient of Variation •Measure of Relative Variation •Always a % •Shows Variation Relative to Mean •Used to Compare 2 or More Groups •Formula (for Sample): 100% X SD CV
- 29. • Stock A: Average Price last year = $50 • Standard Deviation = $5 • Stock B: Average Price last year = $100 • Standard Deviation = $5 Coefficient of Variation: Stock A: CV = 10% Stock B: CV = 5% Comparing Coefficient of Variation
- 30. Correlation: - How much depend the value of one variable on the value of the other one? Y X Y X Y X high positive correlation poor negative correlation no correlation
- 31. How to describe correlation (1): Covariance - The covariance is a statistic representing the degree to which 2 variables vary together n y y x x y x i n i i ) )( ( ) , cov( 1
- 32. cov(x,y) = mean of products of each point deviation from mean values Geometrical interpretation: mean of ‘signed’ areas from rectangles defined by points and the mean value lines n y y x x y x i n i i ) )( ( ) , cov( 1
- 33. sign of covariance = sign of correlation Y X Y X Y X Positive correlation: cov > 0 Negative correlation: cov < 0 No correlation. cov ≈ 0
- 34. 1. 5 test scores for Calculus I are 95, 83, 92, 81, 75. 2. Consider this dataset showing the retirement age of 11 people, in whole years: 54, 54, 54, 55, 56, 57, 57, 58, 58, 60, 60 3. Here are a bunch of 10 point quizzes from MAT117: 9, 6, 7, 10, 9, 4, 9, 2, 9, 10, 7, 7, 5, 6, 7 4. 11, 140, 98, 23, 45, 14, 56, 78, 93, 200, 123, 165 Find the Variance, SD & CV
- 35. • Class Interval Frequency 2 -< 4 3 4 -< 6 18 6 -< 8 9 8 -< 10 7 Find the Variance, SD & CV Example A: 3, 10, 8, 8, 7, 8, 10, 3, 3, 3 Example B: 2, 5, 1, 5, 1, 2 Example C: 5, 7, 9, 1, 7, 5, 0, 4
- 36. Exam marks for 60 students (marked out of 65) mean = 30.3 sd = 14.46 Find the Mean, Median, Mode Variance, SD & CV
- 37. Group Frequency Table Frequency Percent 0 but less than 10 4 6.7 10 but less than 20 9 15.0 20 but less than 30 17 28.3 30 but less than 40 15 25.0 40 but less than 50 9 15.0 50 but less than 60 5 8.3 60 or over 1 1.7 Total 60 100.0