Items 7 through 11 refer to the admission procedure for Watsamata University, a small private…
Items 7 through 11 refer to the admission procedure for Watsamata University, a small private University in Minnesota. Watsamata University requires all applicants to complete an admission examination specifically developed for the University. The test is composed of 100 multiple-choice items. To evaluate the utility of test for admission decisions the university conducted a pilot study in which, for one year, all students who were admitted to the university took the test. The descriptive statistics from the study are presented in Table 1. The relationship between scores on the admission test and freshman year GPA is displayed in the scatter plot shown in Figure 1.
Table 1. Descriptive statistics for admission test evaluation study. N = 50
Admission Tests Scores |
Freshman GPA |
|
Mean |
57.0 |
2.55 |
Standard Deviation |
14.3 |
0.765 |
Figure 1. Scatter Plot admission test scores with freshman year Grade Point Average (GPA), r = 0.85
7. Using the available data, what is the reliability of this data. (5 points)
8. Using your response to item seven, what would you expect the reliability of the data to be if the number of test items were increased to 150? (5 points)
9. Construct a regression formula for this test and freshman GPA, and use it to calculate the predicted freshman year GPA for the student who scored 63 on the admissions examination. What range of scores would you predict, with 90% confidence, for this student’s first year GPA? (10 points)
10. The admissions department assumes that subsequent classes will exhibit the same pattern of performance on the admission test, and that the relationship between the admissions examination and the students’ freshman GPA is relatively stable. Watsamata University has a very simple admission procedure. If a student scores 60 or better on the admission examination, he or she is accepted. In addition students must maintain a 2.0 GPA to continue their studies at Watsamata University. Given this information, is the use of the test likely to enhance the validity of admission decisions made by Watsamata University? Justify your answer using the concepts discussed in class. (10 points)
11. Watsamata University is investigating whether or not its admission test exhibits gender bias. To do this they used the data from the pilot group. The descriptive statistics for male and female applicants, as well as the respective correlation coefficients appear Table 2.
Table 2. Descriptive statistics for admission test evaluation study disaggregated by sex
Men |
Women |
|||
Admission Test Score |
GPA |
Admission Test Score |
GPA |
|
Mean |
52.2 |
2.30 |
60.1 |
2.71 |
Standard Deviation |
13.1 |
0.766 |
14.4 |
0.730 |
Correlation (Admission Test with GAP) |
r = 0.819 |
r = 0.853 |
Calculate separate regression formula for males and females. Use your regression analysis and discuss whether or not this test has a gender bias, and what affect it may have on future applicants. Given your regression analysis, what do you would recommend to the admissions office regarding the future use of this test as part of the admission process? (10 points)
Attachments: