|
 |
|
|
|
Inter-rater Reliability Study
A recent (2009) study compared the “Self” responses of four separate groups. All four groups attended one Eastern U.S. University and while the student population was diverse, the students selected four different classrooms based on their unique scheduling issues. Total “N” = 105 in four groups. Scores created by all participants in the "Pre" assessment were averaged and correlated with each other group.
Average reliability coefficient of: Pearson r = .985
| University Class Section |
Group #1 |
Group #2 |
Group #3 |
Group #4 |
Group #1
(N = 31) |
- |
.99 |
.99 |
.98 |
Group #2
(N = 33) |
|
- |
.99 |
.98 |
Group #3
(N = 29) |
|
|
- |
.98 |
Group #4
(N = 12) |
|
|
|
- |
Because it could be argued that the “polarity” of the GEMA™-Lead360 instrument creates artificially high correlations, the study below created inter-rater correlations within the “Self Above Service” and “Service Above Self” items, separately. The results are listed below.
Self Above Service Items |
| University Class Section |
Group #1 |
Group #2 |
Group #3 |
Group #4 |
Group #1
|
- |
.92 |
.88 |
.88 |
Group #2
|
|
- |
.90 |
.89 |
Group #3
|
|
|
- |
.86 |
Group #4
|
|
|
|
- |
Service Beyond Self Items |
| University Class Section |
Group #1 |
Group #2 |
Group #3 |
Group #4 |
Group #1
|
- |
.91 |
.91 |
.86 |
Group #2
|
|
- |
.91 |
.86 |
Group #3
|
|
|
- |
.87 |
Group #4
|
|
|
|
- |
Average reliability coefficient of: Pearson r = .89
Test and Re-Test Reliability Correlation Coefficients
Linear Correlations (Pearson Product-Moment “r” )
Pre-Post Scores Across All Five Specific Scores for each Area Score and Group |
University Students Arbitrarily Attending Four Separate Classes
Test / Re-test Reliability (three month time gap)
Pre-“N” = 105
Post-“N” = 86 |
| Correlations across five “specific scores” within each area score |
Self Above Service |
Service Beyond Self |
| Group 1 |
Group 2 |
Group 3 |
Group 4 |
Group 1 |
Group 2 |
Group 3 |
Group 4 |
| Entitlement |
Contribution |
Pre-Post Correlations
|
.88 |
77 |
.94 |
.98 |
.95 |
.97 |
.98 |
.78 |
| |
Domination |
Cooperation |
| Pre-Post Correlations |
.99 |
.97 |
.95 |
.79 |
.92 |
.99 |
.95 |
.96 |
| |
Withdrawal |
Connection |
Pre-Post Correlations
|
.88 |
.89 |
.98 |
.88 |
.67 |
.90 |
.88 |
.73 |
------
|
|
|
