Successful execution CONTROL CARDS FOR RUN 1 Control Cards File Name: control.txt Salerno OSCE GSTUDY Salerno OSCE COMMENT The Salerno Medical School runs an 'Objective Structured Clinical Exam' COMMENT at the end of the first clinical year. The OSCE is organized in 10 station circuits COMMENT run over three days, one circuit each on morning, afternoon and evening. COMMENT A total of 85 students will take the exam. The stations have been carefully designed COMMENT and reviewed by a panel of 18 professors. At each station students are rated COMMENT for competence in 5 areas by 2 independent raters on a 4 point scale. COMMENT* Candidate (c) COMMENT* Circuit (q) COMMENT* Station (s) COMMENT* Rater (r) COMMENT* Item (i) OPTIONS NREC 5 "*.lis" TIME NOBANNER EFFECT q 9 EFFECT * c:q 10 10 10 10 10 10 10 10 5 EFFECT s:q 10 10 10 10 10 10 10 10 10 EFFECT r:s:q 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 EFFECT i:s:q 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 FORMAT 8 8 PROCESS "~data.txt" INPUT RECORDS FOR RUN 1 Salerno OSCE RECORD NUMBER 1: 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 1.050 0.050 0.050 1.050 0.050 0.050 -0.950 -0.950 0.050 -0.950 1.050 0.050 0.050 1.050 0.050 0.050 -0.950 -0.950 0.050 -0.950 1.050 1.050 1.050 1.050 1.050 1.050 1.050 0.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 0.050 0.050 1.050 0.050 0.050 -0.950 -0.950 0.050 -0.950 -0.950 -1.950 -1.950 -0.950 -1.950 1.050 1.050 1.050 1.050 1.050 1.050 1.050 0.050 1.050 1.050 1.050 1.050 0.050 1.050 1.050 1.050 0.050 -0.950 0.050 -0.950 1.050 1.050 1.050 1.050 1.050 1.050 0.050 0.050 1.050 0.050 RECORD NUMBER 2: 1.050 0.050 -0.950 0.050 0.050 0.050 -0.950 -1.950 -0.950 -1.950 -0.950 0.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 1.050 0.050 -0.950 0.050 -0.950 0.050 -0.950 -1.950 -0.950 -1.950 0.050 -0.950 -0.950 0.050 -0.950 -0.950 -1.950 -1.950 -0.950 -1.950 1.050 1.050 0.050 1.050 1.050 1.050 0.050 -0.950 0.050 0.050 0.050 -0.950 -1.950 -0.950 -0.950 -0.950 -1.950 -1.950 -1.950 -1.950 -0.950 -1.950 -1.950 -1.950 -1.950 -1.950 -1.950 -1.950 -1.950 -1.950 -0.950 -1.950 -1.950 -0.950 -1.950 -1.950 -1.950 -1.950 -1.950 -1.950 0.050 -0.950 -0.950 0.050 -0.950 -0.950 -1.950 -1.950 -0.950 -1.950 1.050 0.050 -0.950 0.050 0.050 0.050 -0.950 -1.950 -0.950 -1.950 RECORD NUMBER 3: 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 1.050 0.050 0.050 1.050 0.050 0.050 -0.950 -0.950 0.050 -0.950 1.050 0.050 -0.950 0.050 0.050 0.050 -0.950 -1.950 -0.950 -0.950 1.050 1.050 0.050 1.050 0.050 0.050 -0.950 -0.950 0.050 -0.950 1.050 1.050 0.050 1.050 0.050 1.050 0.050 -0.950 0.050 -0.950 1.050 0.050 0.050 1.050 0.050 0.050 -0.950 -1.950 -0.950 -0.950 1.050 1.050 1.050 1.050 1.050 1.050 0.050 0.050 1.050 0.050 1.050 1.050 0.050 1.050 1.050 1.050 0.050 -0.950 0.050 0.050 1.050 1.050 1.050 1.050 1.050 1.050 0.050 0.050 1.050 0.050 RECORD NUMBER 4: 0.050 -0.950 -0.950 0.050 -0.950 -0.950 -1.950 -1.950 -0.950 -1.950 -0.950 0.050 0.050 0.050 0.050 1.050 0.050 0.050 0.050 0.050 0.050 -0.950 -1.950 -0.950 -0.950 -0.950 -1.950 -1.950 -1.950 -1.950 0.050 -0.950 -1.950 -0.950 -1.950 -0.950 -1.950 -1.950 -1.950 -1.950 1.050 0.050 0.050 1.050 0.050 0.050 -0.950 -1.950 -0.950 -0.950 0.050 -0.950 -1.950 -0.950 -0.950 -0.950 -1.950 -1.950 -1.950 -1.950 -0.950 -1.950 -1.950 -1.950 -1.950 -1.950 -1.950 -1.950 -1.950 -1.950 0.050 -0.950 -1.950 -0.950 -1.950 -0.950 -1.950 -1.950 -1.950 -1.950 0.050 -0.950 -1.950 -0.950 -0.950 -0.950 -1.950 -1.950 -1.950 -1.950 0.050 -0.950 -1.950 -0.950 -0.950 -0.950 -1.950 -1.950 -1.950 -1.950 RECORD NUMBER 5: 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 0.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 0.050 1.050 0.050 1.050 1.050 1.050 1.050 1.050 1.050 0.050 0.050 1.050 0.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 1.050 MEANS FOR MAIN EFFECTS FOR RUN 1 Salerno OSCE Means for q 0.224 -0.096 -0.072 0.176 -0.368 0.046 0.105 0.019 -0.072 Means for c:q 0.380 -0.840 0.270 -1.140 0.910 0.600 0.630 0.770 0.430 0.230 -0.350 -0.430 0.240 0.190 0.460 -0.260 0.520 -1.230 0.020 -0.120 -0.680 0.620 0.550 -0.740 -1.260 -1.120 0.600 -0.370 0.720 0.960 0.880 0.390 -0.070 -1.380 0.130 0.860 0.370 -0.370 0.100 0.850 0.340 -1.390 -0.350 0.260 -0.560 -1.080 0.030 -1.470 0.650 -0.110 -0.220 0.840 -1.790 -0.290 0.580 -0.290 0.350 0.680 0.280 0.320 0.710 0.700 -0.730 0.220 0.070 0.420 0.860 -0.990 -0.490 0.280 -1.490 0.950 -0.430 -0.990 0.350 -0.020 0.030 0.620 0.320 0.850 0.910 -1.690 0.710 0.950 -1.240 Means for s:q 0.660 0.230 0.260 -0.040 0.680 0.140 -0.650 0.330 0.190 0.440 0.370 0.230 0.140 -0.520 0.520 -0.440 -1.210 -0.120 0.150 -0.080 0.400 0.060 -0.170 -0.420 0.480 -0.050 -0.870 0.020 -0.140 -0.030 0.710 0.140 0.150 -0.260 0.710 0.100 -0.550 0.300 0.190 0.270 0.130 0.290 -0.480 -0.650 0.250 -0.540 -1.220 -0.410 -0.580 -0.470 0.460 -0.030 -0.000 -0.400 0.630 0.050 -0.800 0.180 0.230 0.140 0.670 0.300 -0.060 -0.350 0.500 0.020 -0.740 0.280 0.080 0.350 0.530 0.020 0.010 -0.330 0.440 -0.160 -0.690 0.190 0.040 0.140 0.150 0.090 -0.050 -0.250 0.070 -0.150 -0.410 -0.010 -0.130 -0.030 Means for r:s:q 0.790 0.530 0.250 0.210 0.570 -0.050 0.350 -0.430 0.930 0.430 0.510 -0.230 -0.190 -1.110 0.550 0.110 0.530 -0.150 0.710 0.170 0.710 0.030 0.230 0.230 0.650 -0.370 -0.110 -0.930 0.850 0.190 0.050 -0.930 -0.830 -1.590 0.270 -0.510 0.550 -0.250 0.370 -0.530 0.670 0.130 0.010 0.110 0.230 -0.570 -0.090 -0.750 0.730 0.230 0.270 -0.370 -0.510 -1.230 0.390 -0.350 0.190 -0.470 0.330 -0.390 0.910 0.510 0.150 0.130 0.470 -0.170 0.170 -0.690 0.930 0.490 0.390 -0.190 -0.130 -0.970 0.590 0.010 0.490 -0.110 0.550 -0.010 0.490 -0.230 0.230 0.350 -0.070 -0.890 -0.130 -1.170 0.590 -0.090 -0.150 -0.930 -0.930 -1.510 0.050 -0.870 -0.110 -1.050 -0.070 -0.870 0.690 0.230 -0.010 -0.050 0.350 -0.350 0.050 -0.850 0.810 0.450 0.350 -0.250 -0.350 -1.250 0.490 -0.130 0.570 -0.110 0.450 -0.170 0.890 0.450 0.310 0.290 0.350 -0.470 0.070 -0.770 0.810 0.190 0.370 -0.330 -0.330 -1.150 0.630 -0.070 0.430 -0.270 0.690 0.010 0.750 0.310 0.030 0.010 0.370 -0.350 0.030 -0.690 0.710 0.170 0.190 -0.510 -0.330 -1.050 0.530 -0.150 0.370 -0.290 0.450 -0.170 0.290 0.010 0.050 0.130 0.050 -0.150 0.010 -0.510 0.210 -0.070 -0.030 -0.270 -0.190 -0.630 0.170 -0.190 0.010 -0.270 0.050 -0.110 Means for i:s:q 0.850 0.650 0.500 0.750 0.550 0.550 0.150 0.150 0.150 0.150 0.750 0.200 -0.150 0.450 0.050 0.600 -0.100 -0.650 0.200 -0.250 0.950 0.700 0.300 0.850 0.600 0.700 0.150 -0.350 0.350 -0.150 -0.000 -0.800 -1.150 -0.400 -0.900 0.650 0.250 0.050 0.500 0.200 0.700 0.150 -0.350 0.350 0.100 0.850 0.400 0.100 0.600 0.250 0.850 0.350 -0.150 0.550 0.250 0.550 0.150 0.150 0.150 0.150 0.750 0.100 -0.500 0.450 -0.100 0.250 -0.550 -1.150 -0.350 -0.800 0.900 0.500 0.150 0.750 0.300 0.250 -0.600 -1.050 -0.150 -0.650 -0.500 -1.350 -1.700 -1.050 -1.450 0.550 -0.150 -0.700 0.100 -0.400 0.700 0.200 -0.500 0.350 -0.000 0.500 -0.250 -0.550 0.250 -0.350 0.750 0.350 0.050 0.550 0.300 0.500 -0.050 -0.050 -0.050 -0.050 0.350 -0.350 -0.550 0.100 -0.400 -0.050 -0.600 -0.700 -0.100 -0.650 0.800 0.450 0.200 0.650 0.300 0.450 -0.100 -0.450 0.050 -0.200 -0.200 -0.900 -1.400 -0.850 -1.000 0.500 -0.100 -0.450 0.300 -0.150 0.350 -0.250 -0.500 0.050 -0.350 0.500 -0.050 -0.500 0.150 -0.250 1.000 0.700 0.350 0.800 0.700 0.500 0.050 0.050 0.050 0.050 0.700 0.250 -0.450 0.250 -0.000 0.300 -0.500 -0.650 0.100 -0.550 0.950 0.650 0.500 0.850 0.600 0.500 -0.000 -0.250 0.350 -0.100 0.200 -0.600 -1.150 -0.350 -0.850 0.750 0.250 -0.100 0.450 0.150 0.650 0.200 -0.300 0.350 0.050 0.650 0.200 -0.050 0.500 0.050 0.600 0.050 -0.250 0.450 -0.200 0.450 0.250 0.250 0.250 0.250 0.100 -0.650 -0.950 -0.200 -0.700 0.100 -0.750 -1.200 -0.450 -0.950 0.750 0.200 -0.200 0.450 0.050 0.100 -0.550 -1.100 -0.350 -0.800 -0.700 -1.350 -1.550 -1.100 -1.400 0.250 -0.500 -0.950 -0.200 -0.650 0.050 -0.700 -1.150 -0.350 -0.750 0.100 -0.600 -0.950 -0.250 -0.650 0.750 0.450 0.150 0.650 0.300 0.450 -0.150 -0.150 -0.150 -0.150 0.550 -0.000 -0.550 0.200 -0.200 0.200 -0.500 -0.900 -0.100 -0.700 0.850 0.600 0.400 0.750 0.550 0.550 0.050 -0.350 0.250 -0.250 -0.150 -0.850 -1.350 -0.600 -1.050 0.600 0.150 -0.200 0.400 -0.050 0.650 0.250 -0.200 0.450 -0.000 0.600 0.150 -0.350 0.350 -0.050 0.950 0.650 0.400 0.850 0.500 0.500 0.250 0.250 0.250 0.250 0.550 -0.150 -0.600 0.100 -0.200 0.250 -0.400 -0.850 -0.100 -0.650 0.850 0.350 0.200 0.800 0.300 0.550 -0.100 -0.400 0.250 -0.200 -0.150 -0.850 -1.200 -0.450 -1.050 0.700 0.300 -0.150 0.500 0.050 0.550 0.050 -0.400 0.300 -0.100 0.750 0.250 -0.000 0.550 0.200 0.800 0.450 0.250 0.750 0.400 0.300 -0.050 -0.050 -0.050 -0.050 0.500 -0.100 -0.450 0.300 -0.200 0.200 -0.450 -0.800 -0.100 -0.500 0.800 0.450 0.050 0.600 0.300 0.350 -0.250 -0.600 0.100 -0.400 -0.050 -0.800 -1.250 -0.550 -0.800 0.650 0.150 -0.300 0.350 0.100 0.500 -0.000 -0.450 0.200 -0.050 0.650 0.150 -0.350 0.250 -0.000 0.450 0.150 -0.050 0.150 0.050 0.250 0.050 0.050 0.050 0.050 0.150 -0.050 -0.250 -0.050 -0.050 0.150 -0.250 -0.550 -0.150 -0.450 0.450 0.050 -0.150 0.050 -0.050 0.050 -0.150 -0.350 -0.050 -0.250 -0.150 -0.450 -0.650 -0.250 -0.550 0.250 -0.150 -0.150 0.150 -0.150 0.050 -0.150 -0.250 -0.050 -0.250 0.150 -0.050 -0.150 -0.050 -0.050 ANOVA TABLE FOR RUN 1 Salerno OSCE ----------------------------------------------------------------------------- Effect df T SS MS VC ----------------------------------------------------------------------------- q 8 247.07000 247.06953 30.88369 -0.03752 c:q 76 4577.75995 4330.68995 56.98276 0.50679 s:q 81 1506.72998 1259.65998 15.55136 0.21327 r:s:q 90 2417.58996 910.85998 10.12067 -0.28739 i:s:q 360 2359.84996 853.11998 2.36978 -1.08200 cs:q 6156 7023.44991 1186.02998 0.19266 0.31249 cr:s:q 6840 8219.54989 285.24000 0.04170 0.69701 ci:s:q 27360 8370.04988 493.47999 0.01804 1.30052 ri:s:q 32400 3319.94994 49.24000 0.00152 2.44732 cri:s:q 2462400 9859.54972 244.15986 0.00010 -2.90702 ----------------------------------------------------------------------------- Mean 0.00047 ----------------------------------------------------------------------------- Total 2535771 9859.54925 ----------------------------------------------------------------------------- Grand Mean: 0.00024 Date and time at beginning of Run 1: Sat Mar 25 06:18:20 2023 Processor time for run: 0 seconds There were no missing items. The calculated grand mean = 1.94976 This value has been subtracted from the actual scores for the calculations. While this improves the accuracy, it does not affect the calculated variances. ----------------------------------- Results G Study. Facet s, random; level = 10.0. Facet r, random; level = 2.0. Facet i, random; level = 5.000000000000009. Variance component 'q' (s) is 0.0; denominator is 1.00; null Variance component 'c:q' (d:s) is 0.50679; denominator is 1.00 x 1.00; τ only Variance component 's:q' (g:s) is 0.21327; denominator is 10.00 x 1.00; Δ only Variance component 'r:s:q' (g:g:s) is 0.0; denominator is 2.00 x 10.00 x 1.00; Δ only Variance component 'i:s:q' (g:g:s) is 0.0; denominator is 5.00 x 10.00 x 1.00; Δ only Variance component 'cs:q' (dg:s) is 0.31249; denominator is 1.00 x 10.00 x 1.00; both δ and Δ Variance component 'cr:s:q' (dg:g:s) is 0.69701; denominator is 1.00 x 2.00 x 10.00 x 1.00; both δ and Δ Variance component 'ci:s:q' (dg:g:s) is 1.30052; denominator is 1.00 x 5.00 x 10.00 x 1.00; both δ and Δ Variance component 'ri:s:q' (gg:g:s) is 2.44732; denominator is 2.00 x 5.00 x 10.00 x 1.00; Δ only Variance component 'cri:s:q' (dgg:g:s) is 0.0; denominator is 1.00 x 2.00 x 5.00 x 10.00 x 1.00; both δ and Δ σ²(τ) = 0.5068 σ²(δ) = 0.0921 σ²(Δ) = 0.1379 GENERALIZABILITY COEFFICIENTS: Eρ² = 0.85 Φ = 0.79 ----------------------------------- Results D-Study. Facet s, random; level = 10.0. Facet r, random; level = 1.0. Facet i, random; level = 5.000000000000009. Variance component 'q' (s) is 0.0; denominator is 1.00; null Variance component 'c:q' (d:s) is 0.50679; denominator is 1.00 x 1.00; τ only Variance component 's:q' (g:s) is 0.21327; denominator is 10.00 x 1.00; Δ only Variance component 'r:s:q' (g:g:s) is 0.0; denominator is 1.00 x 10.00 x 1.00; Δ only Variance component 'i:s:q' (g:g:s) is 0.0; denominator is 5.00 x 10.00 x 1.00; Δ only Variance component 'cs:q' (dg:s) is 0.31249; denominator is 1.00 x 10.00 x 1.00; both δ and Δ Variance component 'cr:s:q' (dg:g:s) is 0.69701; denominator is 1.00 x 1.00 x 10.00 x 1.00; both δ and Δ Variance component 'ci:s:q' (dg:g:s) is 1.30052; denominator is 1.00 x 5.00 x 10.00 x 1.00; both δ and Δ Variance component 'ri:s:q' (gg:g:s) is 2.44732; denominator is 1.00 x 5.00 x 10.00 x 1.00; Δ only Variance component 'cri:s:q' (dgg:g:s) is 0.0; denominator is 1.00 x 1.00 x 5.00 x 10.00 x 1.00; both δ and Δ σ²(τ) = 0.5068 σ²(δ) = 0.1270 σ²(Δ) = 0.1972 GENERALIZABILITY COEFFICIENTS: Eρ² = 0.80 Φ = 0.72 Sig: 1829