Uji Coba 1
Report created on 10/05/2019
1. Specifications
2. Summary statistics
3. Item-by-item results.
The statistical output is also recorded in a comma-separated value (CSV) file of the same name.
Specifications
The Windows paths for the input files used in this analysis were:
The Windows paths for the output files produced by this analysis were:
Hasil Latihan 1
Hasil Latihan 1.csv
Hasil Latihan 1 Scores.csv
Table 1 presents the specifications and basic information concerning the analysis. This provides
important documentation of the setup of the program for historical purposes.
Table 1: Specifications
Summary statistics
Table 2 presents the summary statistics of the test, for the scored items. Definitions of these
statistics are found in the Iteman manual.
Table 3 presents a reliability analysis of the tests. Alpha (also known as KR-20) is the most
commonly used index of reliability, and is therefore used to calculate the standard error of
measurement (SEM) on the raw score scale. Also presented are three configurations of split-half
reliability, first as uncorrected correlations, and then as Spearman-Brown (S-B) corrected
correlations. This is because an uncorrected split-half correlation is referenced to a "test" that
only contains half as many items as the full test, and therefore underestimates reliability.
Table 3: Reliability
Score Alpha SEM Split-Half Split-Half Split-Half S-B S-B First- S-B Odd-
(Random) (First-Last) (Odd-Even) Random Last Even
Scored items 0,808 1,916 0,669 0,734 0,674 0,802 0,847 0,805
Table 4 presents the item statistics and flags for the item(s) that were flagged during the analysis
Figure 1 displays the distribution of the raw scores for the scored items across all domains.
Table 5 displays the frequency distribution for total score shown in Figure 1.
Score Frequency
2 3
3 5
4 8
5 8
6 4
7 9
8 4
9 17
10 11
11 12
12 10
13 9
14 12
15 7
16 14
17 10
18 2
19 2
Figure 2 displays the distribution of the P values for the dichotomously scored items
(correct/incorrect).
Table 6 displays the frequency distribution of the P values shown in Figure 2.
Score Frequency
0,0 to 0,1 0
0,1 to 0,2 1
0,2 to 0,3 1
0,3 to 0,4 1
0,4 to 0,5 4
0,5 to 0,6 5
0,6 to 0,7 4
0,7 to 0,8 4
0,8 to 0,9 0
0,9 to 1,0 0
Figure 3 displays the distribution of the Point-Biserial Correlations for the dichotomously scored
items (correct/incorrect). Table 7 displays the frequency distribution of the Point-Biserial
correlations shown in Figure 3.
Score Frequency
-0,1 to 0,0 1
0,0 to 0,1 0
0,1 to 0,2 1
0,2 to 0,3 4
0,3 to 0,4 4
0,4 to 0,5 6
0,5 to 0,6 4
0,6 to 0,7 0
0,7 to 0,8 0
0,8 to 0,9 0
0,9 to 1,0 0
Figure 4 displays the scatterplot of P (difficulty) by Rpbis (discrimination) for the dichotomously
scored items (correct/incorrect).
Figure 4: P by Rpbis
Figure 5 displays a graph of the Conditional Standard Error of Measurement (CSEM) Formula IV.
Figure 5: CSEM
Item-by-item results
The following section presents the item-by-item results of the analysis. Each item has several
tables and a figure. The figure, called a quantile plot, shows the proportion of examinees
selecting each option, for consecutive segments of the examinees as ranked by score. The key
thing to evaluate in this figure is that the line for the correct answer has a positive slope (goes up
from left to right), which means that examinees with higher scores tend to answer correctly more
often. Conversely, the lines for the incorrect options, called distractors, should have a negative
slope. Note, however, that the use of a small number of groups (e.g., 3 or fewer) oversimplifies
the graph, so that items which are very difficult or very easy (that is, discriminating in only the top
or bottom 20% of examinees) might appear to have poor quantile plots and classical statistics.
For such items, item response theory presents significant advantages in analysis
1. Item information table: records the information supplied by the control file (or Iteman 3 header)
for this
item.
2. Item statistics table: overall item statistics.
3. Option statistics: detailed statistics for each item, which helps diagnose issues in items with
poor
statistics.
4. Quantile plot data: the values used to create the quantile plot.
The item statistics table presents overall item statistics in the first row of numbers. The two most
important item-level statistics for dichotomously scored (correct/incorrect) items are the P value
and the point-biserial correlation, which represent the difficulty and discrimination of the item,
respectively. For polytomously scored (rating scale or partial credit) items, the difficulty is
represented by the mean (average) item score, while the discrimination is represented by a
Pearson r correlation.
The P value is the proportion of examinees that answered an item in the keyed direction. P
ranges from 0 to 1. A high value (0.95) means that an item is easy, a low value (0.25) means that
the item is difficult. The point-biserial correlation (Rpbis) is a measure of the discriminating, or
differentiating, power of the item. Rpbis ranges from -1 to 1. A negative Rpbis is indicative of a
bad item as lower scoring examinees are more likely than higher scoring examinees to respond in
the keyed direction.
For rating scale or partial credit items, the mean item score ranges from the minimum to the
maximum of the scale. For example, if the item has a rating scale of 1 to 5, the possible range for
the mean is 1 to 5. The Pearson r is similar to the Rpbis in that it ranges from -1 to 1, with a
positive r indicating that the item correlates well with total score.
The option statistics table presents statistics for each individual option (alternative). The key
thing to examine in this portion of the table is that no distractors have a higher Rpbis than the
correct answer. That indicates that higher scoring examinees are selecting the incorrect answer,
which therefore might be arguably correct.
The quantile plot data table simply presents the values calculated to create the quantile plot.
Because it contains the same information, the quantile plot itself presents a useful picture of the
item's performance, but this table can be used to examine that performance in detail to help
diagnose possible issues.
Item information
Seq. ID Key Scored Num Options Domain Flags
1 01 C Yes 5 1
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,673 0,448 0,583 0,796
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 26 0,177 -0,324 -0,476 7,231 3,386 Maroon
B 6 0,041 -0,139 -0,314 7,333 3,615 Green
C 99 0,673 0,448 0,583 12,394 3,858 Blue **KEY**
D 7 0,048 -0,254 -0,546 5,429 3,101 Olive
E 9 0,061 -0,021 -0,041 9,778 4,494 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,789 0,487 0,688 0,795
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 5 0,034 -0,127 -0,304 7,200 4,550 Maroon
B 116 0,789 0,487 0,688 12,034 3,890 Green **KEY**
C 5 0,034 -0,227 -0,544 5,000 2,121 Blue
D 9 0,061 -0,212 -0,421 6,556 3,432 Olive
E 12 0,082 -0,306 -0,555 5,750 3,019 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,714 0,294 0,391 0,804
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 105 0,714 0,294 0,391 11,848 4,145 Maroon **KEY**
B 7 0,048 -0,049 -0,106 9,143 4,259 Green
C 27 0,184 -0,129 -0,188 8,926 4,047 Blue
D 4 0,027 -0,192 -0,498 5,250 2,872 Olive
E 4 0,027 -0,252 -0,653 3,750 1,258 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,660 0,570 0,736 0,789
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 10 0,068 -0,141 -0,271 8,000 3,197 Maroon
B 13 0,088 -0,145 -0,257 8,231 2,774 Green
C 97 0,660 0,570 0,736 12,784 3,593 Blue **KEY**
D 5 0,034 -0,227 -0,546 5,200 2,775 Olive
E 22 0,150 -0,426 -0,652 6,000 3,309 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,728 0,464 0,622 0,795
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 8 0,054 -0,069 -0,141 8,875 3,796 Maroon
B 20 0,136 -0,366 -0,575 6,250 3,210 Green
C 2 0,014 -0,030 -0,100 9,000 8,485 Blue
D 10 0,068 -0,246 -0,471 6,300 4,855 Olive
E 107 0,728 0,464 0,622 12,224 3,703 Gray **KEY**
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,469 0,356 0,447 0,801
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 22 0,150 -0,087 -0,133 9,455 3,334 Maroon
B 7 0,048 -0,109 -0,235 8,286 5,187 Green
C 69 0,469 0,356 0,447 12,884 4,187 Blue **KEY**
D 33 0,224 -0,170 -0,237 9,000 3,363 Olive
E 16 0,109 -0,169 -0,281 8,313 4,672 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,361 0,273 0,350 0,806
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 6 0,041 -0,037 -0,084 9,667 5,125 Maroon
B 39 0,265 -0,163 -0,220 9,282 3,845 Green
C 12 0,082 0,017 0,032 10,667 3,525 Blue
D 37 0,252 -0,129 -0,176 9,486 4,240 Olive
E 53 0,361 0,273 0,350 12,943 4,314 Gray **KEY**
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,156 0,309 0,468 0,804
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 76 0,517 0,076 0,095 10,934 3,419 Maroon
B 11 0,075 -0,061 -0,113 9,727 4,941 Green
C 23 0,156 -0,374 -0,567 6,957 4,364 Blue
D 23 0,156 0,309 0,468 14,652 3,827 Olive **KEY**
E 14 0,095 0,007 0,012 10,714 4,497 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,646 0,192 0,247 0,810
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 13 0,088 0,013 0,022 10,308 3,473 Maroon
B 4 0,027 -0,065 -0,168 8,500 3,109 Green
C 95 0,646 0,192 0,247 11,737 4,563 Blue **KEY**
D 9 0,061 -0,196 -0,388 6,889 4,512 Olive
E 26 0,177 -0,099 -0,146 9,231 3,398 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,748 0,516 0,702 0,793
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 9 0,061 -0,092 -0,182 8,556 4,927 Maroon
B 10 0,068 -0,252 -0,483 6,200 1,814 Green
C 9 0,061 -0,340 -0,675 4,556 1,130 Blue
D 110 0,748 0,516 0,702 12,264 3,616 Olive **KEY**
E 9 0,061 -0,237 -0,469 6,222 5,191 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,497 0,544 0,682 0,790
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 22 0,150 0,022 0,034 10,500 2,686 Maroon
B 19 0,129 -0,357 -0,568 6,526 2,932 Green
C 73 0,497 0,544 0,682 13,507 3,447 Blue **KEY**
D 12 0,082 -0,186 -0,338 7,750 4,202 Olive
E 21 0,143 -0,311 -0,483 7,190 3,502 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,605 0,409 0,519 0,798
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 27 0,184 -0,276 -0,402 7,778 3,955 Maroon
B 6 0,041 -0,176 -0,396 6,667 1,633 Green
C 7 0,048 -0,110 -0,237 8,143 4,981 Blue
D 89 0,605 0,409 0,519 12,539 3,798 Olive **KEY**
E 18 0,122 -0,107 -0,172 9,000 4,352 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,544 0,342 0,429 0,802
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 2 0,014 -0,021 -0,069 9,500 6,364 Maroon
B 18 0,122 -0,206 -0,333 7,944 4,556 Green
C 39 0,265 -0,123 -0,166 9,385 3,290 Blue
D 8 0,054 -0,201 -0,414 6,750 3,694 Olive
E 80 0,544 0,342 0,429 12,537 4,173 Gray **KEY**
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,408 0,208 0,264 0,810
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 31 0,211 -0,038 -0,054 10,065 4,106 Maroon
B 17 0,116 -0,370 -0,607 6,059 3,596 Green
C 32 0,218 0,000 0,000 10,375 4,301 Blue
D 60 0,408 0,208 0,264 12,433 3,933 Olive **KEY**
E 7 0,048 0,147 0,315 13,143 3,024 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,517 0,279 0,350 0,806
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 20 0,136 0,141 0,221 11,750 4,351 Maroon
B 76 0,517 0,279 0,350 12,395 4,246 Green **KEY**
C 28 0,190 -0,424 -0,613 6,607 2,897 Blue
D 22 0,150 -0,049 -0,076 9,773 3,085 Olive
E 1 0,007 -0,045 -0,194 8,000 0,000 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,422 0,498 0,629 0,793
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 9 0,061 0,005 0,010 10,444 3,395 Maroon
B 62 0,422 0,498 0,629 13,742 3,621 Green **KEY**
C 12 0,082 -0,124 -0,224 8,667 4,697 Blue
D 28 0,190 -0,238 -0,344 8,357 3,530 Olive
E 36 0,245 -0,279 -0,382 8,361 3,441 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
147 0,524 0,428 0,536 0,797
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 2 0,014 -0,136 -0,452 5,500 2,121 Maroon
B 20 0,136 0,038 0,059 10,650 4,158 Green
C 77 0,524 0,428 0,536 12,935 3,695 Blue **KEY**
D 21 0,143 -0,153 -0,238 8,714 3,117 Olive
E 27 0,184 -0,406 -0,591 6,741 3,748 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
146 0,500 0,338 0,424 0,802
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 15 0,103 0,017 0,028 10,533 4,704 Maroon
B 73 0,500 0,338 0,424 12,726 3,635 Green **KEY**
C 19 0,130 -0,016 -0,025 10,158 3,804 Blue
D 26 0,178 -0,410 -0,601 6,692 3,876 Olive
E 13 0,089 -0,042 -0,075 9,769 4,024 Gray
Omit 0
Not Admin 1 4,000 0,000
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
144 0,257 -0,018 -0,025 0,819
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 34 0,236 0,008 0,011 10,735 3,107 Maroon
B 37 0,257 -0,018 -0,025 11,541 5,089 Green **KEY**
C 19 0,132 -0,187 -0,296 8,632 4,245 Blue
D 7 0,049 -0,134 -0,287 8,143 3,848 Olive
E 47 0,326 0,207 0,269 11,936 4,162 Gray
Omit 0
Not Admin 3 3,667 0,577
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
144 0,583 0,514 0,650 0,791
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 9 0,063 -0,152 -0,299 8,000 2,598 Maroon
B 14 0,097 -0,298 -0,514 6,714 3,583 Green
C 14 0,097 -0,275 -0,474 7,000 3,162 Blue
D 23 0,160 -0,128 -0,193 9,174 4,075 Olive
E 84 0,583 0,514 0,650 13,083 3,482 Gray **KEY**
Omit 0
Not Admin 3 3,667 0,577