As one of State Islamic Universities, UIN Walisongo used various systems to select new candidate of students. The process of recruitment of new students is known as entrance selection test. In this matter, the aim of entrance selection test organized by UIN Walisongo is to describe students’ ability to complete the study for five years. In addition, the results of entrance selection test can be used as a reference in faculty or department where students will be educated. Considering the importance of measuring test-takers’ achievement, it is important for the test-maker to design a good test. One of ways to know the quality of test is through an analysis, namely item analysis.
The main objective of this research is to describe the quality of entrance test of English questions at UIN Walisongo in the Academic Year of 2015/2016, based on the difficulty level, the discriminating power, and the option distractor.
In this research, the researcher conducted quantitative as the method of this research. The data were obtained from English entrance test items at UIN Walisongo in the Academic Year of 2015/2016 and its key answers. It was obtained from 200 students’ answer sheet consist of 100 students who did A code and 100 students who did B code. The data were collected through documentation.
In analyzing the data, the researcher used the application program of ANATES version 4.0.2 to analyze multiple-choice English entrance test items.
The result of this research described that the difficulty level of English entrance test items of A code range was 20% for moderate items, 33,33% was difficult items, and 46,67% was quite difficult items. While, the difficulty level of English entrance test items of B code range was 40% for moderate items, 33,33% for difficult items, and 26,67% for quite difficult items. The overall results indicate the mean of index difficulty level of English entrance test items of A code was 0,23 and B code was 0,26. It means that either English entrance test of A code or B code was difficult items for the test-takers. Then, the discriminating power of English entrance test items of A code showed that 53,33% of the items discriminate very good between upper and lower scoring groups, 26,67% of the items have moderate discriminating power, and 20% of the items have poor discriminating power. Whereas, the discriminating power of English entrance test items of B code showed that 66,67% of the items discriminate very good between upper and lower scoring groups, 13,33% of the items have good discriminating power, 6,67% of the items have moderate discriminating power, and 13,33% of the items have poor discriminating power. As the whole results indicate the mean of index discrimination English entrance test items of A code was 0,36 and B code was 0,44. It means that English entrance test of A code and B code was good enough to discriminate upper and lower students. Later, all of the English entrance test items of A code and B code contain the distractors of incorrect answers that were chosen by at least 5% of the total number of test-takers although some distractors both A code and B code were failed to function well.