Abstract:
The purpose of this research were 1) to develop and verify the quality the test item specifications of the 21st century information communications and technology literacy skill scales for undergraduate students and 2) to develop and verify the quality a tests that make from test item specifications. The sample consisted of 301 undergraduate students, using a purposive sampling. The research instruments were evaluation form, the test item specifications, and skill tests. Data was analyzed by using SPSS and Mplus. The research findings were as follows: 1) Development of test item specifications of the 21st century information communications and technology literacy skill scales that test item specification consisted of Test objectives, Components of the 21st century information communications and technology literacy skill for undergraduate students, Test development guidelines, Table of specification, Test format, Item specification, Sample items, Scoring criteria, and Grading criteria. The quality evaluation result was in the high level (Mean=4.23, SD=0.25). 2) The tests of the 21st century information communications and technology literacy skill scales for undergraduate students is mixed-format tests containing both multiple-choice items, open-ended question items and task. The quality of the tests consisted of content validity, construct validity (Chi-square =152.429, df= 128, P=0.069, CFI = 0.958, TLI = 0.956, RMSEA = 0.025, SRMR=0.046) and reliability was in the high level (α=0.77). The result of the tests of the 21st century information communications and technology literacy skill scales for undergraduate students have average score was 21.14 points out of 35 points or 60.40 percent which was a fair level.