EA

> CAT > Frequently Asked Questions (FAQ)

Frequently Asked Questions (FAQ)

1	What is Computer Adaptive Testing (CAT)?
2	How does CAT differ from conventional testing (paper & pencil)?
3	Why does a student need to take part in a CAT session?
4	How does a student take part in a CAT session?
5	What happens during a CAT session?
6	When does a CAT session terminate?
7	What does a student receive after completing a CAT session?
8	How does a teacher/principal benefit after a student has completed a CAT session?
9	What are the advantages of CAT?
10	Can a task be presented more than once to the same student in a CAT session?

1	What is Computer Adaptive Testing?
	Computer-adaptive testing (CAT) is a computer based method for administering tests/assessments that adapts to the student's ability level. Therefore, it has also been called tailored testing.

2	How does CAT differ from conventional testing (paper & pencil)?
	The tasks are presented by computer with animation and multi-media effects. The assessment is conducted with diversified types of tasks and items in an interactive mode. Each student will receive different sets of tasks, selected by the computer, according to the student’s ability level.

3	Why does a student need to take part in a CAT session?
	CAT is used to assess a student’s ability in a certain subject i.e. Chinese, English, or Mathematics. After completing a CAT session, specific information on the student’s ability is provided instantly. Both the teacher and student receives immediate feedback on the student’s attainment level.

4	How does a student take part in a CAT session?
	The teacher creates a CAT session in the system (usually for a group or a class of students). The procedure is to specify the target students as well as the beginning and end dates for the session, without the need of specifying tasks to be completed. Once a CAT session is created by the teacher, the student completes the session within the time period specified.

What happens during a CAT session?

The CAT system successively selects the most appropriate level of difficulty of a task based on a student’s ability estimated from responses given in completed tasks. From the student’s perspective, the difficulty of the task assigned seems to tailor itself to his level of ability. For example, if a student performs well on a task of intermediate difficulty, he would be presented with a more difficult one. If he performs poorly, he would be presented with a simpler task.

6	When does a CAT session terminate?
	The CAT algorithm is designed to repeatedly administer tasks and update the estimate of a student’s ability accordingly. Usually, the test is terminated when the standard error of measurement of student ability falls below a certain specified value or other criteria to stop is met, such as once the time period assigned for the session is exhausted.

7	What does a student receive after completing a CAT session?
	After completing a CAT session, a student will receive basic information on the number of correct and incorrect responses. The answers for correct items in each task will be shown. For incorrect responses, further hints will be provided.

How does a teacher/principal benefit once a student completes a CAT session?

In addition to basic information of a particular CAT session for a student, the teacher/principal is provided with the estimated student ability level for that session, the expected standard and the student’s previous records. Thus, the development trend and learning progression of a student is observable. This kind of information can also be available for a group of students within a class or students in several classes at the same year level.

What are the advantages of CAT?

Compared to paper-and-pencil tests, CAT technology requires fewer tasks to arrive at an accurate estimate of students’ performance. Particularly, CAT scoring takes into account not just the number of tasks answered correctly, but which tasks are answered correctly. A student who correctly answers a more difficult set of tasks will score higher than one who correctly answers an easier set of tasks. Thus, students are continuously being challenged realistically; i.e. tasks are not too difficult or too easy for them.

10	Can a task be presented more than once to the same student in a CAT session?
	CAT keeps track of all tasks which have been used for testing a student. These tasks will not be selected again for testing the same student for a certain period of time (e.g. 3-month).