Cognitive Test Development
2026-09-16
The first formulation does not name an observable behavior. “Understand” could mean anything, and there is no direct way to assess whether that objective has been met. The second formulation names a specific behavior that can be measured with a single test item.
The second formulation can be turned directly into a test item. The first cannot, not until it is first translated into a more specific form.
Taxonomy
A classification system that arranges categories hierarchically, from the simplest to the most complex.
Instructional objective
A statement of what learners are expected to be able to do after a learning process, formulated as observable and measurable behavior.
These two concepts are linked: taxonomy supplies the vocabulary and structure for formulating instructional objectives at the appropriate level of cognitive complexity.
Two main changes
| Level | Definition | Example verbs |
|---|---|---|
| Remember | Recognizing or recalling information | identify, list, name |
| Understand | Explaining the meaning of information | explain, compare, summarize |
| Apply | Using a procedure in a new situation | calculate, apply, demonstrate |
| Level | Definition | Example verbs |
|---|---|---|
| Analyze | Breaking information into parts and seeing the relationships between them | differentiate, organize, relate |
| Evaluate | Making a judgment based on criteria | judge, compare, predict quality |
| Create | Assembling elements into something new | design, formulate, produce |
The revised taxonomy crosses the cognitive process dimension with the knowledge dimension, producing a 6×4 table. Each cell is a possible combination to be measured; the check marks below indicate one example combination for each type of knowledge:
| Remember | Understand | Apply | Analyze | Evaluate | Create | |
|---|---|---|---|---|---|---|
| Factual | ✓ | |||||
| Conceptual | ✓ | ✓ | ||||
| Procedural | ✓ | ✓ | ✓ | |||
| Metacognitive | ✓ | ✓ | ✓ |
Link to the blueprint
Session 2 explained that a blueprint crosses content domain with cognitive level. This table is the tool used to determine which cells are relevant to fill, and what proportion of items each should have, depending on the construct being measured.
Mager (1962) proposed formulating instructional objectives with three core components: Behavior, Condition, Degree. The Audience component was added later by other instructional design writers (not by Mager himself), forming the ABCD framework that is more widely known today:
| Component | Question | Example |
|---|---|---|
| Audience | Who is learning? | 5th-semester students |
| Behavior | What behavior is expected, stated as an observable verb? | can calculate |
| Condition | Under what conditions/with what tools? | without a calculator, within 2 minutes |
| Degree | How well/what is the success criterion? | with at least 80% accuracy |
Example instructional objective
“5th-semester students (A) can calculate the sum of two fractions with different denominators (B) without a calculator (C) with at least 80% accuracy (D).”
Relevance for test development
An instructional objective that does not use an operational verb is hard to translate directly into a test item. This is why the list of verbs in the taxonomy table (not the level names) serves as the practical reference when writing objectives and test items.
Classify each of the following statements into one of the six levels of cognitive process:
Answer key
Coming up: achievement tests
Session 4 applies this taxonomy directly to achievement tests, the type of cognitive test most closely tied to specific instructional objectives and learning material.
Any questions?
These slides were prepared using and Quarto with a template from UNAIR Theme.
Anderson, L. W., & Krathwohl, D. R. (Eds.). (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. Longman.
Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. H., & Krathwohl, D. R. (1956). Taxonomy of educational objectives: The classification of educational goals. Handbook I, Cognitive domain. David McKay Company.
Krathwohl, D. R. (2002). A revision of Bloom’s taxonomy: An overview. Theory Into Practice, 41(4), 212–218. https://www.jstor.org/stable/1477405?seq=1
Mager, R. F. (1962). Preparing instructional objectives. Fearon Publishers.