Quizzes and exams often make one crucial pedagogical mistake: they do not ask enough reasoning questions. Reasoning questions, simply put, are questions that ask about the reason why an answer to another question is correct. For any given quiz or exam question, there is always an implicit chain of reasoning from the given information to the correct answer. It is the ability to correctly follow this chain of reasoning that should allow students to obtain the correct answer if they genuinely understand the material and can follow that implicit reasoning process.
Let’s look at a simple example of how reasoning questions can be used to make formative assessments, quizzes, and exams more effective. Consider the following example of a typical quiz question that you might find in any college-level critical thinking course:
Example 1:
Consider the following argument: Because Colorado is west of Virginia, and because Nevada is west of Colorado, it follows that Nevada is west of Virginia. This argument is deductively (sound / unsound). |
In this simple example, the correct answer is that the argument is deductively sound. But there is an implicit chain of reasoning from the given information in this example to the correct answer. In order for an argument to be deductively sound, the argument must first be deductively valid (namely, the conclusion must follow by necessity from the premises), and the premises must actually be true.
The problem with the quiz question in Example 1 is that it does nothing to draw out the reasoning steps involved in obtaining the correct answer. It would be much more effective to have a series of questions that require the student to explicitly state the correct answer to a separate question about every step of the reasoning process, as shown here in Example 2:
Example 2:
Consider the following argument: Because Colorado is west of Virginia, and because Nevada is west of Colorado, it follows that Nevada is west of Virginia. This argument is deductively (valid / invalid) because the conclusion (follows / does not follow) by necessity from the premises. The two premises of this argument (are / are not) both true. Therefore, this argument is deductively (sound / unsound). |
Example 2 has several advantages over Example 1:
Almost any simple quiz or exam question, no matter the subject matter, can benefit from being split into at least a two-part question, with the second part asking students to provide the reason(s) why the overall answer to the first part is correct. Or, in the case of a more complex reasoning process, as shown in Example 2, the overall answer can be treated as the last step in a chain of questions, each of which holds students accountable for a separate step in the reasoning process to obtain that correct answer.
The reason that this approach to more sophisticated quiz and exam questions is so broadly extensible is that there is always an implicit reasoning process, or a conceptual gap, however large or small, between the given information in a quiz or exam question and the correct answer. So there is always room to find at least one additional question holding students accountable for the intermediary reasoning process linking the given information to the overall correct answer.
My rule of thumb for increasing the use of reasoning questions in objectively graded quizzes or exams is to avoid single-instance questions that are not explicitly linked to at least one other question, whether as a follow-up question asking about the reasoning behind the correct answer or as a series of questions to hold students accountable for every step in the reasoning process to obtain the correct answer. Quizzes and exams written in this way are more pedagogically helpful for students, as the quizzes themselves become a teaching tool reinforcing the correct or normative reasoning processes students should be mastering. They also do a better job of gauging student comprehension and localizing the source of student errors or conceptual misunderstandings. And they are mathematically more difficult for students to guess their way through without genuine mastery.
Categorized as: Instructional Design
Tagged as: Arguments, Comprehension, Course Writing, Critical Thinking, Deductive Arguments, Examples, Exams, Instructional Design, Logic, Pedagogy, Quizzes, Reasoning, Reasoning Questions, Remediation, Soundness, Tests, Validity