In fact, there are many different types of questions which educators can use to assess learning outcomes. However, it might be a challenging task for writing good test questions measuring learners’ capability correctly. This article will explain in detail some rules to write effective Multiple Choice Questions, one of the most widely used methods for testing learners’ knowledge.
Basically, multiple choice questions are pick-one questions having only one correct answer. Other choices act as the “distractors” which are meant for drawing learners’ attention away from the real answer. Every multiple choice question contains two parts: stem and alternatives. Particularly, stem is the question part comprising the problem needs to be solved. While alternatives part consists of the various options from which learners choose one correct answer.
Now, keep reading to explore some rules for designing stem and alternatives in details.
Rules for Writing Stem
Rule #1: Checking Comprehension and Improve Higher-level Thinking
When it comes to improving learners thinking, it reminds us to Bloom’s Taxonomy theory. According to Bloom, there are six levels within the cognitive domain: Remember, Understand, Applying, Analyze, Evaluate and Create. This means the last goal of using different question types in the lesson not only remember or understand knowledge but also judge and create new things. Hence, multiple choice questions have to take on many tasks. Checking comprehension as well as helping learners develop their higher-level thinking such as problem-solving, critical thinking, creativity. So, don’t waste time with the questions assessing knowledge of trivial facts.
Here’s a simple question to test learners thinking:
To pick answer for this question, learners have to analyze and find out the rule of the series.
Rule #2: Using the Question Format
On the whole, it is a good way to start the multiple choice questions with question words. If you want to test learners’ factual knowledge, you can use “what”, “who”, “when” and “where” questions. Additionally, “which”, “why” and “how” questions are recommended to test learners’ applying and analyzing knowledge. Using simultaneously question words with simple structure help learners have clear orientation on what they should find out in the answers. Moreover, “The stem would be presented in the form of a clear and complete question, focusing on getting a clear answer rather than holding a partial sentence” (Statman, 1988). In other words, a full sentence ending with a question mark is preferable than a sentence with blank.
For example, it is a less effective stem that: “Black cabs” is famous in __________. Now, we need to restructure the sentence like this:
Rule #3: Expressing Full Information
This means that the stem should be meaningful by itself and show problem plainly. That would be great when learner can answer your question without looking at the options. As a master of fact, if a stem doesn’t present problem clearly, it may be ambiguous for learners to answer or even become daunting.
In addition, the question stem should be placed most of words to make answer options shorter. This way, the answer options can be short with key words to make learners more legible. For example, it’s not wise when giving this question to learners:
Which of the following statements is true?
A. Melbourne is known as the Fashion Capital of the World.
B. Milan is known as the Fashion Capital of the World.
C. St Petersburg is known as the Fashion Capital of the World.
D. Rome is known as the Fashion Capital of the World.
So, if you want to see a better change, here is a suggestion:
Rule #4: Removing Unnecessary Information
As said earlier, the question stem should contain sufficient information. However, sufficiency does not mean including too many things, even unnecessary information.
In many researches, multiple choice questions are highly assessed by their versatility, reliability and validity. Thus, if you put many unnecessary materials in stem, it “can decrease the reliability and validity of the test scores” (Haladyna and Downing, 1989). This is one example of a bad multiple choice question:
Nowadays, there are many types of pollution. Air pollution is one of the biggest threats to the environment and affects everyone: humans, animals, crops, cities, forests, aquatic ecosystems… Air pollution can be decreased when we:
A. Use private vehicles
B. Burn fossil fuels
C. Use public transportation
D. Cut down trees and forest
A better suggestion is:
Rule #5: Avoiding Negative Word
In fact, learners often have difficulty understanding items with negative phrasing (Rodriguez, 1997). If test-takers are familiar with the material, negative word can confuse them because they don’t initially observe it. As a result, they may make mistakes when answering negatively worded stems. However, in case you must use it, highlight the negative word in uppercase or bolding them so that it is obvious to learners. So, instead of writing: Which country does not have a king or queen? It is better for writing like this:
Rules for Writing Alternatives.
Rule #1: Using Only One Best Answer
As mentioned before, multiple choice questions are questions type having one-best-answer-items. So, there should be only one option which is clearer than the other options. If not, it will make learners confused and difficult to decide which is most correct. For example, four options in the below picture make learners bewildered which more correct. Neither is correct all of the time.
Rule #2: Making Options Similar in Grammar and Length
Undoubtedly, alternatives should be stated clearly and concisely. Thus, make sure all the options are grammatically parallel to each other. This will make learners think carefully to find the correct answer instead of basing on grammar mistakes. What’s more, don’t use answer length as a hint to find correct option. In some cases, learners tend to guess the answer depends on its length. Often the longest is the most correct. However, if you cannot manage all four options to the same length, use two long and two short. Here is an example of a question with parallel grammatical answers:
Rule #3: Keeping the Distractors Plausible
It is clear that the function of the incorrect options is to distract learners’ attention. Thus, you may evaluate who is really comprehend and concentrate on the course content. If the distractors are farfetched, test-takers will locate the correct answer with ease, even if they have little knowledge. So, making all options plausible to avoid learners guessing the correct answer. In this example, it’s quite easy for learners to realize the difference between all options and it is unlikely that learner would pick the options A, C or D.
What is NOT the benefit of the forest?
A. Increase soil erosion
B. Cleaning the air
C. Providing oxygen
D. Reducing climate change
A better alternatives part should be:
Rule #4: Avoiding Using “All of the above” or “None of the above”
These options are not nice for alternatives. Here’s why. All of the above seems to be obvious give-away answer. To put it in another way, this helps learners can pick right option even if unsure about other alternatives. If they elicit two of the options are correct, the answer must be All of the above, definitely. Whereas, if they find one is wrong, the answer must not be All of the above. Many test-takers tend to read the first option, determine that is correct or not and be misled into choosing it without reading all of the options.
Likewise, None of the above is useless. This option does not test whether learners know the right answer, but only that they know the distractors are not correct.
Additionally, thinking cautiously when using words such as all, always, never, or none. Most learners know that few things are universally right or wrong, so alternatives with these words in them can often be easily dismissed. So, you should refrain from using these words.
Rule #5: Varying the Order of the Correct Options
It is necessary to distribute randomly the correct response. Make sure that most of your correct options aren’t in the “B” or “C” positions, which can often happen. So, don’t let the order of the true answers becomes a hint for learners. When you complete writing multiple choice questions, go through and reorder the place of the correct answers.
Tip: Limit the number of alternatives from 3 to 5 options to make your question objective.
All in all, you get all the basic rules to write effective multiple choice questions. Hope that this helps you a lot. Download ActivePresenter from now on and try to create your own multiple choice questions with these rules.