Using AI to automatically generate Comprehension tests allows you to smoothly design questions suited to the purpose of your test.
Please refer to the following and make use of this feature.
How to use the Comprehension test auto-generation feature
Let AI get you 70% of the way there, then refine it from there
Even when given the same input, AI can produce different results each time it runs.
If the generated test does not meet your expectations, it can be effective to regenerate it several times without changing your instructions.
However, trying to create a perfect test solely through AI auto-generation can actually end up taking more time.
Rather than trying to finalize everything through AI instructions alone, it is more efficient to manually apply the finishing touches once the test reaches around 50–70% completion.
Tips for writing instructions
As shown below, clearly specifying how you want the questions presented makes it easier to generate a test that better meets your expectations.
Be clear about the purpose and audience of the test
Telling the AI what kind of job the course is for and who will be taking the test, as well as describing what state you want learners to be in when they pass the test after Completing the course, helps the AI understand the content more accurately.
Example:
This course is designed for new employees to learn cash register operations.
The purpose of the Comprehension test is to ensure that staff who have Completed the course are able to carry out procedures correctly.
Please note that information which staff can look up in the Manual during work does not need to be memorized.
Specify the content you particularly want to be tested on
Within the Manual, pointing out "especially important sections" or "commonly misunderstood parts" helps ensure those areas are emphasized in the questions. Note that sections highlighted in the Manual's explanatory Text are already prioritized for question generation.
Example:
Please focus especially on questions about verifying conditions when accepting returns and how to fill out return slips.
Specify the Phrasing of questions to match learners' language level
If learners are beginners in Japanese, specifying their level allows the AI to rephrase content in plain, easy-to-understand Japanese. You can also have the AI add a translation of the original Text.
Example:
Please write in plain Japanese suitable for Japanese language beginners (equivalent to JLPT N4).
Please also include a Vietnamese translation after each Japanese sentence.
Ask for common mistakes and misconceptions to be included in the answer choices
You can have the AI suggest answer choices based on common mistakes and misconceptions that occur in actual work.
Example:
Please base the incorrect answer choices on mistakes and misconceptions that commonly occur in real work situations.
Encourage questions that emphasize "understanding" over "memorization"
Learners can retake the Comprehension test as many times as needed until they answer all questions correctly. For this reason, creating a test that checks not just whether learners have memorized content, but whether they have genuinely understood it, will result in a more effective test.
Example:
Please create questions that test understanding of the reasons and background behind procedures, rather than simple memorization.
Template for writing instructions
You can copy the following Text as-is and use it as instructions for the AI.
Example:
This course is designed for [new employees / managers / mid-career staff / part-time staff / Japanese language beginners, etc.] to learn [course content].
The purpose of the Comprehension test is to ensure that staff who have Completed the course are able to [carry out procedures correctly / perform tasks on-site without errors / understand the background of procedures and apply them flexibly].
Please note that information which can be looked up in the Manual during work does not need to be memorized.
For question content, please focus especially on [XX task].
Please write the questions in [plain Japanese / concise language] and include a [XX language] translation alongside.
For incorrect answer choices, please include common on-site mistakes and misunderstandings such as [missing entries / incorrect process flow / insufficient verification / confusion about time slots].
Additionally, please frame the questions around understanding the background and reasoning behind procedures rather than simple memorization, so that comprehension is reinforced.
Notes
- The instruction Text can be a maximum of 500 characters.
Related links
Automatically create and add a Comprehension test
https://teachme.jp/8/manuals/37317894
About Comprehension tests
https://help.teachme.jp/hc/en-us/articles/17887111054617