Leveraging AI for automatic generation of comprehension tests allows for smooth design of questions tailored to the test’s objectives.
Please refer to the following and make the most of this tool.
Image of Utilizing AI to Automatically Generate Comprehension Tests
Have AI create 70% and improve it manually
Even with the same input, AI may yield different results with each operation.
If the results don't meet your expectations, trying multiple times without changing the instructions can still be effective.
However, attempting to create a perfect test using only AI may take more time.
It is more efficient to finish the test manually after achieving around 50–70% completion through AI.
Tips for Giving Instructions
Being specific about how you want the questions to be posed makes it easier to generate a test that meets your expectations.
Clarify the Purpose and Target of the Test
Explaining what job the course is for and who will take the test helps the AI understand what kind of outcome is expected when a learner passes the test.
Example:
This course is designed for new employees to learn cash register operations.
The purpose of the comprehension test is to ensure that staff, upon completing the course, can perform tasks using the correct procedures.
Note: Information that can be referenced in manuals during work does not need to be memorized.
Specify Key Points for the Questions
If you specify "important sections" or "commonly mistaken areas" in the manual, the AI is more likely to focus questions on those parts. Emphasized portions in the manual are prioritized in question generation.
Example:
Focus questions especially on checking conditions for accepting returns and how to fill out return forms.
Adjust Language Based on Learner’s Japanese Level
If the learner is a beginner in Japanese, indicating the level can prompt AI to rewrite in simpler Japanese. AI can also add translations to the original text.
Example:
Please write in simple Japanese for beginners (JLPT N4 level).
Also, add Vietnamese translations after the Japanese.
Include Common Mistakes or Misunderstandings in Answer Choices
You can instruct the AI to include common mistakes or misunderstandings in actual work scenarios as incorrect options.
Example:
Base incorrect answers on typical workplace mistakes or misunderstandings.
Prioritize Understanding Over Memorization
Comprehension tests can be retaken until all questions are answered correctly. Therefore, it is more effective to create questions that assess understanding, not just memorization.
Example:
Create questions that test whether the learner understands the reasons and background of the procedures, not just memorized steps.
Instruction Template
You can copy and use the following text as is for instructions to AI.
Example:
This course is for [new employees / managers / mid-career staff / part-timers / Japanese learners, etc.] to learn [course content].
The purpose of the comprehension test is to ensure that after completing the course, staff can [follow procedures correctly / work without mistakes / understand the background and apply procedures].
Note: Memorization is not required for information that can be referred to in the manual during operations.
Please focus especially on [XX task] in the questions.
Use [simple Japanese / concise expressions] and include [XX language] translations.
Include typical workplace mistakes or misunderstandings such as [missing entries / incorrect flow / insufficient checks / misunderstanding time periods] as incorrect answer choices.
Also, make sure the questions focus on understanding the reasons and background behind the procedures rather than just memorization.
Notes
- Instruction text is limited to a maximum of 500 characters.
Related Links
How to Automatically Create and Add Comprehension Tests
https://teachme.jp/8/manuals/37317894
What is the comprehension test function?
https://help.teachme.jp/hc/en-us/articles/17887111054617