pisa.kzAn independent open project about PISA

№ 004 · Media & AI literacy · Critically evaluate information

Let's check the chatbot's answer

Students spot the signs in a confident AI chatbot answer that call for checking, and suggest ways to verify it.

Material for students

A · a student's question and the chatbot's answer

“Does homework improve results?”

Chatbot: “Yes, this is proven. A 2021 Harvard study showed that students who do 3 hours of homework a day score 40% higher. So the more homework, the better.”

B · school library guide

How to check information

  • Find the source: author, year, where it was published.
  • Compare the information with at least one independent source.
  • Watch out for words like “proven” and “everyone knows”.
  • Check whether the conclusion goes beyond the data.

Questions

1. Name three signs in the chatbot's answer that call for checking.
2. Using guide B, describe two concrete steps to check the answer.
3. How could you rephrase the question to the chatbot so that the answer is easier to check?

Teacher's guide

Skill: approaching AI output critically: asking for sources, checking claims, judging whether conclusions match the data. This links to the PISA 2029 innovative domain, Media & AI Literacy.

Full answer: 1) A specific study is named without a reference; the confident “proven”; the conclusion “the more, the better” goes beyond the data; round numbers (3 hours, 40%). 2) Search for the named study, its author and publication; compare with other sources. 3) For example: “Give references to studies on this topic and tell me where the evidence is weak.”

Typical mistake: saying in general that “AI can be wrong” without naming specific signs.

In your subject

History

Check a “quotation” given by AI against the original source.

Biology

Compare AI health advice with an official medical source.

Languages

Find and mark every factual claim in a text written by AI.

I used this task

Which grade and subject did you use it in, and how did students respond? Your experience helps improve the next tasks. Please do not include students' names or personal data.

How to take part