Skip to content

Review low-confidence questions

There are two reasons a question gets flagged as low confidence:

  1. Discrepancy between the two AI models

    Every question is marked by two AI models. The tolerance is 20% of the question’s total marks, up to a maximum of 6 marks. If the two marks differ by this much or more, the question is flagged as low confidence.

    Question worth Flagged when the models differ by
    5 marks 1 mark or more
    10 marks 2 marks or more
    20 marks 4 marks or more
    30 marks 6 marks or more
    40 marks 6 marks or more (capped)

External assessment submission page, indicating a low confidence question

  1. The question was manually flagged for review when creating/uploading the worksheet.

    External worksheet page, highlighting the flag button

Once you’re in a student’s submission, click Filter. You’ll then be able to:

  • Select questions by confidence level
  • Select specific questions to review
  • Select how to order the filtered questions

Filter by question to review window