Inspera question randomisation

Guide to randomising questions and answers in Inspera Online Assessments as permitted by the Examinations Office.
Types of randomisation Explanation Permitted by the Examinations Office Possible in Inspera Notes
Randomising answers The question is the same on all versions, but the response options (A, B, C, D) are shuffled. Yes Yes
  • If randomisation of answers is selected in Inspera, this would be treated as one exam version with multiple variations for students.
  • Real-time corrections during the exam ARE possible.
Randomising variables

The question and its response options are the same on all versions, but the variables within a response option differ.

E.g., In the same calculation, one version of the text gives students a price of $1.12 to work with but another version gives students a price of $2.43 to work with.

Yes, but with caution and only if you have an approved exemption to use Canvas

Yes, by using the question selection functionality outlined below

  • The Examinations Office advises caution on the use of this type of randomisation, even though the technology allows for it to be created, because of the complexity and potential for errors to creep in when setting and/or marking the exam.
  • Real-time corrections during the exam are possible.
Randomising question selection

The question presented to the student is pulled from a bank of x similar questions and is randomly allocated. All questions within the section have to be of equal marks and level of difficulty.

E.g., Section 1 = Question 1
Students would be randomly assigned one of the following four questions – each would be set up as a separate question in Inspera.

  • Describe the attributes of Audrey Hepburn
  • Describe the attributes of Humphrey Bogart
  • Describe the attributes of Katherine Hepburn
  • Describe the attributes of James Dean
Yes

Yes, noting the ‘pull question’ functionality used in Inspera can also be used in a way that would result in random question order which is not allowed

  • This should be used with caution, as one question could be harder/easier to answer than the other and could cause inequities between students.
  • This can be used with any question type only if each question has the same maximum marks and should only be used where the questions are similar in nature and difficulty.
  • To achieve this, use the Inspera Assessment functionality of Sections in question sets and “pull questions in a section”.
  • Although Inspera functionality does enable ‘pulling’ multiple questions into a section, this is not permitted as it would create a randomising of the order of questions.  It is recommended only one question should be pulled from a few options into a section. This will enable students to easily locate any corrections.
  • It is also important to note that enabling ‘pull’ in sections means markers will not be able to quickly navigate through candidates focusing on one question option at a time; a marker will be presented the question option presented to the student for that section.
Randomising question order

The questions are the same, but the students see them in a different order.

The sequence in which question 99, say, appears would be different for each student.

No Yes
  • Current limitations with the functionality for updating and advising corrections do not enable this to be a viable option.
  • Altering the order of questions can lead to omission of questions and anomalies in the answer sheets.
  • Randomisation of question order makes it problematic to issue correction notices during an exam. It creates uncertainty and increased anxiety for students who raise queries during the exam about a potential error that we are unable to resolve. When an error isn’t resolved quickly during an exam, we receive increasing numbers of student queries, and then complaints following the exam, with claims that the unresolved error caused students to become distracted throughout the rest of their exam, impacting their performance. We do not have robust processes for identifying those exams with randomisation nor functionality to easily communicate issues or make and communicate corrections.  We will be exploring opportunities to improve functionality and processes for Semester 2 to determine if this could be an option going forward.
Randomising question selection and order

Different questions appear on different versions of the examination.

Each student receives a random set of y questions from a test bank of z questions.

No Yes
  • Current limitations with the functionality for updating and advising corrections do not enable this to be a viable option.
  • This functionality would certainly reduce the possibility/ability for students to cheat. However, the strong concerns around it are around equity/fairness to all students. It is simply not possible to say that all questions within a test bank would have a similar level of difficulty and so some students might randomly be being given a “harder” section of questions than others (even if, say, they are grouped into easier, medium, and harder questions and each student received three questions from each category).
  • Since students would randomly be receiving completely different questions, real-time corrections would not be possible.

 

Resources

View the Inspera guide to the randomisation of MCQ options.

Send us some feedback

Please let us know how we can improve this content. For all other enquiries, visit the Staff Service Centre
* Required field

Remote Learning site

This form is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.