You can do this by making a question group that pulls a certain number of questions from a Question Bank. For example, you would make a Question Group (let's say, 3 questions) to pull out of a Question Bank (let's say, 10 questions). Canvas will pull a random 3 questions out of that Bank of 10, ensuring that students won't be asked the exact same questions. The question order will also be randomized.
Further resources:
