WEBVTT 1 00:00:03.419 --> 00:00:15.120 Brian Klaas: Excellent. Alright. So let me start over again. Hi, my name is Brian class. I work in the Center for Teaching and Learning. I also am an instructor in the school's rise center that's part of mmm I 2 00:00:15.450 --> 00:00:26.580 Brian Klaas: And many of you know me as the course plus guy, you know, the course plus person. And that's true, but I am one of a team of people who work on course. Plus, who has been very busy. 3 00:00:27.150 --> 00:00:36.540 Brian Klaas: In the last few months, making updates to all sorts of aspects of course. Plus, but particularly the quiz generator tool to try to 4 00:00:37.200 --> 00:00:45.990 Brian Klaas: Improve the functionality and meet some of the requests and needs around flexibility randomization security that 5 00:00:46.800 --> 00:00:56.640 Brian Klaas: Now that everyone is in the virtual teaching environment has really been requested. And so that's what I'm here to do today I'm here with saline green also from the Center for Teaching and Learning 6 00:00:57.210 --> 00:01:00.990 Brian Klaas: Who is going to be sort of helping out here and putting stuff in the chat as she has already done. 7 00:01:01.440 --> 00:01:12.210 Brian Klaas: Please feel free to ask questions in the chat. You can also unmute yourself and just ask questions and jump in. I have set that in the setup for this today's meeting. 8 00:01:12.780 --> 00:01:15.270 Brian Klaas: The session today probably won't go the full hour 9 00:01:15.900 --> 00:01:28.260 Brian Klaas: Because again, I'm really focusing on an update to what's new in course plus really in the last couple of months. This isn't an introduction to course plus session. This is a session that focuses on new features some pretty major new features. 10 00:01:28.650 --> 00:01:33.060 Brian Klaas: In the last few months. And I just want to walk you through it and give you an opportunity to ask me questions. 11 00:01:33.300 --> 00:01:39.780 Brian Klaas: Or say, hey, can you do this or does it do this or could you make it do this hearing your feedback as well as also super important. 12 00:01:40.050 --> 00:01:47.910 Brian Klaas: And the great thing is, is that really everything. I'm going to show you today has already been used in some capacity by different faculty in different classes. 13 00:01:48.090 --> 00:01:59.940 Brian Klaas: Some very large classes and smaller ones. So we know it's out there and it's working. And I just want to try to give you an idea of what some new options you have in the quiz generator, because since April. 14 00:02:00.390 --> 00:02:10.170 Brian Klaas: We have the course my Steam has introduced 24 new features like completely new feature is not like changing a word is not a feature but like features and abilities and capabilities. 15 00:02:10.410 --> 00:02:18.810 Brian Klaas: In the quiz generator and that's a lot. That's a lot for anyone to keep track of. And that's why we kind of wanted to do this session here today. Something we had heard 16 00:02:19.500 --> 00:02:21.420 Brian Klaas: In some of the deans workshops that 17 00:02:22.050 --> 00:02:32.490 Brian Klaas: You know, faculty, like, well, how do I do use these things and the quiz generator and we wanted to give you an opportunity just to have a walk through and see how to use some of these tools and I'm not going to get to all 24 today. 18 00:02:32.940 --> 00:02:43.980 Brian Klaas: But I'm going to try to cover. Certainly the big ones here and I'm going to be sharing with you today a website that we have set up called the CCL exemplary and best practices site. 19 00:02:44.370 --> 00:02:54.060 Brian Klaas: And any faculty member or academic staff member at the school can get access to the site you can email me. You can email saline, you can contact CT. I'll help and just say, hey, 20 00:02:54.390 --> 00:03:00.660 Brian Klaas: Brian showed that that best practices website and it looked like it had some interesting stuff in there. Could you could I get access to that to see 21 00:03:00.960 --> 00:03:08.130 Brian Klaas: Yes, you can just ask. That's all you have to do is just send one of us an email. See, to help was probably the best person to contact 22 00:03:08.370 --> 00:03:14.820 Brian Klaas: Our best group to contact to say, can I get access to this website so that you can see all of the examples I'm going to show you today. 23 00:03:15.180 --> 00:03:27.060 Brian Klaas: In case I go too fast or you need more time to look at things. And again, as we go along. If you have questions just jump in, in the chat unmute yourself, raise your hand, whatever you're comfortable with. 24 00:03:28.470 --> 00:03:40.080 Brian Klaas: I'm here to answer those questions for you. Okay, let's get started. So the very first thing I'm going to show is something that we introduced to course plus I think three weeks ago, maybe four weeks if that 25 00:03:40.710 --> 00:03:48.780 Brian Klaas: Three weeks ago maybe the combo question. So let's start with looking at the combo question I'm going to switch over to my web browser. If I can find it here we are. 26 00:03:49.080 --> 00:03:57.480 Brian Klaas: Alright, so here we are. And our web browser. Hopefully everybody can see that this is the CTO exemplars and best practices site where we have this 27 00:03:58.200 --> 00:04:06.420 Brian Klaas: These all the demos that I'm going to be doing here today. And so the combo question is a new kind of question that 28 00:04:06.780 --> 00:04:19.950 Brian Klaas: Combines multiple choice with match from two lists with a couple of other interesting possibilities and rather than go into lots of verbal detail about what this looks like. Let me show you some examples of combo questions. 29 00:04:21.420 --> 00:04:24.660 Brian Klaas: So if you look here. Question number 12 30 00:04:25.680 --> 00:04:33.780 Brian Klaas: There is this. There's a tech question is based on the above DATA COMPLETE. The table below. Well, there's no above data there. This is just for demonstration purposes. 31 00:04:34.320 --> 00:04:42.660 Brian Klaas: But you'll notice that there's a table here and apparently there are multiple correct answers that I can put in this table. 32 00:04:43.290 --> 00:04:52.410 Brian Klaas: Well, that's a combo question a combo question allows you to do essentially drop downs, multiple choice questions in combination inside the same question. 33 00:04:52.920 --> 00:05:02.640 Brian Klaas: Another example would be this one right here where we have a paragraph of text and in that paragraph of text, you have to spit choose specific words. 34 00:05:02.910 --> 00:05:07.980 Brian Klaas: So let me show you what this looks like with I actually preview this quiz, what this actually looks like here. 35 00:05:08.910 --> 00:05:14.670 Brian Klaas: So just go in here a preview and I'll scroll down because these questions are at the bottom. So here's my table that I was talking about earlier. 36 00:05:15.330 --> 00:05:25.500 Brian Klaas: And so in this table I'm asked to make calculations and select the correct answer for each of the cells in the table. So this is a simple, you know, 37 00:05:25.800 --> 00:05:35.610 Brian Klaas: Edition problem, right. So I know that 86 plus 19 is 105 and 16 plus 79 is 95 and the total is going to be 200 down here. 38 00:05:36.090 --> 00:05:43.770 Brian Klaas: So a combo question again allows you to put multiple drop downs in multiple places in a question. So here's that other one where 39 00:05:44.310 --> 00:05:53.340 Brian Klaas: In the middle of a it was a sentence right where we have a whole sentence here. And so in this lecture we discussed how we spend our time communicating we spend most of our time 45% 40 00:05:54.270 --> 00:06:04.500 Brian Klaas: Listening hopefully people listen. Next we spend about 30% speaking and we spend 60% of our time communicating by reading while we spend the least time 9% writing 41 00:06:04.920 --> 00:06:17.340 Brian Klaas: So there you go. So it's. Think of it as a sort of match from to list question on steroids. Another example here on the combo question is, you know, this looks like more of a traditional match from to list choice. 42 00:06:17.730 --> 00:06:22.680 Brian Klaas: But it's put into a table and you can have as many of these are I think you can have up to like eight different 43 00:06:24.000 --> 00:06:32.310 Brian Klaas: Eight different combo questions or eight different you know drop downs in our show a different choices in as many drop downs, as you want inside of this 44 00:06:32.910 --> 00:06:37.290 Brian Klaas: So you'll want to know, can you assign three points this question, one for each correct answer. Absolutely. 45 00:06:37.500 --> 00:06:44.880 Brian Klaas: And this example, I only assigned one point but in the quiz generator. You can absolutely assign different point values to each and every question so 46 00:06:45.090 --> 00:06:52.200 Brian Klaas: If in this table example, if this is worth three points each one of these questions would be worth one point. 47 00:06:52.710 --> 00:07:01.110 Brian Klaas: And this is something I'm gonna cover in a little bit. You have the, you know what, I'm just gonna go back and show you what this looks like to edit that question because it will help me show you 48 00:07:02.670 --> 00:07:11.370 Brian Klaas: The various options that you do have. So I'm going to actually go down here and skip over the creation of it for right now because this gets to to Eli's question. 49 00:07:11.940 --> 00:07:18.060 Brian Klaas: In addition to saying it's worth three points that each one of these is worth one point you can say allow partial credit 50 00:07:18.360 --> 00:07:24.630 Brian Klaas: You can allow full or no credit means they means they need to get everything right, or they get nothing. Right. Or they can get partial credit 51 00:07:24.930 --> 00:07:36.990 Brian Klaas: Now in partial credit, you can choose to either penalize the student for each incorrect answer that means they'll get points subtracted for each correct answer or say, No, you're not going to get penalized. You'll just 52 00:07:37.710 --> 00:07:43.350 Brian Klaas: Get a point for each one, you do get correct. So there's some flexibility in that question as well. 53 00:07:44.340 --> 00:07:51.060 Brian Klaas: So to create a combo question really got to think about sort of the layout of this thing first. I gotta think about this ahead of time. 54 00:07:51.450 --> 00:07:59.910 Brian Klaas: Because what the quiz generator will ask you to do is to put in your answers first and you can have answers, by the way, that don't match anything at all. 55 00:08:00.390 --> 00:08:09.840 Brian Klaas: That's it's totally something you can do. You can put I can put like additional ones in here like 173 and 190 things that don't match anything 56 00:08:10.350 --> 00:08:18.990 Brian Klaas: At all I could do that. And that would be perfectly fine, because that's a feature of the combo question and then down here when I actually create my question. 57 00:08:19.920 --> 00:08:28.800 Brian Klaas: So I've created that same table in here and in where I want to put these placeholders or say that this is the where the correct answer goes, we just say 58 00:08:29.430 --> 00:08:36.480 Brian Klaas: Go in here. I'll delete this about I'll say, let's say, a answer number four was the correct thing to put in here. 59 00:08:36.780 --> 00:08:49.320 Brian Klaas: I type bracket, bracket and the quiz generator says, Oh, you're typing. One of the answers and I can select that there and the quiz generator knows that answer. Number four is the correct thing to put in that location. That makes sense. 60 00:08:50.490 --> 00:08:56.970 Brian Klaas: We go back and show you one more example of this of editing the question and I go back up here to this one, where we have the sentence, 61 00:08:57.390 --> 00:09:05.610 Brian Klaas: Again, you know, we just put in when we're editing the questions we put bracket, bracket, and then the number and that says this is the correct answer. 62 00:09:06.030 --> 00:09:13.830 Brian Klaas: From this list up here. So number answer number one is listening. That's the correct answer, answer number two is speaking. That's the correct answer. 63 00:09:14.190 --> 00:09:21.780 Brian Klaas: Answer. Number three is the correct answer. And I can put another one here, you know, I could put sending email I can actually type that out. 64 00:09:22.410 --> 00:09:33.570 Brian Klaas: And that's how you would do it at something I didn't match anything at all. And again, although you're limited to eight separate answers. You could have things repeated there. Oh, people can unmute themselves. 65 00:09:34.710 --> 00:09:42.840 Brian Klaas: Whoops, sorry about that. Celine. Yeah, sorry, I don't like zooming in too much because it sort of like can break the layout to some of these pages, but I just zoomed in a little bit. Hopefully that'll help people. 66 00:09:43.230 --> 00:09:56.220 Brian Klaas: So that's the combo question. It's pretty powerful because you can mix and match things you can have questions that don't match anything at all. You can have questions that were the same answer is match multiple times. That was something that was really difficult to do in 67 00:09:56.790 --> 00:10:08.220 Brian Klaas: The in the quiz generator before with match them two last questions. But here's an example of something where the same answer. You can see answer one is used twice here so you can now do 68 00:10:08.550 --> 00:10:18.750 Brian Klaas: Instead of match them to list questions, you really can't do this because it's just your matching purely text, but in combo questions, you can say this answer is the correct answer. In case you know 69 00:10:19.290 --> 00:10:29.670 Brian Klaas: Two, four, and six, you know, or the third and fifth instance answered a drop down. This has the same answer. So that just provides focuses more flexibility, I'm 70 00:10:30.360 --> 00:10:41.760 Brian Klaas: Evan. He says that we want to add a short answer component would allow us to to provide an explanation allow us to do that. Yeah, absolutely. I'm just understand that the short answer isn't graded necessarily 71 00:10:42.300 --> 00:10:50.160 Brian Klaas: So there is this this option in here in case you don't know, you can say, should the student be allowed to provide an explanation of their answer to this question. 72 00:10:50.850 --> 00:10:59.010 Brian Klaas: You can say yes. In this case, Ebony, and so that the student can type in, here's my short answer component to this. The problem is, is that 73 00:10:59.490 --> 00:11:11.820 Brian Klaas: The combo question is an automatically graded question type because it's matching from a list, essentially. So it's automatically graded. So if you wanted to also have a short answer component 74 00:11:12.510 --> 00:11:18.450 Brian Klaas: You would either have to go back and manually adjust everybody's score upward or downward 75 00:11:19.020 --> 00:11:23.430 Brian Klaas: Which can be time consuming and students be confused, if you like, but the system shows me. I got it right, but 76 00:11:24.090 --> 00:11:28.800 Brian Klaas: It says, I only got four out of five points. Well, because your short answer version wasn't so good. 77 00:11:29.250 --> 00:11:37.560 Brian Klaas: A better option in this case would be to create both a combo question and an essay question and put them in a block together. 78 00:11:37.740 --> 00:11:52.080 Brian Klaas: So they appeared one immediately after the other, and then you just split the points between those two questions that would really be the best way to do it because then you can grade the essay question completely independently of the combo question make sense. 79 00:11:52.410 --> 00:11:52.860 Ebony Moore: Yeah. 80 00:11:52.890 --> 00:11:58.050 Ebony Moore: Thanks Brian that directly been doing, but I just got excited when I saw it and I was like, oh, we can do it all. 81 00:11:58.110 --> 00:12:07.650 Brian Klaas: Oh yeah, yeah, I know the answer explanation is useful. Um, but it's, you know, you'd have to manually recreate everything which wouldn't be super fun. Yeah, no. 82 00:12:07.710 --> 00:12:08.550 Ebony Moore: Got it. Thank you. 83 00:12:09.540 --> 00:12:11.040 Brian Klaas: My pleasure. Okay. 84 00:12:11.100 --> 00:12:11.970 Ebony Moore: Next up, 85 00:12:12.150 --> 00:12:20.250 Brian Klaas: This is really exciting. This is something that's been used in a couple of classes and I am actually using this in my communications practice courses that I teach 86 00:12:20.970 --> 00:12:32.040 Brian Klaas: This I have two of them. This term. And that's tag rule based quizzes. So let me show you what that looks like. So just as a sort of introduction. I'm not. I don't know if everyone is aware 87 00:12:32.940 --> 00:12:41.280 Brian Klaas: But questions in the quizzes generator can have tags associated with them. And these are tags that you come up with 88 00:12:41.790 --> 00:12:46.440 Brian Klaas: Just like hashtags on a tweet or something like that that you come up with that help you define 89 00:12:47.100 --> 00:12:51.870 Brian Klaas: What this question is about. Did it come from the lectures. Did it come from the readings. Is it multiple choice is it 90 00:12:52.410 --> 00:12:57.150 Brian Klaas: Based on content in week one. Is it based on the content from particular faculty member or author 91 00:12:57.780 --> 00:13:07.560 Brian Klaas: Does it cover a specific topic area, whatever it is you can add these tags to questions. And people have done this in small amounts in the past so that 92 00:13:07.800 --> 00:13:18.300 Brian Klaas: They can sort of organize and be like, Oh, I can you know search I when I'm in my question bank here, or I'm adding questions to a quiz. I can search by tag. So actually, if I go over to the quiz view. 93 00:13:19.080 --> 00:13:26.400 Brian Klaas: In here, and I go to my question manager and I go to Edit add, edit, remove questions. 94 00:13:26.910 --> 00:13:34.290 Brian Klaas: It'll come up and I can actually search by tags. I can click on the essay tag and see only questions that are tagged with the essay tag. 95 00:13:34.530 --> 00:13:46.710 Brian Klaas: If I want to look at the readings tag. I can click on that and see only questions that are tagged with reading this is a, it's a way of quick more quickly, putting together the questions for your quiz or exam. 96 00:13:48.660 --> 00:13:56.400 Brian Klaas: But we've taken that feature a big step forward by introducing what we call tag rule based quizzes. 97 00:13:56.910 --> 00:14:09.060 Brian Klaas: Quizzes that where you set up specific rules that say I want three questions with the essay tag. And I want to questions with the lectures tag. 98 00:14:09.720 --> 00:14:17.640 Brian Klaas: randomly pick those questions from any question in my quiz. That's tagged that way and show that to the student 99 00:14:18.510 --> 00:14:29.190 Brian Klaas: So what this does is it allows randomization, which is always a good thing in terms of security on exam right randomization is a very powerful way of helping to ensure academic integrity. 100 00:14:29.460 --> 00:14:37.320 Brian Klaas: On an exam. It makes it so much harder for students cheat when they're not seeing questions, let's say in the same order makes it even harder to cheat. 101 00:14:37.620 --> 00:14:46.050 Brian Klaas: When they're not even seeing the same questions when different students get different questions right that makes it even harder for students to cheat. 102 00:14:46.800 --> 00:14:55.200 Brian Klaas: But when you're in that point you want to be like, you know, the problem with pure randomization. It's like, well, but then someone might get an exam that's relatively easy or 103 00:14:55.770 --> 00:15:07.200 Brian Klaas: Exam. That's really hard, or they're not getting adequate coverage in terms of content. So tag rule based quizzes allow you to ensure adequate cover of content and even question types. 104 00:15:07.560 --> 00:15:12.810 Brian Klaas: So let me show you what this looks like. So if you want to do a tag roll quiz in the setup. 105 00:15:13.680 --> 00:15:22.680 Brian Klaas: There's an option to do this, I'm going to scroll down through this that up down here and it's down here in the question of display all questions or use a subset 106 00:15:23.100 --> 00:15:28.920 Brian Klaas: And in this case, you're going to say I want to do a subset of questions and then the type of subset is either purely random 107 00:15:29.430 --> 00:15:33.570 Brian Klaas: Meaning is just going to randomly Paul five out of 10 questions that you've assigned to this quiz or 108 00:15:34.170 --> 00:15:41.790 Brian Klaas: randomly select from tag based rules. That's how you turn this feature on is to say randomly select from tag base rules. So what are the tag based rules. 109 00:15:42.090 --> 00:15:49.920 Brian Klaas: Look like I'm going to go down here again in the question manager to edit tags selection roles and this is what they look like in this particular quiz. 110 00:15:50.640 --> 00:15:59.820 Brian Klaas: So you can create a rule, it's pretty easy to do, you just select a tag from your that's that's already been established on questions in your quiz. 111 00:16:00.330 --> 00:16:04.560 Brian Klaas: This system shows you how many questions will actually match that tag. And I'll say, 112 00:16:05.190 --> 00:16:13.590 Brian Klaas: Okay, one. So, in this particular case if there's only one question that matches that tag. This is a really good way of saying everybody in the class has to answer this question. 113 00:16:13.980 --> 00:16:18.660 Brian Klaas: So, for example, what some faculty who have already been using this feature have done is they've said okay 114 00:16:19.080 --> 00:16:27.870 Brian Klaas: Everybody's going to get like 15 multiple choice questions, but they're all going to get this one essay question with this one special tag. 115 00:16:28.080 --> 00:16:33.990 Brian Klaas: And that way, everybody gets random multiple choice questions, but everybody has to answer the same essay question. 116 00:16:34.380 --> 00:16:48.300 Brian Klaas: Again tag rules allow you to have that kind of power in your quizzes. So here I've set up, you know, a different number of rules. I want one question that matches both the lectures and multiple choice tag. 117 00:16:48.720 --> 00:17:06.030 Brian Klaas: I want to questions that match the multiple choice quiz tag by itself. I want one match from to list. I want one numeric value and to true false questions. So no matter what version of the quiz. People see they'll always see seven questions total 118 00:17:06.390 --> 00:17:21.360 Brian Klaas: That match these rules up here and then I can test these rules to see what will look like when the students do this are my rules you know working the way I expect them to. And I'll go over here to test rules. And yes, I can do this and it will randomly generate 119 00:17:22.410 --> 00:17:33.090 Brian Klaas: Questions, how that, how would it work for students and I'm pulling on those tags and it shows you what tags got matched to bring up that question. I'm actually going to pop over real quick. Since 120 00:17:33.390 --> 00:17:43.410 Brian Klaas: I'm here and show you how this works in one of my classes that I'm teaching right now. So there's a I have a, I have a quiz with 32 questions. 121 00:17:44.250 --> 00:17:51.990 Brian Klaas: That covers the Lectures and readings from the first week of the class and then each student will only see a subset of that. So I'll go into my question manager. 122 00:17:52.200 --> 00:18:01.260 Brian Klaas: I'll go to my tag selection rules here and each student is only going to see 15 questions again there's 32 questions in my question bank. They're only going to see 15 questions. 123 00:18:01.500 --> 00:18:12.840 Brian Klaas: And so in here. Everybody's going to get to true false questions that are based on the lectures to true false questions that are based on the swab ish book that they were required to read in the first week of the class. 124 00:18:13.620 --> 00:18:19.890 Brian Klaas: For questions that are based on the lectures that are multiple choice and that are about the science of learning. 125 00:18:20.520 --> 00:18:33.510 Brian Klaas: To multiple questions. Two questions that are multiple choice from the swan Swan book and then five more questions that came from the lectures that are multiple choice and I can test this out. And again, it's going to show me. 126 00:18:33.900 --> 00:18:42.030 Brian Klaas: The how each question was matched and then shows me the different sort of ways in which stuff, students can get assigned those questions and if I really want to see it as a student. 127 00:18:42.480 --> 00:18:54.510 Brian Klaas: I can go in here test that quiz out and I will get my randomly assigned questions, just like anybody else, any other student in here. So they're displayed in a random order. 128 00:18:54.900 --> 00:19:04.890 Brian Klaas: And they're randomly selected based on these tag rules. So again, tag rules are really, really powerful when it comes to 129 00:19:05.400 --> 00:19:17.040 Brian Klaas: Making a quiz that has a high degree of randomization, so it's hard for students to cheat, but also ensures that there's adequate coverage in terms of the content. 130 00:19:17.610 --> 00:19:28.530 Brian Klaas: It's really powerful. It's not hard to set up the challenge with tag rule quizzes. The big challenge is you have to add tags to all of your questions. 131 00:19:28.920 --> 00:19:37.290 Brian Klaas: And, you know, if you have. I know everything works on some of the AP exams that can be a lot, right, that you can have. I don't send the files. They have a few hundred 132 00:19:37.560 --> 00:19:43.710 Brian Klaas: hundred hundred questions and adding tags to all those is really time consuming. It's a great opportunity for a TA to come in and do like 133 00:19:43.920 --> 00:19:58.980 Brian Klaas: You know 1012 hours of work and pay them to do that. So you don't have to tag it yourself. But once those tags are there. They're there for that and all your quizzes all your future classes if you copy a quiz from one class to another those tags get copied over there as well. 134 00:20:00.690 --> 00:20:14.400 Brian Klaas: And yes, right. So you just pointed out in the chat. You can add tags to existing questions just by editing them. So if I go into an existing question, I can scroll down here to where it says tags and I can add multiple tags to 135 00:20:14.910 --> 00:20:28.650 Brian Klaas: All of my questions there, so that's that's tag based for tag rule based quizzes, any, any questions about that from anybody. They're really powerful epi 721 721 136 00:20:29.460 --> 00:20:40.920 Brian Klaas: It has been using them use this in the first term on their midterm and final and they had a really good experience with a lot of equity lot more equity than sort of pure randomization would have provided 137 00:20:41.370 --> 00:20:47.130 Brian Klaas: For the faculty in their class. They were really, really happy with that. And this is something that I know that 138 00:20:48.570 --> 00:20:51.120 Brian Klaas: Meridian or West and Karen bandy and Roche are looking at for 139 00:20:51.120 --> 00:20:54.780 Brian Klaas: The big giant 500 plus students to school methods course as well. 140 00:20:55.530 --> 00:20:58.590 Celine Greene (CTL): I just want to add like even if you have your course, even if it's not like 141 00:20:58.890 --> 00:21:08.340 Celine Greene (CTL): Huge amounts of questions. If you were to like group your questions by module or week or whatever that really helps. If you're coming up with a multiple choice piece of a final exam, for instance. 142 00:21:08.670 --> 00:21:19.350 Celine Greene (CTL): To make sure it's equitable in scanning from across the course. You don't have to go pick and choose. You can let course plus do the work. If you've tagged them appropriately like module one, etc. So 143 00:21:19.410 --> 00:21:29.730 Brian Klaas: I think that's a great example of tagging saline is questions that apply to various weeks or modules or sections of content in your class that's, you know, I was showing multiple choice and and content areas. 144 00:21:30.570 --> 00:21:35.370 Brian Klaas: Week tagging is a great way of making that happen. It's a great way of doing that. 145 00:21:35.970 --> 00:21:45.390 Brian Klaas: All right, next up another tool that we put in for those of you who don't want to go the tagging route, but still want to have things so that students do things differently in art, seeing the same exam. 146 00:21:45.750 --> 00:22:02.490 Brian Klaas: Is quiz sets quiz sets. So let me show you what quiz sets are and how they work. So I'm going to go back to all my quizzes in here and what a quiz set is is it is essentially a 147 00:22:03.330 --> 00:22:17.160 Brian Klaas: Think of it as a folder. Think of it as a folder and in this folder you have made copies of different versions of your quiz or exam for the students. And you've sort of randomly put them in a pile. 148 00:22:17.910 --> 00:22:25.020 Brian Klaas: And as students come into your class to take your exam you hand them the first one in the pile. 149 00:22:25.770 --> 00:22:32.070 Brian Klaas: Whatever it is, it can be quiz what the first version second version third version, you don't know you've randomly put them in that pile there. 150 00:22:32.310 --> 00:22:38.790 Brian Klaas: And for each student that comes in and takes the quiz. They get a different version of the pile of version of the exam that's assigned to them. 151 00:22:39.210 --> 00:22:49.320 Brian Klaas: That's what a quiz set is it's a set of exams. One of those is randomly selected and given to the students at the time that they start the exam. 152 00:22:49.950 --> 00:23:03.150 Brian Klaas: So I'm here you can see and my listing of all the quizzes. I do have a quiz set example. And I can also see the quizzes, the separate quizzes that make up that quiz set right there's a part of quiz that quiz that example here. 153 00:23:03.780 --> 00:23:12.630 Brian Klaas: So if I wanted to make a quiz set. I would just sit, click on the button for create a quiz set on the main quiz generator page and then 154 00:23:13.020 --> 00:23:16.320 Brian Klaas: I would select the quizzes that would be included. Now, it's important to note 155 00:23:16.920 --> 00:23:22.200 Brian Klaas: That all quizzes in a set need to have the same number of questions. 156 00:23:22.440 --> 00:23:31.950 Brian Klaas: They need to have the same number of questions. This is super important. Right. You don't want some people taking a quiz that only has 10 questions and some students taking quizzes 15 questions because you 157 00:23:32.310 --> 00:23:45.630 Brian Klaas: Well, I think it would be bad practice and you have students saying you are totally unfair. I got this much harder quiz, because it had 15 questions as opposed to 10 that's not fair, and there needs to be equity there. So that's the sort of only rule about the quizzes. 158 00:23:46.200 --> 00:23:56.760 Brian Klaas: Is that the number of questions needs to be same for each of them there. And then when I create that quiz set whatever settings I sat in that quiz set 159 00:23:57.210 --> 00:24:04.140 Brian Klaas: Override whatever might have been set for those individual quizzes, so you don't have to worry about way did I said the open and close date. 160 00:24:04.380 --> 00:24:13.110 Brian Klaas: Right on each of the quizzes and I set randomization on each of the individual quizzes. Now you don't have to worry about that, because whatever settings you apply at the quiz set level. 161 00:24:13.680 --> 00:24:24.840 Brian Klaas: Trickle down cascade down to all the quizzes and that set. So here you can see that in this set. I actually have three quizzes and that can actually see all the questions that are in each of these quizzes here. 162 00:24:25.290 --> 00:24:35.430 Brian Klaas: Now within each of these quiz quizzes you can apply randomization, you can say display questions in a random order if you want to, to improve the security there if that's something that you want to do. 163 00:24:35.940 --> 00:24:41.640 Brian Klaas: But again, the quizzes and the set whatever you have the settings for the set, meaning 164 00:24:42.240 --> 00:24:49.260 Brian Klaas: Do I want to show the correct and incorrect answers afterwards. What's the open and what's the access began and accents to end date. 165 00:24:49.740 --> 00:24:59.820 Brian Klaas: Is it counted towards the students grade in the final class all those options override and apply down cascade down to whatever quizzes that are in the actual set itself. 166 00:25:00.780 --> 00:25:08.370 Brian Klaas: And then when a student goes to take the quiz. They just get one of the three random quizzes. They don't even notice that there's anything different. 167 00:25:08.940 --> 00:25:21.510 Brian Klaas: But they get one of the three random quizzes assigned to them right then in there. So if I go back now and I look at and you think, Okay, well, now there's three different quizzes and I got to go to the three different quizzes to manage questions and stuff. No, not at all. 168 00:25:22.620 --> 00:25:31.470 Brian Klaas: I mean to manage the student, you know, their special permissions their grades know all of that is managed from a single central location. 169 00:25:31.830 --> 00:25:38.550 Brian Klaas: From the quiz set so you don't have to drill down into a specific quiz and say, Brian, I give you special permissions for this specific with no 170 00:25:38.910 --> 00:25:47.070 Brian Klaas: You just take care of it at the quiz set level when I look at responses and grades. The same thing happens. I look at it from the quiz set level. 171 00:25:47.400 --> 00:25:57.390 Brian Klaas: I don't have to drill down into three different quizzes. Everything is brought in here to me in this quiz set so I can look in, I can see okay here's Betty Boop who got 172 00:25:58.290 --> 00:26:04.050 Brian Klaas: Let's see which version. Ah, right. It even shows you which quiz that student was assigned 173 00:26:04.620 --> 00:26:17.880 Brian Klaas: So I can see here that Betty Boop got quiz to assigned to her. And let's see. Eric Clapton got assigned quiz three assigned to him. And you can see just right away. It's a different quiz entirely 174 00:26:18.360 --> 00:26:26.430 Brian Klaas: Totally different quiz there. Right. So there's the first question for that person and Albus Dumbledore. What did elbows in Albus Dumbledore got quiz to 175 00:26:26.820 --> 00:26:36.750 Brian Klaas: As well. But I can combine this with randomization display order randomization to make it really hard for students to be able to be like, Hey, would you get For question number one on this quiz. 176 00:26:37.050 --> 00:26:43.980 Brian Klaas: Because not only do they have different quizzes. You can even have randomization of display order within those quizzes to make it hard for them to see that there 177 00:26:44.490 --> 00:26:56.730 Brian Klaas: So quiz sets are another way that you can have randomization have greater security in your exam quizzes and exams in your online courses. Some people prefer this route. 178 00:26:57.030 --> 00:27:00.090 Brian Klaas: Because, you know, then they have absolute control. 179 00:27:00.450 --> 00:27:13.080 Brian Klaas: Over what goes into the quiz or exam, while also retaining a higher degree of randomization, because you know student knows what version of the exam, they're going to get so 180 00:27:13.440 --> 00:27:17.760 Brian Klaas: For example, in that be classes, some folks have use this because they've tested out different versions. 181 00:27:17.970 --> 00:27:28.380 Brian Klaas: Of the exam, sort of, over the years, and they're made some modifications and and test out that these were equitable exams, these three different versions or five different version of the exam or equitable, but they put them in a set 182 00:27:28.590 --> 00:27:37.560 Brian Klaas: And so students never really know what question they're going to get. And they do randomized display order of questions and then students really have a very, very, very much more difficult time of cheating. 183 00:27:38.400 --> 00:27:50.640 Brian Klaas: When it comes to taking the exam because everyone's getting a different quiz in a different order. But they've done testing and research to make sure that there's equity among all the different versions of the quiz. So that's quite sense 184 00:27:51.510 --> 00:27:57.390 Celine Greene (CTL): Question. Before you move. Ask questions I type something that I hesitate pushing enter because I want to confirm with you. 185 00:27:57.900 --> 00:28:07.500 Celine Greene (CTL): When you're taking a quiz or linking a quiz to the great book. You will be dealing King, the quiz set correct, not the individual quiz and course plus does the background work right. 186 00:28:07.650 --> 00:28:07.950 Celine Greene (CTL): Right. 187 00:28:08.040 --> 00:28:16.770 Brian Klaas: Now we're supposed to the background work again to make it so that, oh yeah, even though there's five quiz quizzes and the set, it only appears is one item in the gradebook for the student. 188 00:28:18.210 --> 00:28:26.280 Brian Klaas: You as the faculty or TA or staff are the only people who see that it's actually a set. Yeah, that's a great, great point. Thank you. Selina for that. 189 00:28:27.030 --> 00:28:32.100 Brian Klaas: Alright, so that's quiz that again, these are some pretty major new features. I'll tell you, as far as I know. 190 00:28:32.550 --> 00:28:39.960 Brian Klaas: Quiz. That's tagged based quizzes don't exist in any other learning management system. So, you know, little, little plus point for course plus there. 191 00:28:40.470 --> 00:28:49.050 Brian Klaas: Are a couple things about multiple choice that have also changed a couple of things about multiple choice that have also changed since April and back these things. 192 00:28:49.500 --> 00:28:58.950 Brian Klaas: Change this one change the summer and the other one was added. Literally About two weeks ago right before the end right for the final exam. 193 00:28:59.460 --> 00:29:04.080 Brian Klaas: In the, in the stats classes we add to this other feature. So there's two new features around multiple choice. I want to point out 194 00:29:04.560 --> 00:29:15.510 Brian Klaas: One is randomization of answers. And the other one is rich formatting of multiple choice questions. So I'm gonna go back over to my web browser here and show you a 195 00:29:17.760 --> 00:29:28.320 Brian Klaas: These two things here. Actually, it's gonna be hard for me to show you exactly how this works, but I will do my best. So in I'm in the setup. There's a new option. 196 00:29:28.620 --> 00:29:37.800 Brian Klaas: In the quiz setup around randomization for multiple choice questions. So again, we have that, you know, do you want to randomize the display order of questions. So 197 00:29:37.980 --> 00:29:42.720 Brian Klaas: Everybody gets a different question one, a different question to even though they all get the same essential questions in the quiz. 198 00:29:43.260 --> 00:29:46.830 Brian Klaas: For multiple choice questions, you can now randomize the display order. 199 00:29:47.250 --> 00:29:59.040 Brian Klaas: So you can turn that on. So that for every student who takes the quiz, they're going to see the questions displayed in a different order. Which is great again for security, because if you add 200 00:29:59.760 --> 00:30:05.520 Brian Klaas: For example, quiz sets or tag rule based quizzes, where students are getting different versions of the quiz automatically 201 00:30:05.790 --> 00:30:17.040 Brian Klaas: You add randomizing the display order of questions you add randomizing display of answers to multiple choice questions, it's all, it's becomes incredibly difficult for a student to say 202 00:30:17.460 --> 00:30:27.720 Brian Klaas: Hey, is the answer to Question nine D because Question nine is different for each student D is not the same answer for every single student 203 00:30:28.350 --> 00:30:32.790 Brian Klaas: So you can randomize the display order of those questions. Now, it's important to note is it warns you here. 204 00:30:33.150 --> 00:30:40.350 Brian Klaas: If you're going to choose random randomization of answer display of answers to multiple choice questions. You can't say can't get answers like a and c 205 00:30:40.620 --> 00:30:54.630 Brian Klaas: Or a B amp D because everybody will get a different agency and everybody will get a different A, B and D order there so you can't use those kinds of question answers, excuse me, and your multiple choice questions there. 206 00:30:55.290 --> 00:31:03.030 Brian Klaas: But if you are doing that again. Everybody is going each student is going to see those questions in a different order. 207 00:31:03.330 --> 00:31:12.960 Brian Klaas: Which is ours are the answers in a different order. Now if you go in and you go and you and you grade the student, you're going to see, oh, that's an example that I want to show you 208 00:31:13.770 --> 00:31:20.430 Brian Klaas: You will see the questions appear in the same order that you entered them in 209 00:31:21.150 --> 00:31:31.050 Brian Klaas: You won't see them in the order that students showed up it because we thought, you know, people are gonna be like, Wait, why is this why are these answers all out of order. You know, I know that the answer to question one is see 210 00:31:31.680 --> 00:31:40.980 Brian Klaas: Well, yes, we understand that. So if the students see it in random order, you don't see it in random order as faculty there. I thought I had an example of that. But I guess I don't 211 00:31:41.370 --> 00:31:52.560 Brian Klaas: Never mind. But again, this randomization works really well. It's very powerful again for increasing the sort of academic integrity of your quizzes there. The other thing that I want to show 212 00:31:53.430 --> 00:32:12.540 Brian Klaas: Is that multiple choice question answers can now have rich text formatting in them. So let me go down here to a multiple choice question that has rich text formatting. So I'm in. Here's my multiple choice question right, what's the Pythagorean theorem. 213 00:32:13.560 --> 00:32:22.560 Brian Klaas: I now can include rich text formatting in these answers. So here I have included mathematical symbols. So I say, 214 00:32:24.000 --> 00:32:31.770 Brian Klaas: You know, I go to math and I can put in my my my text there my text. So the equation editor in the quiz generator has long used 215 00:32:32.070 --> 00:32:42.870 Brian Klaas: Tax for creating mathematics symbols there but you can now do this in your answers as well. In case you need to do it. So as long as you know some some tax, which is the sort of you know layout. 216 00:32:43.380 --> 00:32:46.440 Brian Klaas: text based layout just DESCRIPTIVE LANGUAGE for mathematical equations. 217 00:32:46.680 --> 00:32:59.520 Brian Klaas: You can include a mathematical equations. Like, for example, C equals c squared equals the square root of a squared plus b squared in your questions. You can also do bold italic underline subscript super script and change the color. 218 00:33:00.180 --> 00:33:05.880 Brian Klaas: Of things in there as well and enable that by default answers are plain text. 219 00:33:07.020 --> 00:33:20.490 Brian Klaas: Multiple Choice answers are plain text. But the moment I click on this little us rich formatting for this answer button. I click on that, it turns into a rich text editor and I can fold this and I can make this 220 00:33:21.090 --> 00:33:24.930 Brian Klaas: Different give it a background color, if I want to. Or I can put in equations there. 221 00:33:25.260 --> 00:33:35.040 Brian Klaas: And that's how you add rich text to your multiple choice answers. And again, this is not just for equations. There are many times faculty have said I would really want to underline something to highlight it. 222 00:33:35.340 --> 00:33:46.320 Brian Klaas: In my answer in the answers here are bold italic italicize, can I do that and up until about three weeks ago. You couldn't do that. But now you can in the quiz Jenner. So again, 223 00:33:46.980 --> 00:33:51.240 Brian Klaas: Multiple Choice randomization and other powerful feature for academic integrity and then 224 00:33:51.990 --> 00:34:00.120 Brian Klaas: Formatting just gives you more flexibility in the content that you share inside our content you create inside your quizzes there. 225 00:34:00.810 --> 00:34:10.050 Brian Klaas: Alright, so those are the big sort of features. I want to spend some time on. There's a couple other things I do want to show you that are different that have been added to 226 00:34:10.740 --> 00:34:21.390 Brian Klaas: The two questions specifically. This was added back in, I think, April or May, but you can now include a word count limit. 227 00:34:21.660 --> 00:34:30.120 Brian Klaas: On essay questions. So you can say, you can only include 500 words you know in this essay question, which is a lot of words, believe you me 228 00:34:30.330 --> 00:34:41.160 Brian Klaas: I understand, though sometimes for some of the departmental comprehensive exams, where they use the quiz generator. That's really important. Right. They don't like no, we don't want students writing more than 200 words this or 500 words, this particular question. 229 00:34:42.090 --> 00:34:44.460 Brian Klaas: That's really very, very, very, very helpful. 230 00:34:45.780 --> 00:34:52.200 Brian Klaas: There's also the ability to put in a essay answer template room actually switch over to my browser. 231 00:34:52.440 --> 00:35:05.010 Brian Klaas: I'm going to show you here because I know this is something that for that avenue would probably be interested in again for the EPI comprehensive exams that came up and let me find my question that has the template answer in it. Ah, yes, here it is. Alright. 232 00:35:05.220 --> 00:35:07.920 Brian Klaas: So, um, here's an essay question right 233 00:35:08.100 --> 00:35:17.460 Brian Klaas: That I can ask you know my prompt, whatever it is. But let's say I want the students to fill out that as a question in a specific way following a very specific format. 234 00:35:18.240 --> 00:35:24.060 Brian Klaas: So I could then in this field that says template that will be pre populated in the student response to the question. 235 00:35:24.420 --> 00:35:33.870 Brian Klaas: I could put in a template that I want them to follow. Right. In this case, here's my prompt I want three pieces of evidence, and then some analysis there you could 236 00:35:34.380 --> 00:35:39.600 Brian Klaas: Put you know a an avatar. This might get back to your question earlier about how can you have both. 237 00:35:40.380 --> 00:35:47.040 Brian Klaas: You know, sort of like, you know, solving equations are answering, you know, multiple choice questions. And so at the same time, we could just do it as an essay 238 00:35:47.340 --> 00:35:52.560 Brian Klaas: I could put a table in here and leave blank cells that students are supposed to fill out right 239 00:35:52.770 --> 00:36:03.600 Brian Klaas: They could have blank cells where they could fill that out and then type right underneath that with another prompt in the same question. So it's all asked the same question. So when I go to take this quiz as a student. 240 00:36:04.050 --> 00:36:08.340 Brian Klaas: So I'm going to jump around here a little bit. Go ahead and preview this quiz. I'll go ahead and test it. 241 00:36:09.060 --> 00:36:20.580 Brian Klaas: That stuff. So when I get to this particular question down here, the one with a template. When I click on enter answer for the first time. There's my template and then I can just type 242 00:36:21.330 --> 00:36:30.210 Brian Klaas: In here and do my analysis here. Right, so they can i mean you know as a student, I can go in and these aren't locked. I can still delete stuff out. 243 00:36:30.780 --> 00:36:48.990 Brian Klaas: We can't sort of lock point per portions of that. But it gives you a template that they can work from when they are answering that essay question which I know for some groups is super, super important there. And so finally, the last thing I do a question enhancement that was added. 244 00:36:50.100 --> 00:36:53.910 Brian Klaas: Earlier this year was that in I showed you the combo question where you can have 245 00:36:54.600 --> 00:36:59.460 Brian Klaas: Answers that don't match anything at all. You can do the same thing with match from to list questions that you have. 246 00:36:59.850 --> 00:37:11.850 Brian Klaas: You can now add in additional items and match from to list questions where those things as items don't match anything at all. That was something that was added back in May. For those of you who use match from two lists, you can do that as well. 247 00:37:12.330 --> 00:37:15.570 Brian Klaas: On the administrative side there's been a few enhancements as well. 248 00:37:16.050 --> 00:37:23.310 Brian Klaas: You can now copy from any quiz that you teach or, you know, copy from any course that you teach us me copy quizzes from any course that you teach 249 00:37:23.580 --> 00:37:32.100 Brian Klaas: So this has become more and more common, where you have, say, you know, it's not just the same course number. It's like you teach this one class with another course number 250 00:37:32.310 --> 00:37:37.500 Brian Klaas: And this other classes over the course number. Do you want to copy quizzes from one to the other. Previously, you couldn't do that. 251 00:37:37.860 --> 00:37:46.500 Brian Klaas: We made this change this summer. So you can now pick any course from which you teach your TA is can pick any horse which they have ta access and then 252 00:37:47.250 --> 00:37:58.770 Brian Klaas: Copy from one to the other. There. So everybody wants to know, can we have uneven numbers on each side of the maximum two lists. Yes, you can. Absolutely. So match them two lists 70 you could have three sort of things you want to match. 253 00:37:59.010 --> 00:38:07.110 Brian Klaas: But, you know, six options over here on the right hand side. So three of those six options wouldn't match anything at all. Yeah. So you can have those 254 00:38:07.440 --> 00:38:13.860 Brian Klaas: Even. Thanks. Yes, I should. That's a, that's a much better way of saying it, having on even numbers on each side of the match them to your list thing there. 255 00:38:14.820 --> 00:38:26.070 Brian Klaas: There is also now grading guidance for essay and fill in the blank questions. And this was this came as a request to us actually show you go back here in the same quiz for the same question. 256 00:38:27.810 --> 00:38:39.780 Brian Klaas: There is the option to include guidance for your co faculty for your TA is when they are grading essay and multiple 257 00:38:40.020 --> 00:38:49.980 Brian Klaas: Sorry essay and fill in the blank questions because, you know, you want to make sure that everybody's been graded in the same way if you're in a big class with lots of CA's or there's multiple faculty members. 258 00:38:50.160 --> 00:39:01.710 Brian Klaas: Who are grading essay questions you want to make sure that folks are using the same set of criteria to grade those essay questions. And so what you can do is, there's now this field this rich text field because you can put stuff in there. 259 00:39:03.210 --> 00:39:13.500 Brian Klaas: Where you can put in whatever you want in terms of grading guidance for student responses to that particular question. So here I have put in a rubric to evaluate the student response right rubrics are good. 260 00:39:13.710 --> 00:39:22.920 Brian Klaas: rubrics are good for grading especially essay questions right. It gives the students and your co instructors something, you know, consistent that everyone can follow 261 00:39:23.310 --> 00:39:32.970 Brian Klaas: And then what I'm actually grading the this quiz. When I'm grading the answer this quiz. If I go into the responses and grades for this quiz for a student 262 00:39:33.210 --> 00:39:33.660 Celine Greene (CTL): And scroll 263 00:39:33.690 --> 00:39:37.110 Celine Greene (CTL): All the way down. I have to be showing us your screen because you're still showing us your 264 00:39:37.350 --> 00:39:38.610 Brian Klaas: Your slideshow so oh my 265 00:39:38.610 --> 00:39:40.650 Brian Klaas: Gosh, I am so sorry. 266 00:39:40.980 --> 00:39:46.050 Brian Klaas: Thank you. Celine. I cannot believe I did that. So let me go back here. 267 00:39:46.410 --> 00:39:49.020 Celine Greene (CTL): You just made me feel better about myself and presenting itself. 268 00:39:49.110 --> 00:39:50.910 Brian Klaas: I do that, I know it's terrible. When I do 269 00:39:50.910 --> 00:40:06.420 Brian Klaas: That. So I thought I was showing you the grading guidance. So here it is. When I add on my essay question. There's now this field for grading guidance and I can put whatever I want in there. In this case, I put a rubric for grading students, and then I go back to my 270 00:40:07.650 --> 00:40:17.880 Brian Klaas: Go in and actually look at the responses and grades. When I'm grading students on here who have taken this quiz. I go all the way down to this question. Here's, here's my my essay question. 271 00:40:18.180 --> 00:40:21.030 Brian Klaas: That had that that had that template right in it. 272 00:40:21.480 --> 00:40:24.180 Brian Klaas: I can click on show great and guides for this question. 273 00:40:24.450 --> 00:40:38.340 Brian Klaas: And it shows me whatever text I put in there. So here's the rubric that I can follow as a TA, or a co faculty member on a on a on a on this class and be able to follow this rubric in terms of evaluating that student 274 00:40:38.670 --> 00:40:46.860 Brian Klaas: So grading guidance can be extremely powerful very useful for making sure that everyone's being graded in the same way. It also works if you do the 275 00:40:47.460 --> 00:41:01.320 Brian Klaas: You know, create all responses to a single question. It shows you the grading guidance right up at the top, and then you just scroll through all the students and grade them that way. So this is another really nice enhancement to the quiz generator that we've added in. 276 00:41:02.760 --> 00:41:10.440 Brian Klaas: Next up I didn't show this before. Again, you can now not penalize students for incorrect answers on multiple multi answer questions. 277 00:41:10.710 --> 00:41:15.600 Brian Klaas: Whether it's a multiple choice multi answer match them to list or a combo question. 278 00:41:15.930 --> 00:41:24.390 Brian Klaas: You now have the option to not penalize them. The default is to penalize them that has. That's the way the quiz generator has been for gosh 1516 years 279 00:41:24.840 --> 00:41:29.340 Brian Klaas: So we didn't want to change that default, all of a sudden, but now you do have that 280 00:41:29.730 --> 00:41:37.500 Brian Klaas: That option as well. And finally, there is an option in the question are now to allow students who didn't take the quiz to see the answer key. 281 00:41:37.800 --> 00:41:47.580 Brian Klaas: So previously, a student had to take the quiz, no matter what, to see the answer key. If you use the answer key option in the quiz generator 282 00:41:47.820 --> 00:41:52.560 Brian Klaas: You now have the option to say, I don't care if they didn't take it or not just let them see the answer key. 283 00:41:52.920 --> 00:42:00.510 Brian Klaas: Because this otherwise folks would have to like print out a copy of the answer key and putting the online library. It was a big hassle for them. So that will save those folks, some time. 284 00:42:01.320 --> 00:42:11.520 Brian Klaas: From question management perspective on if you have one of those large question banks, where you you know you had quest questions from years and years ago. And you just keep collecting them and you have 285 00:42:12.090 --> 00:42:16.830 Brian Klaas: Literally 600 questions and your question bank and you're not using two thirds of them. 286 00:42:17.160 --> 00:42:29.400 Brian Klaas: There is now a button at the top of the question bank page that says delete all unused questions and in one click vid. You can get rid of all the questions that are not currently used in a quiz. 287 00:42:29.670 --> 00:42:38.190 Brian Klaas: In your class that can be a big time saver for those classes that have collected hundreds and hundreds of questions because, you know, it takes a long time. 288 00:42:38.460 --> 00:42:46.140 Brian Klaas: For the question manager page to load and for the all questions in the entire class question bank view. 289 00:42:47.040 --> 00:42:49.440 Brian Klaas: To load as well. So that's a handy thing for you. 290 00:42:49.800 --> 00:42:53.430 Brian Klaas: Also, while you are putting together your, your quiz. 291 00:42:53.670 --> 00:43:05.880 Brian Klaas: On the question manager page there's now a checkbox that says filter out any questions already used in any quiz or exam, you click on that, it automatically hides any question that's already been used in a quiz or exam. 292 00:43:06.120 --> 00:43:10.110 Brian Klaas: Again, this is useful when you have a lot of questions in your question bank and you're like, 293 00:43:10.380 --> 00:43:19.890 Brian Klaas: I don't want to reuse any question that was in like the mid term quiz or the weekly quizzes or whatever. I just want to see questions that haven't been used anywhere at all. You can do that as well. 294 00:43:20.580 --> 00:43:28.590 Brian Klaas: And then finally, you can add question tags two blocks to question blocks that wasn't something that was available until about six eight weeks ago. 295 00:43:28.950 --> 00:43:45.690 Brian Klaas: But now you can add question tax tags two blocks. So question blocks can be part of tag rule based quizzes as well. So again, another little enhancement for the flexibility and management of questions in a quiz there. 296 00:43:46.980 --> 00:43:57.060 Brian Klaas: Okay, so that's really the major things I wanted to show you, today's session. I know that I covered a lot and I may have gone a little fast in some places. 297 00:43:57.930 --> 00:44:03.480 Brian Klaas: All the major features are covered that have been coming to the quiz generate lately have been covered on the CTO blog. 298 00:44:03.960 --> 00:44:14.310 Brian Klaas: So I do posts up there. There are text based post. There's some video introductions short video introduction to some of these things as well. You can refer to for yourself or for your peers. 299 00:44:14.700 --> 00:44:19.680 Brian Klaas: See to help is always willing to answer questions about any of these features. 300 00:44:20.220 --> 00:44:29.910 Brian Klaas: They're really great and also your instructional designer. I know that many of the people who are here today, work with instructional designers in the Center for Teaching and Learning, they know this stuff they can ask 301 00:44:30.270 --> 00:44:41.790 Brian Klaas: You can ask them questions. They can help you come up with best practices because we're talking constantly to the faculty and teachers who are using these features like quiz sets like tag real question quizzes, like the combo question and figuring out 302 00:44:42.840 --> 00:44:51.690 Brian Klaas: what works and what doesn't. And, you know, we want to be able to help you and we want your feedback as well. Every single feature I showed you here today. 303 00:44:52.260 --> 00:45:00.360 Brian Klaas: Came as the result of faculty or administrative staff, saying, I wish course plus could do x 304 00:45:00.660 --> 00:45:11.610 Brian Klaas: Now I'll tell you the tag rule based quite a request came from john McGrady and Pam Berg, about six years ago, but we finally got around to doing it, you know, with the pressure of 305 00:45:11.820 --> 00:45:19.710 Brian Klaas: Being in the virtual environment. But again, all of these features came as a result of faculty and TA saying these are the things I would really like to see 306 00:45:19.890 --> 00:45:32.370 Brian Klaas: In the quiz generator. So if you have suggestions, contact me contact CT. I'll help. Talk to your instructional designer. We want to have that conversation with you and we want to make sure that you're using this in a way that really makes sense to you. 307 00:45:32.790 --> 00:45:35.910 Brian Klaas: And as ebony asked this, the recording of the session 308 00:45:36.300 --> 00:45:45.000 Brian Klaas: Will be on the events page on the CTF teaching tool kit website. If you don't know how to reach the CTF teaching toolkit website. If you've never noticed this. 309 00:45:45.270 --> 00:45:56.280 Brian Klaas: I'll give you one more thing here. I'll go back to the corresponding homepage right here on the left hand side of the page, there's the link for teaching toolkit. You can click on that and that will take you over to 310 00:45:56.940 --> 00:46:02.340 Brian Klaas: The teaching tool kit site or we have the events page with these recordings here as well. 311 00:46:03.060 --> 00:46:15.810 Brian Klaas: So that's really everything I wanted to share today with you. If you have any questions from anybody. I will gladly answer them. Otherwise, thank you so much for your time, hopefully you found this to be useful and helpful today. 312 00:46:17.760 --> 00:46:21.060 Celine Greene (CTL): Feel free to unmute your mics. If you had a question. I'm 313 00:46:23.760 --> 00:46:41.850 Celine Greene (CTL): Brian, I had a question everybody. You're welcome. I had a question, and I apologize if I'm throwing you a curveball, but with the quiz sets if of course it's using sessions instead of Schedule Builder students easily access the quizzes through the quizzes tab. Correct. 314 00:46:41.880 --> 00:46:42.690 Brian Klaas: Yep, yep. 315 00:46:42.750 --> 00:46:53.280 Celine Greene (CTL): And you were saying how the quiz sets their settings override the individual Quiz, Quiz, right. So if I have an opening date for quiz. That's part of a quiz set 316 00:46:53.910 --> 00:47:01.200 Celine Greene (CTL): Is that not going to be included in the list or do I have to purposely make sure that that opening date for the quiz is not actually 317 00:47:01.230 --> 00:47:02.010 That's a great question. 318 00:47:03.300 --> 00:47:13.920 Brian Klaas: If a quiz is part of a set, it is not displayed on the student listing of all the quizzes in the course in course plus sites where they're using class sessions. 319 00:47:15.810 --> 00:47:31.320 Brian Klaas: So it's automatically hidden from view. So you don't even have to worry about that. Yep. So the students would only ever see the link to the set quiz, as opposed to the individual quizzes that make up the set. That's fantastic. Thank you. We thought about that one before we release the feature. 320 00:47:31.860 --> 00:47:33.300 Celine Greene (CTL): Before Celine came down said 321 00:47:33.540 --> 00:47:34.830 Brian Klaas: Exactly what was when I was 322 00:47:34.830 --> 00:47:35.880 Brian Klaas: Like, guys. 323 00:47:36.450 --> 00:47:37.500 Brian Klaas: This is a problem. 324 00:47:38.700 --> 00:47:39.630 Brian Klaas: To fix this, 325 00:47:40.170 --> 00:47:40.740 Celine Greene (CTL): We only had 326 00:47:41.250 --> 00:47:44.160 Celine Greene (CTL): About PKs not problems just solutions we 327 00:47:44.520 --> 00:47:45.540 Just really finding 328 00:47:46.830 --> 00:47:48.240 Celine Greene (CTL): Exactly. Because this is recorded. 329 00:47:49.290 --> 00:47:50.220 Celine Greene (CTL): Right. Of course. 330 00:47:52.800 --> 00:47:53.940 Celine Greene (CTL): Well, thank you, everybody. 331 00:47:54.180 --> 00:47:56.550 Brian Klaas: Thanks, guys. Thank you for attending. I'm 332 00:47:56.880 --> 00:47:57.960 Celine Greene (CTL): Really appreciate it. 333 00:47:58.200 --> 00:47:59.610 Brian Klaas: If you have any follow up questions again. 334 00:47:59.640 --> 00:48:10.080 Brian Klaas: Feel free to contact CTO help reach out to your instructional designer or you can even contact me directly, and I'll gladly talk to you more about the QC quiz generator. So thank you everybody. Have a great rest of your day. 335 00:48:12.390 --> 00:48:13.380 Mackenzie Brown: Thanks for coming. 336 00:48:14.610 --> 00:48:15.240 Brian Klaas: Thank you.