WEBVTT NOTE duration:"00:59:56" NOTE recognizability:0.823 NOTE language:en-us NOTE Confidence: 0.952467896666667 00:00:07.730 --> 00:00:11.108 Hi everyone, welcome to today's workshop. NOTE Confidence: 0.952467896666667 00:00:11.110 --> 00:00:14.085 We're delighted that you have joined us. NOTE Confidence: 0.952467896666667 00:00:14.090 --> 00:00:15.638 My name is Elizabeth Topper ghaleb. NOTE Confidence: 0.952467896666667 00:00:15.640 --> 00:00:18.320 I'm a faculty member in the Department of NOTE Confidence: 0.952467896666667 00:00:18.320 --> 00:00:20.620 Epidemiology and director of the schools NOTE Confidence: 0.952467896666667 00:00:20.620 --> 00:00:22.580 online programs for applied learning, NOTE Confidence: 0.952467896666667 00:00:22.580 --> 00:00:25.920 and I'm joined by HI. NOTE Confidence: 0.952467896666667 00:00:25.920 --> 00:00:28.888 My name is Amy Pinkerton and I'm a NOTE Confidence: 0.952467896666667 00:00:28.888 --> 00:00:30.949 senior instructional designer at the NOTE Confidence: 0.952467896666667 00:00:30.949 --> 00:00:33.019 Center for Teaching and Learning. NOTE Confidence: 0.952467896666667 00:00:33.020 --> 00:00:34.924 So we're happy to have you here NOTE Confidence: 0.952467896666667 00:00:34.924 --> 00:00:37.652 today and we are going to be talking NOTE Confidence: 0.952467896666667 00:00:37.652 --> 00:00:39.132 about backwards course design. NOTE Confidence: 0.952467896666667 00:00:39.140 --> 00:00:42.940 So these are our learning objectives for you. NOTE Confidence: 0.952467896666667 00:00:42.940 --> 00:00:43.633 For this workshop, NOTE Confidence: 0.952467896666667 00:00:43.633 --> 00:00:45.735 we hope that by the end of the workshop NOTE Confidence: 0.952467896666667 00:00:45.735 --> 00:00:47.765 you will be able to do all of the NOTE Confidence: 0.952467896666667 00:00:47.765 --> 00:00:49.515 things that you see on this screen. NOTE Confidence: 0.952467896666667 00:00:49.520 --> 00:00:51.495 So describe the components of NOTE Confidence: 0.952467896666667 00:00:51.495 --> 00:00:53.075 a smart learning objective, NOTE Confidence: 0.952467896666667 00:00:53.080 --> 00:00:55.402 modify a learning objective to make NOTE Confidence: 0.952467896666667 00:00:55.402 --> 00:00:57.740 it compliant with smart principles. NOTE Confidence: 0.952467896666667 00:00:57.740 --> 00:01:00.250 Create a smart learning objective. NOTE Confidence: 0.952467896666667 00:01:00.250 --> 00:01:02.908 Evaluate the alignment of an assessment NOTE Confidence: 0.952467896666667 00:01:02.908 --> 00:01:05.145 with smart learning objectives and NOTE Confidence: 0.952467896666667 00:01:05.145 --> 00:01:07.503 write an assessment to address a NOTE Confidence: 0.952467896666667 00:01:07.503 --> 00:01:09.380 particular smart learning objective. NOTE Confidence: 0.853862995555556 00:01:11.720 --> 00:01:13.896 So typically course design NOTE Confidence: 0.853862995555556 00:01:13.896 --> 00:01:16.616 is done in this order, NOTE Confidence: 0.853862995555556 00:01:16.620 --> 00:01:19.490 and I've done this many times myself. NOTE Confidence: 0.853862995555556 00:01:19.490 --> 00:01:21.576 One might argue that this is actually NOTE Confidence: 0.853862995555556 00:01:21.576 --> 00:01:24.118 backwards, but be that as it may, NOTE Confidence: 0.853862995555556 00:01:24.120 --> 00:01:26.360 we tend to start with the content. NOTE Confidence: 0.853862995555556 00:01:26.360 --> 00:01:28.760 So we identify what we want to teach. NOTE Confidence: 0.853862995555556 00:01:28.760 --> 00:01:30.720 What do I want to tell my students? NOTE Confidence: 0.853862995555556 00:01:30.720 --> 00:01:33.000 I know some things I have some skills. NOTE Confidence: 0.853862995555556 00:01:33.000 --> 00:01:35.052 This is the stuff I want them to know NOTE Confidence: 0.853862995555556 00:01:35.052 --> 00:01:37.123 about and then we create some slides and NOTE Confidence: 0.853862995555556 00:01:37.123 --> 00:01:38.938 we batch them together to make lectures NOTE Confidence: 0.853862995555556 00:01:38.938 --> 00:01:41.318 and we put those in a logical order. NOTE Confidence: 0.853862995555556 00:01:41.318 --> 00:01:43.513 And we've got our slide NOTE Confidence: 0.853862995555556 00:01:43.513 --> 00:01:45.359 presentation all set to go. NOTE Confidence: 0.853862995555556 00:01:45.360 --> 00:01:47.736 And then once those are complete, NOTE Confidence: 0.853862995555556 00:01:47.740 --> 00:01:50.250 we say, well we need assessments because NOTE Confidence: 0.853862995555556 00:01:50.250 --> 00:01:51.860 it's not really a course right now. NOTE Confidence: 0.853862995555556 00:01:51.860 --> 00:01:53.330 It's just a lecture series. NOTE Confidence: 0.853862995555556 00:01:53.330 --> 00:01:55.255 So we create assessments to quiz the NOTE Confidence: 0.853862995555556 00:01:55.255 --> 00:01:57.191 students on the material to say, hey, NOTE Confidence: 0.853862995555556 00:01:57.191 --> 00:01:59.090 I taught you what I wanted to teach you. NOTE Confidence: 0.853862995555556 00:01:59.090 --> 00:02:00.220 Did you get it right? NOTE Confidence: 0.853862995555556 00:02:00.220 --> 00:02:03.156 So we write quizzes and we create projects, NOTE Confidence: 0.853862995555556 00:02:03.160 --> 00:02:05.100 etcetera. NOTE Confidence: 0.853862995555556 00:02:05.100 --> 00:02:07.940 And then when we're all ready to go, NOTE Confidence: 0.853862995555556 00:02:07.940 --> 00:02:09.476 we submit the course. NOTE Confidence: 0.853862995555556 00:02:09.476 --> 00:02:11.396 And typically our instructional designer NOTE Confidence: 0.853862995555556 00:02:11.396 --> 00:02:14.111 or someone at the Committee for Academic NOTE Confidence: 0.853862995555556 00:02:14.111 --> 00:02:16.159 Standards or someone along the way, NOTE Confidence: 0.853862995555556 00:02:16.160 --> 00:02:18.218 says, hey, you need learning objectives, NOTE Confidence: 0.853862995555556 00:02:18.220 --> 00:02:20.341 and we quickly jot down some learning NOTE Confidence: 0.853862995555556 00:02:20.341 --> 00:02:22.580 objectives to match what we've already done. NOTE Confidence: 0.853862995555556 00:02:22.580 --> 00:02:22.982 Really, NOTE Confidence: 0.853862995555556 00:02:22.982 --> 00:02:25.796 after the course design is already complete. NOTE Confidence: 0.853862995555556 00:02:25.800 --> 00:02:28.170 So why is this a problem? NOTE Confidence: 0.853862995555556 00:02:28.170 --> 00:02:30.530 What's wrong with this method? NOTE Confidence: 0.853862995555556 00:02:30.530 --> 00:02:32.946 Well, a few things doing it this way, NOTE Confidence: 0.853862995555556 00:02:32.950 --> 00:02:36.450 the content can seem random or disconnected, NOTE Confidence: 0.853862995555556 00:02:36.450 --> 00:02:38.718 which can be disorienting for students. NOTE Confidence: 0.853862995555556 00:02:38.720 --> 00:02:40.604 This is not a student centered NOTE Confidence: 0.853862995555556 00:02:40.604 --> 00:02:42.390 way of creating a course, NOTE Confidence: 0.853862995555556 00:02:42.390 --> 00:02:43.870 it's a faculty centered way, NOTE Confidence: 0.853862995555556 00:02:43.870 --> 00:02:46.300 so I'm not focusing by doing it this way. NOTE Confidence: 0.853862995555556 00:02:46.300 --> 00:02:47.990 I'm not focusing on what NOTE Confidence: 0.853862995555556 00:02:47.990 --> 00:02:49.342 the students will learn. NOTE Confidence: 0.853862995555556 00:02:49.350 --> 00:02:51.506 I'm focusing on what I as the NOTE Confidence: 0.853862995555556 00:02:51.506 --> 00:02:52.890 instructor want to teach. NOTE Confidence: 0.853862995555556 00:02:52.890 --> 00:02:54.720 And just because I teach it, NOTE Confidence: 0.853862995555556 00:02:54.720 --> 00:02:57.414 no offense to anyone doesn't necessarily NOTE Confidence: 0.853862995555556 00:02:57.414 --> 00:02:59.939 mean they're going to learn it. NOTE Confidence: 0.853862995555556 00:02:59.940 --> 00:03:02.860 So again, it's not student centric, right? NOTE Confidence: 0.853862995555556 00:03:02.860 --> 00:03:06.828 And the content is by the same token NOTE Confidence: 0.853862995555556 00:03:06.828 --> 00:03:08.460 not tied to any learning goals, NOTE Confidence: 0.853862995555556 00:03:08.460 --> 00:03:10.987 which does not bode well for student NOTE Confidence: 0.853862995555556 00:03:10.987 --> 00:03:12.960 engagement when students don't know NOTE Confidence: 0.853862995555556 00:03:12.960 --> 00:03:14.616 why they're learning something. NOTE Confidence: 0.853862995555556 00:03:14.620 --> 00:03:17.268 We know that they're less likely to retain. NOTE Confidence: 0.853862995555556 00:03:17.270 --> 00:03:20.330 Excuse me, retain the material. NOTE Confidence: 0.853862995555556 00:03:20.330 --> 00:03:20.736 Likewise, NOTE Confidence: 0.853862995555556 00:03:20.736 --> 00:03:22.766 the assessments in this method NOTE Confidence: 0.853862995555556 00:03:22.766 --> 00:03:23.984 are an afterthought, NOTE Confidence: 0.853862995555556 00:03:23.990 --> 00:03:25.976 which leads to a lack of NOTE Confidence: 0.853862995555556 00:03:25.976 --> 00:03:26.969 durable transferable learning, NOTE Confidence: 0.853862995555556 00:03:26.970 --> 00:03:29.252 so by durable learning we mean that NOTE Confidence: 0.853862995555556 00:03:29.252 --> 00:03:31.054 deep lasting knowledge retention that NOTE Confidence: 0.853862995555556 00:03:31.054 --> 00:03:32.964 we're hoping for and transferable NOTE Confidence: 0.853862995555556 00:03:32.964 --> 00:03:34.778 learning means that the students NOTE Confidence: 0.853862995555556 00:03:34.778 --> 00:03:36.293 retain the knowledge well enough NOTE Confidence: 0.853862995555556 00:03:36.293 --> 00:03:38.692 so as to be able to apply it to NOTE Confidence: 0.853862995555556 00:03:38.692 --> 00:03:40.250 the next task or problem. NOTE Confidence: 0.853862995555556 00:03:40.250 --> 00:03:44.186 And neither of these is really NOTE Confidence: 0.853862995555556 00:03:44.190 --> 00:03:47.046 highlighted well when the assessments are, NOTE Confidence: 0.853862995555556 00:03:47.050 --> 00:03:47.701 as I said, NOTE Confidence: 0.853862995555556 00:03:47.701 --> 00:03:49.003 kind of an afterthought and come NOTE Confidence: 0.853862995555556 00:03:49.003 --> 00:03:50.250 after we've already created. NOTE Confidence: 0.853862995555556 00:03:50.250 --> 00:03:53.262 I love the content. NOTE Confidence: 0.853862995555556 00:03:53.262 --> 00:03:54.768 So instead. NOTE Confidence: 0.853862995555556 00:03:54.770 --> 00:03:56.768 We have what's called backwards design, NOTE Confidence: 0.853862995555556 00:03:56.770 --> 00:03:58.831 and again I I kind of see this now NOTE Confidence: 0.853862995555556 00:03:58.831 --> 00:04:00.877 that I've tried it out as forwards, NOTE Confidence: 0.853862995555556 00:04:00.880 --> 00:04:02.483 but it takes the order of what NOTE Confidence: 0.853862995555556 00:04:02.483 --> 00:04:04.535 you just saw in the previous slide NOTE Confidence: 0.853862995555556 00:04:04.535 --> 00:04:06.165 and literally reverses the order. NOTE Confidence: 0.853862995555556 00:04:06.170 --> 00:04:08.081 So we start with the end goal NOTE Confidence: 0.853862995555556 00:04:08.081 --> 00:04:08.900 and then work NOTE Confidence: 0.935036593181818 00:04:08.963 --> 00:04:11.015 backwards if you will to ensure NOTE Confidence: 0.935036593181818 00:04:11.015 --> 00:04:13.089 that the students will get there. NOTE Confidence: 0.935036593181818 00:04:13.090 --> 00:04:16.394 So we start by writing learning objectives. NOTE Confidence: 0.935036593181818 00:04:16.400 --> 00:04:18.409 What should the students know or be NOTE Confidence: 0.935036593181818 00:04:18.409 --> 00:04:20.897 able to do by the end of the course? NOTE Confidence: 0.935036593181818 00:04:20.900 --> 00:04:22.880 And you might have noticed that NOTE Confidence: 0.935036593181818 00:04:22.880 --> 00:04:25.219 Amy and I started with the NOTE Confidence: 0.935036593181818 00:04:25.219 --> 00:04:27.107 learning objectives this morning. NOTE Confidence: 0.935036593181818 00:04:27.110 --> 00:04:30.284 Then we create assessments that measure NOTE Confidence: 0.935036593181818 00:04:30.284 --> 00:04:32.400 whether the learning objectives NOTE Confidence: 0.935036593181818 00:04:32.477 --> 00:04:34.498 have been met. So the students. NOTE Confidence: 0.935036593181818 00:04:34.498 --> 00:04:37.080 This is where we want you to go, NOTE Confidence: 0.935036593181818 00:04:37.080 --> 00:04:40.202 and then we devise a method for NOTE Confidence: 0.935036593181818 00:04:40.202 --> 00:04:42.749 figuring out whether they made it. NOTE Confidence: 0.935036593181818 00:04:42.750 --> 00:04:44.850 And then once we do that, NOTE Confidence: 0.935036593181818 00:04:44.850 --> 00:04:46.565 then we can plan the course content. NOTE Confidence: 0.935036593181818 00:04:46.570 --> 00:04:48.526 This is giving them the tools NOTE Confidence: 0.935036593181818 00:04:48.526 --> 00:04:50.599 that they need to get there. NOTE Confidence: 0.935036593181818 00:04:50.600 --> 00:04:51.980 So why is this better? NOTE Confidence: 0.935036593181818 00:04:51.980 --> 00:04:52.889 Next slide, please. NOTE Confidence: 0.90074300125 00:04:56.760 --> 00:04:59.904 So there are benefits to both the students NOTE Confidence: 0.90074300125 00:04:59.904 --> 00:05:03.129 and the faculty for doing it this way, NOTE Confidence: 0.90074300125 00:05:03.130 --> 00:05:04.925 so benefits to students transparency NOTE Confidence: 0.90074300125 00:05:04.925 --> 00:05:07.594 so you can see this is someone looking NOTE Confidence: 0.90074300125 00:05:07.594 --> 00:05:10.550 at a map and we tend to think of the NOTE Confidence: 0.90074300125 00:05:10.550 --> 00:05:12.560 learning objectives as a road map. NOTE Confidence: 0.90074300125 00:05:12.560 --> 00:05:14.541 Again, we're showing the students this is NOTE Confidence: 0.90074300125 00:05:14.541 --> 00:05:16.767 where we want you to go over the course NOTE Confidence: 0.90074300125 00:05:16.767 --> 00:05:18.579 of whatever it is we're presenting, NOTE Confidence: 0.90074300125 00:05:18.580 --> 00:05:20.756 either the in an 8 week course or NOTE Confidence: 0.90074300125 00:05:20.756 --> 00:05:23.379 a 15 week course over a semester, NOTE Confidence: 0.90074300125 00:05:23.380 --> 00:05:26.416 or a one hour workshop to be honest, so. NOTE Confidence: 0.90074300125 00:05:26.416 --> 00:05:28.912 If we have transparency and goals NOTE Confidence: 0.90074300125 00:05:28.912 --> 00:05:29.744 and expectations, NOTE Confidence: 0.90074300125 00:05:29.750 --> 00:05:32.586 it works better for everyone when the NOTE Confidence: 0.90074300125 00:05:32.586 --> 00:05:33.778 instructor has explicitly defined NOTE Confidence: 0.90074300125 00:05:33.778 --> 00:05:35.530 the learning goals of the course, NOTE Confidence: 0.90074300125 00:05:35.530 --> 00:05:37.658 then the learners have a better idea of NOTE Confidence: 0.90074300125 00:05:37.658 --> 00:05:40.240 what the instructor wants them to get out of. NOTE Confidence: 0.90074300125 00:05:40.240 --> 00:05:42.460 All the learning activities, NOTE Confidence: 0.90074300125 00:05:42.460 --> 00:05:44.680 including non graded activities NOTE Confidence: 0.90074300125 00:05:44.680 --> 00:05:47.668 as well as graded assessments. NOTE Confidence: 0.90074300125 00:05:47.670 --> 00:05:50.630 As well, contrary to what I said previously, NOTE Confidence: 0.90074300125 00:05:50.630 --> 00:05:52.670 this is a student centered way NOTE Confidence: 0.90074300125 00:05:52.670 --> 00:05:54.030 of designing a course. NOTE Confidence: 0.90074300125 00:05:54.030 --> 00:05:56.388 So since this model focuses on NOTE Confidence: 0.90074300125 00:05:56.388 --> 00:05:58.386 student learning objectives and not NOTE Confidence: 0.90074300125 00:05:58.386 --> 00:06:00.510 what the instructor wants to teach, NOTE Confidence: 0.90074300125 00:06:00.510 --> 00:06:03.345 it's grounded in student centered NOTE Confidence: 0.90074300125 00:06:03.345 --> 00:06:04.479 learning principles. NOTE Confidence: 0.90074300125 00:06:04.480 --> 00:06:06.530 Evidence from the educational literature NOTE Confidence: 0.90074300125 00:06:06.530 --> 00:06:08.580 suggests that a student centered NOTE Confidence: 0.90074300125 00:06:08.642 --> 00:06:10.467 approach engages students in the NOTE Confidence: 0.90074300125 00:06:10.467 --> 00:06:12.701 learning process much better and helps NOTE Confidence: 0.90074300125 00:06:12.701 --> 00:06:14.441 students connect theory to practice NOTE Confidence: 0.90074300125 00:06:14.441 --> 00:06:16.506 reflect on their own learning and NOTE Confidence: 0.90074300125 00:06:16.506 --> 00:06:18.504 construct new knowledge as they build NOTE Confidence: 0.90074300125 00:06:18.504 --> 00:06:20.600 upon prior knowledge and experience. NOTE Confidence: 0.795797408888889 00:06:22.830 --> 00:06:23.858 Next slide. NOTE Confidence: 0.795797408888889 00:06:23.858 --> 00:06:27.456 So what are the benefits for faculty? NOTE Confidence: 0.795797408888889 00:06:27.460 --> 00:06:29.130 For the instructor, there is NOTE Confidence: 0.795797408888889 00:06:29.130 --> 00:06:30.800 intentionality in the course design, NOTE Confidence: 0.795797408888889 00:06:30.800 --> 00:06:33.150 and this innately encourages intentionally. NOTE Confidence: 0.795797408888889 00:06:33.150 --> 00:06:34.938 This method innately encourages NOTE Confidence: 0.795797408888889 00:06:34.938 --> 00:06:36.726 intentionality during the design NOTE Confidence: 0.795797408888889 00:06:36.726 --> 00:06:38.371 process because it encourages NOTE Confidence: 0.795797408888889 00:06:38.371 --> 00:06:40.101 the instructor to establish the NOTE Confidence: 0.795797408888889 00:06:40.101 --> 00:06:42.063 purpose of doing something before NOTE Confidence: 0.795797408888889 00:06:42.063 --> 00:06:44.218 incorporating it into the curriculum. NOTE Confidence: 0.795797408888889 00:06:44.220 --> 00:06:46.130 This also eliminates the possibility NOTE Confidence: 0.795797408888889 00:06:46.130 --> 00:06:48.040 of doing certain activities or NOTE Confidence: 0.795797408888889 00:06:48.103 --> 00:06:49.646 planning certain assessments just NOTE Confidence: 0.795797408888889 00:06:49.646 --> 00:06:51.818 for the sake of having something. NOTE Confidence: 0.795797408888889 00:06:51.820 --> 00:06:52.244 For example, NOTE Confidence: 0.795797408888889 00:06:52.244 --> 00:06:53.516 at the end of that lecture. NOTE Confidence: 0.846927015 00:06:57.030 --> 00:06:59.010 So how do we go about NOTE Confidence: 0.846927015 00:06:59.010 --> 00:07:00.330 backwards of course design? NOTE Confidence: 0.846927015 00:07:00.330 --> 00:07:03.650 So again, step one is to write the NOTE Confidence: 0.846927015 00:07:03.650 --> 00:07:06.315 learning objectives and the best learning NOTE Confidence: 0.846927015 00:07:06.315 --> 00:07:08.943 objectives are ones that are smart. NOTE Confidence: 0.846927015 00:07:08.950 --> 00:07:11.998 So I'll talk about that in a minute. NOTE Confidence: 0.846927015 00:07:12.000 --> 00:07:15.264 The best way that I've I've heard this NOTE Confidence: 0.846927015 00:07:15.264 --> 00:07:17.654 described in terms of writing the learning NOTE Confidence: 0.846927015 00:07:17.654 --> 00:07:20.399 objectives is how at the end of the course, NOTE Confidence: 0.846927015 00:07:20.400 --> 00:07:22.476 how would you differentiate someone who NOTE Confidence: 0.846927015 00:07:22.476 --> 00:07:24.998 took your course from someone who didn't. NOTE Confidence: 0.846927015 00:07:25.000 --> 00:07:26.662 So what knowledge and skills will NOTE Confidence: 0.846927015 00:07:26.662 --> 00:07:28.407 they have that someone who didn't NOTE Confidence: 0.846927015 00:07:28.407 --> 00:07:29.857 take the course wouldn't have, NOTE Confidence: 0.846927015 00:07:29.860 --> 00:07:31.560 or that they didn't have NOTE Confidence: 0.846927015 00:07:31.560 --> 00:07:33.260 before they took the course, NOTE Confidence: 0.846927015 00:07:33.260 --> 00:07:35.164 so you're giving them a road map NOTE Confidence: 0.846927015 00:07:35.164 --> 00:07:36.910 through where you want them to go. NOTE Confidence: 0.846927015 00:07:36.910 --> 00:07:37.450 So again, NOTE Confidence: 0.846927015 00:07:37.450 --> 00:07:39.070 the best learning objectives are those NOTE Confidence: 0.846927015 00:07:39.070 --> 00:07:40.946 that are smart and hopefully some of NOTE Confidence: 0.846927015 00:07:40.946 --> 00:07:42.660 you are familiar with this nemonic, NOTE Confidence: 0.846927015 00:07:42.660 --> 00:07:45.173 which helps us remember the most important NOTE Confidence: 0.846927015 00:07:45.173 --> 00:07:47.809 attributes of a good learning objective, NOTE Confidence: 0.846927015 00:07:47.810 --> 00:07:51.170 so learning objectives should be specific, NOTE Confidence: 0.846927015 00:07:51.170 --> 00:07:52.148 measurable, attainable, NOTE Confidence: 0.846927015 00:07:52.148 --> 00:07:55.571 or some people use the word achievable NOTE Confidence: 0.846927015 00:07:55.571 --> 00:07:58.369 for the a relevant and time based. NOTE Confidence: 0.846927015 00:07:58.370 --> 00:08:00.484 So let's unpack that a little bit. NOTE Confidence: 0.846927015 00:08:00.490 --> 00:08:03.082 So specific means that the learning NOTE Confidence: 0.846927015 00:08:03.082 --> 00:08:05.207 objective should precisely state exactly NOTE Confidence: 0.846927015 00:08:05.207 --> 00:08:07.807 what the learner should be able to do. NOTE Confidence: 0.846927015 00:08:07.810 --> 00:08:09.567 You don't want something that's too general, NOTE Confidence: 0.846927015 00:08:09.570 --> 00:08:11.042 like they should understand NOTE Confidence: 0.846927015 00:08:11.042 --> 00:08:12.146 public health better. NOTE Confidence: 0.846927015 00:08:12.150 --> 00:08:13.006 That's nice, NOTE Confidence: 0.846927015 00:08:13.006 --> 00:08:15.146 but that's not very specific, NOTE Confidence: 0.846927015 00:08:15.150 --> 00:08:17.124 so give them an idea of very NOTE Confidence: 0.846927015 00:08:17.124 --> 00:08:18.946 specifically what it is that they NOTE Confidence: 0.846927015 00:08:18.946 --> 00:08:20.782 should be gaining from this course. NOTE Confidence: 0.846927015 00:08:20.790 --> 00:08:22.530 What should they be able to NOTE Confidence: 0.846927015 00:08:22.530 --> 00:08:24.460 do by the time it's over? NOTE Confidence: 0.846927015 00:08:24.460 --> 00:08:26.560 The learning objective should be measurable. NOTE Confidence: 0.846927015 00:08:26.560 --> 00:08:27.770 It should be something that NOTE Confidence: 0.846927015 00:08:27.770 --> 00:08:28.980 you can observe or assess. NOTE Confidence: 0.846927015 00:08:28.980 --> 00:08:30.515 If you can't measure whether NOTE Confidence: 0.846927015 00:08:30.515 --> 00:08:31.436 they've achieved it, NOTE Confidence: 0.846927015 00:08:31.440 --> 00:08:33.757 then it's not a very useful objective. NOTE Confidence: 0.846927015 00:08:33.760 --> 00:08:34.092 Also, NOTE Confidence: 0.846927015 00:08:34.092 --> 00:08:36.084 the students need to be able NOTE Confidence: 0.846927015 00:08:36.084 --> 00:08:37.645 to measure whether they've NOTE Confidence: 0.846927015 00:08:37.645 --> 00:08:39.649 achieved the learning objective. NOTE Confidence: 0.846927015 00:08:39.650 --> 00:08:41.290 It should be attainable again, NOTE Confidence: 0.846927015 00:08:41.290 --> 00:08:41.994 or achievable, NOTE Confidence: 0.846927015 00:08:41.994 --> 00:08:44.458 which means that the learner has what NOTE Confidence: 0.846927015 00:08:44.458 --> 00:08:46.906 they need in order to meet the objective NOTE Confidence: 0.846927015 00:08:46.906 --> 00:08:49.759 in terms of background skills or knowledge. NOTE Confidence: 0.846927015 00:08:49.760 --> 00:08:53.694 So this might be that they've taken NOTE Confidence: 0.846927015 00:08:53.694 --> 00:08:57.023 a prerequisite course or that they've NOTE Confidence: 0.846927015 00:08:57.023 --> 00:08:59.462 done prior reading that you've assigned. NOTE Confidence: 0.846927015 00:08:59.462 --> 00:09:01.961 But make sure that they have what NOTE Confidence: 0.846927015 00:09:01.961 --> 00:09:04.145 they need in order to be successful. NOTE Confidence: 0.846927015 00:09:04.150 --> 00:09:06.268 It should clearly be relevant related NOTE Confidence: 0.846927015 00:09:06.268 --> 00:09:08.729 to the course or the discipline. NOTE Confidence: 0.846927015 00:09:08.730 --> 00:09:10.870 While it would be nice if all of my students. NOTE Confidence: 0.846927015 00:09:10.870 --> 00:09:12.082 Learn to make a cheese souffle NOTE Confidence: 0.846927015 00:09:12.082 --> 00:09:13.180 over the next eight weeks. NOTE Confidence: 0.846927015 00:09:13.180 --> 00:09:14.494 It's probably not relevant to what NOTE Confidence: 0.846927015 00:09:14.494 --> 00:09:16.050 it is that I'm teaching them, NOTE Confidence: 0.846927015 00:09:16.050 --> 00:09:18.143 so that wouldn't be a very useful NOTE Confidence: 0.846927015 00:09:18.143 --> 00:09:19.689 learning objective for the course. NOTE Confidence: 0.846927015 00:09:19.690 --> 00:09:20.232 And finally, NOTE Confidence: 0.846927015 00:09:20.232 --> 00:09:21.587 it should be time based, NOTE Confidence: 0.846927015 00:09:21.590 --> 00:09:23.270 so it should be realistic in that NOTE Confidence: 0.846927015 00:09:23.270 --> 00:09:24.700 it's something that can be achieved NOTE Confidence: 0.846927015 00:09:24.700 --> 00:09:26.026 over the time that you have, NOTE Confidence: 0.846927015 00:09:26.030 --> 00:09:27.906 whether and it's an 8 week term NOTE Confidence: 0.846927015 00:09:27.906 --> 00:09:30.603 or a 15 week semester or a one NOTE Confidence: 0.846927015 00:09:30.603 --> 00:09:32.423 hour workshop or or symposium. NOTE Confidence: 0.893297523 00:09:34.440 --> 00:09:36.735 So I'm going to dig a little bit more NOTE Confidence: 0.893297523 00:09:36.735 --> 00:09:39.091 into the M in smart or measurable because NOTE Confidence: 0.893297523 00:09:39.091 --> 00:09:41.489 this is the domain where most learning NOTE Confidence: 0.893297523 00:09:41.489 --> 00:09:43.987 objectives fail to meet the smart criteria. NOTE Confidence: 0.893297523 00:09:43.987 --> 00:09:47.201 I hope that all of you have have at least NOTE Confidence: 0.893297523 00:09:47.201 --> 00:09:50.209 heard of Bloom's taxonomy and maybe have seen NOTE Confidence: 0.893297523 00:09:50.209 --> 00:09:53.314 the diagram that's on the screen right now, NOTE Confidence: 0.893297523 00:09:53.320 --> 00:09:55.720 so this is a paradigm for NOTE Confidence: 0.893297523 00:09:55.720 --> 00:09:57.320 measuring levels of learning, NOTE Confidence: 0.893297523 00:09:57.320 --> 00:09:59.496 and it's it's widely used and and you NOTE Confidence: 0.893297523 00:09:59.496 --> 00:10:01.658 can Google it and you'll find it really NOTE Confidence: 0.893297523 00:10:01.658 --> 00:10:04.164 quickly and you can see that it's. NOTE Confidence: 0.893297523 00:10:04.170 --> 00:10:06.360 Designed as a pyramid intentionally NOTE Confidence: 0.893297523 00:10:06.360 --> 00:10:09.289 because each level builds upon the prior. NOTE Confidence: 0.893297523 00:10:09.290 --> 00:10:11.730 So at the bottom of the pyramid are NOTE Confidence: 0.893297523 00:10:11.730 --> 00:10:14.150 the very basic levels of learning. NOTE Confidence: 0.893297523 00:10:14.150 --> 00:10:15.360 Clearly we want students to NOTE Confidence: 0.893297523 00:10:15.360 --> 00:10:16.570 remember what we told them, NOTE Confidence: 0.893297523 00:10:16.570 --> 00:10:18.098 even better than remembering NOTE Confidence: 0.893297523 00:10:18.098 --> 00:10:20.390 it is if they understand it, NOTE Confidence: 0.893297523 00:10:20.390 --> 00:10:21.770 but that's sort of superficial. NOTE Confidence: 0.893297523 00:10:21.770 --> 00:10:24.276 And then as you go deeper or NOTE Confidence: 0.893297523 00:10:24.276 --> 00:10:26.390 rather higher up the pyramid, NOTE Confidence: 0.893297523 00:10:26.390 --> 00:10:28.700 even better is if students can apply NOTE Confidence: 0.893297523 00:10:28.700 --> 00:10:30.788 what they've learned to a new scenario. NOTE Confidence: 0.893297523 00:10:30.790 --> 00:10:33.046 If they can analyze or evaluate NOTE Confidence: 0.893297523 00:10:33.046 --> 00:10:34.174 what they've learned. NOTE Confidence: 0.893297523 00:10:34.180 --> 00:10:34.732 And ideally, NOTE Confidence: 0.893297523 00:10:34.732 --> 00:10:37.351 if they can get to the deepest level of NOTE Confidence: 0.893297523 00:10:37.351 --> 00:10:39.096 learning where they're creating something NOTE Confidence: 0.893297523 00:10:39.096 --> 00:10:41.459 new based on what they've learned. NOTE Confidence: 0.893297523 00:10:41.460 --> 00:10:45.748 So these words in the pyramid are nice, NOTE Confidence: 0.893297523 00:10:45.750 --> 00:10:48.630 but they're not sort of the best verbs NOTE Confidence: 0.893297523 00:10:48.630 --> 00:10:50.938 for writing a learning objective. NOTE Confidence: 0.893297523 00:10:50.940 --> 00:10:52.102 For example, NOTE Confidence: 0.893297523 00:10:52.102 --> 00:10:55.007 understand you can't directly measure NOTE Confidence: 0.893297523 00:10:55.007 --> 00:10:57.580 whether someone understands something. NOTE Confidence: 0.893297523 00:10:57.580 --> 00:10:59.776 You can measure the manifestation of NOTE Confidence: 0.893297523 00:10:59.776 --> 00:11:01.597 their understanding by asking them NOTE Confidence: 0.893297523 00:11:01.597 --> 00:11:03.355 to relate something back to you. NOTE Confidence: 0.893297523 00:11:03.360 --> 00:11:04.837 So if you look on the right NOTE Confidence: 0.893297523 00:11:04.837 --> 00:11:06.160 hand side of the pyramid, NOTE Confidence: 0.893297523 00:11:06.160 --> 00:11:07.545 you'll see verbs that get NOTE Confidence: 0.893297523 00:11:07.545 --> 00:11:09.500 at the idea in the pyramid. NOTE Confidence: 0.893297523 00:11:09.500 --> 00:11:10.337 So for example, NOTE Confidence: 0.893297523 00:11:10.337 --> 00:11:11.453 for understand I can't NOTE Confidence: 0.893297523 00:11:11.453 --> 00:11:12.839 really see inside your head. NOTE Confidence: 0.893297523 00:11:12.840 --> 00:11:15.108 I can't see whether you understand something, NOTE Confidence: 0.893297523 00:11:15.110 --> 00:11:16.566 but you can describe it to me NOTE Confidence: 0.893297523 00:11:16.566 --> 00:11:18.129 or you can explain it to me, NOTE Confidence: 0.893297523 00:11:18.130 --> 00:11:19.672 or you can identify something and NOTE Confidence: 0.893297523 00:11:19.672 --> 00:11:21.312 that will let me know whether NOTE Confidence: 0.893297523 00:11:21.312 --> 00:11:22.707 or not you understand it. NOTE Confidence: 0.851571416666667 00:11:24.720 --> 00:11:30.498 All right so. Oh this so I took this NOTE Confidence: 0.851571416666667 00:11:30.498 --> 00:11:32.990 picture on the Johns Hopkins Mount NOTE Confidence: 0.851571416666667 00:11:32.990 --> 00:11:35.352 Washington campus two months ago when NOTE Confidence: 0.851571416666667 00:11:35.352 --> 00:11:37.917 I went to pick up my COVID tests that NOTE Confidence: 0.851571416666667 00:11:37.988 --> 00:11:40.568 they have made available for everyone. NOTE Confidence: 0.851571416666667 00:11:40.570 --> 00:11:42.722 And I just happened to be walking past NOTE Confidence: 0.851571416666667 00:11:42.722 --> 00:11:44.830 this bulletin board and I stopped and did NOTE Confidence: 0.851571416666667 00:11:44.830 --> 00:11:46.827 a double take because I saw smart goals. NOTE Confidence: 0.851571416666667 00:11:46.830 --> 00:11:49.028 This was in front of the gym NOTE Confidence: 0.851571416666667 00:11:49.028 --> 00:11:51.248 and so I just found it. NOTE Confidence: 0.851571416666667 00:11:51.250 --> 00:11:52.930 You know, funny because we were NOTE Confidence: 0.851571416666667 00:11:52.930 --> 00:11:54.320 putting this workshop together but NOTE Confidence: 0.851571416666667 00:11:54.320 --> 00:11:55.867 it just shows that smart applies to NOTE Confidence: 0.851571416666667 00:11:55.867 --> 00:11:57.488 more than just learning objectives. NOTE Confidence: 0.851571416666667 00:11:57.490 --> 00:12:00.080 This is in relation to fitness goals, NOTE Confidence: 0.851571416666667 00:12:00.080 --> 00:12:01.949 so same thing the goals should be NOTE Confidence: 0.851571416666667 00:12:01.949 --> 00:12:03.811 specific and they should be measurable NOTE Confidence: 0.851571416666667 00:12:03.811 --> 00:12:05.486 and they should be attainable NOTE Confidence: 0.851571416666667 00:12:05.486 --> 00:12:07.000 and realistic and time based, NOTE Confidence: 0.851571416666667 00:12:07.000 --> 00:12:09.168 even if it's a fitness goal for your NOTE Confidence: 0.851571416666667 00:12:09.168 --> 00:12:11.470 own workout regimen and not a learning NOTE Confidence: 0.851571416666667 00:12:11.470 --> 00:12:13.740 objective that you're writing for a course. NOTE Confidence: 0.851571416666667 00:12:13.740 --> 00:12:16.998 So this nemonic is applicable in NOTE Confidence: 0.851571416666667 00:12:16.998 --> 00:12:20.290 in lots of areas. OK, thank you so. NOTE Confidence: 0.851571416666667 00:12:20.290 --> 00:12:23.628 I want to give you an example now of a NOTE Confidence: 0.851571416666667 00:12:23.628 --> 00:12:25.998 smart learning offset objective and at NOTE Confidence: 0.851571416666667 00:12:26.078 --> 00:12:28.796 the top you can see that I've tied this NOTE Confidence: 0.851571416666667 00:12:28.796 --> 00:12:31.290 to our first workshop objective that I NOTE Confidence: 0.851571416666667 00:12:31.290 --> 00:12:34.538 showed you at the beginning of the session, NOTE Confidence: 0.851571416666667 00:12:34.540 --> 00:12:36.708 which is that I would like for you NOTE Confidence: 0.851571416666667 00:12:36.708 --> 00:12:38.556 to be able to describe the components NOTE Confidence: 0.851571416666667 00:12:38.556 --> 00:12:40.369 of a smart learning objective. NOTE Confidence: 0.851571416666667 00:12:40.370 --> 00:12:42.113 So on the left we have some NOTE Confidence: 0.851571416666667 00:12:42.113 --> 00:12:43.560 information that's all hypothetical. NOTE Confidence: 0.851571416666667 00:12:43.560 --> 00:12:45.534 So let's say there's a force called NOTE Confidence: 0.851571416666667 00:12:45.534 --> 00:12:47.405 introduction to the history of public NOTE Confidence: 0.851571416666667 00:12:47.405 --> 00:12:49.343 health vaccine campaigns in the United NOTE Confidence: 0.851571416666667 00:12:49.343 --> 00:12:51.517 States and the instructor for this course. NOTE Confidence: 0.851571416666667 00:12:51.520 --> 00:12:52.648 Has written this learning NOTE Confidence: 0.851571416666667 00:12:52.648 --> 00:12:54.770 objective at the end of the course, NOTE Confidence: 0.851571416666667 00:12:54.770 --> 00:12:56.948 students will be able to understand NOTE Confidence: 0.851571416666667 00:12:56.948 --> 00:12:58.979 the history of global public NOTE Confidence: 0.851571416666667 00:12:58.979 --> 00:13:00.509 health vaccine campaigns. NOTE Confidence: 0.851571416666667 00:13:00.510 --> 00:13:05.284 So let's talk about whether this learning NOTE Confidence: 0.851571416666667 00:13:05.284 --> 00:13:09.119 objective meets the smart criteria. NOTE Confidence: 0.851571416666667 00:13:09.120 --> 00:13:11.520 So any if you can click? NOTE Confidence: 0.782745398571429 00:13:14.820 --> 00:13:17.795 So sorry I should have asked first, NOTE Confidence: 0.782745398571429 00:13:17.800 --> 00:13:21.118 so so is this learning objectives NOTE Confidence: 0.782745398571429 00:13:21.120 --> 00:13:24.242 specific and you can see that I NOTE Confidence: 0.782745398571429 00:13:24.242 --> 00:13:26.659 don't think that's a specific. NOTE Confidence: 0.782745398571429 00:13:26.660 --> 00:13:29.128 It's very broad, right? NOTE Confidence: 0.782745398571429 00:13:29.128 --> 00:13:31.596 It's understanding the entire NOTE Confidence: 0.782745398571429 00:13:31.596 --> 00:13:34.424 history of not just public health NOTE Confidence: 0.782745398571429 00:13:34.424 --> 00:13:36.234 vaccine campaigns in the US, NOTE Confidence: 0.782745398571429 00:13:36.240 --> 00:13:38.300 but globally over, you know, NOTE Confidence: 0.782745398571429 00:13:38.300 --> 00:13:40.736 across all time it's very broad. NOTE Confidence: 0.782745398571429 00:13:40.740 --> 00:13:42.785 It's probably a huge topic NOTE Confidence: 0.782745398571429 00:13:42.785 --> 00:13:44.830 that would take longer than. NOTE Confidence: 0.782745398571429 00:13:44.830 --> 00:13:46.288 One would have in this course, NOTE Confidence: 0.782745398571429 00:13:46.290 --> 00:13:47.688 and it's not specific at all. NOTE Confidence: 0.782745398571429 00:13:47.690 --> 00:13:49.115 There's lots of different pathways NOTE Confidence: 0.782745398571429 00:13:49.115 --> 00:13:51.090 that one could take to get there, NOTE Confidence: 0.782745398571429 00:13:51.090 --> 00:13:53.092 so I would say it is not NOTE Confidence: 0.782745398571429 00:13:53.092 --> 00:13:54.740 specific what about measurable. NOTE Confidence: 0.782745398571429 00:13:54.740 --> 00:13:56.820 What does anyone want to? NOTE Confidence: 0.782745398571429 00:13:56.820 --> 00:13:58.740 Raise your hand or put in the chat NOTE Confidence: 0.782745398571429 00:13:58.740 --> 00:14:00.536 and and talk about whether you NOTE Confidence: 0.782745398571429 00:14:00.536 --> 00:14:02.420 find this to be measurable based NOTE Confidence: 0.782745398571429 00:14:02.483 --> 00:14:04.229 on the blooms taxonomy verbs that NOTE Confidence: 0.782745398571429 00:14:04.229 --> 00:14:06.060 we talked about a moment ago. NOTE Confidence: 0.808173476625 00:14:09.750 --> 00:14:11.250 It's she says it's hard NOTE Confidence: 0.808173476625 00:14:11.250 --> 00:14:12.150 to measure understanding. NOTE Confidence: 0.808173476625 00:14:12.150 --> 00:14:12.936 That's exactly right. NOTE Confidence: 0.808173476625 00:14:12.936 --> 00:14:14.508 I feel exactly the same way. NOTE Confidence: 0.808173476625 00:14:14.510 --> 00:14:16.772 You can't really see whether somebody NOTE Confidence: 0.808173476625 00:14:16.772 --> 00:14:18.280 understands something unless they NOTE Confidence: 0.808173476625 00:14:18.333 --> 00:14:20.085 do something to demonstrate for you NOTE Confidence: 0.808173476625 00:14:20.085 --> 00:14:22.049 whether or not they understand it. NOTE Confidence: 0.808173476625 00:14:22.050 --> 00:14:23.930 So I would say it is not measurable. NOTE Confidence: 0.808173476625 00:14:23.930 --> 00:14:25.910 What about a team of people? NOTE Confidence: 0.808173476625 00:14:25.910 --> 00:14:28.010 That's kind of a tricky 1. NOTE Confidence: 0.808173476625 00:14:28.010 --> 00:14:28.770 But what do you think? NOTE Confidence: 0.906755192222222 00:14:34.470 --> 00:14:36.254 Yeah, that's that's that's NOTE Confidence: 0.906755192222222 00:14:36.254 --> 00:14:38.484 kind of a tricky 1. NOTE Confidence: 0.906755192222222 00:14:38.490 --> 00:14:39.722 Daniella says not attainable. NOTE Confidence: 0.906755192222222 00:14:39.722 --> 00:14:41.827 The class is about the US, right? NOTE Confidence: 0.906755192222222 00:14:41.827 --> 00:14:43.369 So so I would say that's NOTE Confidence: 0.906755192222222 00:14:43.369 --> 00:14:44.730 why it's not specific. NOTE Confidence: 0.906755192222222 00:14:44.730 --> 00:14:47.155 But I also agree it's NOTE Confidence: 0.906755192222222 00:14:47.155 --> 00:14:48.610 probably not attainable. NOTE Confidence: 0.906755192222222 00:14:48.610 --> 00:14:51.160 Likely someone would need much more NOTE Confidence: 0.906755192222222 00:14:51.160 --> 00:14:53.273 information than is being delivered NOTE Confidence: 0.906755192222222 00:14:53.273 --> 00:14:56.001 in this course to be able to go NOTE Confidence: 0.906755192222222 00:14:56.001 --> 00:14:58.230 broader and understand the entire. NOTE Confidence: 0.906755192222222 00:14:58.230 --> 00:14:59.742 Global history of public NOTE Confidence: 0.906755192222222 00:14:59.742 --> 00:15:00.876 health vaccine campaigns. NOTE Confidence: 0.906755192222222 00:15:00.880 --> 00:15:01.948 Is it relevant? NOTE Confidence: 0.804583575714286 00:15:15.700 --> 00:15:18.129 There's one one no vote anyone else? NOTE Confidence: 0.898247730909091 00:15:20.380 --> 00:15:22.412 I'd say it's relevant, NOTE Confidence: 0.898247730909091 00:15:22.412 --> 00:15:26.120 it's it's relevant sort of plus right. NOTE Confidence: 0.898247730909091 00:15:26.120 --> 00:15:27.260 It's relevant to the topic, NOTE Confidence: 0.898247730909091 00:15:27.260 --> 00:15:30.704 but it's much more broad to the topics. NOTE Confidence: 0.898247730909091 00:15:30.704 --> 00:15:34.200 Thanks selene. Relevant to. NOTE Confidence: 0.898247730909091 00:15:34.200 --> 00:15:36.036 And it depends my favorite answer. NOTE Confidence: 0.898247730909091 00:15:36.040 --> 00:15:38.192 It does depend you know and and some NOTE Confidence: 0.898247730909091 00:15:38.192 --> 00:15:40.350 of these things are not very clearly NOTE Confidence: 0.898247730909091 00:15:40.350 --> 00:15:42.366 cut black or white, it's it's. NOTE Confidence: 0.898247730909091 00:15:42.366 --> 00:15:43.898 It's a judgment call, NOTE Confidence: 0.898247730909091 00:15:43.900 --> 00:15:48.292 but you want to be as adherent to these NOTE Confidence: 0.898247730909091 00:15:48.300 --> 00:15:50.484 these five areas as you possibly can NOTE Confidence: 0.898247730909091 00:15:50.484 --> 00:15:52.958 when writing a good learning objective. NOTE Confidence: 0.898247730909091 00:15:52.960 --> 00:15:56.320 And finally, time based. NOTE Confidence: 0.898247730909091 00:15:56.320 --> 00:15:58.480 Amy. No, I don't think so. NOTE Confidence: 0.898247730909091 00:15:58.480 --> 00:16:00.388 I think it would take a lot more than NOTE Confidence: 0.898247730909091 00:16:00.388 --> 00:16:02.269 probably the eight weeks if the eight weeks, NOTE Confidence: 0.898247730909091 00:16:02.270 --> 00:16:04.580 assuming it's eight weeks right? NOTE Confidence: 0.898247730909091 00:16:04.580 --> 00:16:08.153 If that time is planned for just the US NOTE Confidence: 0.898247730909091 00:16:08.153 --> 00:16:11.170 history and it's just an introduction, NOTE Confidence: 0.898247730909091 00:16:11.170 --> 00:16:13.738 there's probably a lot more to be said, NOTE Confidence: 0.898247730909091 00:16:13.740 --> 00:16:16.026 so probably not not the best NOTE Confidence: 0.898247730909091 00:16:16.026 --> 00:16:18.550 in terms of being time based. NOTE Confidence: 0.952041925 00:16:20.590 --> 00:16:22.270 OK, so let's make it smart. NOTE Confidence: 0.952041925 00:16:22.270 --> 00:16:25.277 Let's say we change it now so NOTE Confidence: 0.952041925 00:16:25.277 --> 00:16:27.006 you can see it's the same course, NOTE Confidence: 0.952041925 00:16:27.010 --> 00:16:29.326 but now the learning objective is NOTE Confidence: 0.952041925 00:16:29.326 --> 00:16:31.345 to describe the events surrounding NOTE Confidence: 0.952041925 00:16:31.345 --> 00:16:33.345 the origin of the smallpox NOTE Confidence: 0.952041925 00:16:33.345 --> 00:16:35.570 vaccine in the 19th century. NOTE Confidence: 0.952041925 00:16:35.570 --> 00:16:39.315 So now what do we think about NOTE Confidence: 0.952041925 00:16:39.315 --> 00:16:41.770 whether this is? Specific. NOTE Confidence: 0.889148986666667 00:16:44.120 --> 00:16:45.776 Anyone want to change their answer? NOTE Confidence: 0.7505860775 00:16:55.980 --> 00:16:56.740 Any you can click? NOTE Confidence: 0.889674731428571 00:17:04.250 --> 00:17:06.210 This one doesn't have the same animation, NOTE Confidence: 0.889674731428571 00:17:06.210 --> 00:17:10.630 so we'll just have to name it. Well. NOTE Confidence: 0.889674731428571 00:17:10.630 --> 00:17:13.745 It should. Maybe it went away somehow. NOTE Confidence: 0.9273217625 00:17:16.120 --> 00:17:19.104 Weird, OK, well, we'll just swing it then. NOTE Confidence: 0.9273217625 00:17:19.110 --> 00:17:20.888 All right so I would say this NOTE Confidence: 0.9273217625 00:17:20.888 --> 00:17:23.017 is much more specific than the NOTE Confidence: 0.9273217625 00:17:23.017 --> 00:17:24.926 other learning objective, right? NOTE Confidence: 0.9273217625 00:17:24.926 --> 00:17:27.956 It's not the global history. NOTE Confidence: 0.9273217625 00:17:27.960 --> 00:17:30.062 It's not even the entire U.S. history. NOTE Confidence: 0.9273217625 00:17:30.062 --> 00:17:32.954 It's specific to events surrounding the NOTE Confidence: 0.9273217625 00:17:32.954 --> 00:17:36.508 origin of the smallpox vaccine campaign. NOTE Confidence: 0.9273217625 00:17:36.510 --> 00:17:37.802 Given certain time period. NOTE Confidence: 0.9273217625 00:17:37.802 --> 00:17:40.709 So I would say it is now specific. NOTE Confidence: 0.9273217625 00:17:40.710 --> 00:17:43.368 It's also measurable because now we're NOTE Confidence: 0.9273217625 00:17:43.368 --> 00:17:46.568 using the word describe and not understand. NOTE Confidence: 0.9273217625 00:17:46.570 --> 00:17:50.462 So in asking students to describe something NOTE Confidence: 0.9273217625 00:17:50.462 --> 00:17:54.769 you can measure based on their description, NOTE Confidence: 0.9273217625 00:17:54.770 --> 00:17:57.152 their level of understanding of the NOTE Confidence: 0.9273217625 00:17:57.152 --> 00:17:59.110 information that you've given them, NOTE Confidence: 0.9273217625 00:17:59.110 --> 00:18:02.038 and probably given the fact that NOTE Confidence: 0.9273217625 00:18:02.038 --> 00:18:05.290 it's more narrow and more specific, NOTE Confidence: 0.9273217625 00:18:05.290 --> 00:18:07.126 it is more attainable. NOTE Confidence: 0.9273217625 00:18:07.126 --> 00:18:08.962 Relevant and likely achievable NOTE Confidence: 0.9273217625 00:18:08.962 --> 00:18:11.029 in the time allotted. NOTE Confidence: 0.9273217625 00:18:11.030 --> 00:18:12.550 So time based as well. NOTE Confidence: 0.933674238888889 00:18:14.910 --> 00:18:18.609 All right, so I don't think we need that. NOTE Confidence: 0.933674238888889 00:18:18.610 --> 00:18:21.760 Oh, it's the next, go ahead. NOTE Confidence: 0.933674238888889 00:18:21.760 --> 00:18:23.386 This was the one with the NOTE Confidence: 0.933674238888889 00:18:23.386 --> 00:18:24.700 with the animations on it. NOTE Confidence: 0.933674238888889 00:18:24.700 --> 00:18:26.476 It's OK, so just click through NOTE Confidence: 0.933674238888889 00:18:26.476 --> 00:18:28.688 and we'll go to the next slide. NOTE Confidence: 0.933674238888889 00:18:28.690 --> 00:18:29.228 Great thanks. NOTE Confidence: 0.933674238888889 00:18:29.228 --> 00:18:31.380 So now we have an activity for you NOTE Confidence: 0.933674238888889 00:18:31.445 --> 00:18:33.149 to try this on your own so you NOTE Confidence: 0.933674238888889 00:18:33.149 --> 00:18:35.324 can see at the top of the next NOTE Confidence: 0.933674238888889 00:18:35.324 --> 00:18:36.716 two learning objectives for this NOTE Confidence: 0.933674238888889 00:18:36.716 --> 00:18:38.578 workshop were to have you be able NOTE Confidence: 0.933674238888889 00:18:38.578 --> 00:18:40.542 to both modify a learning objective NOTE Confidence: 0.933674238888889 00:18:40.542 --> 00:18:42.594 to make it compliant with smart NOTE Confidence: 0.933674238888889 00:18:42.651 --> 00:18:44.679 principles and then write your own. NOTE Confidence: 0.933674238888889 00:18:44.680 --> 00:18:45.976 So for activity one. NOTE Confidence: 0.933674238888889 00:18:45.976 --> 00:18:48.775 I wonder if you can improve upon this NOTE Confidence: 0.933674238888889 00:18:48.775 --> 00:18:51.109 learning objective to make it smart. NOTE Confidence: 0.933674238888889 00:18:51.110 --> 00:18:52.940 So here's this hypothetical learning NOTE Confidence: 0.933674238888889 00:18:52.940 --> 00:18:55.569 objective at the end of this course, NOTE Confidence: 0.933674238888889 00:18:55.570 --> 00:18:57.454 students will be able to know NOTE Confidence: 0.933674238888889 00:18:57.454 --> 00:18:58.710 the similarities and differences. NOTE Confidence: 0.933674238888889 00:18:58.710 --> 00:19:01.900 Between various epidemiologic study designs. NOTE Confidence: 0.933674238888889 00:19:01.900 --> 00:19:04.322 So why don't you take maybe two NOTE Confidence: 0.933674238888889 00:19:04.322 --> 00:19:06.778 minutes and see if you can tweak NOTE Confidence: 0.933674238888889 00:19:06.778 --> 00:19:08.453 that to make it smarter? NOTE Confidence: 0.86080861875 00:19:14.770 --> 00:19:17.250 Daniella, I see you are raising your hands. NOTE Confidence: 0.86080861875 00:19:17.250 --> 00:19:19.650 Do you have a question? NOTE Confidence: 0.86080861875 00:19:19.650 --> 00:19:22.378 I do I have a question about the NOTE Confidence: 0.86080861875 00:19:22.378 --> 00:19:24.731 time based in the pneumonic because NOTE Confidence: 0.86080861875 00:19:24.731 --> 00:19:26.657 with the so with the previous NOTE Confidence: 0.86080861875 00:19:26.657 --> 00:19:28.606 example where you shifted from sort NOTE Confidence: 0.86080861875 00:19:28.606 --> 00:19:30.460 of knowing all the whole history NOTE Confidence: 0.86080861875 00:19:30.460 --> 00:19:32.300 of global vaccination campaigns to NOTE Confidence: 0.86080861875 00:19:32.300 --> 00:19:34.976 smallpox in the 19th century is the NOTE Confidence: 0.86080861875 00:19:34.976 --> 00:19:37.722 time based supposed to be about? NOTE Confidence: 0.86080861875 00:19:37.722 --> 00:19:40.606 The sort of the topic that you're NOTE Confidence: 0.86080861875 00:19:40.606 --> 00:19:43.010 teaching about or is the time based NOTE Confidence: 0.86080861875 00:19:43.010 --> 00:19:45.188 meant to be about what's achievable NOTE Confidence: 0.86080861875 00:19:45.188 --> 00:19:47.306 in the course the the latter, NOTE Confidence: 0.86080861875 00:19:47.306 --> 00:19:49.700 so it it means that you're you're NOTE Confidence: 0.86080861875 00:19:49.773 --> 00:19:52.539 giving the students enough time to NOTE Confidence: 0.86080861875 00:19:52.539 --> 00:19:54.383 achieve that learning objective NOTE Confidence: 0.86080861875 00:19:54.453 --> 00:19:56.532 over the course of your over the NOTE Confidence: 0.86080861875 00:19:56.532 --> 00:19:57.476 course of your course, NOTE Confidence: 0.86080861875 00:19:57.480 --> 00:19:59.405 so it can be achieved in an NOTE Confidence: 0.86080861875 00:19:59.405 --> 00:20:01.496 8 week term or in a 15 weeks. NOTE Confidence: 0.86080861875 00:20:01.500 --> 00:20:03.180 So, so to that extent, NOTE Confidence: 0.86080861875 00:20:03.180 --> 00:20:05.098 your knowledge of the of the topic NOTE Confidence: 0.86080861875 00:20:05.098 --> 00:20:07.317 itself is part of what define will NOTE Confidence: 0.86080861875 00:20:07.317 --> 00:20:08.992 will help you identify whether NOTE Confidence: 0.86080861875 00:20:08.992 --> 00:20:10.340 something is actually time. NOTE Confidence: 0.86080861875 00:20:10.340 --> 00:20:12.986 OK, so in other words time bound, NOTE Confidence: 0.86080861875 00:20:12.990 --> 00:20:15.070 so because you could very. NOTE Confidence: 0.86080861875 00:20:15.070 --> 00:20:17.390 I mean maybe if you got into all the degree, NOTE Confidence: 0.86080861875 00:20:17.390 --> 00:20:18.806 maybe gritty details you spend a NOTE Confidence: 0.86080861875 00:20:18.806 --> 00:20:20.318 whole course eight week course just NOTE Confidence: 0.86080861875 00:20:20.318 --> 00:20:21.884 teaching about the origins of the NOTE Confidence: 0.86080861875 00:20:21.884 --> 00:20:23.300 smallpox vaccine in the 19th century. NOTE Confidence: 0.86080861875 00:20:23.300 --> 00:20:24.360 Like depending to what detail NOTE Confidence: 0.86080861875 00:20:24.360 --> 00:20:25.946 you want to get into, right? NOTE Confidence: 0.86080861875 00:20:25.946 --> 00:20:27.524 That's exactly right. NOTE Confidence: 0.86080861875 00:20:27.524 --> 00:20:29.989 So thank you as the instructor to decide. NOTE Confidence: 0.86080861875 00:20:29.990 --> 00:20:30.634 OK, this is the. NOTE Confidence: 0.86080861875 00:20:30.634 --> 00:20:32.303 This is the path I want to go down and NOTE Confidence: 0.86080861875 00:20:32.303 --> 00:20:33.739 this is how we're going to get there. NOTE Confidence: 0.86080861875 00:20:33.740 --> 00:20:34.550 OK, thank you. NOTE Confidence: 0.86080861875 00:20:34.550 --> 00:20:35.900 That you have enough time? NOTE Confidence: 0.86080861875 00:20:35.900 --> 00:20:36.125 Yeah, NOTE Confidence: 0.86080861875 00:20:36.125 --> 00:20:37.250 thank you for the question. NOTE Confidence: 0.83587687 00:21:12.080 --> 00:21:15.049 Our two minute timer just just went off. NOTE Confidence: 0.9083714325 00:21:18.030 --> 00:21:20.718 Great thank you, Amy. NOTE Confidence: 0.9083714325 00:21:20.720 --> 00:21:24.419 So would anyone like to take a stab at? NOTE Confidence: 0.9083714325 00:21:24.420 --> 00:21:28.298 Trying to smarten up our learning objective. NOTE Confidence: 0.9083714325 00:21:28.300 --> 00:21:29.488 I don't think that's a word. NOTE Confidence: 0.851793823333333 00:21:42.830 --> 00:21:45.870 I can give it a shot. Great. NOTE Confidence: 0.836980076666667 00:21:47.960 --> 00:21:51.206 And so. The first thing I NOTE Confidence: 0.836980076666667 00:21:51.206 --> 00:21:54.480 did was change the word no. NOTE Confidence: 0.836980076666667 00:21:54.480 --> 00:21:59.001 And I went for something I guess higher NOTE Confidence: 0.836980076666667 00:21:59.001 --> 00:22:01.803 up on the taxonomy for distinguished NOTE Confidence: 0.836980076666667 00:22:01.803 --> 00:22:03.519 similarities and differences. NOTE Confidence: 0.836980076666667 00:22:03.520 --> 00:22:06.070 That's great, and then. NOTE Confidence: 0.8434405475 00:22:09.920 --> 00:22:12.153 It was difficult to to write out NOTE Confidence: 0.8434405475 00:22:12.153 --> 00:22:16.010 exactly how to say this, but. NOTE Confidence: 0.8434405475 00:22:16.010 --> 00:22:17.426 Various epidemiologic study NOTE Confidence: 0.8434405475 00:22:17.426 --> 00:22:19.786 designs seemed a little large. NOTE Confidence: 0.8434405475 00:22:19.790 --> 00:22:23.949 So I just I use the word selected just NOTE Confidence: 0.8434405475 00:22:23.949 --> 00:22:25.863 to indicate that that would probably NOTE Confidence: 0.8434405475 00:22:25.863 --> 00:22:28.238 need to be honed in a little bit. NOTE Confidence: 0.8434405475 00:22:28.240 --> 00:22:29.740 Yeah, that's really good. NOTE Confidence: 0.8434405475 00:22:29.740 --> 00:22:31.990 Thank you so you got it. NOTE Confidence: 0.8434405475 00:22:31.990 --> 00:22:34.868 The domains of specific and measurable right? NOTE Confidence: 0.8434405475 00:22:34.868 --> 00:22:35.432 And I agree. NOTE Confidence: 0.8434405475 00:22:35.432 --> 00:22:36.560 I think this can be approved. NOTE Confidence: 0.8434405475 00:22:36.560 --> 00:22:39.542 Improved upon in both of those ways NOTE Confidence: 0.8434405475 00:22:39.542 --> 00:22:42.059 because it's not very specific. NOTE Confidence: 0.8434405475 00:22:42.060 --> 00:22:45.280 I like the way that you changed the the word. NOTE Confidence: 0.8434405475 00:22:45.280 --> 00:22:48.010 Various one could even specify NOTE Confidence: 0.8434405475 00:22:48.010 --> 00:22:50.194 exactly which designs right? NOTE Confidence: 0.8434405475 00:22:50.200 --> 00:22:52.594 So I want students to know the NOTE Confidence: 0.8434405475 00:22:52.594 --> 00:22:53.620 similarities and differences, NOTE Confidence: 0.8434405475 00:22:53.620 --> 00:22:55.816 for example, between the cohort study NOTE Confidence: 0.8434405475 00:22:55.816 --> 00:22:58.250 design and a randomized clinical trial. NOTE Confidence: 0.8434405475 00:22:58.250 --> 00:22:59.518 You could, you know, NOTE Confidence: 0.8434405475 00:22:59.518 --> 00:23:01.103 get really even more specific, NOTE Confidence: 0.8434405475 00:23:01.110 --> 00:23:02.742 and that's OK too. NOTE Confidence: 0.8434405475 00:23:02.742 --> 00:23:03.966 And then measurable. NOTE Confidence: 0.8434405475 00:23:03.970 --> 00:23:05.350 You're absolutely right to NOTE Confidence: 0.8434405475 00:23:05.350 --> 00:23:07.075 know something is very nice, NOTE Confidence: 0.8434405475 00:23:07.080 --> 00:23:09.690 but it's really hard to measure NOTE Confidence: 0.8434405475 00:23:09.690 --> 00:23:11.886 whether somebody knows something just NOTE Confidence: 0.8434405475 00:23:11.886 --> 00:23:14.622 like it's hard to measure whether NOTE Confidence: 0.8434405475 00:23:14.622 --> 00:23:15.990 somebody understands something. NOTE Confidence: 0.8434405475 00:23:15.990 --> 00:23:18.370 So I like, I like the change that you made, NOTE Confidence: 0.8434405475 00:23:18.370 --> 00:23:19.560 another one that actually goes NOTE Confidence: 0.8434405475 00:23:19.560 --> 00:23:21.062 to the same level of blooms NOTE Confidence: 0.8434405475 00:23:21.062 --> 00:23:22.347 taxonomy that you went to, NOTE Confidence: 0.8434405475 00:23:22.350 --> 00:23:25.902 which is the analyze level would be comparing NOTE Confidence: 0.8434405475 00:23:25.902 --> 00:23:28.068 and contrast which sort of gets at that. NOTE Confidence: 0.8434405475 00:23:28.070 --> 00:23:29.040 You know, NOTE Confidence: 0.8434405475 00:23:29.040 --> 00:23:31.465 knowing the similarities and differences. NOTE Confidence: 0.8434405475 00:23:31.470 --> 00:23:32.006 That's great, NOTE Confidence: 0.8434405475 00:23:32.006 --> 00:23:32.810 any other thoughts? NOTE Confidence: 0.8434405475 00:23:32.810 --> 00:23:33.478 Thank you for that. NOTE Confidence: 0.957046439 00:23:38.570 --> 00:23:41.550 OK, well we can move on to the next activity, NOTE Confidence: 0.957046439 00:23:41.550 --> 00:23:43.860 so this will have you creating your NOTE Confidence: 0.957046439 00:23:43.860 --> 00:23:45.719 own smart learning objective given NOTE Confidence: 0.957046439 00:23:45.719 --> 00:23:47.729 parameters of your own course. NOTE Confidence: 0.957046439 00:23:47.730 --> 00:23:49.176 Whether it's a course that you're NOTE Confidence: 0.957046439 00:23:49.176 --> 00:23:50.140 currently teaching a course NOTE Confidence: 0.957046439 00:23:50.183 --> 00:23:51.367 that you've previously taught, NOTE Confidence: 0.957046439 00:23:51.370 --> 00:23:53.190 a course that you're thinking about teaching, NOTE Confidence: 0.957046439 00:23:53.190 --> 00:23:56.270 or even a course that you've taken. NOTE Confidence: 0.957046439 00:23:56.270 --> 00:23:59.518 So take a few minutes, see if you can. NOTE Confidence: 0.863512033333333 00:24:01.600 --> 00:24:03.448 Write your own smart learning objective. NOTE Confidence: 0.9164296284 00:25:08.610 --> 00:25:11.094 And I don't mean to suggest by this activity NOTE Confidence: 0.9164296284 00:25:11.094 --> 00:25:13.330 that it only takes about a minute and a NOTE Confidence: 0.9164296284 00:25:13.330 --> 00:25:15.668 half to write a good learning objective. NOTE Confidence: 0.9164296284 00:25:15.670 --> 00:25:18.006 So it's unfair, but I wanted to give NOTE Confidence: 0.9164296284 00:25:18.006 --> 00:25:20.965 you a little bit of time to try it out, NOTE Confidence: 0.9164296284 00:25:20.970 --> 00:25:23.390 so if anyone has one, NOTE Confidence: 0.9164296284 00:25:23.390 --> 00:25:24.846 I welcome you to share it with us. NOTE Confidence: 0.9164296284 00:25:24.850 --> 00:25:27.142 But if not, you know that's NOTE Confidence: 0.9164296284 00:25:27.142 --> 00:25:27.906 certainly understandable. NOTE Confidence: 0.9164296284 00:25:27.910 --> 00:25:30.584 It's a skill, and it takes time, NOTE Confidence: 0.9164296284 00:25:30.590 --> 00:25:32.774 so this is something that maybe NOTE Confidence: 0.9164296284 00:25:32.774 --> 00:25:34.561 you could think about afterwards, NOTE Confidence: 0.9164296284 00:25:34.561 --> 00:25:36.216 but did anyone want to NOTE Confidence: 0.9164296284 00:25:36.216 --> 00:25:37.790 share before we move on? NOTE Confidence: 0.92261635625 00:25:39.960 --> 00:25:41.080 I don't want to. I don't want to, NOTE Confidence: 0.92261635625 00:25:41.080 --> 00:25:43.019 you know, put anyone on the spot. NOTE Confidence: 0.92261635625 00:25:43.020 --> 00:25:44.616 Oh here's one. Thank you Daniela. NOTE Confidence: 0.92261635625 00:25:44.620 --> 00:25:47.090 Develop a stakeholder management plan NOTE Confidence: 0.92261635625 00:25:47.090 --> 00:25:50.100 based on analysis of common actors NOTE Confidence: 0.92261635625 00:25:50.100 --> 00:25:53.292 involved in health policy making and LMC NOTE Confidence: 0.92261635625 00:25:53.292 --> 00:25:56.187 using policy case examples from class. NOTE Confidence: 0.92261635625 00:25:56.190 --> 00:25:57.558 That's really nice. NOTE Confidence: 0.92261635625 00:25:57.558 --> 00:25:58.926 That's really nice. NOTE Confidence: 0.92261635625 00:25:58.930 --> 00:26:01.549 I like how you do sort of referred back NOTE Confidence: 0.92261635625 00:26:01.549 --> 00:26:04.065 to using what we've done in class, NOTE Confidence: 0.92261635625 00:26:04.070 --> 00:26:05.720 right right in there in the NOTE Confidence: 0.92261635625 00:26:05.720 --> 00:26:07.680 objective to make it very specific. NOTE Confidence: 0.908718133913043 00:26:09.920 --> 00:26:11.990 Develop a plan is great because NOTE Confidence: 0.908718133913043 00:26:11.990 --> 00:26:14.128 that's taking the the knowledge and NOTE Confidence: 0.908718133913043 00:26:14.128 --> 00:26:16.543 skills that they have and using them NOTE Confidence: 0.908718133913043 00:26:16.543 --> 00:26:19.168 to create something new IT sounds NOTE Confidence: 0.908718133913043 00:26:19.168 --> 00:26:21.968 very relevant to the course you know NOTE Confidence: 0.908718133913043 00:26:21.968 --> 00:26:23.288 without knowing anything else about NOTE Confidence: 0.908718133913043 00:26:23.288 --> 00:26:24.916 the course and just reading the NOTE Confidence: 0.908718133913043 00:26:24.916 --> 00:26:26.494 learning objective in and of itself, NOTE Confidence: 0.908718133913043 00:26:26.500 --> 00:26:28.915 I can tell that it's quite relevant. NOTE Confidence: 0.908718133913043 00:26:28.920 --> 00:26:29.604 That's really nice. NOTE Confidence: 0.908718133913043 00:26:29.604 --> 00:26:30.516 Thank you for that. NOTE Confidence: 0.946334185833333 00:26:34.940 --> 00:26:36.215 OK, any other thoughts before NOTE Confidence: 0.946334185833333 00:26:36.215 --> 00:26:38.089 we move on to the next part? NOTE Confidence: 0.948831266666667 00:26:40.640 --> 00:26:42.410 If not, I will turn it NOTE Confidence: 0.948831266666667 00:26:42.410 --> 00:26:43.690 over to Amy. Thank you. NOTE Confidence: 0.877397153157895 00:26:46.190 --> 00:26:49.598 Alright, thank you so our next step in NOTE Confidence: 0.877397153157895 00:26:49.598 --> 00:26:52.566 backwards design is to create assessments NOTE Confidence: 0.877397153157895 00:26:52.566 --> 00:26:55.106 based on your learning objectives. NOTE Confidence: 0.877397153157895 00:26:55.110 --> 00:26:56.510 So when you think of your assessments, NOTE Confidence: 0.877397153157895 00:26:56.510 --> 00:26:58.848 they're kind of like mile markers in NOTE Confidence: 0.877397153157895 00:26:58.848 --> 00:27:01.144 that they mark student progress through NOTE Confidence: 0.877397153157895 00:27:01.144 --> 00:27:04.395 a course and ensure that students are on NOTE Confidence: 0.877397153157895 00:27:04.395 --> 00:27:06.747 track and also achieve their end goal. NOTE Confidence: 0.877397153157895 00:27:06.750 --> 00:27:08.100 So it's important to align your NOTE Confidence: 0.877397153157895 00:27:08.100 --> 00:27:09.450 assessments with the learning objectives, NOTE Confidence: 0.877397153157895 00:27:09.450 --> 00:27:11.130 because if your assessments don't NOTE Confidence: 0.877397153157895 00:27:11.130 --> 00:27:12.810 align with your learning objectives, NOTE Confidence: 0.877397153157895 00:27:12.810 --> 00:27:14.914 then you have no way of actually measuring NOTE Confidence: 0.877397153157895 00:27:14.914 --> 00:27:16.828 or knowing that students accomplished. NOTE Confidence: 0.877397153157895 00:27:16.830 --> 00:27:18.684 That they've set out to accomplish NOTE Confidence: 0.877397153157895 00:27:18.684 --> 00:27:20.973 so you want to make sure that NOTE Confidence: 0.877397153157895 00:27:20.973 --> 00:27:22.941 your your assessments are a valid NOTE Confidence: 0.877397153157895 00:27:22.941 --> 00:27:25.170 way of measuring student success. NOTE Confidence: 0.877397153157895 00:27:25.170 --> 00:27:28.146 So let's take a closer look at assessments NOTE Confidence: 0.877397153157895 00:27:28.150 --> 00:27:30.630 when you're designing your assessments. NOTE Confidence: 0.877397153157895 00:27:30.630 --> 00:27:32.290 It's also important to consider NOTE Confidence: 0.877397153157895 00:27:32.290 --> 00:27:33.950 the purpose of the assessment, NOTE Confidence: 0.877397153157895 00:27:33.950 --> 00:27:36.302 and there are two primary purposes NOTE Confidence: 0.877397153157895 00:27:36.302 --> 00:27:37.086 for assessment. NOTE Confidence: 0.877397153157895 00:27:37.090 --> 00:27:39.740 There are formative assessments and NOTE Confidence: 0.877397153157895 00:27:39.740 --> 00:27:41.330 summative formative assessments. NOTE Confidence: 0.877397153157895 00:27:41.330 --> 00:27:43.310 Those are those knowledge checkpoints NOTE Confidence: 0.877397153157895 00:27:43.310 --> 00:27:45.678 that happen throughout a course or NOTE Confidence: 0.877397153157895 00:27:45.678 --> 00:27:47.610 throughout a module or throughout a NOTE Confidence: 0.877397153157895 00:27:47.610 --> 00:27:49.864 workshop in which you are providing NOTE Confidence: 0.877397153157895 00:27:49.864 --> 00:27:51.504 corrective feedback to students. NOTE Confidence: 0.877397153157895 00:27:51.510 --> 00:27:52.830 So when you think formative, NOTE Confidence: 0.877397153157895 00:27:52.830 --> 00:27:53.630 think feedback, NOTE Confidence: 0.877397153157895 00:27:53.630 --> 00:27:56.030 and then there are summative assessments. NOTE Confidence: 0.877397153157895 00:27:56.030 --> 00:27:57.570 That usually your formative NOTE Confidence: 0.877397153157895 00:27:57.570 --> 00:27:58.725 assessments build towards, NOTE Confidence: 0.877397153157895 00:27:58.730 --> 00:28:00.542 and that's your typically NOTE Confidence: 0.877397153157895 00:28:00.542 --> 00:28:02.807 your your what you're grading, NOTE Confidence: 0.877397153157895 00:28:02.810 --> 00:28:05.395 or what students are submitting NOTE Confidence: 0.877397153157895 00:28:05.395 --> 00:28:07.980 and receiving a grade on. NOTE Confidence: 0.877397153157895 00:28:07.980 --> 00:28:08.317 So. NOTE Confidence: 0.877397153157895 00:28:08.317 --> 00:28:10.676 So as you're thinking about your assessments, NOTE Confidence: 0.877397153157895 00:28:10.680 --> 00:28:12.155 not only tie them to NOTE Confidence: 0.877397153157895 00:28:12.155 --> 00:28:13.040 your learning objectives, NOTE Confidence: 0.877397153157895 00:28:13.040 --> 00:28:15.128 but also think can your learning NOTE Confidence: 0.877397153157895 00:28:15.128 --> 00:28:16.910 objective be broken into pieces NOTE Confidence: 0.877397153157895 00:28:16.910 --> 00:28:18.540 that build on each other. NOTE Confidence: 0.877397153157895 00:28:18.540 --> 00:28:19.170 So those form? NOTE Confidence: 0.877397153157895 00:28:19.170 --> 00:28:19.590 How do, NOTE Confidence: 0.877397153157895 00:28:19.590 --> 00:28:21.585 how are you going to have formative NOTE Confidence: 0.877397153157895 00:28:21.585 --> 00:28:23.434 assessments that build on each other NOTE Confidence: 0.877397153157895 00:28:23.434 --> 00:28:24.694 towards a summative assessment, NOTE Confidence: 0.877397153157895 00:28:24.700 --> 00:28:26.364 in which you course? NOTE Confidence: 0.877397153157895 00:28:26.364 --> 00:28:29.484 Correct for students who need who need NOTE Confidence: 0.877397153157895 00:28:29.484 --> 00:28:33.103 feedback to stay on the right track. NOTE Confidence: 0.877397153157895 00:28:33.110 --> 00:28:34.993 So let's look at some examples of NOTE Confidence: 0.877397153157895 00:28:34.993 --> 00:28:37.052 how to actually align your your NOTE Confidence: 0.877397153157895 00:28:37.052 --> 00:28:38.636 learning your assessments with NOTE Confidence: 0.877397153157895 00:28:38.636 --> 00:28:39.824 your learning objectives, NOTE Confidence: 0.877397153157895 00:28:39.830 --> 00:28:41.657 and I'm going to do this by NOTE Confidence: 0.877397153157895 00:28:41.657 --> 00:28:42.990 showing showing some examples. NOTE Confidence: 0.877397153157895 00:28:42.990 --> 00:28:45.838 So here we have a smart learning objective, NOTE Confidence: 0.877397153157895 00:28:45.840 --> 00:28:48.024 and we'll look at the corresponding NOTE Confidence: 0.877397153157895 00:28:48.024 --> 00:28:48.388 assessment. NOTE Confidence: 0.877397153157895 00:28:48.390 --> 00:28:51.309 So learning objective one presents a clear, NOTE Confidence: 0.877397153157895 00:28:51.310 --> 00:28:54.330 concise and motivational oral message. NOTE Confidence: 0.877397153157895 00:28:54.330 --> 00:28:55.850 So that's your learning objective. NOTE Confidence: 0.81983605625 00:28:57.860 --> 00:28:59.968 And the corresponding assessment NOTE Confidence: 0.81983605625 00:28:59.968 --> 00:29:02.450 is present a clear, concise, NOTE Confidence: 0.81983605625 00:29:02.450 --> 00:29:04.300 and motivational oral message in NOTE Confidence: 0.81983605625 00:29:04.300 --> 00:29:06.840 the form of an elevator pitch. NOTE Confidence: 0.81983605625 00:29:06.840 --> 00:29:09.150 So here we have a measurable learning NOTE Confidence: 0.81983605625 00:29:09.150 --> 00:29:11.060 objective, and we've basically taken NOTE Confidence: 0.81983605625 00:29:11.060 --> 00:29:12.640 that measurable learning objective, NOTE Confidence: 0.81983605625 00:29:12.640 --> 00:29:15.295 and we've reformatted it with a little bit of NOTE Confidence: 0.81983605625 00:29:15.295 --> 00:29:17.797 extra information to make it an assessment. NOTE Confidence: 0.81983605625 00:29:17.800 --> 00:29:20.596 So we're literally copying our objective NOTE Confidence: 0.81983605625 00:29:20.596 --> 00:29:23.599 into the instructions for the assessment. NOTE Confidence: 0.81983605625 00:29:23.600 --> 00:29:24.290 In this case, NOTE Confidence: 0.81983605625 00:29:24.290 --> 00:29:26.759 we've added in the form of an elevator pitch, NOTE Confidence: 0.81983605625 00:29:26.760 --> 00:29:28.195 but it could also have been just NOTE Confidence: 0.81983605625 00:29:28.195 --> 00:29:29.560 as easily have been a 5 minute. NOTE Confidence: 0.81983605625 00:29:29.560 --> 00:29:33.424 Presentation or group project and so forth. NOTE Confidence: 0.81983605625 00:29:33.430 --> 00:29:35.790 Let's look at another example. NOTE Confidence: 0.81983605625 00:29:35.790 --> 00:29:38.234 Evaluate health information presented NOTE Confidence: 0.81983605625 00:29:38.234 --> 00:29:41.289 through advertising news and entertainment, NOTE Confidence: 0.81983605625 00:29:41.290 --> 00:29:43.360 and again the corresponding assessment NOTE Confidence: 0.81983605625 00:29:43.360 --> 00:29:46.609 for this is using the provided rubric. NOTE Confidence: 0.81983605625 00:29:46.610 --> 00:29:48.390 Evaluate health information presented NOTE Confidence: 0.81983605625 00:29:48.390 --> 00:29:50.170 in the following advertising NOTE Confidence: 0.81983605625 00:29:50.170 --> 00:29:52.490 news and entertainment examples. NOTE Confidence: 0.81983605625 00:29:52.490 --> 00:29:53.890 So again, we're we're looking NOTE Confidence: 0.81983605625 00:29:53.890 --> 00:29:55.010 at that learning objective. NOTE Confidence: 0.81983605625 00:29:55.010 --> 00:29:57.082 We're pulling the the verb out or NOTE Confidence: 0.81983605625 00:29:57.082 --> 00:29:58.790 pulling the important words out and NOTE Confidence: 0.81983605625 00:29:58.790 --> 00:30:00.561 we're just giving a little bit of NOTE Confidence: 0.81983605625 00:30:00.620 --> 00:30:02.265 extra information about how students NOTE Confidence: 0.81983605625 00:30:02.265 --> 00:30:04.378 are actually going to go about this. NOTE Confidence: 0.81983605625 00:30:04.378 --> 00:30:05.080 In this case, NOTE Confidence: 0.81983605625 00:30:05.080 --> 00:30:07.336 they're using a rubric to evaluate, NOTE Confidence: 0.81983605625 00:30:07.340 --> 00:30:09.740 and they're given examples NOTE Confidence: 0.81983605625 00:30:09.740 --> 00:30:11.540 that they're evaluating. NOTE Confidence: 0.81983605625 00:30:11.540 --> 00:30:13.328 And finally, example three NOTE Confidence: 0.81983605625 00:30:13.328 --> 00:30:15.563 produce and analyze public health, NOTE Confidence: 0.81983605625 00:30:15.570 --> 00:30:18.670 thematic maps, tables and graphs. NOTE Confidence: 0.81983605625 00:30:18.670 --> 00:30:21.526 And the assessment is, you guessed it, NOTE Confidence: 0.81983605625 00:30:21.530 --> 00:30:23.518 students actually will use NOTE Confidence: 0.81983605625 00:30:23.518 --> 00:30:25.918 software tools to produce, analyze, NOTE Confidence: 0.81983605625 00:30:25.918 --> 00:30:27.550 and analyze public health, NOTE Confidence: 0.81983605625 00:30:27.550 --> 00:30:29.690 thematic maps, tables and graphs. NOTE Confidence: 0.81983605625 00:30:29.690 --> 00:30:30.434 So again, NOTE Confidence: 0.81983605625 00:30:30.434 --> 00:30:32.666 if you're learning objective is measurable, NOTE Confidence: 0.81983605625 00:30:32.670 --> 00:30:35.004 then this step should be relatively NOTE Confidence: 0.81983605625 00:30:35.004 --> 00:30:37.083 easy because they're actually doing NOTE Confidence: 0.81983605625 00:30:37.083 --> 00:30:38.927 or demonstrating the measurable NOTE Confidence: 0.81983605625 00:30:38.927 --> 00:30:40.771 behavior that you've already NOTE Confidence: 0.81983605625 00:30:40.771 --> 00:30:42.909 identified in your learning objective. NOTE Confidence: 0.81983605625 00:30:42.910 --> 00:30:44.806 Now this is also a great check that NOTE Confidence: 0.81983605625 00:30:44.806 --> 00:30:46.890 if your objective is not measurable, NOTE Confidence: 0.81983605625 00:30:46.890 --> 00:30:48.143 you have to go back and rewrite NOTE Confidence: 0.81983605625 00:30:48.143 --> 00:30:49.329 it to make it measurable. NOTE Confidence: 0.81983605625 00:30:49.330 --> 00:30:51.794 So this is a great check to make NOTE Confidence: 0.81983605625 00:30:51.794 --> 00:30:54.548 sure that what you're asking students NOTE Confidence: 0.81983605625 00:30:54.548 --> 00:30:56.604 to accomplish is measurable. NOTE Confidence: 0.81983605625 00:30:56.610 --> 00:30:59.914 All right, any questions before we move on. NOTE Confidence: 0.91241005375 00:31:04.080 --> 00:31:07.624 OK, so now let's do a quick activity, NOTE Confidence: 0.91241005375 00:31:07.630 --> 00:31:10.101 so this activity is tied to our NOTE Confidence: 0.91241005375 00:31:10.101 --> 00:31:11.160 workshop learning objective. NOTE Confidence: 0.91241005375 00:31:11.160 --> 00:31:13.764 Evaluate the of an assessment with smart NOTE Confidence: 0.91241005375 00:31:13.764 --> 00:31:15.955 learning objectives and for this activity NOTE Confidence: 0.91241005375 00:31:15.955 --> 00:31:18.314 we're going to use the reaction buttons. NOTE Confidence: 0.91241005375 00:31:18.320 --> 00:31:21.208 So in the lower bar of your zoom NOTE Confidence: 0.91241005375 00:31:21.208 --> 00:31:23.986 screen you should see a little NOTE Confidence: 0.91241005375 00:31:23.986 --> 00:31:25.958 button that says reactions, NOTE Confidence: 0.91241005375 00:31:25.960 --> 00:31:27.444 and if you click on that button NOTE Confidence: 0.91241005375 00:31:27.444 --> 00:31:28.679 you should see this little. NOTE Confidence: 0.91241005375 00:31:28.680 --> 00:31:30.912 These options pop up and there are two NOTE Confidence: 0.91241005375 00:31:30.912 --> 00:31:32.900 options that we're going to use today. NOTE Confidence: 0.91241005375 00:31:32.900 --> 00:31:34.332 One is the yes. NOTE Confidence: 0.91241005375 00:31:34.332 --> 00:31:35.990 Option, which is the little green NOTE Confidence: 0.91241005375 00:31:35.990 --> 00:31:37.775 circle with the check mark and the NOTE Confidence: 0.91241005375 00:31:37.775 --> 00:31:39.495 other is the no option which is the NOTE Confidence: 0.91241005375 00:31:39.549 --> 00:31:41.430 little red circle with the X and what NOTE Confidence: 0.91241005375 00:31:41.430 --> 00:31:43.810 I'm going to do is show you a learning NOTE Confidence: 0.91241005375 00:31:43.810 --> 00:31:45.594 a learning objective with an assessment NOTE Confidence: 0.91241005375 00:31:45.594 --> 00:31:47.568 and you're going to select yes. NOTE Confidence: 0.91241005375 00:31:47.570 --> 00:31:48.894 This assessment aligns with NOTE Confidence: 0.91241005375 00:31:48.894 --> 00:31:50.549 the learning objective or no. NOTE Confidence: 0.91241005375 00:31:50.550 --> 00:31:53.170 This assessment does not align NOTE Confidence: 0.91241005375 00:31:53.170 --> 00:31:55.266 with the learning objective. NOTE Confidence: 0.91241005375 00:31:55.270 --> 00:31:55.856 All right, NOTE Confidence: 0.91241005375 00:31:55.856 --> 00:31:57.321 so our learning objective is NOTE Confidence: 0.91241005375 00:31:57.321 --> 00:31:59.150 at the end of this course. NOTE Confidence: 0.91241005375 00:31:59.150 --> 00:32:01.030 Students will describe the events NOTE Confidence: 0.91241005375 00:32:01.030 --> 00:32:02.910 surrounding the origin of the NOTE Confidence: 0.91241005375 00:32:02.977 --> 00:32:05.185 smallpox vaccine in the 19th century, NOTE Confidence: 0.91241005375 00:32:05.190 --> 00:32:07.644 and our assessment is create an NOTE Confidence: 0.91241005375 00:32:07.644 --> 00:32:09.730 annotated timeline that describes the NOTE Confidence: 0.91241005375 00:32:09.730 --> 00:32:11.998 events surrounding the origin of the NOTE Confidence: 0.91241005375 00:32:11.998 --> 00:32:14.269 smallpox vaccine in the 19th century. NOTE Confidence: 0.91241005375 00:32:14.270 --> 00:32:15.206 After receiving feedback, NOTE Confidence: 0.91241005375 00:32:15.206 --> 00:32:17.078 you will use this timeline to NOTE Confidence: 0.91241005375 00:32:17.078 --> 00:32:18.849 work on your final presentation, NOTE Confidence: 0.91241005375 00:32:18.850 --> 00:32:20.800 so again using those reaction buttons, NOTE Confidence: 0.91241005375 00:32:20.800 --> 00:32:21.900 what do you think? NOTE Confidence: 0.91241005375 00:32:21.900 --> 00:32:24.060 Does this assessment align with the learning? NOTE Confidence: 0.91241005375 00:32:24.060 --> 00:32:24.580 Objective. NOTE Confidence: 0.790103845 00:32:29.680 --> 00:32:33.340 All right, we got some yeses. NOTE Confidence: 0.790103845 00:32:33.340 --> 00:32:34.630 Couple more guesses. NOTE Confidence: 0.780449307142857 00:32:38.870 --> 00:32:42.230 So yes, this does in fact align. NOTE Confidence: 0.780449307142857 00:32:42.230 --> 00:32:44.108 This is a great formative assessment, NOTE Confidence: 0.780449307142857 00:32:44.110 --> 00:32:46.310 and that not only does it align with NOTE Confidence: 0.780449307142857 00:32:46.310 --> 00:32:48.300 your with the learning objective, NOTE Confidence: 0.780449307142857 00:32:48.300 --> 00:32:49.880 and that you're actually having NOTE Confidence: 0.780449307142857 00:32:49.880 --> 00:32:51.144 students describe the events, NOTE Confidence: 0.780449307142857 00:32:51.150 --> 00:32:52.710 but it also clearly you clearly NOTE Confidence: 0.780449307142857 00:32:52.710 --> 00:32:54.829 in this in the instructions here, NOTE Confidence: 0.780449307142857 00:32:54.830 --> 00:32:56.210 it clearly lets the students NOTE Confidence: 0.780449307142857 00:32:56.210 --> 00:32:57.590 know that they're going to NOTE Confidence: 0.780449307142857 00:32:57.643 --> 00:32:59.198 then use this timeline receive. NOTE Confidence: 0.780449307142857 00:32:59.200 --> 00:33:00.160 They're going to submit NOTE Confidence: 0.780449307142857 00:33:00.160 --> 00:33:01.120 the timeline receive feed. NOTE Confidence: 0.73626686 00:33:09.150 --> 00:33:12.480 Think we lost Amy Liz. NOTE Confidence: 0.73626686 00:33:12.480 --> 00:33:14.076 Back and then use it in NOTE Confidence: 0.73626686 00:33:14.076 --> 00:33:14.874 their final presentation, NOTE Confidence: 0.73626686 00:33:14.880 --> 00:33:16.608 so as a formative assessment you NOTE Confidence: 0.73626686 00:33:16.608 --> 00:33:18.388 can students in my am I here. NOTE Confidence: 0.73626686 00:33:18.390 --> 00:33:19.629 I'm sorry. What was? I don't know. NOTE Confidence: 0.73626686 00:33:19.630 --> 00:33:21.170 The last thing you heard, but yes, NOTE Confidence: 0.73626686 00:33:21.170 --> 00:33:23.795 this this does align with the assessment. NOTE Confidence: 0.73626686 00:33:23.800 --> 00:33:24.885 I'm not sure what all you heard, NOTE Confidence: 0.73626686 00:33:24.890 --> 00:33:25.655 I'll just repeat. NOTE Confidence: 0.73626686 00:33:25.655 --> 00:33:27.440 So the verbiage and the language is NOTE Confidence: 0.73626686 00:33:27.497 --> 00:33:28.943 the same from the learning objective NOTE Confidence: 0.73626686 00:33:28.943 --> 00:33:30.567 and this is a great formative NOTE Confidence: 0.73626686 00:33:30.567 --> 00:33:32.087 assessment in that it builds NOTE Confidence: 0.73626686 00:33:32.087 --> 00:33:34.860 towards that final presentation. NOTE Confidence: 0.73626686 00:33:34.860 --> 00:33:37.910 Alright, here's our next example. NOTE Confidence: 0.73626686 00:33:37.910 --> 00:33:39.734 We're using the same smart learning NOTE Confidence: 0.73626686 00:33:39.734 --> 00:33:41.829 objective for all of these examples, NOTE Confidence: 0.73626686 00:33:41.830 --> 00:33:42.590 so again, NOTE Confidence: 0.73626686 00:33:42.590 --> 00:33:44.110 we're having students describe NOTE Confidence: 0.73626686 00:33:44.110 --> 00:33:45.630 the events surrounding the NOTE Confidence: 0.73626686 00:33:45.690 --> 00:33:47.450 origin of the smallpox vaccine. NOTE Confidence: 0.73626686 00:33:47.450 --> 00:33:49.270 Only this time we're looking NOTE Confidence: 0.73626686 00:33:49.270 --> 00:33:51.183 at a summative assessment for NOTE Confidence: 0.73626686 00:33:51.183 --> 00:33:52.542 your final presentation, NOTE Confidence: 0.73626686 00:33:52.542 --> 00:33:54.807 present an annotated timeline that NOTE Confidence: 0.73626686 00:33:54.807 --> 00:33:56.442 describes the events surrounding NOTE Confidence: 0.73626686 00:33:56.442 --> 00:33:58.302 the origin of the smallpox NOTE Confidence: 0.73626686 00:33:58.302 --> 00:34:00.170 vaccine in the 19th century. NOTE Confidence: 0.73626686 00:34:00.170 --> 00:34:01.706 So let me know using those NOTE Confidence: 0.73626686 00:34:01.706 --> 00:34:03.106 reaction buttons does this align NOTE Confidence: 0.73626686 00:34:03.106 --> 00:34:04.418 with the learning objective? NOTE Confidence: 0.86667347125 00:34:10.750 --> 00:34:12.562 I see some yeses. NOTE Confidence: 0.86667347125 00:34:12.562 --> 00:34:14.746 And you are correct, yes, NOTE Confidence: 0.86667347125 00:34:14.746 --> 00:34:17.308 this does align with the learning objective. NOTE Confidence: 0.86667347125 00:34:17.310 --> 00:34:19.032 Again, think of this as the NOTE Confidence: 0.86667347125 00:34:19.032 --> 00:34:20.622 summative assessment that goes with NOTE Confidence: 0.86667347125 00:34:20.622 --> 00:34:22.166 the previous formative assessment, NOTE Confidence: 0.86667347125 00:34:22.170 --> 00:34:24.510 where students are describing the events. NOTE Confidence: 0.86667347125 00:34:24.510 --> 00:34:26.835 So this does align with NOTE Confidence: 0.86667347125 00:34:26.835 --> 00:34:28.230 this learning objective. NOTE Confidence: 0.86667347125 00:34:28.230 --> 00:34:31.247 All right, here's our next example again. NOTE Confidence: 0.86667347125 00:34:31.250 --> 00:34:32.279 Same learning objective, NOTE Confidence: 0.86667347125 00:34:32.279 --> 00:34:34.680 only this time we have two formative NOTE Confidence: 0.86667347125 00:34:34.745 --> 00:34:36.827 assessments that build on each other, NOTE Confidence: 0.86667347125 00:34:36.830 --> 00:34:39.626 so part one is completed 10 NOTE Confidence: 0.86667347125 00:34:39.626 --> 00:34:41.490 question multiple choice knowledge. NOTE Confidence: 0.86667347125 00:34:41.490 --> 00:34:44.130 Check on identifying the events surrounding NOTE Confidence: 0.86667347125 00:34:44.130 --> 00:34:47.199 the origin of the smallpox vaccine. NOTE Confidence: 0.86667347125 00:34:47.200 --> 00:34:49.120 And then Part 2 is once. NOTE Confidence: 0.86667347125 00:34:49.120 --> 00:34:50.920 You can complete the knowledge NOTE Confidence: 0.86667347125 00:34:50.920 --> 00:34:52.560 check with 100% accuracy, NOTE Confidence: 0.86667347125 00:34:52.560 --> 00:34:54.400 describe each event identified NOTE Confidence: 0.86667347125 00:34:54.400 --> 00:34:57.100 in one to two sentences. NOTE Confidence: 0.86667347125 00:34:57.100 --> 00:34:58.360 So together, NOTE Confidence: 0.86667347125 00:34:58.360 --> 00:35:00.880 do these formative assessments NOTE Confidence: 0.86667347125 00:35:00.880 --> 00:35:03.360 align with the learning objective? NOTE Confidence: 0.7004823875 00:35:07.770 --> 00:35:12.989 I see some yeses. The more yeses. NOTE Confidence: 0.7004823875 00:35:12.990 --> 00:35:15.470 And you're correct, yes again, NOTE Confidence: 0.7004823875 00:35:15.470 --> 00:35:17.042 so yes, these formative NOTE Confidence: 0.7004823875 00:35:17.042 --> 00:35:19.007 assessments build on each other, NOTE Confidence: 0.7004823875 00:35:19.010 --> 00:35:21.778 and the Part 2 in particular aligns with NOTE Confidence: 0.7004823875 00:35:21.778 --> 00:35:24.395 the learning objective in that they're NOTE Confidence: 0.7004823875 00:35:24.395 --> 00:35:27.179 actually having students describe each event. NOTE Confidence: 0.7004823875 00:35:27.180 --> 00:35:28.764 So what's great about this example NOTE Confidence: 0.7004823875 00:35:28.764 --> 00:35:30.547 is you can see how formative NOTE Confidence: 0.7004823875 00:35:30.547 --> 00:35:32.563 assessments can build on each other. NOTE Confidence: 0.7004823875 00:35:32.570 --> 00:35:34.600 So here we have students NOTE Confidence: 0.7004823875 00:35:34.600 --> 00:35:36.224 first identifying the events, NOTE Confidence: 0.7004823875 00:35:36.230 --> 00:35:38.710 and then once they can identify the events, NOTE Confidence: 0.7004823875 00:35:38.710 --> 00:35:39.830 then they describe the NOTE Confidence: 0.7004823875 00:35:39.830 --> 00:35:41.230 events in their own words, NOTE Confidence: 0.7004823875 00:35:41.230 --> 00:35:42.966 so you can see a progression there. NOTE Confidence: 0.7004823875 00:35:42.970 --> 00:35:46.966 Across time, as they're working towards NOTE Confidence: 0.7004823875 00:35:46.966 --> 00:35:50.250 a achieving that learning goal. NOTE Confidence: 0.7004823875 00:35:50.250 --> 00:35:53.130 And finally, here's our last example. NOTE Confidence: 0.7004823875 00:35:53.130 --> 00:35:54.186 Same learning objective. NOTE Confidence: 0.7004823875 00:35:54.186 --> 00:35:55.946 Only this time we have NOTE Confidence: 0.7004823875 00:35:55.946 --> 00:35:57.370 a summative assessment. NOTE Confidence: 0.7004823875 00:35:57.370 --> 00:35:59.210 Select two significant related NOTE Confidence: 0.7004823875 00:35:59.210 --> 00:36:01.050 events surrounding the origin NOTE Confidence: 0.7004823875 00:36:01.050 --> 00:36:03.210 of the smallpox vaccine. NOTE Confidence: 0.7004823875 00:36:03.210 --> 00:36:05.190 Give a 5 minute oral presentation NOTE Confidence: 0.7004823875 00:36:05.190 --> 00:36:07.310 that explains how these events are NOTE Confidence: 0.7004823875 00:36:07.310 --> 00:36:09.530 related and how they impacted the NOTE Confidence: 0.7004823875 00:36:09.530 --> 00:36:11.029 overall progression of smallpox. NOTE Confidence: 0.7004823875 00:36:11.030 --> 00:36:13.610 Vaccine usage in the 19th century. NOTE Confidence: 0.7004823875 00:36:13.610 --> 00:36:15.380 So does this assessment align NOTE Confidence: 0.7004823875 00:36:15.380 --> 00:36:16.796 with the learning objective? NOTE Confidence: 0.78327262 00:36:22.010 --> 00:36:25.160 What I see some guesses. NOTE Confidence: 0.8896693625 00:36:29.220 --> 00:36:33.404 So this one's a little tricky this one. NOTE Confidence: 0.8896693625 00:36:33.410 --> 00:36:36.098 This one doesn't quite align with the NOTE Confidence: 0.8896693625 00:36:36.098 --> 00:36:38.038 learning objective because it actually NOTE Confidence: 0.8896693625 00:36:38.038 --> 00:36:40.198 goes above and beyond just describing NOTE Confidence: 0.8896693625 00:36:40.198 --> 00:36:42.610 the events where students are actually NOTE Confidence: 0.8896693625 00:36:42.610 --> 00:36:44.808 analyzing the events and looking at how NOTE Confidence: 0.8896693625 00:36:44.808 --> 00:36:47.289 the event and the impact of the events. NOTE Confidence: 0.8896693625 00:36:47.290 --> 00:36:49.761 So for this one, what I would NOTE Confidence: 0.8896693625 00:36:49.761 --> 00:36:52.457 recommend if I saw this in a course NOTE Confidence: 0.8896693625 00:36:52.457 --> 00:36:54.686 is to have keep the students will NOTE Confidence: 0.8896693625 00:36:54.686 --> 00:36:56.306 describe the events learning objective, NOTE Confidence: 0.8896693625 00:36:56.310 --> 00:36:58.730 but then have another learning NOTE Confidence: 0.8896693625 00:36:58.730 --> 00:37:00.666 objective stating that students NOTE Confidence: 0.8896693625 00:37:00.666 --> 00:37:03.047 will analyze 2 significant events. NOTE Confidence: 0.8896693625 00:37:03.047 --> 00:37:04.803 Surrounding the origin of NOTE Confidence: 0.8896693625 00:37:04.803 --> 00:37:06.120 the smallpox vaccine. NOTE Confidence: 0.8896693625 00:37:06.120 --> 00:37:10.800 That way you, the students. NOTE Confidence: 0.8896693625 00:37:10.800 --> 00:37:12.624 That way you can keep the previous one NOTE Confidence: 0.8896693625 00:37:12.624 --> 00:37:14.230 where they're learning how to describe NOTE Confidence: 0.8896693625 00:37:14.230 --> 00:37:15.886 the events and then eventually working NOTE Confidence: 0.8896693625 00:37:15.935 --> 00:37:17.459 towards analyzing the events so it NOTE Confidence: 0.8896693625 00:37:17.459 --> 00:37:18.954 doesn't align with this learning objective. NOTE Confidence: 0.8896693625 00:37:18.954 --> 00:37:20.139 But that doesn't mean it's NOTE Confidence: 0.8896693625 00:37:20.139 --> 00:37:21.360 not a good assessment. NOTE Confidence: 0.8896693625 00:37:21.360 --> 00:37:22.641 That just means that you need to NOTE Confidence: 0.8896693625 00:37:22.641 --> 00:37:24.253 go back and look at your learning NOTE Confidence: 0.8896693625 00:37:24.253 --> 00:37:25.777 objectives and make sure they're either NOTE Confidence: 0.8896693625 00:37:25.823 --> 00:37:27.198 written at the appropriate level, NOTE Confidence: 0.8896693625 00:37:27.200 --> 00:37:29.927 or if you need to add a higher level NOTE Confidence: 0.8896693625 00:37:29.927 --> 00:37:31.977 learning objective to your course. NOTE Confidence: 0.8896693625 00:37:31.980 --> 00:37:35.956 Alright, so now let's now it's your turn. NOTE Confidence: 0.8896693625 00:37:35.960 --> 00:37:38.016 So for this I'm going to have you NOTE Confidence: 0.8896693625 00:37:38.016 --> 00:37:40.380 write an assessment to address a NOTE Confidence: 0.8896693625 00:37:40.380 --> 00:37:42.160 specific smart learning objective. NOTE Confidence: 0.8896693625 00:37:42.160 --> 00:37:43.704 So here's our objective. NOTE Confidence: 0.8896693625 00:37:43.704 --> 00:37:46.020 We're using a different objective now, NOTE Confidence: 0.8896693625 00:37:46.020 --> 00:37:47.964 so now we're going to use by the NOTE Confidence: 0.8896693625 00:37:47.964 --> 00:37:49.260 end of this course, NOTE Confidence: 0.8896693625 00:37:49.260 --> 00:37:51.582 students will be able to identify NOTE Confidence: 0.8896693625 00:37:51.582 --> 00:37:53.130 2 international health programs NOTE Confidence: 0.8896693625 00:37:53.191 --> 00:37:54.739 and discuss their history, NOTE Confidence: 0.8896693625 00:37:54.740 --> 00:37:56.772 and I'd like you to take 2 minutes NOTE Confidence: 0.8896693625 00:37:56.772 --> 00:37:58.532 to write a short assessment NOTE Confidence: 0.8896693625 00:37:58.532 --> 00:38:00.120 for this learning objective. NOTE Confidence: 0.8896693625 00:38:00.120 --> 00:38:03.230 So I'm going to set the timer for 2 minutes. NOTE Confidence: 0.8896693625 00:38:03.230 --> 00:38:05.858 And and then I'll have volunteers NOTE Confidence: 0.8896693625 00:38:05.858 --> 00:38:08.350 share what they come up with. NOTE Confidence: 0.8896693625 00:38:08.350 --> 00:38:09.050 So again, NOTE Confidence: 0.8896693625 00:38:09.050 --> 00:38:10.450 you're reading an assessment NOTE Confidence: 0.8896693625 00:38:10.450 --> 00:38:11.850 for this learning objective. NOTE Confidence: 0.836660462 00:39:34.180 --> 00:39:36.930 All right, there's the timer. NOTE Confidence: 0.836660462 00:39:36.930 --> 00:39:39.378 All right, so if I if you would like NOTE Confidence: 0.836660462 00:39:39.378 --> 00:39:42.167 to volunteer what you've come up with, NOTE Confidence: 0.836660462 00:39:42.170 --> 00:39:44.506 you can post it in the in the NOTE Confidence: 0.836660462 00:39:44.506 --> 00:39:47.068 chat or you can raise your hand. NOTE Confidence: 0.836660462 00:39:47.070 --> 00:39:49.222 Oh, we do have a is the learning NOTE Confidence: 0.836660462 00:39:49.222 --> 00:39:50.190 effective specific enough? NOTE Confidence: 0.836660462 00:39:50.190 --> 00:39:51.402 That's a good point, NOTE Confidence: 0.836660462 00:39:51.402 --> 00:39:53.999 so I'm assuming that this is a course NOTE Confidence: 0.836660462 00:39:53.999 --> 00:39:56.147 that they're going to be looking NOTE Confidence: 0.836660462 00:39:56.147 --> 00:39:57.575 at international health programs NOTE Confidence: 0.836660462 00:39:57.575 --> 00:39:59.822 and I think being able to identify NOTE Confidence: 0.836660462 00:39:59.822 --> 00:40:01.488 2 international health programs, NOTE Confidence: 0.836660462 00:40:01.488 --> 00:40:04.164 I think that's probably specific enough, NOTE Confidence: 0.836660462 00:40:04.170 --> 00:40:05.170 but you're right that it. NOTE Confidence: 0.836660462 00:40:05.170 --> 00:40:07.018 It depends on the course that this. NOTE Confidence: 0.836660462 00:40:07.020 --> 00:40:09.816 Let this learning objective live within. NOTE Confidence: 0.836660462 00:40:09.820 --> 00:40:12.238 It might not be specific enough, NOTE Confidence: 0.836660462 00:40:12.240 --> 00:40:14.960 but for our for our purposes we're going NOTE Confidence: 0.836660462 00:40:14.960 --> 00:40:17.547 to assume that it is specific enough. NOTE Confidence: 0.836660462 00:40:17.550 --> 00:40:20.610 So any volunteers to come up with a an NOTE Confidence: 0.836660462 00:40:20.610 --> 00:40:22.968 assessment for this learning objective? NOTE Confidence: 0.93171656 00:40:30.650 --> 00:40:31.440 All right? NOTE Confidence: 0.883608932 00:40:34.980 --> 00:40:36.732 So one thing that since I NOTE Confidence: 0.883608932 00:40:36.732 --> 00:40:37.900 don't see any volunteers, NOTE Confidence: 0.883608932 00:40:37.900 --> 00:40:40.231 one thing that I came up with is so NOTE Confidence: 0.883608932 00:40:40.231 --> 00:40:42.729 they're going to have to identify 2 NOTE Confidence: 0.883608932 00:40:42.729 --> 00:40:44.734 international health programs so they have. NOTE Confidence: 0.883608932 00:40:44.734 --> 00:40:46.673 So the students perhaps would do this NOTE Confidence: 0.883608932 00:40:46.673 --> 00:40:49.115 in a paper, but then we also have NOTE Confidence: 0.883608932 00:40:49.115 --> 00:40:51.209 the verb discuss their history and NOTE Confidence: 0.883608932 00:40:51.209 --> 00:40:53.297 discuss is an interesting verb because NOTE Confidence: 0.883608932 00:40:53.297 --> 00:40:55.830 it's used a lot in courses, but. NOTE Confidence: 0.920756163333333 00:40:59.420 --> 00:41:01.275 But not necessarily in which NOTE Confidence: 0.920756163333333 00:41:01.275 --> 00:41:02.759 students are actively discussing. NOTE Confidence: 0.920756163333333 00:41:02.760 --> 00:41:04.314 So when you see the verb discuss, NOTE Confidence: 0.920756163333333 00:41:04.320 --> 00:41:05.695 it's important to actually have NOTE Confidence: 0.920756163333333 00:41:05.695 --> 00:41:07.070 a discussion or an interaction NOTE Confidence: 0.920756163333333 00:41:07.116 --> 00:41:08.232 between students where they NOTE Confidence: 0.920756163333333 00:41:08.232 --> 00:41:09.627 actually get to discuss whatever NOTE Confidence: 0.920756163333333 00:41:09.627 --> 00:41:11.684 it is that they're supposed to be NOTE Confidence: 0.920756163333333 00:41:11.684 --> 00:41:12.836 discussing and learning objective. NOTE Confidence: 0.920756163333333 00:41:12.840 --> 00:41:14.200 Oh, I see a question, Daniela. NOTE Confidence: 0.732645190909091 00:41:16.350 --> 00:41:18.555 This is a little bit connected to NOTE Confidence: 0.732645190909091 00:41:18.555 --> 00:41:20.158 partly Adam's question because he NOTE Confidence: 0.732645190909091 00:41:20.158 --> 00:41:21.406 and I work in international health NOTE Confidence: 0.732645190909091 00:41:21.406 --> 00:41:22.730 and programs can be interventions. NOTE Confidence: 0.732645190909091 00:41:22.730 --> 00:41:23.930 It could be institutions, NOTE Confidence: 0.732645190909091 00:41:23.930 --> 00:41:25.130 it could be organizations, NOTE Confidence: 0.732645190909091 00:41:25.130 --> 00:41:27.006 could be a number of different things NOTE Confidence: 0.732645190909091 00:41:27.006 --> 00:41:29.153 and I guess what I saw identify you NOTE Confidence: 0.732645190909091 00:41:29.153 --> 00:41:31.081 just said write a paper right and NOTE Confidence: 0.732645190909091 00:41:31.081 --> 00:41:33.384 identified to me means go out to NOTE Confidence: 0.732645190909091 00:41:33.384 --> 00:41:35.274 various databases or references that NOTE Confidence: 0.732645190909091 00:41:35.274 --> 00:41:38.150 I would provide you as an instructor NOTE Confidence: 0.732645190909091 00:41:38.150 --> 00:41:39.720 and identify 2 international health NOTE Confidence: 0.732645190909091 00:41:39.720 --> 00:41:41.470 programs for which you can write about, NOTE Confidence: 0.732645190909091 00:41:41.470 --> 00:41:43.528 which you can sort of write NOTE Confidence: 0.732645190909091 00:41:43.528 --> 00:41:45.590 a history that to me that. NOTE Confidence: 0.732645190909091 00:41:45.590 --> 00:41:47.998 The Umm the identified piece to me seems NOTE Confidence: 0.732645190909091 00:41:47.998 --> 00:41:50.633 like a precursor to get into a point NOTE Confidence: 0.732645190909091 00:41:50.633 --> 00:41:53.097 where you would write a paper about it. NOTE Confidence: 0.732645190909091 00:41:53.100 --> 00:41:55.120 Yes, yes, so that's right. NOTE Confidence: 0.732645190909091 00:41:55.120 --> 00:41:57.423 So identify in this case identify as NOTE Confidence: 0.732645190909091 00:41:57.423 --> 00:41:59.858 a lower level blooms taxonomy verb, NOTE Confidence: 0.732645190909091 00:41:59.860 --> 00:42:02.520 so perhaps it wouldn't just be identified. NOTE Confidence: 0.732645190909091 00:42:02.520 --> 00:42:06.486 It would also be explain or or NOTE Confidence: 0.732645190909091 00:42:06.486 --> 00:42:08.316 analyze or compare and contrast NOTE Confidence: 0.732645190909091 00:42:08.316 --> 00:42:11.257 so so I identify as a lower level NOTE Confidence: 0.732645190909091 00:42:11.257 --> 00:42:13.363 verb versus a higher level verb. NOTE Confidence: 0.732645190909091 00:42:13.370 --> 00:42:15.778 And perhaps since I'm not an expert NOTE Confidence: 0.732645190909091 00:42:15.778 --> 00:42:17.400 in international health programs, NOTE Confidence: 0.732645190909091 00:42:17.400 --> 00:42:20.501 perhaps this was not a very well NOTE Confidence: 0.732645190909091 00:42:20.501 --> 00:42:21.830 written learning objective. NOTE Confidence: 0.732645190909091 00:42:21.830 --> 00:42:23.774 I I thought it would be broad enough NOTE Confidence: 0.732645190909091 00:42:23.774 --> 00:42:25.588 or specific enough for this activity, NOTE Confidence: 0.732645190909091 00:42:25.590 --> 00:42:27.186 but perhaps it caused some confusion, NOTE Confidence: 0.732645190909091 00:42:27.190 --> 00:42:28.998 so apologies about that. NOTE Confidence: 0.858315116666667 00:42:31.510 --> 00:42:32.830 What do you what do you say about NOTE Confidence: 0.858315116666667 00:42:32.830 --> 00:42:34.149 what did you say about the world? NOTE Confidence: 0.858315116666667 00:42:34.150 --> 00:42:38.320 Just closed? You change it into what? NOTE Confidence: 0.858315116666667 00:42:38.320 --> 00:42:39.064 Ohh for discuss. NOTE Confidence: 0.858315116666667 00:42:39.064 --> 00:42:41.051 So what I was saying about discuss so NOTE Confidence: 0.858315116666667 00:42:41.051 --> 00:42:43.230 discuss is a verb that comes up a lot in NOTE Confidence: 0.858315116666667 00:42:43.230 --> 00:42:45.100 learning objective and learning objectives. NOTE Confidence: 0.858315116666667 00:42:45.100 --> 00:42:47.444 But one thing about it is that it NOTE Confidence: 0.858315116666667 00:42:47.444 --> 00:42:49.530 implies that students are actually NOTE Confidence: 0.858315116666667 00:42:49.530 --> 00:42:51.920 interacting and discussing that topic. NOTE Confidence: 0.858315116666667 00:42:51.920 --> 00:42:55.832 So if you use the verb discuss I in order NOTE Confidence: 0.858315116666667 00:42:55.832 --> 00:42:59.360 to make it align with the assessment, NOTE Confidence: 0.858315116666667 00:42:59.360 --> 00:43:01.768 it should be tied to a discussion forum NOTE Confidence: 0.858315116666667 00:43:01.768 --> 00:43:04.284 activity or some kind of round table NOTE Confidence: 0.858315116666667 00:43:04.284 --> 00:43:06.139 discussion where students are actually NOTE Confidence: 0.858315116666667 00:43:06.207 --> 00:43:08.447 actively discussing that topic versus. NOTE Confidence: 0.858315116666667 00:43:08.450 --> 00:43:12.608 Explaining or analyzing or comparing that. NOTE Confidence: 0.858315116666667 00:43:12.610 --> 00:43:12.842 Otherwise, NOTE Confidence: 0.858315116666667 00:43:12.842 --> 00:43:15.170 it's one of those verbs that comes up a lot, NOTE Confidence: 0.858315116666667 00:43:15.170 --> 00:43:18.068 but not necessarily tied to the assessment. NOTE Confidence: 0.858315116666667 00:43:18.070 --> 00:43:19.852 So if you use the word NOTE Confidence: 0.858315116666667 00:43:19.852 --> 00:43:21.040 discuss in your objective, NOTE Confidence: 0.858315116666667 00:43:21.040 --> 00:43:23.560 then make sure students are NOTE Confidence: 0.858315116666667 00:43:23.560 --> 00:43:25.914 actually discussing what their what NOTE Confidence: 0.858315116666667 00:43:25.914 --> 00:43:28.154 they're supposed to be discussing. NOTE Confidence: 0.858315116666667 00:43:28.160 --> 00:43:31.913 All right, so if are there no more questions, NOTE Confidence: 0.858315116666667 00:43:31.920 --> 00:43:33.607 I'll move on to the next step. NOTE Confidence: 0.619572313 00:43:35.800 --> 00:43:38.320 Oh, I just threw out and we NOTE Confidence: 0.619572313 00:43:38.320 --> 00:43:39.978 just saw people of assessment, NOTE Confidence: 0.619572313 00:43:39.978 --> 00:43:42.707 so if it would be like I mean since NOTE Confidence: 0.619572313 00:43:42.707 --> 00:43:44.759 they have to discuss making them NOTE Confidence: 0.619572313 00:43:44.759 --> 00:43:47.109 get in groups or something right? NOTE Confidence: 0.619572313 00:43:47.110 --> 00:43:50.518 And then having a manageable number NOTE Confidence: 0.619572313 00:43:50.518 --> 00:43:53.570 of presentations and in length. NOTE Confidence: 0.619572313 00:43:53.570 --> 00:43:54.990 Yes, that's a good yes. NOTE Confidence: 0.619572313 00:43:54.990 --> 00:43:56.670 Thank you, thank you for posting NOTE Confidence: 0.619572313 00:43:56.670 --> 00:43:59.384 that you have in groups of three to NOTE Confidence: 0.619572313 00:43:59.384 --> 00:44:01.299 five prepared 10 minute presentation NOTE Confidence: 0.619572313 00:44:01.299 --> 00:44:02.916 introducing two programs and NOTE Confidence: 0.619572313 00:44:02.916 --> 00:44:04.956 explaining their origin. So yes, NOTE Confidence: 0.619572313 00:44:04.956 --> 00:44:07.987 and since they're working in groups then, NOTE Confidence: 0.619572313 00:44:07.990 --> 00:44:09.240 then they should be discussing NOTE Confidence: 0.619572313 00:44:09.240 --> 00:44:10.240 that within their group, NOTE Confidence: 0.619572313 00:44:10.240 --> 00:44:12.492 so that's that's good. NOTE Confidence: 0.619572313 00:44:12.492 --> 00:44:13.618 Thank you. NOTE Confidence: 0.619572313 00:44:13.620 --> 00:44:14.250 All right, NOTE Confidence: 0.619572313 00:44:14.250 --> 00:44:16.455 so now looking at our final step NOTE Confidence: 0.619572313 00:44:16.455 --> 00:44:19.128 in our backwards design process is NOTE Confidence: 0.619572313 00:44:19.128 --> 00:44:21.418 identify course content that aligns NOTE Confidence: 0.619572313 00:44:21.494 --> 00:44:23.374 with learning objectives and for NOTE Confidence: 0.619572313 00:44:23.374 --> 00:44:26.058 this step we focused a lot on smart NOTE Confidence: 0.619572313 00:44:26.058 --> 00:44:27.388 learning objectives and we focused NOTE Confidence: 0.619572313 00:44:27.388 --> 00:44:29.180 a lot on aligning assessments. NOTE Confidence: 0.619572313 00:44:29.180 --> 00:44:30.727 We're not going to go into as NOTE Confidence: 0.619572313 00:44:30.727 --> 00:44:32.159 much detail with course content, NOTE Confidence: 0.619572313 00:44:32.160 --> 00:44:34.204 but we are going to highlight some NOTE Confidence: 0.619572313 00:44:34.204 --> 00:44:36.646 things to consider as you're choosing NOTE Confidence: 0.619572313 00:44:36.646 --> 00:44:38.734 content either curating existing NOTE Confidence: 0.619572313 00:44:38.734 --> 00:44:41.566 content or creating new content for NOTE Confidence: 0.619572313 00:44:41.566 --> 00:44:43.924 your course that identifies or that. NOTE Confidence: 0.619572313 00:44:43.924 --> 00:44:46.270 The lines with your learning objectives. NOTE Confidence: 0.619572313 00:44:46.270 --> 00:44:48.290 So as you're putting together NOTE Confidence: 0.619572313 00:44:48.290 --> 00:44:50.310 your course content after you've NOTE Confidence: 0.619572313 00:44:50.375 --> 00:44:52.327 written your smart objectives, NOTE Confidence: 0.619572313 00:44:52.330 --> 00:44:53.810 you've identified your assessments. NOTE Confidence: 0.619572313 00:44:53.810 --> 00:44:56.368 Think of your content as the as NOTE Confidence: 0.619572313 00:44:56.368 --> 00:44:58.000 the stuff that the students need NOTE Confidence: 0.619572313 00:44:58.000 --> 00:45:00.209 in order to accomplish their goals. NOTE Confidence: 0.619572313 00:45:00.210 --> 00:45:02.262 So what's in their backpack that NOTE Confidence: 0.619572313 00:45:02.262 --> 00:45:04.602 they need to take on their journey NOTE Confidence: 0.619572313 00:45:04.602 --> 00:45:06.709 to get to the the end goal? NOTE Confidence: 0.619572313 00:45:06.710 --> 00:45:09.454 And this is really important when it NOTE Confidence: 0.619572313 00:45:09.454 --> 00:45:12.089 comes to thinking of that smart goal. NOTE Confidence: 0.619572313 00:45:12.090 --> 00:45:14.680 If it's attainable or achievable. NOTE Confidence: 0.619572313 00:45:14.680 --> 00:45:16.912 So if students don't have the NOTE Confidence: 0.619572313 00:45:16.912 --> 00:45:18.400 content that they need, NOTE Confidence: 0.619572313 00:45:18.400 --> 00:45:20.360 then the learning objectives are NOTE Confidence: 0.619572313 00:45:20.360 --> 00:45:21.928 not attainable or achievable, NOTE Confidence: 0.619572313 00:45:21.930 --> 00:45:24.690 so this is really tied to what do NOTE Confidence: 0.619572313 00:45:24.690 --> 00:45:27.215 students need to know to accomplish NOTE Confidence: 0.619572313 00:45:27.215 --> 00:45:29.264 accomplish that goal and some NOTE Confidence: 0.619572313 00:45:29.264 --> 00:45:31.436 things to consider is what prior NOTE Confidence: 0.619572313 00:45:31.436 --> 00:45:33.709 knowledge or prerequisites are you? NOTE Confidence: 0.619572313 00:45:33.710 --> 00:45:35.385 Assuming that students are coming NOTE Confidence: 0.619572313 00:45:35.385 --> 00:45:37.510 into your course already with, so, NOTE Confidence: 0.619572313 00:45:37.510 --> 00:45:40.660 so does your course have a prerequisite, NOTE Confidence: 0.619572313 00:45:40.660 --> 00:45:41.788 and if it doesn't, NOTE Confidence: 0.619572313 00:45:41.788 --> 00:45:43.198 should it have a prerequisite? NOTE Confidence: 0.619572313 00:45:43.200 --> 00:45:44.580 Or, you know, think about? NOTE Confidence: 0.619572313 00:45:44.580 --> 00:45:47.065 What are you assuming students already know? NOTE Confidence: 0.619572313 00:45:47.070 --> 00:45:49.170 Next, look at your factual knowledge. NOTE Confidence: 0.619572313 00:45:49.170 --> 00:45:53.910 So this is what what facts, NOTE Confidence: 0.619572313 00:45:53.910 --> 00:45:55.606 concepts and terminology will NOTE Confidence: 0.619572313 00:45:55.606 --> 00:45:58.150 your students learn as a result NOTE Confidence: 0.619572313 00:45:58.220 --> 00:45:59.748 of taking this course? NOTE Confidence: 0.619572313 00:45:59.750 --> 00:46:01.184 Will your course have a glossary NOTE Confidence: 0.619572313 00:46:01.184 --> 00:46:02.969 of terms or some kind of handout? NOTE Confidence: 0.619572313 00:46:02.970 --> 00:46:05.497 If there are a lot of factual NOTE Confidence: 0.619572313 00:46:05.497 --> 00:46:07.668 knowledge items learned in this course, NOTE Confidence: 0.619572313 00:46:07.670 --> 00:46:09.838 so think about how are you going to NOTE Confidence: 0.619572313 00:46:09.838 --> 00:46:11.829 give them like factual knowledge. NOTE Confidence: 0.619572313 00:46:11.830 --> 00:46:14.050 Next, think about your procedural knowledge. NOTE Confidence: 0.619572313 00:46:14.050 --> 00:46:15.874 So what procedures, techniques, NOTE Confidence: 0.619572313 00:46:15.874 --> 00:46:16.330 methods, NOTE Confidence: 0.619572313 00:46:16.330 --> 00:46:18.418 or processes will be taught in NOTE Confidence: 0.619572313 00:46:18.418 --> 00:46:20.466 your course and then finally NOTE Confidence: 0.619572313 00:46:20.466 --> 00:46:22.209 strategic level knowledge, NOTE Confidence: 0.619572313 00:46:22.210 --> 00:46:24.145 which is what complex thinking NOTE Confidence: 0.619572313 00:46:24.145 --> 00:46:25.693 strategies will students need NOTE Confidence: 0.619572313 00:46:25.693 --> 00:46:27.808 to develop within your course. NOTE Confidence: 0.619572313 00:46:27.810 --> 00:46:30.242 And as you you think about these types NOTE Confidence: 0.619572313 00:46:30.242 --> 00:46:32.371 of knowledge and how how you're going NOTE Confidence: 0.619572313 00:46:32.371 --> 00:46:34.430 to present these to your students, NOTE Confidence: 0.619572313 00:46:34.430 --> 00:46:36.224 always remember to go back to NOTE Confidence: 0.619572313 00:46:36.224 --> 00:46:37.816 your learning objectives and be NOTE Confidence: 0.619572313 00:46:37.816 --> 00:46:39.176 intentional with your content. NOTE Confidence: 0.619572313 00:46:39.180 --> 00:46:41.609 If something doesn't fit or aligns with. NOTE Confidence: 0.799127651111111 00:46:41.610 --> 00:46:43.470 Or if something doesn't align with NOTE Confidence: 0.799127651111111 00:46:43.470 --> 00:46:45.284 their learning objectives, either remove NOTE Confidence: 0.799127651111111 00:46:45.284 --> 00:46:48.378 it or clearly label it as optional. NOTE Confidence: 0.799127651111111 00:46:48.380 --> 00:46:49.874 But be careful because you don't NOTE Confidence: 0.799127651111111 00:46:49.874 --> 00:46:52.149 want to flood your course with a lot NOTE Confidence: 0.799127651111111 00:46:52.149 --> 00:46:53.377 of optional extraneous information NOTE Confidence: 0.799127651111111 00:46:53.377 --> 00:46:54.879 that could confuse students, NOTE Confidence: 0.799127651111111 00:46:54.880 --> 00:46:57.757 so try to stay, stay focused and NOTE Confidence: 0.799127651111111 00:46:57.757 --> 00:47:00.100 be intentional with your content. NOTE Confidence: 0.799127651111111 00:47:00.100 --> 00:47:02.110 Oh, and I'll repeat what NOTE Confidence: 0.799127651111111 00:47:02.110 --> 00:47:03.316 procedural knowledge is. NOTE Confidence: 0.799127651111111 00:47:03.320 --> 00:47:06.320 Procedural knowledge is what procedures, NOTE Confidence: 0.799127651111111 00:47:06.320 --> 00:47:08.588 techniques or methods will your students NOTE Confidence: 0.799127651111111 00:47:08.588 --> 00:47:11.039 learn and possibly apply in your course. NOTE Confidence: 0.89619167 00:47:13.690 --> 00:47:16.180 All right, any questions about content? NOTE Confidence: 0.878607362727273 00:47:21.600 --> 00:47:23.048 All right, if not, NOTE Confidence: 0.878607362727273 00:47:23.048 --> 00:47:25.610 I'll pass things back off to Liz. NOTE Confidence: 0.878607362727273 00:47:25.610 --> 00:47:30.090 Thank you. Thanks, Amy, so we've we've NOTE Confidence: 0.878607362727273 00:47:30.090 --> 00:47:32.720 given you something to think about. NOTE Confidence: 0.878607362727273 00:47:32.720 --> 00:47:36.296 I hope and you know when you when you NOTE Confidence: 0.878607362727273 00:47:36.296 --> 00:47:39.164 take on something new things don't NOTE Confidence: 0.878607362727273 00:47:39.164 --> 00:47:42.199 always go right from the get go, NOTE Confidence: 0.878607362727273 00:47:42.200 --> 00:47:44.279 but some of you might be thinking, NOTE Confidence: 0.878607362727273 00:47:44.280 --> 00:47:46.597 well this is great for future reference, NOTE Confidence: 0.878607362727273 00:47:46.600 --> 00:47:47.896 but I already teach a course. NOTE Confidence: 0.878607362727273 00:47:47.900 --> 00:47:49.559 It's already. It's already up and running. NOTE Confidence: 0.878607362727273 00:47:49.560 --> 00:47:51.738 I've thought it through several times. NOTE Confidence: 0.878607362727273 00:47:51.740 --> 00:47:52.706 Excuse me so. NOTE Confidence: 0.878607362727273 00:47:52.706 --> 00:47:55.719 I can't go back in time and start over NOTE Confidence: 0.878607362727273 00:47:55.719 --> 00:47:59.032 and you don't have to so you can apply NOTE Confidence: 0.878607362727273 00:47:59.032 --> 00:48:02.200 these principles to your existing course. NOTE Confidence: 0.878607362727273 00:48:02.200 --> 00:48:02.738 Pardon me, NOTE Confidence: 0.878607362727273 00:48:02.738 --> 00:48:05.160 even if you didn't design it quite this way, NOTE Confidence: 0.878607362727273 00:48:05.160 --> 00:48:06.952 so the first thing that I would NOTE Confidence: 0.878607362727273 00:48:06.952 --> 00:48:08.945 recommend that you do is examine your NOTE Confidence: 0.878607362727273 00:48:08.945 --> 00:48:10.697 learning objectives and make sure that NOTE Confidence: 0.878607362727273 00:48:10.753 --> 00:48:12.595 they adhere to the smart principles. NOTE Confidence: 0.878607362727273 00:48:12.600 --> 00:48:14.856 So look them over, look at your verbs. NOTE Confidence: 0.878607362727273 00:48:14.860 --> 00:48:18.688 Look at the specificity, look at. NOTE Confidence: 0.878607362727273 00:48:18.690 --> 00:48:19.222 You know, NOTE Confidence: 0.878607362727273 00:48:19.222 --> 00:48:20.286 I'm sure they're relevant, NOTE Confidence: 0.878607362727273 00:48:20.290 --> 00:48:23.370 but are they too big in order to NOTE Confidence: 0.878607362727273 00:48:23.370 --> 00:48:25.990 be achievable in the time allotted? NOTE Confidence: 0.878607362727273 00:48:25.990 --> 00:48:28.066 So try and tweak the learning NOTE Confidence: 0.878607362727273 00:48:28.066 --> 00:48:30.313 objectives here and there to make NOTE Confidence: 0.878607362727273 00:48:30.313 --> 00:48:32.695 them smart and then adjust your NOTE Confidence: 0.878607362727273 00:48:32.695 --> 00:48:34.207 assessments accordingly where needed NOTE Confidence: 0.878607362727273 00:48:34.207 --> 00:48:36.496 to ensure that they align with your NOTE Confidence: 0.878607362727273 00:48:36.496 --> 00:48:37.841 new smart learning objectives. NOTE Confidence: 0.878607362727273 00:48:37.841 --> 00:48:40.927 So I think if you if you go to NOTE Confidence: 0.878607362727273 00:48:40.927 --> 00:48:42.577 the learning objectives you make NOTE Confidence: 0.878607362727273 00:48:42.577 --> 00:48:44.100 a couple of tweaks, NOTE Confidence: 0.878607362727273 00:48:44.100 --> 00:48:47.402 then accordingly go to the assessments NOTE Confidence: 0.878607362727273 00:48:47.402 --> 00:48:49.814 that are relevant to those objectives, NOTE Confidence: 0.878607362727273 00:48:49.820 --> 00:48:51.818 make relevant tweaks there where needed. NOTE Confidence: 0.878607362727273 00:48:51.820 --> 00:48:52.460 You don't have to, NOTE Confidence: 0.878607362727273 00:48:52.460 --> 00:48:52.780 you know, NOTE Confidence: 0.878607362727273 00:48:52.780 --> 00:48:54.388 wipe the slate clean and start NOTE Confidence: 0.878607362727273 00:48:54.388 --> 00:48:56.230 all over again and then finally, NOTE Confidence: 0.878607362727273 00:48:56.230 --> 00:48:58.638 as Amy was just alluding to make NOTE Confidence: 0.878607362727273 00:48:58.638 --> 00:49:01.070 sure that your content is is NOTE Confidence: 0.878607362727273 00:49:01.070 --> 00:49:03.095 exactly what the student needs, NOTE Confidence: 0.878607362727273 00:49:03.100 --> 00:49:05.656 not more and not less right. NOTE Confidence: 0.878607362727273 00:49:05.660 --> 00:49:08.091 Make sure that the content sorry NOTE Confidence: 0.878607362727273 00:49:08.091 --> 00:49:10.146 leads the students to success. NOTE Confidence: 0.878607362727273 00:49:10.150 --> 00:49:11.606 On the revised assessments. NOTE Confidence: 0.878607362727273 00:49:11.606 --> 00:49:13.426 So taking out what might NOTE Confidence: 0.878607362727273 00:49:13.426 --> 00:49:15.379 be extraneous information, NOTE Confidence: 0.878607362727273 00:49:15.380 --> 00:49:16.745 making it optional, NOTE Confidence: 0.878607362727273 00:49:16.745 --> 00:49:19.930 or maybe adding something in as needed. NOTE Confidence: 0.510321085 00:49:25.700 --> 00:49:28.340 And finally, some common fall. NOTE Confidence: 0.510321085 00:49:28.340 --> 00:49:29.648 So again, when you when you're NOTE Confidence: 0.510321085 00:49:29.648 --> 00:49:31.069 trying something new, it's not all NOTE Confidence: 0.510321085 00:49:31.069 --> 00:49:32.840 going to work easily the first time, NOTE Confidence: 0.510321085 00:49:32.840 --> 00:49:34.610 or maybe even the second time. NOTE Confidence: 0.510321085 00:49:34.610 --> 00:49:36.986 And Amy and I experienced all NOTE Confidence: 0.510321085 00:49:36.986 --> 00:49:38.570 of these pitfalls ourselves, NOTE Confidence: 0.510321085 00:49:38.570 --> 00:49:41.198 and in putting this workshop together. NOTE Confidence: 0.510321085 00:49:41.200 --> 00:49:43.713 So one common pitfall is trying to NOTE Confidence: 0.510321085 00:49:43.713 --> 00:49:46.740 assess one of your learning objectives. NOTE Confidence: 0.510321085 00:49:46.740 --> 00:49:48.708 So because this is a session NOTE Confidence: 0.510321085 00:49:48.708 --> 00:49:49.692 on backwards design, NOTE Confidence: 0.510321085 00:49:49.700 --> 00:49:51.785 our first learning objective that NOTE Confidence: 0.510321085 00:49:51.785 --> 00:49:54.640 we wrote was something about we want NOTE Confidence: 0.510321085 00:49:54.640 --> 00:49:57.097 participants to be able to explain the. NOTE Confidence: 0.510321085 00:49:57.100 --> 00:49:58.268 Elements of backwards design, NOTE Confidence: 0.510321085 00:49:58.268 --> 00:49:59.762 but then we realized, well, NOTE Confidence: 0.510321085 00:49:59.762 --> 00:50:01.050 we're not assessing that, NOTE Confidence: 0.510321085 00:50:01.050 --> 00:50:02.976 so it's not really fair to leave it in, NOTE Confidence: 0.510321085 00:50:02.980 --> 00:50:04.110 because how will you know? NOTE Confidence: 0.510321085 00:50:04.110 --> 00:50:06.189 And how will we know if that NOTE Confidence: 0.510321085 00:50:06.189 --> 00:50:07.669 learning objective has been met? NOTE Confidence: 0.510321085 00:50:07.670 --> 00:50:09.490 So we took it out. NOTE Confidence: 0.510321085 00:50:09.490 --> 00:50:10.967 So if you're going to have something NOTE Confidence: 0.510321085 00:50:10.967 --> 00:50:12.570 in there as a learning objective, NOTE Confidence: 0.510321085 00:50:12.570 --> 00:50:14.600 then really believe in it as an NOTE Confidence: 0.510321085 00:50:14.600 --> 00:50:16.081 objective and make sure that NOTE Confidence: 0.510321085 00:50:16.081 --> 00:50:17.992 you're going to assess it so that NOTE Confidence: 0.510321085 00:50:17.992 --> 00:50:20.126 the students know and you know NOTE Confidence: 0.510321085 00:50:20.126 --> 00:50:21.926 whether they've met that objective. NOTE Confidence: 0.510321085 00:50:21.930 --> 00:50:23.200 Another common pitfall we've talked NOTE Confidence: 0.510321085 00:50:23.200 --> 00:50:24.873 about this is having a learning NOTE Confidence: 0.510321085 00:50:24.873 --> 00:50:26.309 objective that's not measurable, NOTE Confidence: 0.510321085 00:50:26.310 --> 00:50:29.124 so go back to those blooms verbs. NOTE Confidence: 0.510321085 00:50:29.130 --> 00:50:31.125 There's a slide here that shows them NOTE Confidence: 0.510321085 00:50:31.125 --> 00:50:33.320 you can look them up really easily. NOTE Confidence: 0.510321085 00:50:33.320 --> 00:50:36.170 It's everywhere. Celine put very nicely. NOTE Confidence: 0.510321085 00:50:36.170 --> 00:50:39.060 Put a link in the chat that's there as well, NOTE Confidence: 0.510321085 00:50:39.060 --> 00:50:41.328 so those are easy to find. NOTE Confidence: 0.510321085 00:50:41.330 --> 00:50:43.568 Make sure that you're using verbs NOTE Confidence: 0.510321085 00:50:43.568 --> 00:50:45.602 that make sense so that the NOTE Confidence: 0.510321085 00:50:45.602 --> 00:50:46.818 learning objective is something NOTE Confidence: 0.510321085 00:50:46.818 --> 00:50:48.819 that you can observe or measure, NOTE Confidence: 0.510321085 00:50:48.820 --> 00:50:50.100 and likewise it's beneficial NOTE Confidence: 0.510321085 00:50:50.100 --> 00:50:51.060 for the students. NOTE Confidence: 0.510321085 00:50:51.060 --> 00:50:53.006 As well so that they can get NOTE Confidence: 0.510321085 00:50:53.006 --> 00:50:54.692 an assessment of of whether NOTE Confidence: 0.510321085 00:50:54.692 --> 00:50:56.260 they've met that objective. NOTE Confidence: 0.510321085 00:50:56.260 --> 00:50:57.490 And then finally, NOTE Confidence: 0.510321085 00:50:57.490 --> 00:51:00.360 the third pitfall that we saw because NOTE Confidence: 0.510321085 00:51:00.439 --> 00:51:02.489 we experienced this first hand NOTE Confidence: 0.510321085 00:51:02.489 --> 00:51:05.140 is falling back into old habits, NOTE Confidence: 0.510321085 00:51:05.140 --> 00:51:07.180 meaning working on the content first. NOTE Confidence: 0.510321085 00:51:07.180 --> 00:51:09.070 So Amy and I started out with NOTE Confidence: 0.510321085 00:51:09.070 --> 00:51:10.680 the best of intentions. NOTE Confidence: 0.510321085 00:51:10.680 --> 00:51:12.336 We wrote the learning objectives first NOTE Confidence: 0.510321085 00:51:12.336 --> 00:51:14.364 and then we went right to content NOTE Confidence: 0.510321085 00:51:14.364 --> 00:51:15.819 because that's what we've always NOTE Confidence: 0.510321085 00:51:15.819 --> 00:51:17.552 done and we had to stop ourselves NOTE Confidence: 0.510321085 00:51:17.552 --> 00:51:19.365 a few times and say wait a minute, NOTE Confidence: 0.510321085 00:51:19.365 --> 00:51:21.530 wait a minute, write the assessments first, NOTE Confidence: 0.510321085 00:51:21.530 --> 00:51:22.625 which was our. NOTE Confidence: 0.510321085 00:51:22.630 --> 00:51:24.359 The activities that we had you all NOTE Confidence: 0.510321085 00:51:24.359 --> 00:51:26.237 do and then go back and fill in. NOTE Confidence: 0.510321085 00:51:26.240 --> 00:51:27.926 This content and it's not easy. NOTE Confidence: 0.510321085 00:51:27.930 --> 00:51:29.190 It's like any new skill. NOTE Confidence: 0.510321085 00:51:29.190 --> 00:51:32.130 It feels awkward at first, NOTE Confidence: 0.510321085 00:51:32.130 --> 00:51:33.822 but when you get to the end of it, NOTE Confidence: 0.510321085 00:51:33.830 --> 00:51:36.386 I really do feel like it makes more sense. NOTE Confidence: 0.510321085 00:51:36.390 --> 00:51:38.970 This way it's more student centered. NOTE Confidence: 0.510321085 00:51:38.970 --> 00:51:40.524 You take the focus off of yourself NOTE Confidence: 0.510321085 00:51:40.524 --> 00:51:42.087 and what you want to teach you. NOTE Confidence: 0.510321085 00:51:42.090 --> 00:51:43.440 Put the focus on the students NOTE Confidence: 0.510321085 00:51:43.440 --> 00:51:44.909 and where you want them to go. NOTE Confidence: 0.510321085 00:51:44.910 --> 00:51:47.192 You're giving them a a road map NOTE Confidence: 0.510321085 00:51:47.192 --> 00:51:49.549 for where you want to take them, NOTE Confidence: 0.510321085 00:51:49.550 --> 00:51:50.395 and then you're giving them NOTE Confidence: 0.510321085 00:51:50.395 --> 00:51:51.490 what they need to get there, NOTE Confidence: 0.510321085 00:51:51.490 --> 00:51:53.030 and also making sure that you're all NOTE Confidence: 0.510321085 00:51:53.030 --> 00:51:54.690 able to assess whether that happened. NOTE Confidence: 0.713480313333334 00:51:59.970 --> 00:52:03.008 Next, slide any. All right, NOTE Confidence: 0.713480313333334 00:52:03.008 --> 00:52:05.920 so with that we're going to open the. NOTE Confidence: 0.713480313333334 00:52:05.920 --> 00:52:08.071 We have a couple minutes left for Q&A and NOTE Confidence: 0.713480313333334 00:52:08.071 --> 00:52:10.373 I see we have a few hands free raised, NOTE Confidence: 0.713480313333334 00:52:10.380 --> 00:52:12.459 so we'd like to open the floor to questions. NOTE Confidence: 0.713480313333334 00:52:12.460 --> 00:52:16.195 I think Adam you had your hand up first. NOTE Confidence: 0.713480313333334 00:52:16.200 --> 00:52:17.284 Sure, thanks for this. NOTE Confidence: 0.713480313333334 00:52:17.284 --> 00:52:19.388 By the way, I found it helpful, NOTE Confidence: 0.713480313333334 00:52:19.388 --> 00:52:20.998 particularly thinking about the ordering NOTE Confidence: 0.713480313333334 00:52:20.998 --> 00:52:23.021 of the class and also I realized that NOTE Confidence: 0.713480313333334 00:52:23.021 --> 00:52:24.803 I have been understanding learning NOTE Confidence: 0.713480313333334 00:52:24.803 --> 00:52:27.459 objectives very differently as kind of NOTE Confidence: 0.713480313333334 00:52:27.459 --> 00:52:29.697 broader and oftentimes not very helpful. NOTE Confidence: 0.713480313333334 00:52:29.700 --> 00:52:31.008 It sounds like so, NOTE Confidence: 0.713480313333334 00:52:31.008 --> 00:52:33.692 but one of the things that we have NOTE Confidence: 0.713480313333334 00:52:33.692 --> 00:52:35.932 to do in some courses is account NOTE Confidence: 0.713480313333334 00:52:35.932 --> 00:52:38.080 for these CDPH competencies. NOTE Confidence: 0.713480313333334 00:52:38.080 --> 00:52:39.970 And do you find that it's easier NOTE Confidence: 0.713480313333334 00:52:39.970 --> 00:52:40.780 to just like, NOTE Confidence: 0.713480313333334 00:52:40.780 --> 00:52:43.140 make them specific learning objectives? NOTE Confidence: 0.713480313333334 00:52:43.140 --> 00:52:44.778 So what we've done is kind of NOTE Confidence: 0.713480313333334 00:52:44.778 --> 00:52:46.368 like embed them or tie them and. NOTE Confidence: 0.713480313333334 00:52:46.370 --> 00:52:47.635 And indicate where they're tied NOTE Confidence: 0.713480313333334 00:52:47.635 --> 00:52:48.647 to different learning objectives. NOTE Confidence: 0.713480313333334 00:52:48.650 --> 00:52:50.549 There might be looking at how specific it is. NOTE Confidence: 0.713480313333334 00:52:50.550 --> 00:52:52.110 Might be best to just like put them NOTE Confidence: 0.713480313333334 00:52:52.110 --> 00:52:53.746 as a separate one and then that NOTE Confidence: 0.713480313333334 00:52:53.746 --> 00:52:55.430 also led me to another question. NOTE Confidence: 0.713480313333334 00:52:55.430 --> 00:52:57.650 Which was you probably covered this? NOTE Confidence: 0.713480313333334 00:52:57.650 --> 00:52:58.580 I was a little bit late, NOTE Confidence: 0.713480313333334 00:52:58.580 --> 00:53:00.860 but how many learning objectives typically NOTE Confidence: 0.713480313333334 00:53:00.860 --> 00:53:03.508 would you have for an average class? NOTE Confidence: 0.713480313333334 00:53:03.510 --> 00:53:06.206 Because as you get more specific I would NOTE Confidence: 0.713480313333334 00:53:06.206 --> 00:53:08.566 think you would need more of them. NOTE Confidence: 0.713480313333334 00:53:08.570 --> 00:53:10.178 Yeah, those those are great questions. NOTE Confidence: 0.713480313333334 00:53:10.180 --> 00:53:11.628 Thank you and and you didn't miss anything. NOTE Confidence: 0.713480313333334 00:53:11.630 --> 00:53:12.690 I didn't cover how many, NOTE Confidence: 0.713480313333334 00:53:12.690 --> 00:53:13.690 but that's a great question. NOTE Confidence: 0.713480313333334 00:53:13.690 --> 00:53:16.003 So thank you for raising it and you know, NOTE Confidence: 0.713480313333334 00:53:16.010 --> 00:53:18.032 like with most things that there's NOTE Confidence: 0.713480313333334 00:53:18.032 --> 00:53:19.043 no magic number, NOTE Confidence: 0.713480313333334 00:53:19.050 --> 00:53:20.916 but I think it goes towards, NOTE Confidence: 0.713480313333334 00:53:20.920 --> 00:53:21.492 you know, NOTE Confidence: 0.713480313333334 00:53:21.492 --> 00:53:22.922 manageability in the time that NOTE Confidence: 0.713480313333334 00:53:22.922 --> 00:53:24.988 you have so you know in our NOTE Confidence: 0.713480313333334 00:53:24.988 --> 00:53:26.423 environment is usually 8 weeks. NOTE Confidence: 0.713480313333334 00:53:26.430 --> 00:53:27.940 Unless of course you're putting NOTE Confidence: 0.713480313333334 00:53:27.940 --> 00:53:30.151 together like a one hour you know NOTE Confidence: 0.713480313333334 00:53:30.151 --> 00:53:31.766 seminar or workshop or something. NOTE Confidence: 0.713480313333334 00:53:31.770 --> 00:53:35.258 But the the number I find the number NOTE Confidence: 0.713480313333334 00:53:35.258 --> 00:53:37.250 you're right, the more specific you get, NOTE Confidence: 0.713480313333334 00:53:37.250 --> 00:53:38.214 probably the more learning NOTE Confidence: 0.713480313333334 00:53:38.214 --> 00:53:39.419 objectives you're going to need. NOTE Confidence: 0.713480313333334 00:53:39.420 --> 00:53:43.137 At the same time, if you have 17 learning NOTE Confidence: 0.713480313333334 00:53:43.137 --> 00:53:45.309 objectives for an 8 week course, NOTE Confidence: 0.713480313333334 00:53:45.310 --> 00:53:47.366 that's you know more than two a week. NOTE Confidence: 0.713480313333334 00:53:47.370 --> 00:53:49.010 That's probably not so doable, NOTE Confidence: 0.713480313333334 00:53:49.010 --> 00:53:51.970 so I think it depends on the timing, NOTE Confidence: 0.713480313333334 00:53:51.970 --> 00:53:54.670 but also. NOTE Confidence: 0.713480313333334 00:53:54.670 --> 00:53:57.790 You know, sort of the the. NOTE Confidence: 0.713480313333334 00:53:57.790 --> 00:53:59.630 I guess the best word is the specificity, NOTE Confidence: 0.713480313333334 00:53:59.630 --> 00:53:59.832 right? NOTE Confidence: 0.713480313333334 00:53:59.832 --> 00:54:01.332 Is it kind of a small, quick, NOTE Confidence: 0.713480313333334 00:54:01.332 --> 00:54:02.460 very specific thing that NOTE Confidence: 0.713480313333334 00:54:02.460 --> 00:54:03.870 you're going to cover in? NOTE Confidence: 0.713480313333334 00:54:03.870 --> 00:54:04.394 You know, NOTE Confidence: 0.713480313333334 00:54:04.394 --> 00:54:06.228 half a week or a week's time? NOTE Confidence: 0.713480313333334 00:54:06.230 --> 00:54:08.274 Or is it something that's specific but NOTE Confidence: 0.713480313333334 00:54:08.274 --> 00:54:10.284 it's a bigger topic and you're going NOTE Confidence: 0.713480313333334 00:54:10.284 --> 00:54:12.521 to take two weeks of your eight weeks NOTE Confidence: 0.713480313333334 00:54:12.521 --> 00:54:14.761 of the course to cover this one thing. NOTE Confidence: 0.713480313333334 00:54:14.770 --> 00:54:16.154 So I, I think it, you know, NOTE Confidence: 0.713480313333334 00:54:16.154 --> 00:54:17.246 I hate to give the answer. NOTE Confidence: 0.713480313333334 00:54:17.250 --> 00:54:19.320 It depends because, you know, NOTE Confidence: 0.713480313333334 00:54:19.320 --> 00:54:20.290 that's not really an answer, NOTE Confidence: 0.713480313333334 00:54:20.290 --> 00:54:21.430 but it really does, I think, NOTE Confidence: 0.713480313333334 00:54:21.430 --> 00:54:24.517 depend on on a number of factors. NOTE Confidence: 0.713480313333334 00:54:24.520 --> 00:54:24.900 Uh, NOTE Confidence: 0.713480313333334 00:54:24.900 --> 00:54:26.800 the other question was about NOTE Confidence: 0.713480313333334 00:54:26.800 --> 00:54:27.940 the CPH competencies, NOTE Confidence: 0.713480313333334 00:54:27.940 --> 00:54:29.644 and that's kind of a tricky NOTE Confidence: 0.713480313333334 00:54:29.644 --> 00:54:30.780 thing because that's like, NOTE Confidence: 0.713480313333334 00:54:30.780 --> 00:54:31.268 you know, NOTE Confidence: 0.713480313333334 00:54:31.268 --> 00:54:32.244 here are some learning NOTE Confidence: 0.713480313333334 00:54:32.244 --> 00:54:33.220 objectives that you didn't NOTE Confidence: 0.878594509230769 00:54:33.262 --> 00:54:35.270 get to write, but you have to have NOTE Confidence: 0.878594509230769 00:54:35.270 --> 00:54:36.740 your students achieve them anyway, NOTE Confidence: 0.878594509230769 00:54:36.740 --> 00:54:39.420 so too bad for you. NOTE Confidence: 0.878594509230769 00:54:39.420 --> 00:54:41.190 And I think that sometimes they're NOTE Confidence: 0.878594509230769 00:54:41.190 --> 00:54:43.618 written in such a way that it could be. NOTE Confidence: 0.878594509230769 00:54:43.620 --> 00:54:45.095 It could sound like a NOTE Confidence: 0.878594509230769 00:54:45.095 --> 00:54:45.980 coarse learning objective, NOTE Confidence: 0.878594509230769 00:54:45.980 --> 00:54:48.782 but I tend to think of those as you know, NOTE Confidence: 0.878594509230769 00:54:48.782 --> 00:54:51.099 that's the objective for the whole program, NOTE Confidence: 0.878594509230769 00:54:51.100 --> 00:54:52.760 not just one course, right? NOTE Confidence: 0.878594509230769 00:54:52.760 --> 00:54:54.230 So sometimes there's an objective NOTE Confidence: 0.878594509230769 00:54:54.230 --> 00:54:56.274 for the program that your course is NOTE Confidence: 0.878594509230769 00:54:56.274 --> 00:54:58.087 the one that's going to bring the NOTE Confidence: 0.878594509230769 00:54:58.087 --> 00:54:59.550 students to meet that objective, NOTE Confidence: 0.878594509230769 00:54:59.550 --> 00:55:01.034 and you didn't get to write it, NOTE Confidence: 0.878594509230769 00:55:01.040 --> 00:55:03.440 but it's probably best to, NOTE Confidence: 0.878594509230769 00:55:03.440 --> 00:55:06.030 you know, keep it in there because. NOTE Confidence: 0.878594509230769 00:55:06.030 --> 00:55:07.854 That's the way that we need NOTE Confidence: 0.878594509230769 00:55:07.854 --> 00:55:09.070 to think about it, NOTE Confidence: 0.878594509230769 00:55:09.070 --> 00:55:11.394 but that if you feel like it's. NOTE Confidence: 0.878594509230769 00:55:11.400 --> 00:55:12.936 Not specific enough, NOTE Confidence: 0.878594509230769 00:55:12.936 --> 00:55:13.960 for example, NOTE Confidence: 0.878594509230769 00:55:13.960 --> 00:55:16.264 maybe you could rewrite it as two separate NOTE Confidence: 0.878594509230769 00:55:16.264 --> 00:55:17.677 learning objectives to say all right? NOTE Confidence: 0.878594509230769 00:55:17.680 --> 00:55:20.664 Well, we have to do this and we have to do NOTE Confidence: 0.878594509230769 00:55:20.664 --> 00:55:23.338 this in order to accomplish that competency. NOTE Confidence: 0.878594509230769 00:55:23.340 --> 00:55:25.734 I think I think you asked whether NOTE Confidence: 0.878594509230769 00:55:25.740 --> 00:55:26.860 did you ask something about NOTE Confidence: 0.878594509230769 00:55:26.860 --> 00:55:28.450 like keeping it as a separate. NOTE Confidence: 0.878594509230769 00:55:28.450 --> 00:55:29.500 Sort of category. NOTE Confidence: 0.878594509230769 00:55:29.500 --> 00:55:31.950 Or did I mishear you about that? NOTE Confidence: 0.933794444444444 00:55:34.220 --> 00:55:36.019 No, no, I think you answered my NOTE Confidence: 0.933794444444444 00:55:36.019 --> 00:55:37.272 questions right, but it does. NOTE Confidence: 0.933794444444444 00:55:37.272 --> 00:55:38.980 It does make me whether you have NOTE Confidence: 0.933794444444444 00:55:39.035 --> 00:55:41.065 like sub objectives within a NOTE Confidence: 0.933794444444444 00:55:41.065 --> 00:55:42.283 overarching learning objective. NOTE Confidence: 0.905790358181818 00:55:44.660 --> 00:55:45.704 I suppose you could, NOTE Confidence: 0.905790358181818 00:55:45.704 --> 00:55:47.540 although you know someone might argue well, NOTE Confidence: 0.905790358181818 00:55:47.540 --> 00:55:49.232 then that means that the objective NOTE Confidence: 0.905790358181818 00:55:49.232 --> 00:55:52.720 is not specific enough, right? NOTE Confidence: 0.905790358181818 00:55:52.720 --> 00:55:54.208 Thanks, this is helpful. NOTE Confidence: 0.905790358181818 00:55:54.208 --> 00:55:56.068 Thank you for your questions. NOTE Confidence: 0.905790358181818 00:55:56.070 --> 00:55:58.866 Daniela. Hi so my question, NOTE Confidence: 0.905790358181818 00:55:58.866 --> 00:56:00.450 this is also I agree with Adam. NOTE Confidence: 0.905790358181818 00:56:00.450 --> 00:56:01.944 This was extremely helpful and I NOTE Confidence: 0.905790358181818 00:56:01.944 --> 00:56:03.965 and when you describe it this way of NOTE Confidence: 0.905790358181818 00:56:03.965 --> 00:56:05.429 start with the learning objectives and NOTE Confidence: 0.905790358181818 00:56:05.482 --> 00:56:07.186 then the assessments and the content. NOTE Confidence: 0.905790358181818 00:56:07.190 --> 00:56:08.550 That sounds really reasonable NOTE Confidence: 0.905790358181818 00:56:08.550 --> 00:56:09.910 and kind of crazy. NOTE Confidence: 0.905790358181818 00:56:09.910 --> 00:56:11.215 How that we're not really NOTE Confidence: 0.905790358181818 00:56:11.215 --> 00:56:12.810 taught to do it this way. NOTE Confidence: 0.905790358181818 00:56:12.810 --> 00:56:14.322 My question is connected to the NOTE Confidence: 0.905790358181818 00:56:14.322 --> 00:56:15.600 conversation you're already having about. NOTE Confidence: 0.905790358181818 00:56:15.600 --> 00:56:17.262 Sort of the number of objectives NOTE Confidence: 0.905790358181818 00:56:17.262 --> 00:56:18.580 and specificity and so on. NOTE Confidence: 0.905790358181818 00:56:18.580 --> 00:56:20.524 A course that I closed out with someone. NOTE Confidence: 0.905790358181818 00:56:20.530 --> 00:56:22.035 I came on the scene after it NOTE Confidence: 0.905790358181818 00:56:22.035 --> 00:56:23.160 had already been designed. NOTE Confidence: 0.905790358181818 00:56:23.160 --> 00:56:25.275 It was being taught and so the amount of NOTE Confidence: 0.905790358181818 00:56:25.275 --> 00:56:27.205 tweaks that we did were kind of minimal, NOTE Confidence: 0.905790358181818 00:56:27.210 --> 00:56:28.640 but. NOTE Confidence: 0.905790358181818 00:56:28.640 --> 00:56:31.216 What that person did was they approached NOTE Confidence: 0.905790358181818 00:56:31.216 --> 00:56:34.244 it with with having sort of larger NOTE Confidence: 0.905790358181818 00:56:34.244 --> 00:56:36.096 overarching course objectives and NOTE Confidence: 0.905790358181818 00:56:36.096 --> 00:56:38.792 then much more specific objectives NOTE Confidence: 0.905790358181818 00:56:38.792 --> 00:56:42.140 by week depending on the topic NOTE Confidence: 0.905790358181818 00:56:42.239 --> 00:56:44.954 that was being covered and that NOTE Confidence: 0.905790358181818 00:56:44.954 --> 00:56:46.718 allowed that allowed the sort of NOTE Confidence: 0.905790358181818 00:56:46.718 --> 00:56:48.808 the US the the overarching course NOTE Confidence: 0.905790358181818 00:56:48.808 --> 00:56:51.094 objectives to align with the CPH. NOTE Confidence: 0.905790358181818 00:56:51.100 --> 00:56:53.074 We were one of those courses that NOTE Confidence: 0.905790358181818 00:56:53.074 --> 00:56:55.496 had to meet the CPH for some things, NOTE Confidence: 0.905790358181818 00:56:55.500 --> 00:56:57.544 and then allow us for more specificity. NOTE Confidence: 0.905790358181818 00:56:57.550 --> 00:56:58.982 Within the week I. NOTE Confidence: 0.905790358181818 00:56:58.982 --> 00:57:00.320 Personally, I feel like there's a. NOTE Confidence: 0.905790358181818 00:57:00.320 --> 00:57:03.230 There's something to be said about NOTE Confidence: 0.905790358181818 00:57:03.230 --> 00:57:05.019 approaching the overall course NOTE Confidence: 0.905790358181818 00:57:05.019 --> 00:57:07.184 objectives with a little bit NOTE Confidence: 0.905790358181818 00:57:07.184 --> 00:57:08.939 more specificity than we had. NOTE Confidence: 0.905790358181818 00:57:08.940 --> 00:57:10.848 But I was wondering if you NOTE Confidence: 0.905790358181818 00:57:10.848 --> 00:57:12.120 have any thoughts about. NOTE Confidence: 0.905790358181818 00:57:12.120 --> 00:57:14.628 Introducing the idea of. NOTE Confidence: 0.905790358181818 00:57:14.630 --> 00:57:17.030 Week specific or presentation specific NOTE Confidence: 0.905790358181818 00:57:17.030 --> 00:57:19.889 objectives as well that speak to NOTE Confidence: 0.905790358181818 00:57:19.889 --> 00:57:22.556 help the student kind of connect to NOTE Confidence: 0.905790358181818 00:57:22.556 --> 00:57:24.810 the overarching learning objectives. NOTE Confidence: 0.905790358181818 00:57:24.810 --> 00:57:25.242 Yeah, I, NOTE Confidence: 0.905790358181818 00:57:25.242 --> 00:57:26.754 I think that's I mean I'll let NOTE Confidence: 0.905790358181818 00:57:26.754 --> 00:57:27.778 Amy answer as well, NOTE Confidence: 0.905790358181818 00:57:27.780 --> 00:57:29.026 but I I think that would be NOTE Confidence: 0.905790358181818 00:57:29.026 --> 00:57:29.869 a great thing to do. NOTE Confidence: 0.905790358181818 00:57:29.870 --> 00:57:30.226 You know, NOTE Confidence: 0.905790358181818 00:57:30.226 --> 00:57:31.294 from from my point of view, NOTE Confidence: 0.905790358181818 00:57:31.300 --> 00:57:33.004 anything that gives the students kind NOTE Confidence: 0.905790358181818 00:57:33.004 --> 00:57:35.189 of that road map idea right of like NOTE Confidence: 0.905790358181818 00:57:35.189 --> 00:57:37.258 this is exactly where I want you to go. NOTE Confidence: 0.905790358181818 00:57:37.260 --> 00:57:39.115 Here's a broader goal and here here, NOTE Confidence: 0.905790358181818 00:57:39.120 --> 00:57:40.165 the little pieces that are NOTE Confidence: 0.905790358181818 00:57:40.165 --> 00:57:41.530 going to let us get there. NOTE Confidence: 0.905790358181818 00:57:41.530 --> 00:57:43.308 I don't see anything wrong with that. NOTE Confidence: 0.905790358181818 00:57:43.310 --> 00:57:45.430 Maybe you have additional thoughts. NOTE Confidence: 0.905790358181818 00:57:45.430 --> 00:57:46.687 Yes, I agree. NOTE Confidence: 0.905790358181818 00:57:46.687 --> 00:57:48.782 Having breaking your your learning NOTE Confidence: 0.905790358181818 00:57:48.782 --> 00:57:50.476 objectives that are overarching NOTE Confidence: 0.905790358181818 00:57:50.476 --> 00:57:52.441 for your course down into NOTE Confidence: 0.905790358181818 00:57:52.441 --> 00:57:54.540 smaller pieces can only benefit. NOTE Confidence: 0.905790358181818 00:57:54.540 --> 00:57:54.793 Agents, NOTE Confidence: 0.905790358181818 00:57:54.793 --> 00:57:56.564 as long as everything is in alignment NOTE Confidence: 0.905790358181818 00:57:56.564 --> 00:57:57.978 and builds towards each other, NOTE Confidence: 0.905790358181818 00:57:57.980 --> 00:58:00.752 and in fact course plus is set NOTE Confidence: 0.905790358181818 00:58:00.752 --> 00:58:02.800 up to have learning objectives NOTE Confidence: 0.905790358181818 00:58:02.800 --> 00:58:04.520 specific for like lectures. NOTE Confidence: 0.905790358181818 00:58:04.520 --> 00:58:06.530 For example on lecture material pages. NOTE Confidence: 0.905790358181818 00:58:06.530 --> 00:58:06.857 So, NOTE Confidence: 0.905790358181818 00:58:06.857 --> 00:58:08.819 so we highly recommend that you NOTE Confidence: 0.905790358181818 00:58:08.819 --> 00:58:11.359 fill that that those boxes in for NOTE Confidence: 0.905790358181818 00:58:11.359 --> 00:58:13.214 your lectures or course content, NOTE Confidence: 0.905790358181818 00:58:13.220 --> 00:58:15.719 but we wouldn't have to have an NOTE Confidence: 0.905790358181818 00:58:15.719 --> 00:58:18.039 assessment for each one of those NOTE Confidence: 0.905790358181818 00:58:18.039 --> 00:58:20.004 smaller objectives week by week. NOTE Confidence: 0.905790358181818 00:58:20.010 --> 00:58:21.105 Not necessarily, no, NOTE Confidence: 0.905790358181818 00:58:21.105 --> 00:58:22.930 just for the overarching ones, NOTE Confidence: 0.905790358181818 00:58:22.930 --> 00:58:26.008 for I would think. Yeah, OK, thank you. NOTE Confidence: 0.905790358181818 00:58:26.008 --> 00:58:28.605 Yep and Celine. I think I saw your hand up. NOTE Confidence: 0.905790358181818 00:58:28.610 --> 00:58:29.186 Yeah, I know, NOTE Confidence: 0.905790358181818 00:58:29.186 --> 00:58:30.530 we're just about all the time but NOTE Confidence: 0.845731475384615 00:58:30.575 --> 00:58:31.492 just real quick, Danielle. NOTE Confidence: 0.845731475384615 00:58:31.492 --> 00:58:33.064 You said something that like I NOTE Confidence: 0.845731475384615 00:58:33.064 --> 00:58:35.043 struck like a gong in my head we NOTE Confidence: 0.845731475384615 00:58:35.043 --> 00:58:36.430 weren't taught to teach that way. NOTE Confidence: 0.845731475384615 00:58:36.430 --> 00:58:39.012 The whole thing is you actually. If you. NOTE Confidence: 0.845731475384615 00:58:39.012 --> 00:58:41.119 If you had been taught to design, NOTE Confidence: 0.845731475384615 00:58:41.120 --> 00:58:43.286 whatever it it's that we're not. NOTE Confidence: 0.845731475384615 00:58:43.290 --> 00:58:45.126 That's not the box we were NOTE Confidence: 0.845731475384615 00:58:45.126 --> 00:58:46.350 presented at this way. NOTE Confidence: 0.845731475384615 00:58:46.350 --> 00:58:48.072 It's not so much of how you NOTE Confidence: 0.845731475384615 00:58:48.072 --> 00:58:50.052 were taught to teach, but how. NOTE Confidence: 0.845731475384615 00:58:50.052 --> 00:58:52.964 How we observed in learning which if NOTE Confidence: 0.845731475384615 00:58:52.964 --> 00:58:56.097 you as faculty design your lessons, NOTE Confidence: 0.845731475384615 00:58:56.100 --> 00:58:57.210 design your courses, NOTE Confidence: 0.845731475384615 00:58:57.210 --> 00:58:58.320 design your activities, NOTE Confidence: 0.845731475384615 00:58:58.320 --> 00:59:01.272 making certain from step one that NOTE Confidence: 0.845731475384615 00:59:01.272 --> 00:59:03.384 the students know why you're doing NOTE Confidence: 0.845731475384615 00:59:03.384 --> 00:59:05.501 XYZ that holds you accountable and NOTE Confidence: 0.845731475384615 00:59:05.501 --> 00:59:08.263 it makes it better for them and it NOTE Confidence: 0.845731475384615 00:59:08.263 --> 00:59:10.108 makes you a better facilitator, NOTE Confidence: 0.845731475384615 00:59:10.110 --> 00:59:12.276 a better teacher, a better educator. NOTE Confidence: 0.845731475384615 00:59:12.280 --> 00:59:14.428 And again, just. NOTE Confidence: 0.845731475384615 00:59:14.430 --> 00:59:16.040 Break the box of hey just do NOTE Confidence: 0.845731475384615 00:59:16.040 --> 00:59:18.046 what I say just make sure that NOTE Confidence: 0.845731475384615 00:59:18.046 --> 00:59:19.611 you get those students engaged NOTE Confidence: 0.845731475384615 00:59:19.611 --> 00:59:21.503 by holding yourself accountable NOTE Confidence: 0.845731475384615 00:59:21.503 --> 00:59:23.527 by presenting those objectives. NOTE Confidence: 0.8092489375 00:59:26.040 --> 00:59:28.200 Thank you, thank you Celine and real quick. NOTE Confidence: 0.8092489375 00:59:28.200 --> 00:59:30.009 I know we're at time but I wanted to NOTE Confidence: 0.8092489375 00:59:30.009 --> 00:59:32.159 mention that the Center for teaching and NOTE Confidence: 0.8092489375 00:59:32.159 --> 00:59:33.423 learning has instructional designers NOTE Confidence: 0.8092489375 00:59:33.473 --> 00:59:34.937 available to help you with this, NOTE Confidence: 0.8092489375 00:59:34.940 --> 00:59:36.295 so I recommend either reaching NOTE Confidence: 0.8092489375 00:59:36.295 --> 00:59:37.650 out to the instructional designer NOTE Confidence: 0.8092489375 00:59:37.701 --> 00:59:38.717 assigned to your course, NOTE Confidence: 0.8092489375 00:59:38.720 --> 00:59:40.336 but if you don't know who that is, NOTE Confidence: 0.8092489375 00:59:40.340 --> 00:59:42.776 you can contact Cpl help at NOTE Confidence: 0.8092489375 00:59:42.780 --> 00:59:44.328 jhu.edu and they will connect you NOTE Confidence: 0.8092489375 00:59:44.328 --> 00:59:45.880 to the right person. Thank you.