WEBVTT

0ed9eb3e-86cd-4532-9c08-664598bb6f9d-0
00:00:00.080 --> 00:00:02.542
Before Celine yells at me,
I want to make sure I record this to the

0ed9eb3e-86cd-4532-9c08-664598bb6f9d-1
00:00:02.542 --> 00:00:02.760
cloud.

bd67100b-fe44-4243-a113-697315cbf251-0
00:00:02.760 --> 00:00:04.600
So we have a recording this for later on.

ad69687b-1548-4a47-95b6-9e7db53de74c-0
00:00:04.840 --> 00:00:07.465
So in the next hour,
these are the things we're going to wind

ad69687b-1548-4a47-95b6-9e7db53de74c-1
00:00:07.465 --> 00:00:09.920
up talking about spending about 10
minutes on each topic,

ad69687b-1548-4a47-95b6-9e7db53de74c-2
00:00:09.920 --> 00:00:12.079
maybe a little bit more on some of the
other ones.

0fa44b07-63bd-481a-99e2-e7b61b4989a0-0
00:00:12.080 --> 00:00:16.706
But the whole goal here is to provide you
with background and resources and

0fa44b07-63bd-481a-99e2-e7b61b4989a0-1
00:00:16.706 --> 00:00:20.907
thinking about how you can transition
your face to face assessments,

0fa44b07-63bd-481a-99e2-e7b61b4989a0-2
00:00:20.907 --> 00:00:23.829
particularly midterms,
finals exams in general,

0fa44b07-63bd-481a-99e2-e7b61b4989a0-3
00:00:23.829 --> 00:00:27.542
into an online environment,
building an building an academic

0fa44b07-63bd-481a-99e2-e7b61b4989a0-4
00:00:27.542 --> 00:00:28.760
integrity as you go.

036e466d-79dd-4ec5-882d-800e0319a38c-0
00:00:28.760 --> 00:00:32.120
And some of the options that are
available to you in thinking about that.

f67b42ac-314d-4c5b-9bd0-65ee4369d023-0
00:00:32.120 --> 00:00:36.058
And what we're going to do first is I'm
going to actually turn this over to Amy

f67b42ac-314d-4c5b-9bd0-65ee4369d023-1
00:00:36.058 --> 00:00:39.160
so she can talk a little bit about some
alternatives to exams.

60d4cecb-326e-4eab-b49e-63d1b120eca3-0
00:00:39.160 --> 00:00:43.492
Now, we fully understand that for,
you know, the School of Public Health,

60d4cecb-326e-4eab-b49e-63d1b120eca3-1
00:00:43.492 --> 00:00:47.999
midterms are next week and there's
probably not a lot of time to rethink the

60d4cecb-326e-4eab-b49e-63d1b120eca3-2
00:00:47.999 --> 00:00:50.399
entire assessment strategy that you have.

604adbba-41f3-4d2d-9a98-a48fff2c9ab1-0
00:00:50.400 --> 00:00:55.524
But given that social distancing,
maybe having to offer online classes is

604adbba-41f3-4d2d-9a98-a48fff2c9ab1-1
00:00:55.524 --> 00:01:00.787
something that is going to happen maybe a
little bit longer than we expect,

604adbba-41f3-4d2d-9a98-a48fff2c9ab1-2
00:01:00.787 --> 00:01:03.280
maybe again at some point next year.

740690d5-5413-4b8b-8a54-2d10cc39562a-0
00:01:03.280 --> 00:01:08.447
It's good to think about these strategies
above and beyond simply replicating a

740690d5-5413-4b8b-8a54-2d10cc39562a-1
00:01:08.447 --> 00:01:11.160
traditional exam in an online environment.

f9120273-daf0-4b89-82b4-977186657ae2-0
00:01:11.320 --> 00:01:13.520
And Amy's going to talk about that for a
little while.

71caea0c-ce40-4335-9722-3f92c451835e-0
00:01:13.520 --> 00:01:15.040
So Amy, I will turn it over to you.

da8eb29a-8a83-4a98-8bf7-22d3808864f5-0
00:01:15.480 --> 00:01:18.080
I believe you have Co host controls and
you can unmute yourself.

5394e8f5-52cc-4981-aca6-ebe5aabc50e6-0
00:01:18.080 --> 00:01:19.758
And,
and I'm going to stop sharing this

5394e8f5-52cc-4981-aca6-ebe5aabc50e6-1
00:01:19.758 --> 00:01:21.520
because you probably have your own slides.

4b757913-638a-4229-8266-9f85b549da2a-0
00:01:21.520 --> 00:01:23.080
Yep, yes, thank you.

e28e4699-8f97-4a7d-999e-9ad276149f78-0
00:01:23.360 --> 00:01:24.000
Excellent.

acc9bb89-49e5-4eff-a702-923ae70099d2-0
00:01:24.840 --> 00:01:29.240
And you should be able to share your
slides from your desktop.

30fb31cb-7f5c-4660-af38-12b3c9ca6b81-0
00:01:30.040 --> 00:01:30.400
Yes.

da4b0d67-0816-4547-bcad-0d7a959dd3e0-0
00:01:30.400 --> 00:01:31.320
Thank you so much.

01abd1ca-ce41-4146-8022-8277e8d7660d-0
00:01:31.960 --> 00:01:35.040
And then you should be able to see the
slides.

abbf0d27-0b9f-45fd-8f04-afeb95210b1f-0
00:01:35.040 --> 00:01:35.800
Let me know.

2f4e3109-3c0e-43e5-93e6-fb8464225530-0
00:01:37.080 --> 00:01:37.800
Yep, we can see them.

15c34eae-d994-44d9-a1da-ce26ccff6a8d-0
00:01:37.960 --> 00:01:38.400
Perfect.

16b93aae-ec07-4868-acc6-b579b0e7fe31-0
00:01:38.560 --> 00:01:42.280
All right, let me just bring up.

7a8c1d17-04ee-4978-a2c2-ee0c3e93b0e7-0
00:01:42.400 --> 00:01:46.437
OK, so as Brian mentioned,
my name is Amy Pinkerton and I'm an

7a8c1d17-04ee-4978-a2c2-ee0c3e93b0e7-1
00:01:46.437 --> 00:01:48.360
instructional designer at CTL.

c80a8230-b089-4b98-a84c-65ef7f93df02-0
00:01:48.680 --> 00:01:52.464
And today I'll just give a brief overview
of some of the ways that you can rethink

c80a8230-b089-4b98-a84c-65ef7f93df02-1
00:01:52.464 --> 00:01:53.240
your assessments.

d0735a3d-f613-4d6f-921e-00cf40551a8a-0
00:01:53.440 --> 00:01:58.173
And this will not be an exhaustive list,
but should give you some ideas that you

d0735a3d-f613-4d6f-921e-00cf40551a8a-1
00:01:58.173 --> 00:02:00.160
can start implementing right away.

051510f5-da49-4b8a-9a7d-6f2ead5ca5f1-0
00:02:00.760 --> 00:02:02.160
So I'll dive right in.

f26cf675-7e18-45ef-a31b-f57c9b627a86-0
00:02:03.400 --> 00:02:08.595
So when looking at your assessments,
the best place to start is with your

f26cf675-7e18-45ef-a31b-f57c9b627a86-1
00:02:08.595 --> 00:02:10.000
learning objectives.

6eea5c7b-5464-4627-9550-a656e09d1e4e-0
00:02:10.360 --> 00:02:15.347
So I always recommend when I work with
faculty to ask yourself what should the

6eea5c7b-5464-4627-9550-a656e09d1e4e-1
00:02:15.347 --> 00:02:16.800
students be able to do?

6ae8aab6-bba7-44c8-9310-239894b10b1b-0
00:02:17.040 --> 00:02:20.920
And then have the students demonstrate
that competency in their assessment.

be7bbc68-9885-4757-8123-ca222036e09d-0
00:02:21.560 --> 00:02:24.640
This ensures that your assessment aligns
with your objectives.

ab160e9b-13e1-4ac4-9471-4e925addc4c9-0
00:02:25.400 --> 00:02:28.080
And then also consider other skills that
you want to assess.

6a09cb21-9d40-4e23-aa28-e5dc0d2dee69-0
00:02:28.080 --> 00:02:33.201
So for example, writing ability,
perhaps speaking skills or the ability to

6a09cb21-9d40-4e23-aa28-e5dc0d2dee69-1
00:02:33.201 --> 00:02:34.840
collaborate with others.

ff20e7a7-4d80-4d4e-9528-9b7007220245-0
00:02:35.120 --> 00:02:37.760
And then also keep those in mind whenever.

1b543ae5-3dc6-4b5b-b48a-e819c40f5a51-0
00:02:37.800 --> 00:02:39.580
That way,
whenever you start building your

1b543ae5-3dc6-4b5b-b48a-e819c40f5a51-1
00:02:39.580 --> 00:02:42.520
assessments or rethinking your
assessments, you have a starting point.

5bc07eca-b7db-44bb-a62f-428f1f4b9bbb-0
00:02:42.560 --> 00:02:45.686
You have a list of things that you want
the students to be able to do or

5bc07eca-b7db-44bb-a62f-428f1f4b9bbb-1
00:02:45.686 --> 00:02:46.200
demonstrate.

64c2785d-2cec-4ddc-a3d4-dd6f782d6b1d-0
00:02:49.080 --> 00:02:52.080
So as Brian mentioned,
midterms are next week.

5403c024-e91f-4cb2-9a78-f780b13e1f13-0
00:02:52.400 --> 00:02:55.280
So most of you probably already have
developed an exam.

4992f6e7-3b6e-4322-b606-250c8d281dbc-0
00:02:56.000 --> 00:03:00.259
If you already have an exam developed and
there's some small adjustments that you

4992f6e7-3b6e-4322-b606-250c8d281dbc-1
00:03:00.259 --> 00:03:04.000
can make that you might consider making
instead of a complete overhaul.

81f53cea-9b3e-4af2-9df2-8c6c1b48d0dc-0
00:03:04.000 --> 00:03:07.500
And then some of the other ideas that
I'll share in a bit you could maybe

81f53cea-9b3e-4af2-9df2-8c6c1b48d0dc-1
00:03:07.500 --> 00:03:09.960
incorporate in future exams or in future
offerings.

3bbc11b9-9d20-4de7-bfd7-198d97ce2f06-0
00:03:10.640 --> 00:03:16.020
So a couple small adjustments that you
can make to an existing exam include

3bbc11b9-9d20-4de7-bfd7-198d97ce2f06-1
00:03:16.020 --> 00:03:19.560
adding explanations to multiple choice
questions.

8408a1a9-62ef-4154-a5b4-9c82f01399e6-0
00:03:19.560 --> 00:03:22.753
So for example,
you might ask students to explain why

8408a1a9-62ef-4154-a5b4-9c82f01399e6-1
00:03:22.753 --> 00:03:26.480
they answered their multiple choice
question in a certain way,

8408a1a9-62ef-4154-a5b4-9c82f01399e6-2
00:03:26.480 --> 00:03:31.152
or have the students explain if they
either why they chose their answer or why

8408a1a9-62ef-4154-a5b4-9c82f01399e6-3
00:03:31.152 --> 00:03:33.400
the alternative answers are incorrect.

46b05e08-4d24-4322-a09f-a0d31b1ac270-0
00:03:34.280 --> 00:03:39.019
Another question type that you might
consider incorporating in a multiple

46b05e08-4d24-4322-a09f-a0d31b1ac270-1
00:03:39.019 --> 00:03:44.079
choice exam is having the students create
a short answer essay or a meaningful

46b05e08-4d24-4322-a09f-a0d31b1ac270-2
00:03:44.079 --> 00:03:44.720
paragraph.

805aad00-4f7f-48ef-826f-0d8101808896-0
00:03:44.720 --> 00:03:47.644
So for example,
you might give the students a list of

805aad00-4f7f-48ef-826f-0d8101808896-1
00:03:47.644 --> 00:03:52.084
terms that they need to not only define
but also describe how they interrelate to

805aad00-4f7f-48ef-826f-0d8101808896-2
00:03:52.084 --> 00:03:52.680
each other.

80d5f0c9-12b8-49de-8b21-41896e963d0c-0
00:03:52.960 --> 00:03:57.656
So including more than just multiple
choice questions is a really great way to

80d5f0c9-12b8-49de-8b21-41896e963d0c-1
00:03:57.656 --> 00:03:59.440
gauge your students knowledge.

1affd15d-435e-40ad-9528-7d307ff09b57-0
00:04:00.240 --> 00:04:04.316
And then finally,
another small adjustment is having the

1affd15d-435e-40ad-9528-7d307ff09b57-1
00:04:04.316 --> 00:04:10.182
students do multiple quizzes across the
term as opposed to a single comprehensive

1affd15d-435e-40ad-9528-7d307ff09b57-2
00:04:10.182 --> 00:04:13.400
exam,
unless there's a pedagogical reason to

1affd15d-435e-40ad-9528-7d307ff09b57-3
00:04:13.400 --> 00:04:17.120
have one or two high stake exams within
the course.

95012eea-2811-43a8-ad71-c11e784b0c17-0
00:04:17.120 --> 00:04:20.460
So some courses that make sense,
but for most courses,

95012eea-2811-43a8-ad71-c11e784b0c17-1
00:04:20.460 --> 00:04:24.408
if you break up your assessments across
multiple grading points,

95012eea-2811-43a8-ad71-c11e784b0c17-2
00:04:24.408 --> 00:04:29.268
then that gives you more checkpoints or
opportunities to check in with students

95012eea-2811-43a8-ad71-c11e784b0c17-3
00:04:29.268 --> 00:04:30.240
across the term.

c64fa7da-a61a-4c8b-b84e-7457e571b6a9-0
00:04:32.360 --> 00:04:34.720
So those are some small adjustments that
you can make.

c87d8f9f-f591-467e-af4f-d8ecc5b57637-0
00:04:34.720 --> 00:04:36.720
Now let's look at some alternatives.

578592f7-2425-46bb-b7d7-ddad1818d1f8-0
00:04:39.880 --> 00:04:44.203
So if you're willing to think creatively
about assessments that go beyond the

578592f7-2425-46bb-b7d7-ddad1818d1f8-1
00:04:44.203 --> 00:04:48.028
traditional exam or paper,
then you might be able to actually design

578592f7-2425-46bb-b7d7-ddad1818d1f8-2
00:04:48.028 --> 00:04:52.185
assessments that are more accurate
reflections of the kind of thinking and

578592f7-2425-46bb-b7d7-ddad1818d1f8-3
00:04:52.185 --> 00:04:55.400
problem solving that you want your
students to engage in.

193ec7bd-7faf-44a4-a55e-1a6c3ad52d8d-0
00:04:55.720 --> 00:04:58.508
So these are assessments that might
better align with your learning

193ec7bd-7faf-44a4-a55e-1a6c3ad52d8d-1
00:04:58.508 --> 00:04:58.960
objectives.

becfba8e-f3bc-4d8b-bfb3-53be7c56bebd-0
00:04:58.960 --> 00:05:03.010
So remember before when I mentioned
learning objectives by rethinking your

becfba8e-f3bc-4d8b-bfb3-53be7c56bebd-1
00:05:03.010 --> 00:05:03.280
exam?

5ce6e2bc-4832-411a-8324-5daa0c34802e-0
00:05:03.280 --> 00:05:07.846
This is an opportunity to really make
sure that you're what you're assessing

5ce6e2bc-4832-411a-8324-5daa0c34802e-1
00:05:07.846 --> 00:05:10.160
aligns with what you want to to assess.

9973deec-f5c5-43c7-8560-8ac31e30d98d-0
00:05:11.160 --> 00:05:15.333
So for example,
you might consider incorporating some

9973deec-f5c5-43c7-8560-8ac31e30d98d-1
00:05:15.333 --> 00:05:20.280
authentic real world assessments into
your exam or your course.

8f1653db-6a3e-45b9-986f-6080a807744c-0
00:05:20.640 --> 00:05:24.791
So these are things, and again,
I'm this is just a quick list,

8f1653db-6a3e-45b9-986f-6080a807744c-1
00:05:24.791 --> 00:05:29.799
but these are things that might include,
say a mock policy memo or research

8f1653db-6a3e-45b9-986f-6080a807744c-2
00:05:29.799 --> 00:05:34.609
proposal or briefing to a specified
audience like an elected official or

8f1653db-6a3e-45b9-986f-6080a807744c-3
00:05:34.609 --> 00:05:35.400
stakeholder.

8cd2b271-e8d1-4a95-ba56-0f8bdd84401f-0
00:05:36.000 --> 00:05:40.967
And you can even incorporate some peer
review into that type of assessment so

8cd2b271-e8d1-4a95-ba56-0f8bdd84401f-1
00:05:40.967 --> 00:05:45.872
that students might take on the role of
different stakeholders and then give

8cd2b271-e8d1-4a95-ba56-0f8bdd84401f-2
00:05:45.872 --> 00:05:50.840
their peer feedback based on whatever
stakeholder identity they're taking on.

f00c8112-61bb-45ee-8336-c55b5a7526f6-0
00:05:51.960 --> 00:05:55.000
You can also have students participate in
a in a mock interview.

a998bc6b-5c0e-4a2e-9ebe-c1e20468bdca-0
00:05:55.720 --> 00:05:58.836
So in which case you might be the
interviewer and the students are being

a998bc6b-5c0e-4a2e-9ebe-c1e20468bdca-1
00:05:58.836 --> 00:06:01.183
interviewed,
or you could have students interview each

a998bc6b-5c0e-4a2e-9ebe-c1e20468bdca-2
00:06:01.183 --> 00:06:01.440
other.

3f8a47d8-3c0b-45d2-824a-b680ecceb99f-0
00:06:01.440 --> 00:06:04.302
Depending on what it is you'd like to
assess,

3f8a47d8-3c0b-45d2-824a-b680ecceb99f-1
00:06:04.302 --> 00:06:09.280
you might consider having a mock debate
between students or groups of students.

c88674c2-4b6a-4511-b045-02530574267c-0
00:06:09.840 --> 00:06:12.967
And finally,
you might have students create an

c88674c2-4b6a-4511-b045-02530574267c-1
00:06:12.967 --> 00:06:17.160
annotated anthology or a research
bibliography for the course.

918b20d6-cab3-442b-8997-133e83c37d27-0
00:06:17.160 --> 00:06:20.507
And then not only do you have that for
that current offering,

918b20d6-cab3-442b-8997-133e83c37d27-1
00:06:20.507 --> 00:06:24.988
but you can take some of the best pieces
from that anthology and keep building it,

918b20d6-cab3-442b-8997-133e83c37d27-2
00:06:24.988 --> 00:06:27.040
course offering after course offering.

526f8160-244f-499e-9e56-52730284fbb5-0
00:06:27.920 --> 00:06:32.030
So those are some basic real world
examples of types of assessments that

526f8160-244f-499e-9e56-52730284fbb5-1
00:06:32.030 --> 00:06:33.720
students might be asked to do.

f8a12190-272f-465f-ac0a-5d213485c83d-0
00:06:34.600 --> 00:06:37.240
Now let's look at some other ones.

f8f4a149-d35f-4644-968c-c99a222b848b-0
00:06:37.240 --> 00:06:42.107
So perhaps you might have students or you
might want students to do something more

f8f4a149-d35f-4644-968c-c99a222b848b-1
00:06:42.107 --> 00:06:44.160
visual or present, present an idea.

0e17e051-cf56-4ac7-97da-cd14d2aba345-0
00:06:44.400 --> 00:06:47.541
So maybe like I said,
one of those other skill sets that you

0e17e051-cf56-4ac7-97da-cd14d2aba345-1
00:06:47.541 --> 00:06:51.146
want to assess is students public
speaking skills or their ability to

0e17e051-cf56-4ac7-97da-cd14d2aba345-2
00:06:51.146 --> 00:06:53.000
collaborate and present information.

18a56966-17fc-4662-ac73-9d902b3c76bd-0
00:06:53.920 --> 00:06:57.920
So in this case you might consider
different types of presentations.

87aa4ceb-1546-4939-8130-ad77ed96749d-0
00:06:58.600 --> 00:07:02.947
A present a professional presentation
like a Ted talk or maybe a mock

87aa4ceb-1546-4939-8130-ad77ed96749d-1
00:07:02.947 --> 00:07:05.680
conference demonstration is a good
example.

b59c89a9-5620-46b3-b3a0-3a9e7065ca81-0
00:07:05.680 --> 00:07:10.011
Or we've seen classes that have class
poster sessions similar to poster

b59c89a9-5620-46b3-b3a0-3a9e7065ca81-1
00:07:10.011 --> 00:07:13.200
sessions that you would see at academic
conferences.

40197164-bda2-4d80-93e5-a8e732e5e468-0
00:07:14.480 --> 00:07:18.006
And finally,
you could have the students present

40197164-bda2-4d80-93e5-a8e732e5e468-1
00:07:18.006 --> 00:07:22.323
something more visual, for example,
a concept map, a chart,

40197164-bda2-4d80-93e5-a8e732e5e468-2
00:07:22.323 --> 00:07:28.008
or a graph with maybe a a accompanying
summary or text summary that they would

40197164-bda2-4d80-93e5-a8e732e5e468-3
00:07:28.008 --> 00:07:29.520
present to the class.

53d7fbac-20c5-4658-9d4c-2a61faa39ef3-0
00:07:31.600 --> 00:07:35.076
So all of these examples, and again,
this is not an exhaustive list,

53d7fbac-20c5-4658-9d4c-2a61faa39ef3-1
00:07:35.076 --> 00:07:38.200
just some ideas to get you a little bit
motivated to look at.

a58cab09-a3a2-4212-a009-7e9e36891206-0
00:07:38.480 --> 00:07:43.310
Some possible alternatives can be done
using the tools available to you and your

a58cab09-a3a2-4212-a009-7e9e36891206-1
00:07:43.310 --> 00:07:46.291
students,
either directly in course plus or using

a58cab09-a3a2-4212-a009-7e9e36891206-2
00:07:46.291 --> 00:07:48.200
tools available through Hopkins.

3f38031f-e8c5-44ba-852a-285c18f82e46-0
00:07:48.200 --> 00:07:51.795
And if you are interested in any of these,
I recommend you talk to your

3f38031f-e8c5-44ba-852a-285c18f82e46-1
00:07:51.795 --> 00:07:55.590
instructional designer where you can
brainstorm together and see what works

3f38031f-e8c5-44ba-852a-285c18f82e46-2
00:07:55.590 --> 00:07:56.240
best for you.

eb72dcad-d2dd-490a-9c8f-2d8692f57b27-0
00:07:57.520 --> 00:08:00.335
So again,
if you're interested in implementing an

eb72dcad-d2dd-490a-9c8f-2d8692f57b27-1
00:08:00.335 --> 00:08:03.544
alternative exam,
remember that you don't have to change

eb72dcad-d2dd-490a-9c8f-2d8692f57b27-2
00:08:03.544 --> 00:08:04.840
everything all at once.

748dc1e9-ff77-43ad-81f8-5ffcd82fe5a8-0
00:08:05.360 --> 00:08:09.822
And you can make small changes over time
and across assignments and across course

748dc1e9-ff77-43ad-81f8-5ffcd82fe5a8-1
00:08:09.822 --> 00:08:13.795
offerings until you find something that
really aligns with your learning

748dc1e9-ff77-43ad-81f8-5ffcd82fe5a8-2
00:08:13.795 --> 00:08:16.680
objectives and works well for you and
your students.

1e5f3080-4c25-4ffe-b74e-6354e09e86fe-0
00:08:17.120 --> 00:08:19.840
So with that,
I'll hand things back over to Brian.

4c8bf0b9-7f2d-4bb5-8c28-cb618de890cf-0
00:08:20.640 --> 00:08:22.465
OK, Well,
if there's any questions for Amy,

4c8bf0b9-7f2d-4bb5-8c28-cb618de890cf-1
00:08:22.465 --> 00:08:24.000
now would be a good time to ask them.

dd3e2118-59cf-4109-a9e5-9a3d87006d2c-0
00:08:24.000 --> 00:08:25.760
We certainly will take questions
throughout.

369d51ab-35c7-480c-adb5-14ff1b293403-0
00:08:26.280 --> 00:08:29.308
If you do have a question,
you can click the raise hand button or

369d51ab-35c7-480c-adb5-14ff1b293403-1
00:08:29.308 --> 00:08:32.520
just unmute yourself cuz everyone has the
ability to do that in Zoom.

fea4055e-cfd3-4398-b2ec-1b192137dc94-0
00:08:32.520 --> 00:08:33.520
It's one of the joys of Zoom.

32b9e3a7-98d7-4168-86e6-a06e71a611ea-0
00:08:34.000 --> 00:08:37.480
And if you do have a question for Amy or
me at any point, go ahead and do that.

572d576c-6307-4e47-a331-728edc418fcd-0
00:08:37.480 --> 00:08:39.760
Otherwise we will continue on with the
presentation.

182cb1c0-ed88-40af-b089-163c4bd5db0a-0
00:08:41.280 --> 00:08:43.920
Hi Amy, this is Lori Dean,
can you hear me?

a90f5adc-0f20-4cbd-8160-2f0fdd48db91-0
00:08:44.240 --> 00:08:47.040
Yes, great.

534f8f31-e4a4-4219-ae7a-fb2f3aadea01-0
00:08:47.360 --> 00:08:50.806
I can show myself too,
so I don't look like a,

534f8f31-e4a4-4219-ae7a-fb2f3aadea01-1
00:08:50.806 --> 00:08:52.640
I'm not creeping you out.

514466a5-d06f-45f8-90f1-a5d25d8c4d37-0
00:08:53.240 --> 00:08:57.377
I, I was wondering, so I,
I was intrigued by your idea of doing,

514466a5-d06f-45f8-90f1-a5d25d8c4d37-1
00:08:57.377 --> 00:09:00.560
of having students kind of interview one
another.

4c43d3ce-5dc4-4d15-bdcd-7dfc61ebed9b-0
00:09:01.360 --> 00:09:03.120
But then I guess how do you grade that?

7828e90e-d7f5-4b77-863d-9a0ee395e3fc-0
00:09:03.120 --> 00:09:05.440
And I'm actually even thinking about some
of the other things you mentioned.

83a7954a-b617-4850-a4a9-24ded93392df-0
00:09:05.440 --> 00:09:08.629
How do you actually evaluate them on a
point system or something that would

83a7954a-b617-4850-a4a9-24ded93392df-1
00:09:08.629 --> 00:09:09.720
contribute to their grade?

31a1b3b7-e4a2-4a90-99bc-4e725e58f995-0
00:09:09.720 --> 00:09:11.760
Is it kind of,
they just do it and they get credit?

d733dc4b-08dc-4f32-98e8-34485427d67b-0
00:09:12.040 --> 00:09:12.920
What would you recommend?

0f568358-09d3-4402-a3d2-f5349b681bba-0
00:09:13.360 --> 00:09:16.486
So for that,
what I would recommend is having the

0f568358-09d3-4402-a3d2-f5349b681bba-1
00:09:16.486 --> 00:09:20.800
students interview themselves
synchronously and have them record it.

d3677f5c-1805-422e-be4f-47d89e03af7c-0
00:09:20.800 --> 00:09:23.520
So they would maybe do it through Zoom
and record their Zoom session.

a108ac23-ed23-42df-a9ce-4127024a44c5-0
00:09:23.840 --> 00:09:27.180
And then that way they can,
they can also peer review so rate

a108ac23-ed23-42df-a9ce-4127024a44c5-1
00:09:27.180 --> 00:09:30.520
themselves like how did,
how they think the other person did.

f9a369be-0e5e-41b6-875c-42c622b1a3a2-0
00:09:30.520 --> 00:09:34.772
But then also you have the chance to go
back and see how they acted in the

f9a369be-0e5e-41b6-875c-42c622b1a3a2-1
00:09:34.772 --> 00:09:36.360
interview and the recording.

60515ccd-ecdb-4d2b-b995-89d063275cf3-0
00:09:36.360 --> 00:09:38.400
So that would that's how I would do it
virtually.

df58ea0f-1084-4062-9d6d-5ea0e4e43ca7-0
00:09:39.760 --> 00:09:43.567
And I would just suggest also,
so since I do teach these communication

df58ea0f-1084-4062-9d6d-5ea0e4e43ca7-1
00:09:43.567 --> 00:09:47.481
classes where it's about giving
presentations or elevator pitches or any

df58ea0f-1084-4062-9d6d-5ea0e4e43ca7-2
00:09:47.481 --> 00:09:49.680
number of different things using rubrics.

3f4c6b15-66f0-4395-891a-25b4963805e2-0
00:09:49.680 --> 00:09:53.390
Rubrics are a great way to guide students
in terms of what you expect out of them

3f4c6b15-66f0-4395-891a-25b4963805e2-1
00:09:53.390 --> 00:09:56.874
in this activity and to give them a
pretty objective and clear assessment of

3f4c6b15-66f0-4395-891a-25b4963805e2-2
00:09:56.874 --> 00:09:57.959
what they've done right.

17dd38d3-2e40-4ae1-9310-17059c4ee929-0
00:09:58.120 --> 00:10:00.800
If you're giving the rubrics upfront to
them, they know what's expected.

6cb9218f-df37-47e3-a830-7ea00e0b651c-0
00:10:00.800 --> 00:10:03.453
And if they hit all the Marks and hit all
the points and do it well,

6cb9218f-df37-47e3-a830-7ea00e0b651c-1
00:10:03.453 --> 00:10:04.800
they're going to get a great grade.

8db2b4ed-eb2f-4ef8-8c7f-faa73d664f09-0
00:10:05.000 --> 00:10:08.400
If they completely skip entire criteria,
they're not going to do so well.

67c7cb06-3ab1-4ddb-b5e2-2c578980adf0-0
00:10:08.800 --> 00:10:13.115
So rubrics in this kind of an environment,
at least for me where I do a lot of these,

67c7cb06-3ab1-4ddb-b5e2-2c578980adf0-1
00:10:13.115 --> 00:10:15.824
I sort of, you know,
sort of more sort of qualitative

67c7cb06-3ab1-4ddb-b5e2-2c578980adf0-2
00:10:15.824 --> 00:10:19.587
experiential learning activities do
really help make things very clear for

67c7cb06-3ab1-4ddb-b5e2-2c578980adf0-3
00:10:19.587 --> 00:10:20.240
the students.

9e386595-b978-479d-a089-e3e1889436ea-0
00:10:20.240 --> 00:10:23.600
And I very rarely get arguments about why
did I get this grade.

a1872195-3b94-42a0-b4d8-6f73a007856b-0
00:10:23.600 --> 00:10:24.720
It's like, well, it's in the rubric.

3100abcc-a4a7-4292-a144-5c32f555eb73-0
00:10:24.720 --> 00:10:25.280
So there you go.

6b516870-a360-4f8d-8baf-6cd01ee5659c-0
00:10:26.160 --> 00:10:26.400
Yes.

15a1bac5-aed2-4b4e-8629-f7ba4c2416cf-0
00:10:28.120 --> 00:10:29.600
OK, other questions.

d7dd4d53-2c91-4244-899b-45b7b8e0552f-0
00:10:29.600 --> 00:10:32.640
Otherwise,
I'll go back over to my presentation here.

b602bab0-8860-41a6-87aa-e6fa2db04f97-0
00:10:33.680 --> 00:10:36.640
All right,
so thank you Amy very much for that.

39ee7ea0-763f-4c52-a9d2-fb0ebe5a4875-0
00:10:36.880 --> 00:10:38.840
Hopefully everyone can see my screen.

c8684db7-78a2-449a-b4ca-dfcf25415259-0
00:10:38.840 --> 00:10:40.280
Can everyone see like the whole screen?

f263eda1-5b25-40fa-ba13-42b5bfcf11d9-0
00:10:40.680 --> 00:10:42.240
Like yes, everything?

89b45dc9-c1b5-4715-88fd-c197f39ba9d3-0
00:10:42.480 --> 00:10:43.480
Or is it just the power?

318cc732-6b9f-4787-8014-ac720603df8d-0
00:10:43.480 --> 00:10:44.360
Is it just the keynote?

413a5a45-caa8-49d3-80a1-6d01f11b9318-0
00:10:44.440 --> 00:10:45.400
It should be just the keynote now.

570299bc-a8a5-4c26-b359-9064c5341c3d-0
00:10:45.440 --> 00:10:47.040
But yeah, just a slide.

d175ec4c-2eb7-47a5-b070-0aa9877add35-0
00:10:47.240 --> 00:10:47.760
OK, cool.

2270de70-25be-4eef-a873-8dba2e9b42d7-0
00:10:47.760 --> 00:10:48.720
So let's talk.

9475c44a-dc48-4a71-8a54-4d8de0d8c29f-0
00:10:48.840 --> 00:10:53.555
So we can't talk about online assessments
without talking about academic integrity,

9475c44a-dc48-4a71-8a54-4d8de0d8c29f-1
00:10:53.555 --> 00:10:57.934
especially when we're talking about
midterms or finals or quizzes or exams or

9475c44a-dc48-4a71-8a54-4d8de0d8c29f-2
00:10:57.934 --> 00:10:58.720
time projects.

8fd477e5-dc5f-4afa-94bb-c36bf1a8a6b7-0
00:10:58.920 --> 00:11:01.080
Academic integrity is super important.

8b325646-5806-4d03-a170-6ed49f67abc6-0
00:11:01.240 --> 00:11:04.233
We want to make sure that the students
are doing the work that they're expected

8b325646-5806-4d03-a170-6ed49f67abc6-1
00:11:04.233 --> 00:11:05.880
to do and they're responsible for the
work.

68f52c4d-3572-4886-83f6-05e1b9f4a973-0
00:11:06.320 --> 00:11:08.705
And it's not,
we're not encouraging cheating simply

68f52c4d-3572-4886-83f6-05e1b9f4a973-1
00:11:08.705 --> 00:11:12.238
because we're online or making it easier
for students to cheat because we're

68f52c4d-3572-4886-83f6-05e1b9f4a973-2
00:11:12.238 --> 00:11:12.560
online.

c289edd9-87d3-440c-89fb-8ad7d16feba8-0
00:11:12.560 --> 00:11:16.684
Academic integrity is really important
and one of the biggest barriers we find

c289edd9-87d3-440c-89fb-8ad7d16feba8-1
00:11:16.684 --> 00:11:19.868
that many faculty,
particularly here at the School of Public

c289edd9-87d3-440c-89fb-8ad7d16feba8-2
00:11:19.868 --> 00:11:22.269
Health,
have to running their exams inside of

c289edd9-87d3-440c-89fb-8ad7d16feba8-3
00:11:22.269 --> 00:11:26.028
Course Plus or doing any kind of
significant assessment in say the quiz

c289edd9-87d3-440c-89fb-8ad7d16feba8-4
00:11:26.028 --> 00:11:27.960
generator tool inside of Course Plus.

bab9a530-07ac-42d0-bd2d-fdd75430551f-0
00:11:27.960 --> 00:11:31.104
And we get it, and this is important,
but there are ways of building an

bab9a530-07ac-42d0-bd2d-fdd75430551f-1
00:11:31.104 --> 00:11:34.291
academic integrity from the start when
you're thinking about your exams,

bab9a530-07ac-42d0-bd2d-fdd75430551f-2
00:11:34.291 --> 00:11:37.960
when you're thinking about your midterms,
finals, or online assessments in general.

ade67941-fe63-4e2b-9189-36fa19ddfec6-0
00:11:38.360 --> 00:11:41.120
And Course Plus has a number of tools
that help do that.

ec599c73-ede9-45d7-94d7-18b7e2ebf1da-0
00:11:41.120 --> 00:11:44.748
And I'll go over now sort of them in
general and then show you how to actually

ec599c73-ede9-45d7-94d7-18b7e2ebf1da-1
00:11:44.748 --> 00:11:46.080
activate them or set them up.

fcb34afe-a20e-4155-a9af-01b257de3079-0
00:11:46.720 --> 00:11:49.095
If you're going to be using an online
assessment,

fcb34afe-a20e-4155-a9af-01b257de3079-1
00:11:49.095 --> 00:11:52.897
and by that I largely mean you're going
to be using the quiz generator tool for

fcb34afe-a20e-4155-a9af-01b257de3079-2
00:11:52.897 --> 00:11:53.800
midterms or finals.

26c0523b-2146-437b-b156-84775312349f-0
00:11:54.120 --> 00:11:57.960
I will talk about another tool that you
can use to that might be a really great

26c0523b-2146-437b-b156-84775312349f-1
00:11:57.960 --> 00:11:59.160
transition point for you.

a1e3fdf5-f283-433d-b858-d0a062e41ba1-0
00:11:59.640 --> 00:12:04.423
But a lot of this has to do particularly
with say an assessment as we think of it

a1e3fdf5-f283-433d-b858-d0a062e41ba1-1
00:12:04.423 --> 00:12:06.640
as like an exam midterm or final exam.

fbddceb9-0b7d-47ce-b326-900b6bc7bdda-0
00:12:07.160 --> 00:12:11.193
So the first thing about assessments is
deciding whether they are open or closed

fbddceb9-0b7d-47ce-b326-900b6bc7bdda-1
00:12:11.193 --> 00:12:12.040
book assessments.

929fe32a-8d36-4fb1-aa07-5ddf1b128bd2-0
00:12:12.080 --> 00:12:13.160
And it's so critical.

c6df4ab0-b1b7-4ce6-be40-f2db77511b2d-0
00:12:13.160 --> 00:12:14.760
We learn time and time again.

f427998c-ab50-4ebc-929c-af6eed5283f3-0
00:12:15.160 --> 00:12:17.120
I work with you on Vernick very closely.

63c278e5-d5ad-4740-9412-ca7f4ea4babc-0
00:12:17.480 --> 00:12:21.191
Whenever there's a question about did
students cheat on an exam in course Plus

63c278e5-d5ad-4740-9412-ca7f4ea4babc-1
00:12:21.191 --> 00:12:25.137
people come to me and they're like, Brian,
can you look at the log and give me your

63c278e5-d5ad-4740-9412-ca7f4ea4babc-2
00:12:25.137 --> 00:12:25.560
feedback?

82ceae2d-6df2-4b8e-b112-6f423559ea09-0
00:12:25.560 --> 00:12:28.320
And can you look at the raw server logs
and see this and see that?

dfb0e86e-d479-4676-91c1-2fdf4a540f78-0
00:12:28.320 --> 00:12:32.277
And I spend hours and hours sometimes
doing sort of forensic analysis of

dfb0e86e-d479-4676-91c1-2fdf4a540f78-1
00:12:32.277 --> 00:12:36.560
student behavior that's captured through
the data that we have in course plus.

a7a66752-0b3d-4f35-a09f-3bb455954785-0
00:12:37.320 --> 00:12:41.407
And a lot of times these kinds of
questions and these kinds of issues that

a7a66752-0b3d-4f35-a09f-3bb455954785-1
00:12:41.407 --> 00:12:45.877
ultimately get referred to to yon can be
avoided by being really clear about what

a7a66752-0b3d-4f35-a09f-3bb455954785-2
00:12:45.877 --> 00:12:47.240
you expect from students.

c15bc9c5-9cff-41eb-8e71-2cb9bd5ae4d0-0
00:12:47.440 --> 00:12:48.400
Is it open book?

a5ab61b1-6c07-4088-b097-41dbb024c4fd-0
00:12:48.400 --> 00:12:49.240
Is it closed book?

0dc9d50e-4abe-4970-818c-26acac4f1c47-0
00:12:49.240 --> 00:12:50.520
What does closed book mean?

ada2e7e1-fa1b-432a-b0e0-0fcaad272134-0
00:12:50.720 --> 00:12:52.400
Does it mean that you can have notes?

d893c3cb-3349-4ff0-866a-e7e1ef363954-0
00:12:52.400 --> 00:12:55.040
Does it mean that you can get up and walk
away from your computer?

b6283eae-617a-4889-a15d-f0773d3b57f9-0
00:12:55.040 --> 00:12:59.680
Does it mean you can access the exam
multiple times in a limited time window?

cbe817a9-0a42-4d29-a305-d6e9241489e5-0
00:13:00.080 --> 00:13:01.280
What does open book mean?

5d07a35d-87ca-44b8-b13b-8982bda825d4-0
00:13:01.280 --> 00:13:03.280
What are the resources you can access?

18156ffd-6050-421d-9d02-d915ea3b9577-0
00:13:03.520 --> 00:13:08.373
Being really specific about this is
critical to avoiding student questions

18156ffd-6050-421d-9d02-d915ea3b9577-1
00:13:08.373 --> 00:13:09.280
and confusion.

1d81e4cb-a285-4152-8347-a446e488bf25-0
00:13:09.280 --> 00:13:13.445
And then you can write out a full page of
your instructions about what's allowed

1d81e4cb-a285-4152-8347-a446e488bf25-1
00:13:13.445 --> 00:13:14.680
and not and not allowed.

9c36d987-25c9-423b-b72c-ac5530e6977b-0
00:13:14.680 --> 00:13:20.161
It is better to be overly explicit than
to assume that students will understand

9c36d987-25c9-423b-b72c-ac5530e6977b-1
00:13:20.161 --> 00:13:23.040
what your definition of open or closed is.

7a193329-97f6-4c1b-9ed3-ff75a4328cf8-0
00:13:23.360 --> 00:13:24.880
And it's really a good idea.

b4a3dbb7-a006-4d91-a02e-70cc62a66f36-0
00:13:25.200 --> 00:13:26.998
It's not, you know,
right at the exam time,

b4a3dbb7-a006-4d91-a02e-70cc62a66f36-1
00:13:26.998 --> 00:13:28.920
but the day before or a couple of days
before.

3b2019d2-2ec0-4cda-bdf5-02d803be2e9c-0
00:13:29.000 --> 00:13:30.920
Or distribute those instructions.

98d2208f-553e-4ba8-987e-9330997ab5c4-0
00:13:30.920 --> 00:13:34.637
Distribute that definition of open book
or closed book to the students in your

98d2208f-553e-4ba8-987e-9330997ab5c4-1
00:13:34.637 --> 00:13:34.920
class.

fdc1f251-324d-4df2-af7d-d870a0ff3247-0
00:13:35.120 --> 00:13:37.160
Use the class e-mail tool to do that.

9e45fedc-21fe-4998-b9a2-6ed41ca5a824-0
00:13:37.360 --> 00:13:41.245
That way if students have questions,
they can ask you before they potentially

9e45fedc-21fe-4998-b9a2-6ed41ca5a824-1
00:13:41.245 --> 00:13:42.640
get themselves into trouble.

481082fa-7937-42e6-87b3-093b26979ce4-0
00:13:42.880 --> 00:13:46.942
So decide if it's going to be open or
closed and then be very explicit with

481082fa-7937-42e6-87b3-093b26979ce4-1
00:13:46.942 --> 00:13:48.600
students about what that means.

8fc704e5-bf96-4954-8502-7d213097eac8-0
00:13:49.240 --> 00:13:53.618
Another way that's really helpful,
especially when we're talking about exams

8fc704e5-bf96-4954-8502-7d213097eac8-1
00:13:53.618 --> 00:13:57.200
to to make to help build an academic
integrity is time boxing.

ca8c9a0f-75f7-43ab-8410-dd659d93bff2-0
00:13:57.360 --> 00:13:58.520
And this is always a challenge.

906cb5a0-be7e-4a71-befd-83672c42a805-0
00:13:58.520 --> 00:14:01.104
Sometimes in the face to face environment
we say, OK,

906cb5a0-be7e-4a71-befd-83672c42a805-1
00:14:01.104 --> 00:14:03.880
we have a 90 minute or you know,
80 minute class session.

1fb7cab2-3f3e-41d6-be44-062540570b07-0
00:14:04.000 --> 00:14:05.760
So our exam can only go to 80 minutes.

fda87775-c088-452e-8740-e0c015936c95-0
00:14:05.760 --> 00:14:10.040
But now that we're online, you know what,
I'll give students 2 1/2 hours to do this.

07a9b0ba-1b65-4322-a5c6-25459cb5f215-0
00:14:10.440 --> 00:14:12.960
Well, is that the right approach?

3432d4d3-b4d1-4647-b2a3-c8dad37162b7-0
00:14:12.960 --> 00:14:17.850
Because maybe 90 minutes is the right
amount of time to ensure or 80 minutes or

3432d4d3-b4d1-4647-b2a3-c8dad37162b7-1
00:14:17.850 --> 00:14:22.862
60 minutes is the right amount of time to
ensure that only a student with mastery

3432d4d3-b4d1-4647-b2a3-c8dad37162b7-2
00:14:22.862 --> 00:14:27.080
of the subject matter can answer the
questions in the time allotted.

10b77203-03f2-42de-a072-e81965c16b78-0
00:14:27.240 --> 00:14:30.126
What you don't want to want up doing is
simply because it's online,

10b77203-03f2-42de-a072-e81965c16b78-1
00:14:30.126 --> 00:14:33.650
saying we're going to give people lots of
extra time to complete this exam because

10b77203-03f2-42de-a072-e81965c16b78-2
00:14:33.650 --> 00:14:34.160
it's online.

c8370672-8e0e-4e32-8686-8abd2cf20f2b-0
00:14:34.480 --> 00:14:36.522
Well,
they could use that extra time to look at

c8370672-8e0e-4e32-8686-8abd2cf20f2b-1
00:14:36.522 --> 00:14:39.800
their notes, to research, to do things,
to have books open in front of them.

dc35ee8c-a668-4315-b47f-687c68c83267-0
00:14:40.280 --> 00:14:44.464
And time boxing is a great way to ensure
that only students who have real mastery

dc35ee8c-a668-4315-b47f-687c68c83267-1
00:14:44.464 --> 00:14:47.680
of the subject can answer the questions
and the time allotted.

51f0e0a6-c3b2-4c64-8d54-636cda4f2e3c-0
00:14:48.000 --> 00:14:51.136
Now the challenge here,
of course is balancing that against

51f0e0a6-c3b2-4c64-8d54-636cda4f2e3c-1
00:14:51.136 --> 00:14:53.960
really asking them to do too much in too
little time.

2844c463-1ee5-411b-a7eb-72eeac17590a-0
00:14:53.960 --> 00:14:57.502
And you probably know from your own
experience in the online,

2844c463-1ee5-411b-a7eb-72eeac17590a-1
00:14:57.502 --> 00:15:01.845
assuming the on campus environment,
how many questions can be answered in a

2844c463-1ee5-411b-a7eb-72eeac17590a-2
00:15:01.845 --> 00:15:03.159
60 minute or 90 minute.

25e942cf-8066-4abb-bcee-0fc5d747d709-0
00:15:03.320 --> 00:15:07.924
So just think about not making it so that
students have tons of time just because

25e942cf-8066-4abb-bcee-0fc5d747d709-1
00:15:07.924 --> 00:15:09.440
it's an online environment.

6971a08c-efab-4a56-a3bc-4f55d03dd63d-0
00:15:09.440 --> 00:15:11.000
Keep that time boxing in place.

019fb9c3-1f0a-48b1-a29b-781af5480e35-0
00:15:11.000 --> 00:15:15.934
It will help them focus and help reduce
their opportunity to go and cheat on

019fb9c3-1f0a-48b1-a29b-781af5480e35-1
00:15:15.934 --> 00:15:17.280
things they're doing.

bd6b4169-04d4-4466-bc78-5e90431ad79b-0
00:15:18.000 --> 00:15:21.804
Randomization is another great way of
helping to prevent and reduce the

bd6b4169-04d4-4466-bc78-5e90431ad79b-1
00:15:21.804 --> 00:15:22.280
cheating.

4207d639-2e69-4f06-9359-8283570e3c53-0
00:15:22.760 --> 00:15:25.174
Course Plus,
the quiz generator tool in Course Plus

4207d639-2e69-4f06-9359-8283570e3c53-1
00:15:25.174 --> 00:15:26.800
has two ways of randomizing things.

4223783d-78a5-4785-b009-ae0f57907c87-0
00:15:26.800 --> 00:15:29.256
One,
the display order of questions so that

4223783d-78a5-4785-b009-ae0f57907c87-1
00:15:29.256 --> 00:15:31.936
you know,
every student gets a different order,

4223783d-78a5-4785-b009-ae0f57907c87-2
00:15:31.936 --> 00:15:34.560
display order of the questions that are
there.

20487e17-3656-4b73-b960-da1828fa72dd-0
00:15:34.920 --> 00:15:38.004
If you do have questions that need to be
presented, like you know,

20487e17-3656-4b73-b960-da1828fa72dd-1
00:15:38.004 --> 00:15:39.800
questions 7 and 8, refer to this graph.

a28023b3-e7dc-4d13-a349-1c7a64f8c0d7-0
00:15:39.800 --> 00:15:41.481
Well,
you can create a block of questions so

a28023b3-e7dc-4d13-a349-1c7a64f8c0d7-1
00:15:41.481 --> 00:15:42.640
that they always stay together.

43ea8f79-a09b-4016-a44f-1cb34c47e0cc-0
00:15:42.640 --> 00:15:46.875
Those two questions always stay together,
but they might be randomized in the

43ea8f79-a09b-4016-a44f-1cb34c47e0cc-1
00:15:46.875 --> 00:15:50.840
larger set in terms of the display the
order of of what is in your quiz.

53bd05b1-4c12-4ab7-b1b8-337b9652dbb3-0
00:15:50.840 --> 00:15:53.760
And this is a great way of saying
preventing students from saying here's

53bd05b1-4c12-4ab7-b1b8-337b9652dbb3-1
00:15:53.760 --> 00:15:54.600
the quick answer key.

873d04c0-e8ff-4485-94e4-afee09ab6c7d-0
00:15:54.600 --> 00:15:59.558
Question 1 is a question 2 is C question
3 is D can't do that if everybody's is

873d04c0-e8ff-4485-94e4-afee09ab6c7d-1
00:15:59.558 --> 00:16:00.240
randomized.

773f305e-fdb6-43fb-ad54-ae7e81d7b52c-0
00:16:00.840 --> 00:16:05.683
The even better way of doing
randomization and helping to ensure

773f305e-fdb6-43fb-ad54-ae7e81d7b52c-1
00:16:05.683 --> 00:16:11.569
academic integrity is if you have a Bank
of questions from which questions are

773f305e-fdb6-43fb-ad54-ae7e81d7b52c-2
00:16:11.569 --> 00:16:12.240
selected.

616b170f-d48d-41ff-96a3-0d7f6487482a-0
00:16:12.480 --> 00:16:15.910
So by this I mean,
let's say you have an exam with 20

616b170f-d48d-41ff-96a3-0d7f6487482a-1
00:16:15.910 --> 00:16:19.087
questions,
but you build out 30 questions and you

616b170f-d48d-41ff-96a3-0d7f6487482a-2
00:16:19.087 --> 00:16:21.120
tell the quiz generator display.

cb91bdf6-515d-40c3-beae-a1e3ae3fbd4b-0
00:16:21.120 --> 00:16:24.880
Each student only gets 20 out of the 30
questions that are in my exam.

3a8719dc-2ad6-41ef-bca7-41b5c4dfa4a7-0
00:16:25.160 --> 00:16:29.657
That makes it so much harder for students
to share answers with one another because

3a8719dc-2ad6-41ef-bca7-41b5c4dfa4a7-1
00:16:29.657 --> 00:16:33.672
they don't know not only are the
questions going to be randomized in their

3a8719dc-2ad6-41ef-bca7-41b5c4dfa4a7-2
00:16:33.672 --> 00:16:36.563
display order,
they also don't know that student B is

3a8719dc-2ad6-41ef-bca7-41b5c4dfa4a7-3
00:16:36.563 --> 00:16:39.080
going to have the same questions as
student A.

da949109-c020-47cf-b497-95433912953d-0
00:16:39.520 --> 00:16:44.084
So question banks can be really,
really powerful way to help ensure

da949109-c020-47cf-b497-95433912953d-1
00:16:44.084 --> 00:16:47.240
academic integrity for students in your
exams.

32136fa3-255e-4368-8177-ae82738205e6-0
00:16:47.680 --> 00:16:50.120
Looks like somebody had a question in the
chat there.

7ec6b216-ae07-4801-b59b-f61e195f51ea-0
00:16:51.440 --> 00:16:52.999
Oh,
can question bank create problems if

7ec6b216-ae07-4801-b59b-f61e195f51ea-1
00:16:52.999 --> 00:16:54.520
certain questions are harder than other?

a965910f-a5ed-4985-a577-13fc0e28e25c-0
00:16:54.520 --> 00:16:55.680
That's what Beth Resnick asked.

2a9b7e14-a881-4b26-afe0-999dac803463-0
00:16:55.680 --> 00:16:55.960
Yeah.

cf99b931-383b-4e02-b699-247c889207b5-0
00:16:55.960 --> 00:17:00.197
So the thing the question bank can't do
is sort of qualitatively assess that

cf99b931-383b-4e02-b699-247c889207b5-1
00:17:00.197 --> 00:17:04.600
these are harder questions and these are
easier questions and balance them out.

74f217e0-fadc-4f26-93f7-3d0c4b566a55-0
00:17:04.800 --> 00:17:08.060
Or, you know,
I want to make sure that there are at the

74f217e0-fadc-4f26-93f7-3d0c4b566a55-1
00:17:08.060 --> 00:17:11.320
minimum of three questions from these
five topic areas.

d2fbb9cc-83ea-45fb-a816-990111609bdc-0
00:17:11.320 --> 00:17:12.040
It can't do that.

549eb3c7-bc11-4153-ba53-e037d570f132-0
00:17:12.040 --> 00:17:14.080
It's purely random selection.

71c978f9-5fdb-4e80-aaf8-a0623da73ca6-0
00:17:14.720 --> 00:17:17.133
So in that sense,
if you do have questions that are

71c978f9-5fdb-4e80-aaf8-a0623da73ca6-1
00:17:17.133 --> 00:17:20.614
significantly harder than others,
students are some students who could end

71c978f9-5fdb-4e80-aaf8-a0623da73ca6-2
00:17:20.614 --> 00:17:23.399
up with a really hard questions and the
students who don't.

ea140b1c-e2ee-4933-ac51-5197e2128170-0
00:17:23.400 --> 00:17:26.726
But one of the goals, of course,
is to try to write questions that are

ea140b1c-e2ee-4933-ac51-5197e2128170-1
00:17:26.726 --> 00:17:28.320
equally as difficult for everyone.

ac8b2414-47bf-4b2b-aefc-1cc22bbb75ee-0
00:17:28.320 --> 00:17:30.395
But that is a good thing to consider,
Beth,

ac8b2414-47bf-4b2b-aefc-1cc22bbb75ee-1
00:17:30.395 --> 00:17:33.840
because it won't be able to make those
qualitative decisions about that.

e2f86544-51f2-4a9a-9329-16fe5c4b2dff-0
00:17:36.440 --> 00:17:38.769
Next thing,
There is an academic ethics signature

e2f86544-51f2-4a9a-9329-16fe5c4b2dff-1
00:17:38.769 --> 00:17:40.120
option in the quiz generator.

8fa6a608-0d1d-457f-927c-3fb444524d81-0
00:17:40.120 --> 00:17:43.637
And I know it sounds silly that someone
can just type their name, but you know,

8fa6a608-0d1d-457f-927c-3fb444524d81-1
00:17:43.637 --> 00:17:46.978
studies have shown that when folks are
actually asked to sign their name to

8fa6a608-0d1d-457f-927c-3fb444524d81-2
00:17:46.978 --> 00:17:49.264
something,
they are more likely to adhere to it and

8fa6a608-0d1d-457f-927c-3fb444524d81-3
00:17:49.264 --> 00:17:49.880
to hold to it.

dd2f13d6-11e5-453b-bb6c-2289386c308e-0
00:17:50.200 --> 00:17:53.415
So there is an option where a student has
to say that, yes,

dd2f13d6-11e5-453b-bb6c-2289386c308e-1
00:17:53.415 --> 00:17:57.703
I agree with the the school's academic
ethics policy and will be bound to it in

dd2f13d6-11e5-453b-bb6c-2289386c308e-2
00:17:57.703 --> 00:17:58.400
any disputes.

e3105d57-7bf7-45bf-822f-4707d8f1fd8e-0
00:17:58.840 --> 00:18:02.036
And that can help again,
get students in the right mindset for

e3105d57-7bf7-45bf-822f-4707d8f1fd8e-1
00:18:02.036 --> 00:18:03.000
academic integrity.

e20b5943-bf89-471d-b827-0a38d66d0681-0
00:18:03.600 --> 00:18:07.572
A strategy that a couple of some faculty
I've seen have used are actually breaking

e20b5943-bf89-471d-b827-0a38d66d0681-1
00:18:07.572 --> 00:18:10.156
your exam into multiple parts so that you
would have,

e20b5943-bf89-471d-b827-0a38d66d0681-2
00:18:10.156 --> 00:18:11.640
and this is a couple of things.

4349d40c-0eec-4903-a69e-0e57e58ea089-0
00:18:11.640 --> 00:18:15.700
1 So basically what happens is there's a
multiple choice part and then there's an

4349d40c-0eec-4903-a69e-0e57e58ea089-1
00:18:15.700 --> 00:18:16.840
open answer essay part.

720ef0f9-09df-43b5-8697-22eba59f28bb-0
00:18:17.080 --> 00:18:20.995
And students take these as two separate
exams or two separate quizzes, exams,

720ef0f9-09df-43b5-8697-22eba59f28bb-1
00:18:20.995 --> 00:18:24.760
whatever you want to call them within
that, whatever time limit you allot.

2dffb482-3bfe-492d-99c1-9ef5782fd5d8-0
00:18:24.760 --> 00:18:28.127
So you can say look on Monday you're
going to take your exam and send two

2dffb482-3bfe-492d-99c1-9ef5782fd5d8-1
00:18:28.127 --> 00:18:28.400
parts.

30593446-118b-4fbe-94d9-a26a81253bda-0
00:18:28.560 --> 00:18:32.840
There is a 30 minute multiple choice and
a 40 minute written portion to it.

fb92d8f3-93e8-4f30-85d5-c6b707af52b3-0
00:18:33.400 --> 00:18:35.240
And what this allows is 2 things.

ce2f5410-e372-4e47-b62c-ea4a6386ada0-0
00:18:35.240 --> 00:18:38.520
One, with the multiple choice part,
you could give students immediate

ce2f5410-e372-4e47-b62c-ea4a6386ada0-1
00:18:38.520 --> 00:18:40.958
feedback,
meaning you could show them what they got

ce2f5410-e372-4e47-b62c-ea4a6386ada0-2
00:18:40.958 --> 00:18:42.880
right and what they got wrong right away.

ea40c3b7-f220-4408-b186-c0f6d2b13e16-0
00:18:42.880 --> 00:18:45.178
So they could say, wow,
I need to brush up on this,

ea40c3b7-f220-4408-b186-c0f6d2b13e16-1
00:18:45.178 --> 00:18:46.240
I need to focus on this.

c683a3e5-6325-4cc1-9c06-37a6c38c61fb-0
00:18:46.680 --> 00:18:49.280
And then it also gives them an
opportunity for a break.

d65e2d13-9269-4128-907c-b76175b70ff3-0
00:18:49.280 --> 00:18:53.360
It takes the pressure off of them before
they have to move on to the final.

758e46a9-1d01-4dae-8af2-17d5bb90ce6d-0
00:18:53.440 --> 00:18:56.529
The the essay part,
which for many students can be more

758e46a9-1d01-4dae-8af2-17d5bb90ce6d-1
00:18:56.529 --> 00:18:58.240
challenging and more difficult.

115422de-1748-4d44-886a-f71b49e62c3f-0
00:18:58.640 --> 00:19:01.993
And this reduces pressure,
reduces incentives to cheat because

115422de-1748-4d44-886a-f71b49e62c3f-1
00:19:01.993 --> 00:19:05.560
students have less overall pressure put
on them at any given time.

2b848558-2dc7-49d9-91c6-d199f1137e48-0
00:19:05.560 --> 00:19:12.206
And right now we're students are really
dealing with a myriad of challenges from

2b848558-2dc7-49d9-91c6-d199f1137e48-1
00:19:12.206 --> 00:19:15.160
electricity to food supply to money.

f51ff90e-d4e2-4b8b-aa88-266c0759f1c9-0
00:19:15.160 --> 00:19:17.566
How are they going to pay for things in
their homes, their families,

f51ff90e-d4e2-4b8b-aa88-266c0759f1c9-1
00:19:17.566 --> 00:19:18.160
their apartments?

066f574a-3d9a-4140-8102-d75f755eb928-0
00:19:18.360 --> 00:19:20.070
You know,
am I going to be able to help pay the

066f574a-3d9a-4140-8102-d75f755eb928-1
00:19:20.070 --> 00:19:20.640
rent next month?

38f433bd-049f-4367-a4dd-c2f127612162-0
00:19:21.000 --> 00:19:25.006
Sometimes taking off a little pressure
can go a long way in making students be

38f433bd-049f-4367-a4dd-c2f127612162-1
00:19:25.006 --> 00:19:29.266
less likely to resort to cheating because
they're under such pressure to get things

38f433bd-049f-4367-a4dd-c2f127612162-2
00:19:29.266 --> 00:19:29.520
done.

f0d36cc6-1a83-4a24-b419-9058f702321e-0
00:19:29.680 --> 00:19:33.962
So this is 1 strategy that a couple
faculty have found that for them does

f0d36cc6-1a83-4a24-b419-9058f702321e-1
00:19:33.962 --> 00:19:38.360
seem to engage students more in ethical
behavior when they're taking exams.

a03dbd57-24d3-4e12-8bee-9f633df0c128-0
00:19:39.760 --> 00:19:44.214
The other thing that Course Plus does is
that Course Plus has an option if you are

a03dbd57-24d3-4e12-8bee-9f633df0c128-1
00:19:44.214 --> 00:19:47.488
doing an exam, a midterm or final exam,
something like that,

a03dbd57-24d3-4e12-8bee-9f633df0c128-2
00:19:47.488 --> 00:19:51.459
to track student activity in the sense
that it can track whether or not a

a03dbd57-24d3-4e12-8bee-9f633df0c128-3
00:19:51.459 --> 00:19:54.680
student leaves the exam page while
they're taking the exam.

731b31b9-659d-420a-bb57-a0ad21e85bfd-0
00:19:55.000 --> 00:19:57.480
And I'll show you some examples of this
later on.

c84bbe1c-9f78-4bed-8219-7d5d6f585d19-0
00:19:57.680 --> 00:20:01.257
But basically what it means is that if a
student is in a web browser and they

c84bbe1c-9f78-4bed-8219-7d5d6f585d19-1
00:20:01.257 --> 00:20:03.000
click outside the web browser for any.

cf8f0879-64cd-4a4e-b505-2e504e415ba9-0
00:20:03.080 --> 00:20:07.880
Anything or switch to another tab or
somehow switch to another application.

691fb4c9-cd12-4331-b889-fe90eda0d68b-0
00:20:07.880 --> 00:20:13.012
Even where the exam loses focus,
it will be flagged in Course Plus and you

691fb4c9-cd12-4331-b889-fe90eda0d68b-1
00:20:13.012 --> 00:20:16.160
can see when they leave and when they
return.

0d80d56e-48a5-48d6-8546-1996ff1e6981-0
00:20:16.680 --> 00:20:20.360
So what it does not do is it doesn't see
what the student does on their desktop.

8ee71a17-56eb-47fd-8c13-d7e1c214dc2e-0
00:20:20.360 --> 00:20:22.160
It's not recording the screen, right?

50935364-5736-49ad-b814-c31ca2a9a679-0
00:20:22.320 --> 00:20:27.066
So we can't see that Brian left and went
to Microsoft Word and looked at this

50935364-5736-49ad-b814-c31ca2a9a679-1
00:20:27.066 --> 00:20:28.040
particular file.

98a24e75-c499-4e48-9121-9014eef3d2c4-0
00:20:28.200 --> 00:20:29.880
We can't see that in Course Plus.

73e677ae-308d-4beb-84ef-2c33ef1645ce-0
00:20:29.880 --> 00:20:35.025
All we can say is yes,
the student left and came back and if

73e677ae-308d-4beb-84ef-2c33ef1645ce-1
00:20:35.025 --> 00:20:41.520
they accessed anything else in course
plus during the time that they were in

73e677ae-308d-4beb-84ef-2c33ef1645ce-2
00:20:41.520 --> 00:20:42.280
the exam.

23f0a091-d8fc-43d5-890c-b9d25dc74b4b-0
00:20:42.560 --> 00:20:45.722
So for example,
like I'm on my my desktop right now,

23f0a091-d8fc-43d5-890c-b9d25dc74b4b-1
00:20:45.722 --> 00:20:46.200
my iMac.

4da0b312-3a57-4d20-8ef8-86525f1da8d1-0
00:20:46.400 --> 00:20:51.253
If I were taking an exam and I decided to
go on my phone onto Course Plus and

4da0b312-3a57-4d20-8ef8-86525f1da8d1-1
00:20:51.253 --> 00:20:55.733
download some files and check some
lectures while I was taking my exam,

4da0b312-3a57-4d20-8ef8-86525f1da8d1-2
00:20:55.733 --> 00:20:57.600
this feature would track that.

9da371fd-6144-4012-88c2-091af1aecd51-0
00:20:57.800 --> 00:21:02.536
It would show you the exact time in the
exam when the student went in and did

9da371fd-6144-4012-88c2-091af1aecd51-1
00:21:02.536 --> 00:21:02.840
that.

9c82fe88-9a64-4bdd-bfb1-3f57a7c50c45-0
00:21:03.040 --> 00:21:06.833
So it's powerful in the sense that if a
student's going into Course Plus and

9c82fe88-9a64-4bdd-bfb1-3f57a7c50c45-1
00:21:06.833 --> 00:21:10.873
doing other things or switching off the
exam page, we know this, we can see this,

9c82fe88-9a64-4bdd-bfb1-3f57a7c50c45-2
00:21:10.873 --> 00:21:11.760
we can track this.

25207b20-8539-4949-b132-ece6c093594a-0
00:21:12.080 --> 00:21:16.407
What it can't do is say, well,
what were they doing when they switched

25207b20-8539-4949-b132-ece6c093594a-1
00:21:16.407 --> 00:21:17.200
off the exam?

fa9b6b58-f6a5-481c-a91a-26cf5d2d38fe-0
00:21:17.360 --> 00:21:18.920
Were they looking at APDF?

30fef2bd-73c5-4227-927f-c2f8096f020e-0
00:21:19.080 --> 00:21:21.800
Were they emailing or IM ING instant
messaging their friends?

750a09da-a017-496b-826a-eb65c295c29c-0
00:21:21.800 --> 00:21:22.520
We don't know.

79a1db03-199e-4f0a-8313-b44981010569-0
00:21:22.520 --> 00:21:27.217
We can't track that kind of stuff,
but it can be useful and sort of basic

79a1db03-199e-4f0a-8313-b44981010569-1
00:21:27.217 --> 00:21:28.360
activity tracking.

2d76c41a-82ce-49c4-a995-b50b8ffb12d0-0
00:21:29.040 --> 00:21:32.316
And it really is shocking to me,
even though this feature has been around

2d76c41a-82ce-49c4-a995-b50b8ffb12d0-1
00:21:32.316 --> 00:21:34.795
for a while,
even though many students are aware of it,

2d76c41a-82ce-49c4-a995-b50b8ffb12d0-2
00:21:34.795 --> 00:21:37.895
faculty tell them about it,
it still shocks me to this day the number

2d76c41a-82ce-49c4-a995-b50b8ffb12d0-3
00:21:37.895 --> 00:21:40.242
of students who,
even though their activity is being

2d76c41a-82ce-49c4-a995-b50b8ffb12d0-4
00:21:40.242 --> 00:21:42.278
tracked,
still go off or still download other

2d76c41a-82ce-49c4-a995-b50b8ffb12d0-5
00:21:42.278 --> 00:21:43.120
material in course.

0d82cffc-3935-47c2-ba96-0bd438fb7479-0
00:21:43.120 --> 00:21:46.159
Plus,
this is not a good feature for open book

0d82cffc-3935-47c2-ba96-0bd438fb7479-1
00:21:46.159 --> 00:21:47.000
exams, right?

68fc8f38-2446-478b-8428-e8522f19167c-0
00:21:47.000 --> 00:21:50.160
Because if it's an open book exam,
everyone's going to go off the exam page.

4cf3fc8b-bb27-435b-91f9-de40049c85a8-0
00:21:50.160 --> 00:21:53.040
They're allowed to look at other
resources potentially.

bb9e4c21-06cc-4dea-bcfb-5fd2908ad05f-0
00:21:53.640 --> 00:21:57.740
So it's this is area that sometimes trips
faculty up to like it shows me that all

bb9e4c21-06cc-4dea-bcfb-5fd2908ad05f-1
00:21:57.740 --> 00:21:59.240
the students left course plus.

739c2484-b0f1-4ec2-8b3a-13d0f294c4a7-0
00:21:59.240 --> 00:22:01.000
It's like, well,
you had an open book exam.

2c8379b3-2cb4-4027-8766-54f5d88c32e1-0
00:22:01.000 --> 00:22:04.120
Of course they're going to leave course
plus during their open book exam.

bcb4496a-43bd-42f8-b23c-eac00309564e-0
00:22:04.320 --> 00:22:07.796
But it is a powerful tool for those exams
that are closed book where you only want

bcb4496a-43bd-42f8-b23c-eac00309564e-1
00:22:07.796 --> 00:22:11.188
the student to be in there one time and
tracking their activity while they're in

bcb4496a-43bd-42f8-b23c-eac00309564e-2
00:22:11.188 --> 00:22:11.440
there.

1d139800-7168-44ed-94bc-5de250d855b8-0
00:22:12.400 --> 00:22:15.763
So the last sort of method of last resort
in terms of building an academic

1d139800-7168-44ed-94bc-5de250d855b8-1
00:22:15.763 --> 00:22:16.840
integrity is proctoring.

6f445a15-601b-412e-a1cb-ef6ccc55ee0d-0
00:22:17.640 --> 00:22:20.449
For over 2 decades,
the Center for Teaching and Learning has

6f445a15-601b-412e-a1cb-ef6ccc55ee0d-1
00:22:20.449 --> 00:22:23.720
had an in person sort of Proctor system
where students pick a Proctor.

15961bbb-f8a9-47dc-8a67-4eb21fae802e-0
00:22:23.880 --> 00:22:26.729
That person gets validated,
sort of a random set of those people get

15961bbb-f8a9-47dc-8a67-4eb21fae802e-1
00:22:26.729 --> 00:22:28.960
validated making sure they are who they
say they are.

634496d6-aadb-4477-8b42-292f3160e5d7-0
00:22:29.280 --> 00:22:33.440
And when the date and time of the exam
comes, a password is sent to that Proctor.

87f0a41d-7a08-4e0e-b034-2eb5801bb648-0
00:22:33.440 --> 00:22:37.431
The Proctor then uses the password to
unlock the exam for the student,

87f0a41d-7a08-4e0e-b034-2eb5801bb648-1
00:22:37.431 --> 00:22:42.098
verifies with the faculty through a form
on a field on the exam itself saying yes,

87f0a41d-7a08-4e0e-b034-2eb5801bb648-2
00:22:42.098 --> 00:22:43.560
this person did not cheat.

efcb8252-01f6-4253-a118-2fd304c92fb9-0
00:22:43.560 --> 00:22:45.480
I, you know,
vouch for them on their behalf.

c3a4f71d-f367-4a32-9fb5-925a406a14f2-0
00:22:47.040 --> 00:22:48.640
That's worked really, really well for us.

b0a77fbb-088c-49ee-a95b-a06246075390-0
00:22:48.760 --> 00:22:51.416
In fact,
I can think of in the 20 some years we've

b0a77fbb-088c-49ee-a95b-a06246075390-1
00:22:51.416 --> 00:22:55.375
been doing this proctoring system,
there's been one case in which a student

b0a77fbb-088c-49ee-a95b-a06246075390-2
00:22:55.375 --> 00:22:58.240
worked with somebody to cheat while
taking their exam.

191374ea-0243-4646-b29f-6b05b5c1b954-0
00:22:59.120 --> 00:23:02.760
In an era of social distancing,
this is probably not possible.

c35d8c02-77dd-40b7-b045-0c324e962008-0
00:23:03.680 --> 00:23:05.665
It's very,
very difficult for anyone to be doing

c35d8c02-77dd-40b7-b045-0c324e962008-1
00:23:05.665 --> 00:23:06.760
this at this point in time.

9b771da3-f381-45e6-908d-555514bdbdb1-0
00:23:06.760 --> 00:23:07.960
I would not recommend it.

c0644135-6479-40b8-aab0-67a247f6ae5e-0
00:23:08.240 --> 00:23:11.648
Proctoring also requires essentially that
you set this up somehow,

c0644135-6479-40b8-aab0-67a247f6ae5e-1
00:23:11.648 --> 00:23:13.480
A we can at least a week in advance.

084816d7-1cdb-438d-a788-d6974f7740dc-0
00:23:13.640 --> 00:23:16.520
Students have to know they have to
schedule with their proctoring.

5611980f-743f-4229-b9b5-a443a6adca62-0
00:23:16.760 --> 00:23:19.560
There are online proctoring systems that
are out there.

bcf4bc35-8f52-4f66-8f89-51b2756df178-0
00:23:19.720 --> 00:23:22.336
The burden of that cost is borne by the
student,

bcf4bc35-8f52-4f66-8f89-51b2756df178-1
00:23:22.336 --> 00:23:25.968
and depending on the system that's used
and the length of the exam,

bcf4bc35-8f52-4f66-8f89-51b2756df178-2
00:23:25.968 --> 00:23:29.920
it can be anywhere from $25 for one exam
up to about $75.00 for one exam.

25f0aaf1-a6d5-409e-af2a-7291fcc0d1d3-0
00:23:30.160 --> 00:23:32.360
That's a huge burden to put on students.

231c13b8-af74-4bc0-b42d-e3ac2256fa93-0
00:23:32.760 --> 00:23:35.520
These systems do do record the student's
screen.

0afe1287-31dc-4ffd-82dc-7c472d208bff-0
00:23:35.720 --> 00:23:37.240
They have make them have their camera on.

91746e8c-9b79-4427-ad3d-3c3724121af1-0
00:23:37.240 --> 00:23:38.720
They make them have their microphone on.

7a4b8401-573d-41a1-bba8-8b4c96ca573d-0
00:23:38.840 --> 00:23:42.280
This can be a real challenge for students
who are in low bandwidth situations.

3a401731-5acc-448c-8161-c42c206b53fd-0
00:23:42.440 --> 00:23:44.400
You don't know where necessarily where
people are.

44396c24-f159-490e-9c05-39f18bbd98e3-0
00:23:44.400 --> 00:23:46.600
People could be living in remote areas
right now.

90d039dd-3a8f-4710-afe7-db97a8dcf4a5-0
00:23:47.120 --> 00:23:50.280
They could be paying for every byte of
data they use in their classes.

69dcce95-1189-4214-8095-9eb8165d5195-0
00:23:50.800 --> 00:23:53.440
This is really not a method that we
recommend.

cdb66148-beb3-4f7f-b2c3-25ed6853db26-0
00:23:53.760 --> 00:23:58.106
Some classes have used it in times when
social distancing was not in place,

cdb66148-beb3-4f7f-b2c3-25ed6853db26-1
00:23:58.106 --> 00:24:00.280
but we know that people talk about it.

3725f233-bc6f-4a7f-aab7-2bd0ab91d5cd-0
00:24:00.280 --> 00:24:02.440
They're like,
why aren't we using this all the time?

ccdfd073-95e9-446b-b8fb-398df4b27500-0
00:24:02.920 --> 00:24:06.454
There's a lot of challenges for it around
getting the software installed on

ccdfd073-95e9-446b-b8fb-398df4b27500-1
00:24:06.454 --> 00:24:09.199
somebody's desktop,
around the costs involved for students

ccdfd073-95e9-446b-b8fb-398df4b27500-2
00:24:09.199 --> 00:24:10.919
and on the bandwidth that's required.

453149a2-2e71-4ebd-80b0-9141d230e3f0-0
00:24:10.920 --> 00:24:16.447
So we really do not recommend certainly
right now looking at proctoring as an

453149a2-2e71-4ebd-80b0-9141d230e3f0-1
00:24:16.447 --> 00:24:19.920
option for you in your exams in the
fourth term.

67e98290-460e-457d-8eac-2b97590da6e2-0
00:24:20.080 --> 00:24:23.480
In this term, any questions so far,
If anyone has any questions,

67e98290-460e-457d-8eac-2b97590da6e2-1
00:24:23.480 --> 00:24:24.840
just jump in and ask them.

123795cb-2ed5-42c3-8e81-d622c2d89402-0
00:24:24.880 --> 00:24:28.320
Otherwise,
I'm going to move on to another option.

5b5b6f88-4c96-4146-8e14-fe0d52d211ba-0
00:24:28.320 --> 00:24:30.626
So that's,
that's sort of the overview of academic

5b5b6f88-4c96-4146-8e14-fe0d52d211ba-1
00:24:30.626 --> 00:24:33.160
integrity and ensuring that that happens
in your exams.

dfd05756-f398-49e9-9df4-b706214cb7ad-0
00:24:33.560 --> 00:24:36.440
Questions about that concerns from
anybody.

17c627f8-44fc-4018-b455-9996cf61b7f2-0
00:24:38.760 --> 00:24:41.975
OK, So if you do have questions,
you can type them in or just jump in and

17c627f8-44fc-4018-b455-9996cf61b7f2-1
00:24:41.975 --> 00:24:42.280
ask me.

ce23a47e-2cdd-4e2b-b28c-68056af03c5f-0
00:24:42.680 --> 00:24:46.814
But one tool that is available right now
in course Plus that isn't the quiz

ce23a47e-2cdd-4e2b-b28c-68056af03c5f-1
00:24:46.814 --> 00:24:51.166
generator, that isn't for that you know,
these multiple choice essay true false

ce23a47e-2cdd-4e2b-b28c-68056af03c5f-2
00:24:51.166 --> 00:24:55.518
match from to list kind of questions that
might work really well for you is the

ce23a47e-2cdd-4e2b-b28c-68056af03c5f-3
00:24:55.518 --> 00:24:56.280
timed Dropbox.

3a98940a-afd0-4b32-91f3-9c9401d62c6b-0
00:24:56.400 --> 00:24:57.480
The timed Dropbox.

f38aceff-bfef-425b-ac5b-2042a2dd224b-0
00:24:57.480 --> 00:25:02.093
So many of you are probably familiar with
drop boxes where you would have a student

f38aceff-bfef-425b-ac5b-2042a2dd224b-1
00:25:02.093 --> 00:25:06.707
sort of turn in a paper or a presentation
or some kind of document at at some point

f38aceff-bfef-425b-ac5b-2042a2dd224b-2
00:25:06.707 --> 00:25:08.519
there's a deadline for it, right?

a0765c1a-df38-4c04-bb8e-a93579eca4e5-0
00:25:08.520 --> 00:25:09.360
It's a really nice tool.

7842733b-c6bc-443a-8d39-05ce12e5a762-0
00:25:09.360 --> 00:25:10.960
A lot of people use it in course.

162c9f7d-b3bd-4fb3-bdff-3472407d1c4e-0
00:25:10.960 --> 00:25:13.880
Plus the Time Box Dropbox is different.

19a728a6-88fd-4567-b39e-9b4c1e402c69-0
00:25:14.600 --> 00:25:16.589
Now,
the Dropbox does have a couple of

19a728a6-88fd-4567-b39e-9b4c1e402c69-1
00:25:16.589 --> 00:25:18.680
features on it around academic integrity.

62356271-8367-410c-8512-8b7e01045adf-0
00:25:18.880 --> 00:25:20.640
There is an honor pledge thing that you
know,

62356271-8367-410c-8512-8b7e01045adf-1
00:25:20.640 --> 00:25:23.700
before the students submit the their
Dropbox file to the Dropbox, they have to,

62356271-8367-410c-8512-8b7e01045adf-2
00:25:23.700 --> 00:25:25.040
they have to sign their name there.

d49749fc-ef33-4eb2-91ee-26e38339c9ef-0
00:25:25.640 --> 00:25:27.680
You can ask if the Dropbox is for an exam.

87de5a36-3cb3-450d-849a-787ff969839a-0
00:25:27.680 --> 00:25:30.398
If it is for an exam,
the student doesn't have the option to

87de5a36-3cb3-450d-849a-787ff969839a-1
00:25:30.398 --> 00:25:33.920
retrieve their file at a later point in
time, which is sometimes a good thing.

adea75e7-18f7-4942-a66d-13b6c5bee877-0
00:25:34.880 --> 00:25:36.720
And then there's this time Dropbox.

4f9513c9-06e9-489c-b391-d60b0a709ea5-0
00:25:36.960 --> 00:25:44.601
And what that essentially allows you to
do is to have a student unlock a Dropbox,

4f9513c9-06e9-489c-b391-d60b0a709ea5-1
00:25:44.601 --> 00:25:45.720
take a file.

18e0389a-ca48-4a15-8b3f-cff862539a1e-0
00:25:45.800 --> 00:25:49.183
In this case,
it would be your exam file and within a

18e0389a-ca48-4a15-8b3f-cff862539a1e-1
00:25:49.183 --> 00:25:53.005
certain time period,
2 hours and 90 minutes, thirty minutes,

18e0389a-ca48-4a15-8b3f-cff862539a1e-2
00:25:53.005 --> 00:25:55.949
whatever you want that that time period
to be,

18e0389a-ca48-4a15-8b3f-cff862539a1e-3
00:25:55.949 --> 00:25:59.959
the student would do that work and they
must turn that file in,

18e0389a-ca48-4a15-8b3f-cff862539a1e-4
00:25:59.959 --> 00:26:03.280
submit it back to that Dropbox before
time runs out.

94792361-60ab-4a5d-a12c-5ddf3e3c7489-0
00:26:03.560 --> 00:26:07.027
So that's the idea of a time Dropbox is
that you have a document,

94792361-60ab-4a5d-a12c-5ddf3e3c7489-1
00:26:07.027 --> 00:26:09.759
students need to fill it out,
do something with it,

94792361-60ab-4a5d-a12c-5ddf3e3c7489-2
00:26:09.759 --> 00:26:13.280
and then turn in that same document later
on before time runs out.

7dfcc852-b932-4eb8-9ed9-f8798e1576d5-0
00:26:13.520 --> 00:26:15.960
It gives them flexibility as to when they
start the exam.

6f4c780a-74cc-49d6-bca6-dd4f126a3c79-0
00:26:16.120 --> 00:26:19.235
You could say, look,
you have to do it within 24 hours,

6f4c780a-74cc-49d6-bca6-dd4f126a3c79-1
00:26:19.235 --> 00:26:23.743
right within on our exams on Thursday,
so sometime between midnight and 11:59 PM

6f4c780a-74cc-49d6-bca6-dd4f126a3c79-2
00:26:23.743 --> 00:26:26.080
Eastern Time, you must complete this exam.

ffb7e9e6-af38-40e7-adc0-b1d855b815c0-0
00:26:26.080 --> 00:26:30.797
But you decide the 90 minute window in
which you're going to take this and then

ffb7e9e6-af38-40e7-adc0-b1d855b815c0-1
00:26:30.797 --> 00:26:31.800
submit this exam.

b7a19d08-ebd1-4c84-92d1-92f62dee4c8e-0
00:26:32.160 --> 00:26:38.080
And this is a good tool for good for
situations where text isn't good enough.

6910d91d-8986-4d57-9ef5-2a68a7e9f2fe-0
00:26:38.280 --> 00:26:41.544
So, for example,
if you have students doing stuff in XLS

6910d91d-8986-4d57-9ef5-2a68a7e9f2fe-1
00:26:41.544 --> 00:26:45.381
part of their exam, right,
this is something that the time Dropbox

6910d91d-8986-4d57-9ef5-2a68a7e9f2fe-2
00:26:45.381 --> 00:26:47.901
would would, would, would,
no pun intended,

6910d91d-8986-4d57-9ef5-2a68a7e9f2fe-3
00:26:47.901 --> 00:26:52.540
excel at because you can't do Excel files,
you can't submit files as part of the

6910d91d-8986-4d57-9ef5-2a68a7e9f2fe-4
00:26:52.540 --> 00:26:53.400
quiz generator.

7b47dd07-babd-46e5-a2c3-f78f49a9121b-0
00:26:53.400 --> 00:26:57.595
So if you're doing midterms or final
exams as part of the quiz generator tool,

7b47dd07-babd-46e5-a2c3-f78f49a9121b-1
00:26:57.595 --> 00:26:59.560
you can't have students submit files.

a8617e5d-2cf4-49a7-b181-9d6a86cc837b-0
00:26:59.760 --> 00:27:04.783
This would be a good reason to have use
the time Dropbox right where it's it's,

a8617e5d-2cf4-49a7-b181-9d6a86cc837b-1
00:27:04.783 --> 00:27:09.680
I think in many ways it's a very fast
conversion of an exam over to an online

a8617e5d-2cf4-49a7-b181-9d6a86cc837b-2
00:27:09.680 --> 00:27:10.120
format.

14d1e25b-409e-4f69-b231-6e198c48dddd-0
00:27:10.280 --> 00:27:13.217
You know,
if you have students who need to hand

14d1e25b-409e-4f69-b231-6e198c48dddd-1
00:27:13.217 --> 00:27:16.217
write lots of equations in your exams,
you know,

14d1e25b-409e-4f69-b231-6e198c48dddd-2
00:27:16.217 --> 00:27:20.624
whether you're doing EPI or bio stats or
some of the sort of, you know,

14d1e25b-409e-4f69-b231-6e198c48dddd-3
00:27:20.624 --> 00:27:24.969
chemical compounds or you know,
or biology where you have to write out

14d1e25b-409e-4f69-b231-6e198c48dddd-4
00:27:24.969 --> 00:27:28.152
formulae,
things like that or draw maps or whatever

14d1e25b-409e-4f69-b231-6e198c48dddd-5
00:27:28.152 --> 00:27:28.520
it is.

c7cdf60b-e4bb-4a52-a687-6879ed44fdc3-0
00:27:28.680 --> 00:27:31.520
If that's what they would do on a paper
exam in your class.

cf8167d5-9d2f-4a5e-b9ac-29ce0e72525b-0
00:27:32.360 --> 00:27:37.833
The time Dropbox is probably a better way
to do that because you could have

cf8167d5-9d2f-4a5e-b9ac-29ce0e72525b-1
00:27:37.833 --> 00:27:43.451
students do this work, print it out,
take pictures of it and submit that back

cf8167d5-9d2f-4a5e-b9ac-29ce0e72525b-2
00:27:43.451 --> 00:27:48.781
to you in a Word document or use the
whiteboard drawing features on their

cf8167d5-9d2f-4a5e-b9ac-29ce0e72525b-3
00:27:48.781 --> 00:27:54.039
laptops or desktops or phones to draw
stuff and insert that into the the

cf8167d5-9d2f-4a5e-b9ac-29ce0e72525b-4
00:27:54.039 --> 00:27:54.759
responses.

8bb4cca4-4761-4d1e-bcf0-5dd7e41c7440-0
00:27:54.760 --> 00:27:59.514
The quiz generator actually allows you to
do that in some more limited ways,

8bb4cca4-4761-4d1e-bcf0-5dd7e41c7440-1
00:27:59.514 --> 00:28:04.331
but this is an option for kind of fast
conversion from you know a paper based

8bb4cca4-4761-4d1e-bcf0-5dd7e41c7440-2
00:28:04.331 --> 00:28:08.160
exam that you normally give out out to an
online environment.

9005db9e-9c13-43fe-b279-d991ccf8292a-0
00:28:08.160 --> 00:28:12.688
Now it's important to note though,
that with the time Dropbox students can

9005db9e-9c13-43fe-b279-d991ccf8292a-1
00:28:12.688 --> 00:28:14.560
retain a copy of the exam file.

6d194947-aefc-4c6c-b705-ddb1c10d10b8-0
00:28:14.840 --> 00:28:17.360
The exam file doesn't disappear,
it doesn't go away.

38e4332c-3d1b-4c46-b97e-f36d8e1546b7-0
00:28:17.600 --> 00:28:18.640
It's out there forever.

0845a9a1-1e9f-4e4b-a3bc-a75f47f929f5-0
00:28:18.640 --> 00:28:21.694
Students have a copy,
they download a copy onto their desktops

0845a9a1-1e9f-4e4b-a3bc-a75f47f929f5-1
00:28:21.694 --> 00:28:23.440
and then they submit it back to you.

03592b1e-464c-42d4-80e6-e08345b9e8d1-0
00:28:23.440 --> 00:28:25.680
So they're going to have a copy of that
exam file.

2cff8324-d6f2-4730-b0b9-7b416f7c3132-0
00:28:26.240 --> 00:28:29.736
It also doesn't have features that the
quiz that generator does for special

2cff8324-d6f2-4730-b0b9-7b416f7c3132-1
00:28:29.736 --> 00:28:32.818
permissions like taking the exam outside
of the normal exam dates,

2cff8324-d6f2-4730-b0b9-7b416f7c3132-2
00:28:32.818 --> 00:28:35.808
doesn't allow for retakes,
or it doesn't do automatic grading of

2cff8324-d6f2-4730-b0b9-7b416f7c3132-3
00:28:35.808 --> 00:28:39.350
multiple choice questions or true,
false or match from to list like the quiz

2cff8324-d6f2-4730-b0b9-7b416f7c3132-4
00:28:39.350 --> 00:28:40.040
generator does.

0e4cdf13-ecb2-4b46-8585-ed3a76d29abe-0
00:28:40.320 --> 00:28:45.520
But again, this is a good,
good option when text by itself isn't

0e4cdf13-ecb2-4b46-8585-ed3a76d29abe-1
00:28:45.520 --> 00:28:47.200
enough in your exams.

9ef9a98c-4d76-48b7-946c-bf68c02027cd-0
00:28:47.240 --> 00:28:48.240
Just want to point it out there.

0390a02a-7efe-4205-97b4-40fa705ca1de-0
00:28:48.240 --> 00:28:51.520
Not a lot of people know that it's there,
but it can be a really useful feature.

65acfcf5-b844-4a97-a206-9ec109e42999-0
00:28:51.960 --> 00:28:53.040
Any questions about that?

842d335d-c79e-4c69-9dfe-78bde327bb5e-0
00:28:53.320 --> 00:28:54.760
About the time drop boxes?

f0c2d007-9a94-4c0f-9842-0caf21467706-0
00:28:57.080 --> 00:28:58.200
OK, All right.

3387edef-12ba-447d-ad0c-99a025c22f74-0
00:28:58.200 --> 00:29:00.760
Is someone gonna jump in with a question?

9b237397-a3e6-4f31-bec6-ec6b3d1c5ff6-0
00:29:00.760 --> 00:29:03.840
Cuz if you have one, it's Yeah,
actually it's Celine.

b033ffb5-869d-484a-bed1-0c2ed26ebdec-0
00:29:04.400 --> 00:29:04.960
Hi, Celine.

31d9dd8c-3908-4190-9579-98450eb177f6-0
00:29:05.360 --> 00:29:09.274
Hi, I on the time drop box,
even though we don't allow special

31d9dd8c-3908-4190-9579-98450eb177f6-1
00:29:09.274 --> 00:29:12.443
permissions,
am I correct in the fact that we also

31d9dd8c-3908-4190-9579-98450eb177f6-2
00:29:12.443 --> 00:29:14.680
don't stop students from submitting?

43ce2729-8bc7-4e19-9a27-f993e9b54589-0
00:29:14.680 --> 00:29:17.646
In other words,
it would be flagged as submitted late but

43ce2729-8bc7-4e19-9a27-f993e9b54589-1
00:29:17.646 --> 00:29:20.000
it would still be accessible to the
students.

e749111d-6372-45c5-8056-9d058621b39c-0
00:29:20.000 --> 00:29:24.353
So if they were to have technology
problems like for whatever reason that

e749111d-6372-45c5-8056-9d058621b39c-1
00:29:24.353 --> 00:29:27.648
they could still submit it after that
time has dropped,

e749111d-6372-45c5-8056-9d058621b39c-2
00:29:27.648 --> 00:29:32.237
but then it would be flagged and they
would still have to get in contact with

e749111d-6372-45c5-8056-9d058621b39c-3
00:29:32.237 --> 00:29:33.120
the instructor.

d081955f-44a4-4d22-8d4b-3c429ed92d00-0
00:29:33.560 --> 00:29:36.800
Or do they just not have access after
that time has passed?

1f5c6477-29dc-49a9-8322-f5b76c062a82-0
00:29:36.840 --> 00:29:39.960
So with the time Dropbox,
unfortunately once your times up, it's up.

605ea9f7-7770-4c09-ad03-12a4460fe413-0
00:29:39.960 --> 00:29:42.360
You gotta,
you have to contact the faculty.

ce53c928-1782-4b9f-a8d8-6799aa91f030-0
00:29:42.960 --> 00:29:45.440
The faculty can submit the file on your
behalf.

7e9c0710-2a93-4a52-ac1b-6513014112cd-0
00:29:45.440 --> 00:29:48.779
So if you were to say I missed the
deadline because of technology problems,

7e9c0710-2a93-4a52-ac1b-6513014112cd-1
00:29:48.779 --> 00:29:51.020
you'd contact the faculty,
explain your situation,

7e9c0710-2a93-4a52-ac1b-6513014112cd-2
00:29:51.020 --> 00:29:54.448
say here's my file and the faculty could
upload that into the Dropbox for the

7e9c0710-2a93-4a52-ac1b-6513014112cd-3
00:29:54.448 --> 00:29:54.800
student.

887a4194-5cb4-403b-9d08-93dbba9b28e3-0
00:29:54.800 --> 00:29:59.200
But with time drop boxes,
students can't submit once time runs out.

21b59ea6-6af1-410c-89fe-3ea59bfe4c5f-0
00:30:01.800 --> 00:30:04.240
With regular drop boxes,
they can submit after the fact.

53aa0ceb-515f-4f39-b449-aa211c887469-0
00:30:04.920 --> 00:30:06.600
OK, thank you for the clarification.

9d9a1171-4970-4e4d-b970-4ffc3cef9094-0
00:30:06.920 --> 00:30:07.480
Sure, that's OK.

601d6729-fe22-4cf8-b6f7-199768461b0e-0
00:30:07.480 --> 00:30:08.480
It's a really important point.

d942d9ea-d2fa-410b-9f2a-c522f8d79c68-0
00:30:08.560 --> 00:30:09.880
It's a definitely important point there.

8860c9df-21bd-4db7-a32b-462376df1f3e-0
00:30:11.320 --> 00:30:13.677
OK,
So what I'd like to do now is sort of

8860c9df-21bd-4db7-a32b-462376df1f3e-1
00:30:13.677 --> 00:30:18.169
walk through some of the actual on screen
options of how to set up exams in the

8860c9df-21bd-4db7-a32b-462376df1f3e-2
00:30:18.169 --> 00:30:21.088
quiz generator,
particularly around these issues of

8860c9df-21bd-4db7-a32b-462376df1f3e-3
00:30:21.088 --> 00:30:24.119
academic integrity and sort of what they
entail here.

8d0e0545-e939-41e8-9e7d-75f4129ee678-0
00:30:24.120 --> 00:30:28.900
So I'm gonna stop sharing my slides and
get out of here and I'm back in Zoom and

8d0e0545-e939-41e8-9e7d-75f4129ee678-1
00:30:28.900 --> 00:30:33.562
I'm gonna start sharing my web browser,
which hopefully you can all see on the

8d0e0545-e939-41e8-9e7d-75f4129ee678-2
00:30:33.562 --> 00:30:34.920
screen in front of you.

6ebd4df4-2b23-464f-b471-78811bc24c2e-0
00:30:35.320 --> 00:30:38.880
So if you're not familiar,
this is the Quiz Generator tool.

e6fe97f7-830d-4d87-b156-e15712b49b7c-0
00:30:38.880 --> 00:30:43.511
It's available inside of Faculty tools
and inside of every course website,

e6fe97f7-830d-4d87-b156-e15712b49b7c-1
00:30:43.511 --> 00:30:45.240
so I will point it out here.

fa686ea2-5b67-45c1-a0c1-8b0f691d87fd-0
00:30:45.240 --> 00:30:46.760
It's under activities and assignments.

72527b64-af6c-4077-a24e-10c9c01be176-0
00:30:47.040 --> 00:30:49.651
I click on Quiz Generator and then create
a quiz,

72527b64-af6c-4077-a24e-10c9c01be176-1
00:30:49.651 --> 00:30:52.680
and I'm not going to go through every
single detail here.

d1742f0d-815b-4c57-ae35-147b4428f5bb-0
00:30:52.680 --> 00:30:56.674
I want to go through the ones that are
specifically around setting up exams the

d1742f0d-815b-4c57-ae35-147b4428f5bb-1
00:30:56.674 --> 00:31:00.120
right way to make sure that academic
integrity is sort of maximized.

d3d19b08-e6f6-454e-b3c3-a76b1646b37e-0
00:31:00.480 --> 00:31:05.143
Well, at least from a sort of, you know,
observance and conformance perspective

d3d19b08-e6f6-454e-b3c3-a76b1646b37e-1
00:31:05.143 --> 00:31:05.960
with students.

c5d72400-38b8-4362-a9c1-1afc29e179dc-0
00:31:06.160 --> 00:31:09.138
And by the way, we, the,
the instructional design team and the

c5d72400-38b8-4362-a9c1-1afc29e179dc-1
00:31:09.138 --> 00:31:11.880
Center for Teaching and Learning has this
great document.

cfd421af-07fc-42e4-9990-4ff639457c24-0
00:31:12.000 --> 00:31:16.320
It's a complete guide to setting up an
exam in a course.

33d571e9-d4e9-49c8-bf26-b08479523148-0
00:31:16.320 --> 00:31:21.034
Plus it's available off the Teaching
Toolkit website that's available to

33d571e9-d4e9-49c8-bf26-b08479523148-1
00:31:21.034 --> 00:31:21.680
everybody.

ae0ea20b-3a8e-44b0-8d70-8cf2b705ae82-0
00:31:21.840 --> 00:31:25.120
I'll actually put the link in the chat
right now.

36b8cde5-1244-4e03-aa76-439a91041809-0
00:31:25.160 --> 00:31:27.562
Oh, darn it,
I clicked the wrong button and stop

36b8cde5-1244-4e03-aa76-439a91041809-1
00:31:27.562 --> 00:31:28.200
sharing that.

95325061-1cc1-4242-8481-3592aefffba2-0
00:31:28.600 --> 00:31:30.360
I'll go ahead and put this in the chat
right now.

84171d9f-8cb7-403a-b438-c5f7a272a4f4-0
00:31:30.520 --> 00:31:34.880
We'll try to also follow up with
everybody who is in the the session today

84171d9f-8cb7-403a-b438-c5f7a272a4f4-1
00:31:34.880 --> 00:31:38.310
and send you an e-mail with links to a
bunch of resources,

84171d9f-8cb7-403a-b438-c5f7a272a4f4-2
00:31:38.310 --> 00:31:40.520
including a copy of this presentation.

83626b49-8558-4713-8350-08ef0dfe5278-0
00:31:40.840 --> 00:31:45.072
We'll try to do that for you tomorrow,
but the guy that I just LinkedIn there

83626b49-8558-4713-8350-08ef0dfe5278-1
00:31:45.072 --> 00:31:47.080
has all the options, all the details.

918abf21-2b8a-47ea-8d0f-f3fe477f9261-0
00:31:47.280 --> 00:31:52.346
I want to focus on the ones right now
that are more germane to making sure you

918abf21-2b8a-47ea-8d0f-f3fe477f9261-1
00:31:52.346 --> 00:31:55.360
set things up for say a midterm or final
exam.

652f5b60-dbbe-44fc-88b3-e6cd1fda3bf3-0
00:31:55.680 --> 00:31:58.758
So I'm going to skip a number of the
things up here like the quiz title and

652f5b60-dbbe-44fc-88b3-e6cd1fda3bf3-1
00:31:58.758 --> 00:32:02.040
when students can start doing it and the
due date and all that other good stuff.

0d67ee1c-87d4-4351-88e0-e4ef5ba5e480-0
00:32:02.040 --> 00:32:03.807
I'm going to start on this option that
says,

0d67ee1c-87d4-4351-88e0-e4ef5ba5e480-1
00:32:03.807 --> 00:32:06.440
is the quiz counted towards the students
final grade in the class?

28ed6f9d-2d77-4691-b480-8c78b215722b-0
00:32:06.440 --> 00:32:08.438
Well,
we would assume that in a midterm or

28ed6f9d-2d77-4691-b480-8c78b215722b-1
00:32:08.438 --> 00:32:09.600
final, the answer is yes.

70ee50ee-61b3-4e40-9082-147bbe15f421-0
00:32:09.600 --> 00:32:13.131
And when you click that button,
a number of options then appear on the

70ee50ee-61b3-4e40-9082-147bbe15f421-1
00:32:13.131 --> 00:32:13.480
screen.

d965b27d-da6f-49bb-9bf3-6c3cb3f4bd66-0
00:32:13.720 --> 00:32:17.342
So the first one is this is a high stake
exam automatically flagged students who

d965b27d-da6f-49bb-9bf3-6c3cb3f4bd66-1
00:32:17.342 --> 00:32:19.400
switch off the page or look at other
content.

b1bc2b6b-a0a9-4ddc-b11d-54e5b2ae9a17-0
00:32:19.680 --> 00:32:22.024
So this is what I was talking about
earlier,

b1bc2b6b-a0a9-4ddc-b11d-54e5b2ae9a17-1
00:32:22.024 --> 00:32:26.297
the tracking of students so that if they
were to click off the the the quiz page,

b1bc2b6b-a0a9-4ddc-b11d-54e5b2ae9a17-2
00:32:26.297 --> 00:32:30.518
if they were to open another web browser
or tab or switch over to Microsoft Word

b1bc2b6b-a0a9-4ddc-b11d-54e5b2ae9a17-3
00:32:30.518 --> 00:32:33.280
or something like that,
it would flag that in there.

2144177f-a705-4909-9feb-9eb74a1c64c5-0
00:32:33.280 --> 00:32:36.651
And if they were to download or access
materials inside of course,

2144177f-a705-4909-9feb-9eb74a1c64c5-1
00:32:36.651 --> 00:32:39.520
plus while taking the exam,
it would track that as well.

cea8bbf3-2c18-4b51-bba1-90f073ccfd4f-0
00:32:39.760 --> 00:32:42.710
Now,
a really important caveat about this is

cea8bbf3-2c18-4b51-bba1-90f073ccfd4f-1
00:32:42.710 --> 00:32:46.840
that in the quiz generator on questions,
you can attach files.

37ba80df-fe3f-492b-b95b-81882beee357-0
00:32:47.040 --> 00:32:50.705
So what often happens is that faculty
will sometimes say, say,

37ba80df-fe3f-492b-b95b-81882beee357-1
00:32:50.705 --> 00:32:52.160
here's an equation guide.

cbd90258-5c7d-44bd-b771-2b59db96059f-0
00:32:52.160 --> 00:32:57.160
Here is a glossary to you for you to
refer to while you're taking the exam.

b014a4ea-5339-4a72-a295-09da745e22ac-0
00:32:57.720 --> 00:33:00.492
Well,
if you do that and you want students to

b014a4ea-5339-4a72-a295-09da745e22ac-1
00:33:00.492 --> 00:33:04.410
go look at that document,
they're going to be switching back and

b014a4ea-5339-4a72-a295-09da745e22ac-2
00:33:04.410 --> 00:33:07.122
forth and back and forth between that
guide,

b014a4ea-5339-4a72-a295-09da745e22ac-3
00:33:07.122 --> 00:33:10.920
between that glossary and your webs and
the and the exam page.

39f5c5a7-7cd2-4313-8c5b-ac0b2c8be4ff-0
00:33:11.080 --> 00:33:14.614
So it's going to show them switching back
and forth and back and forth multiple

39f5c5a7-7cd2-4313-8c5b-ac0b2c8be4ff-1
00:33:14.614 --> 00:33:14.880
times.

0910b227-02d1-4d34-b2b5-92d852f12145-0
00:33:15.080 --> 00:33:17.768
So we again, you know,
this is an area of confusion for faculty

0910b227-02d1-4d34-b2b5-92d852f12145-1
00:33:17.768 --> 00:33:20.330
because they're like,
but it says they left the exam a whole

0910b227-02d1-4d34-b2b5-92d852f12145-2
00:33:20.330 --> 00:33:20.960
bunch of times.

e3708b67-ad16-4a96-9bb9-fc493b301eaa-0
00:33:20.960 --> 00:33:23.193
Well, sure,
you gave them a glossary document,

e3708b67-ad16-4a96-9bb9-fc493b301eaa-1
00:33:23.193 --> 00:33:26.520
you gave them a reference guide,
you gave them an equations document.

c6c72cab-eace-4532-b02f-f009d66524d2-0
00:33:26.520 --> 00:33:28.795
That said,
here's how you solve these problems,

c6c72cab-eace-4532-b02f-f009d66524d2-1
00:33:28.795 --> 00:33:29.080
right?

a917f8c6-0da7-4ffa-8441-aa6b555e0208-0
00:33:29.360 --> 00:33:34.388
So just be really careful in terms of
attaching files to the exam that students

a917f8c6-0da7-4ffa-8441-aa6b555e0208-1
00:33:34.388 --> 00:33:37.280
would then need in order to open up the
exam.

51e770da-0a42-4801-aeb8-4b2d0f5e617e-0
00:33:37.440 --> 00:33:42.079
Try to embed as much as you can into the
exam when the questions,

51e770da-0a42-4801-aeb8-4b2d0f5e617e-1
00:33:42.079 --> 00:33:47.562
the text blocks in the exam as possible
so that students never have to switch

51e770da-0a42-4801-aeb8-4b2d0f5e617e-2
00:33:47.562 --> 00:33:49.319
outside of the exam page.

6d1e3146-b4e4-48c0-a036-a09ccad528a2-0
00:33:50.040 --> 00:33:51.360
OK, Does that make sense to everybody?

6a9ef0d2-4ca7-4354-a452-2002272364dd-0
00:33:52.000 --> 00:33:53.724
So again,
if you turn it on this feature on,

6a9ef0d2-4ca7-4354-a452-2002272364dd-1
00:33:53.724 --> 00:33:56.560
it'll automatically sort of do that in
the background and track students.

23fc9565-fa9d-4323-8ded-3d13ce445297-0
00:33:56.560 --> 00:33:58.160
Otherwise it doesn't track them at all.

95f9af0b-b376-4610-b4fb-b51037897f46-0
00:33:59.440 --> 00:34:02.052
The next option,
require the student to sign their name to

95f9af0b-b376-4610-b4fb-b51037897f46-1
00:34:02.052 --> 00:34:03.160
the academic ethics code.

7f52b1ce-8fc8-4b6d-897b-f3447a4e16f2-0
00:34:03.320 --> 00:34:05.280
You often want to turn that on as well.

eb657a86-39a7-40eb-a2dc-47a4b6edd98d-0
00:34:05.560 --> 00:34:07.906
And then finally,
here's this one about requiring a

eb657a86-39a7-40eb-a2dc-47a4b6edd98d-1
00:34:07.906 --> 00:34:09.080
password to access a quiz.

e13570da-f878-429b-a39d-c98ccc27571f-0
00:34:09.280 --> 00:34:12.105
So again,
unless you are using an in person Proctor

e13570da-f878-429b-a39d-c98ccc27571f-1
00:34:12.105 --> 00:34:15.692
with each of these people to whom you'll
be sending the password,

e13570da-f878-429b-a39d-c98ccc27571f-2
00:34:15.692 --> 00:34:17.159
do not turn that option on.

2dbc0b6e-86b1-47a1-86c8-52dfc93fe4ba-0
00:34:17.160 --> 00:34:20.246
Otherwise,
no students will be able to access the

2dbc0b6e-86b1-47a1-86c8-52dfc93fe4ba-1
00:34:20.246 --> 00:34:22.840
exam, which is probably not what you want.

49851633-1145-49fc-8f3b-1b1eb4084da0-0
00:34:24.000 --> 00:34:26.816
All right,
the next one is this issue of number of

49851633-1145-49fc-8f3b-1b1eb4084da0-1
00:34:26.816 --> 00:34:30.240
attempts versus number of times students
can access the quiz.

0ce5a874-42da-47b6-a12d-442c20019306-0
00:34:30.640 --> 00:34:35.000
So in the quiz generator,
you can set it up so that a student can

0ce5a874-42da-47b6-a12d-442c20019306-1
00:34:35.000 --> 00:34:38.040
make, let's say, 5 attempts on a quiz,
right?

38c7fa35-d524-45b1-8227-bebe9074ddbf-0
00:34:38.160 --> 00:34:40.040
They don't like their grade,
they'll try it again.

579e1c0c-7a52-4a92-bcc1-810208eedc9b-0
00:34:40.160 --> 00:34:41.000
They don't like their grade.

176898db-761f-4a5b-91fb-a545521aba0e-0
00:34:41.000 --> 00:34:44.640
They'll try it again up to five times or
three times or as many as you want.

eef4609a-0485-4969-b77f-228bfb17f77c-0
00:34:45.320 --> 00:34:49.223
Most times with a midterm or final exam,
you want to leave that number at one,

eef4609a-0485-4969-b77f-228bfb17f77c-1
00:34:49.223 --> 00:34:49.520
right?

2fa31198-af89-4768-be3b-05600303d9be-0
00:34:49.520 --> 00:34:54.680
They should only be taking the exam one
time rather than multiple times.

cb00f056-3cb4-43d5-822d-1161f57b2319-0
00:34:55.240 --> 00:35:00.648
However, depending on what your needs are,
you may want to say during each overall

cb00f056-3cb4-43d5-822d-1161f57b2319-1
00:35:00.648 --> 00:35:03.840
attempt,
let the students access the quiz either

cb00f056-3cb4-43d5-822d-1161f57b2319-2
00:35:03.840 --> 00:35:05.600
one time or multiple times.

aaf4c347-1167-4c28-b722-ced02330e6f3-0
00:35:05.760 --> 00:35:09.085
So what the difference here that
sometimes confuses people is that if the

aaf4c347-1167-4c28-b722-ced02330e6f3-1
00:35:09.085 --> 00:35:12.366
students can access only once,
and that's often what people do for high,

aaf4c347-1167-4c28-b722-ced02330e6f3-2
00:35:12.366 --> 00:35:16.142
for midterms, for finals, they say, look,
I don't want the student to be able to go

aaf4c347-1167-4c28-b722-ced02330e6f3-3
00:35:16.142 --> 00:35:18.120
in and out of the quiz over and over
again.

08e434dc-7337-413a-9302-9c946a6fed2b-0
00:35:18.120 --> 00:35:18.760
I don't want them.

c724c822-ab2e-46ca-970a-87d812ffda5b-0
00:35:18.760 --> 00:35:20.080
I want them only one time.

cef69b94-2b75-41d4-85e1-b9a20704454a-0
00:35:20.480 --> 00:35:21.560
That is fine.

80b138a7-0c8a-4527-84d1-fcb306e7f05d-0
00:35:21.880 --> 00:35:26.694
That's you can do that,
but if the students web browser crashes,

80b138a7-0c8a-4527-84d1-fcb306e7f05d-1
00:35:26.694 --> 00:35:27.880
they lose power.

1c59330b-6efd-4655-8812-1be1e7643926-0
00:35:28.000 --> 00:35:31.587
Whatever it is,
they're going to have to come to you and

1c59330b-6efd-4655-8812-1be1e7643926-1
00:35:31.587 --> 00:35:34.609
say, hey, I lost power,
my web browser crashed,

1c59330b-6efd-4655-8812-1be1e7643926-2
00:35:34.609 --> 00:35:36.120
can you let me in again?

ba616969-c603-485f-b8d0-db8fe4439ad9-0
00:35:36.120 --> 00:35:39.029
That's just it's a,
it's an it's administrative overhead,

ba616969-c603-485f-b8d0-db8fe4439ad9-1
00:35:39.029 --> 00:35:42.741
but it does help to ensure academic
integrity because it doesn't give the

ba616969-c603-485f-b8d0-db8fe4439ad9-2
00:35:42.741 --> 00:35:46.754
students the option to kind of like leave
the exam and come back multiple times

ba616969-c603-485f-b8d0-db8fe4439ad9-3
00:35:46.754 --> 00:35:48.560
without any kind of penalty to them.

feb00658-8844-4dca-9b97-1948a6e27991-0
00:35:48.560 --> 00:35:52.640
Does it make sense what that option is
for To everybody?

29754273-f155-4c3d-b6be-a7596cbef212-0
00:35:54.400 --> 00:35:54.760
Hi, Brian.

fa32d9a2-832c-4f30-bbd2-9db8b943ba75-0
00:35:54.880 --> 00:35:55.240
I'm sorry.

c9530849-4e69-4c62-9c22-88f977b8a21c-0
00:35:55.240 --> 00:35:56.680
You were saying it's hard to see what I'm
doing.

fe400ae4-3896-4b82-8173-652e027c3157-0
00:35:56.680 --> 00:35:58.160
Yeah, I said could you zoom in?

e37c4bea-cfc8-4f7f-b490-cd2c5431ed41-0
00:35:58.280 --> 00:35:58.560
Yes.

874e5f7f-1c90-44b5-8551-cdf4ee5cea48-0
00:35:58.560 --> 00:36:00.000
Sorry about that, Lorraine.

a9988a17-96d0-4312-8da8-35a49c811143-0
00:36:00.000 --> 00:36:00.680
That was my bad.

2391515e-b2b0-4b40-852b-f0dc02e5a2a3-0
00:36:00.680 --> 00:36:01.760
I should have seen that earlier.

8ae4e18f-ef39-40a1-86db-8d880ae8da3b-0
00:36:01.760 --> 00:36:03.440
That probably makes it a little bit
easier to see.

eb2b1da6-02e9-4400-9e2e-8687a9920399-0
00:36:03.440 --> 00:36:04.400
I just put it in there.

57b16f70-70f4-48ad-acd7-272c0d7b3273-0
00:36:04.400 --> 00:36:05.000
So yeah.

396c91f3-c548-417b-9691-955c3c210c40-0
00:36:05.000 --> 00:36:05.240
OK, OK.

e435bdb4-e077-47dc-b004-2c1af99933d9-0
00:36:06.880 --> 00:36:07.520
No, no, that's.

e7f46dd3-c8f2-456a-afa3-e079e37fc6c7-0
00:36:07.520 --> 00:36:08.760
I should have paid attention first.

136f8766-a1a9-4f7d-a75b-73e47ad5a67e-0
00:36:08.760 --> 00:36:13.494
Celine would yell at me about that from
an accessibility and usability standpoint,

136f8766-a1a9-4f7d-a75b-73e47ad5a67e-1
00:36:13.494 --> 00:36:15.320
and I should know better myself.

e54c0e20-f126-41e6-9956-62ba1837fb6f-0
00:36:16.200 --> 00:36:18.530
OK,
the next option I want to show is allow

e54c0e20-f126-41e6-9956-62ba1837fb6f-1
00:36:18.530 --> 00:36:19.960
students to print the quiz.

3c139cac-8894-4e7d-a2c8-c28fee642409-0
00:36:20.160 --> 00:36:23.920
So by default,
students can print the quiz.

b7e4c48d-a317-4a6d-8662-793dd0d8fb18-0
00:36:24.280 --> 00:36:26.323
They can print the quiz page,
they can save it as APDF,

b7e4c48d-a317-4a6d-8662-793dd0d8fb18-1
00:36:26.323 --> 00:36:27.600
they can print it to their printer.

ce833d5d-07f2-45ad-9d69-98f9dcacad01-0
00:36:27.960 --> 00:36:30.760
Midterms and exams,
you often don't want students to do this.

42ffa2dc-b289-493d-89db-457231ec4718-0
00:36:30.760 --> 00:36:32.080
So don't overlook this.

04b09e9c-f7bb-4c9b-927f-c5ef6662ceee-0
00:36:32.080 --> 00:36:33.320
Allow students to print the quiz.

867e8e71-eded-48b5-ae7f-e90c8091fba5-0
00:36:33.320 --> 00:36:34.480
One say no.

1ed030da-ac0f-45dc-ab6a-8bc807b882e2-0
00:36:34.640 --> 00:36:37.754
And what will happen is a student,
we can't turn off the print feature on

1ed030da-ac0f-45dc-ab6a-8bc807b882e2-1
00:36:37.754 --> 00:36:38.680
their computer, right?

acd3c106-c767-4f58-87ae-c4c170016c84-0
00:36:38.680 --> 00:36:40.520
We can't reach across the Internet and do
that.

edcae5f0-6e00-4e78-835f-b5b2c4a80a9c-0
00:36:40.880 --> 00:36:43.000
But if they try to print it out,
they'll just get blank pages.

aed52c79-9f29-4b77-b265-b16c51ce3543-0
00:36:43.160 --> 00:36:44.320
They won't be able to see it at all.

b8ebaa4e-4130-49ce-8666-e1b742267f22-0
00:36:44.560 --> 00:36:46.887
Now,
if a student wants to record their screen

b8ebaa4e-4130-49ce-8666-e1b742267f22-1
00:36:46.887 --> 00:36:50.800
or use their camera to take pictures of
the screen, we can't stop that, right?

3213f5ef-9c7f-4029-b547-7d47d1152539-0
00:36:51.000 --> 00:36:52.920
That's not something we can prevent them
from doing.

cffce47c-a3c5-46fd-8e91-c74dde1008cb-0
00:36:53.040 --> 00:36:56.920
But we can do is say you can't print the
whole quiz.

aeaba218-817f-434b-8481-54ca3951bb78-0
00:36:57.880 --> 00:37:01.280
The next one is display all questions or
a random subset.

db4f82bf-89f5-462c-9cfb-08a3b490c712-0
00:37:01.400 --> 00:37:04.400
So this is the question bank option right
here.

5eac433b-d3de-462b-bb83-4781ba5e3480-0
00:37:04.920 --> 00:37:08.913
So if I say a random subset,
I have to say the number of questions I

5eac433b-d3de-462b-bb83-4781ba5e3480-1
00:37:08.913 --> 00:37:13.080
want them to use the student to the
student to have to actually answer.

cbbb74e0-c0c2-4783-83c3-93e745cf4d7e-0
00:37:13.280 --> 00:37:16.876
And this gets back to that sort of
earlier question that Beth asked,

cbbb74e0-c0c2-4783-83c3-93e745cf4d7e-1
00:37:16.876 --> 00:37:20.421
you know, about, you know,
harder questions versus easier questions

cbbb74e0-c0c2-4783-83c3-93e745cf4d7e-2
00:37:20.421 --> 00:37:23.080
or you know,
questions from different topic areas.

8487ce42-f01e-44f5-9546-ca8fcdf09098-0
00:37:23.080 --> 00:37:24.480
It can't make those decisions.

95ea2ccd-578f-4115-8234-c9d6bcfbd4c2-0
00:37:24.480 --> 00:37:28.809
It's not smart enough to do that yet,
but this is where you would put in the

95ea2ccd-578f-4115-8234-c9d6bcfbd4c2-1
00:37:28.809 --> 00:37:32.240
option to say, hey,
it's a there's 40 questions in the bank.

be597096-96d1-47a0-8620-0ffdc5d6238c-0
00:37:32.240 --> 00:37:33.760
Students only have to answer 20.

30893cb7-a515-47a8-bcd9-ce76f2bcab1c-0
00:37:33.920 --> 00:37:36.079
Again,
that goes a long way to ensuring academic

30893cb7-a515-47a8-bcd9-ce76f2bcab1c-1
00:37:36.079 --> 00:37:36.520
integrity.

b4d090cf-027f-4494-b55e-c21a6707a963-0
00:37:38.040 --> 00:37:41.951
The next one is that I want to point out
is maximum time to allowed to complete

b4d090cf-027f-4494-b55e-c21a6707a963-1
00:37:41.951 --> 00:37:42.440
this quiz.

2b496391-0cd7-4e51-9899-112dd29dda43-0
00:37:42.680 --> 00:37:43.960
And this is about time boxing.

80457af9-2cd0-4c2d-8365-49eb08a16398-0
00:37:43.960 --> 00:37:45.040
And this is what you want to say.

d5c53bc2-9016-430a-b2ea-fa55a3aef241-0
00:37:45.040 --> 00:37:48.596
You want to say here, Yeah,
You students have 90 minutes from the

d5c53bc2-9016-430a-b2ea-fa55a3aef241-1
00:37:48.596 --> 00:37:51.560
time they start the quiz until they
complete the quiz.

ed24759f-83a6-4344-805f-8ee322c96665-0
00:37:51.560 --> 00:37:53.600
So yeah,
I want them to give them 90 minutes to do

ed24759f-83a6-4344-805f-8ee322c96665-1
00:37:53.600 --> 00:37:53.800
this.

9ad34787-b73d-4feb-8767-f60e19bf763c-0
00:37:54.000 --> 00:37:58.614
That's where you would enter in that
option, you know, 90 minutes, 120 minutes,

9ad34787-b73d-4feb-8767-f60e19bf763c-1
00:37:58.614 --> 00:37:59.480
whatever it is.

dd4b28c8-b861-482b-87d8-6a1a64031e92-0
00:38:01.080 --> 00:38:04.007
And yeah,
so we don't recommend you sort of leave

dd4b28c8-b861-482b-87d8-6a1a64031e92-1
00:38:04.007 --> 00:38:06.760
it at open forever and ever and ever and
ever.

219d5111-e79b-4967-9a75-f7c29d1bc935-0
00:38:07.240 --> 00:38:08.000
It's not AI.

74e8d0a7-11e8-4d4e-8b4d-c4fec5eb944f-0
00:38:08.000 --> 00:38:09.520
Guess it's not a problem if you do.

e6031cb3-c8da-4321-bd0d-3d8a57b6e493-0
00:38:10.280 --> 00:38:15.203
But students who try to take a four hour
quiz or a six hour exam in one sitting,

e6031cb3-c8da-4321-bd0d-3d8a57b6e493-1
00:38:15.203 --> 00:38:20.065
often they get exhausted or they lose
their Internet connection or their laptop

e6031cb3-c8da-4321-bd0d-3d8a57b6e493-2
00:38:20.065 --> 00:38:21.160
runs out of power.

34f1f26e-480e-4d7b-9db1-fc24149898c8-0
00:38:21.320 --> 00:38:22.840
We've seen all these things happen there.

26e83c6f-193f-403b-9707-bcb2c7a394b3-0
00:38:22.840 --> 00:38:25.680
So it's a good idea to keep an under 2
hours time boxing there.

b2665f51-c01d-4a73-98fd-f3d59923f8cd-0
00:38:26.440 --> 00:38:29.194
And then you can also show notifications
on the screen,

b2665f51-c01d-4a73-98fd-f3d59923f8cd-1
00:38:29.194 --> 00:38:32.341
these little alerts that'll pop up that
say you have, you know,

b2665f51-c01d-4a73-98fd-f3d59923f8cd-2
00:38:32.341 --> 00:38:35.440
you can say you have 15 minutes left,
you have 5 minutes left.

ae2ac8c1-400e-49b9-9040-3bbdd7ad72bc-0
00:38:36.760 --> 00:38:40.120
We really don't recommend more than than
one of those alerts.

3613eb48-04db-4a4d-95c2-d17a7c5c2e31-0
00:38:40.120 --> 00:38:41.560
They stress students out.

31b81b8f-300d-4435-85be-11c360f8f3a3-0
00:38:42.240 --> 00:38:42.840
They really do.

407873e5-7308-453d-9a93-5fcf19cb7cb4-0
00:38:42.840 --> 00:38:44.800
They're like, I know, I know, I know,
I'm running out of time.

8bf0ed1b-7dfe-4513-b4b8-be5f7a6b867c-0
00:38:44.800 --> 00:38:45.560
Don't remind me.

2f84846b-7157-4d84-bf95-ce4c6807d0aa-0
00:38:45.560 --> 00:38:49.574
Because they do have a little clock that
if you set a time limit on the exam,

2f84846b-7157-4d84-bf95-ce4c6807d0aa-1
00:38:49.574 --> 00:38:53.742
a little clock will appear in the upper
right corner of their screen that counts

2f84846b-7157-4d84-bf95-ce4c6807d0aa-2
00:38:53.742 --> 00:38:54.000
down.

fd12d7ae-7c49-4555-80a5-0e014f748f0c-0
00:38:54.000 --> 00:38:56.840
They can hide that clock,
but it is up there.

065830ee-570d-4ee8-8694-67a004f762c7-0
00:38:57.040 --> 00:39:00.618
And sometimes students say they feel a
lot of pressure when these alerts pop up

065830ee-570d-4ee8-8694-67a004f762c7-1
00:39:00.618 --> 00:39:01.960
in the middle of their screen.

9ea16c66-1b16-46e5-ba7b-3e8aaa8f8b83-0
00:39:01.960 --> 00:39:04.807
But we also get feedback from students
who say, well,

9ea16c66-1b16-46e5-ba7b-3e8aaa8f8b83-1
00:39:04.807 --> 00:39:07.760
I didn't realize I would run out of time,
what do I do?

5cb31371-506e-4476-b8d7-44bdbffac66f-0
00:39:08.000 --> 00:39:11.160
So you might want to put like a 5 minute
reminder or something on there.

41238068-5ed9-4016-b9bb-6ff75a88bf89-0
00:39:11.800 --> 00:39:14.280
So that's in terms of the setup there.

71d9cf74-ef6a-41f2-af06-3d3881a745db-0
00:39:14.800 --> 00:39:18.800
The other thing I want to show is oops,
wrong, clicked on the wrong thing.

ad81459a-66e0-4c43-ad14-bbf7a82ddd7b-0
00:39:19.520 --> 00:39:26.480
The other thing I want to show is the
sharing of results here and there we go.

4cccde66-b8e4-460c-a21b-922c7750c18d-0
00:39:26.760 --> 00:39:30.236
So the sharing,
there's a lot of detail and granularity

4cccde66-b8e4-460c-a21b-922c7750c18d-1
00:39:30.236 --> 00:39:34.520
in terms of sharing results,
what you can display both on screen and

4cccde66-b8e4-460c-a21b-922c7750c18d-2
00:39:34.520 --> 00:39:36.880
in an e-mail once scoring is complete.

41b41488-f327-4b8c-a71f-9f9ce3c77fd2-0
00:39:37.520 --> 00:39:42.080
For midterm and final exams,
we strongly recommend that you leave all

41b41488-f327-4b8c-a71f-9f9ce3c77fd2-1
00:39:42.080 --> 00:39:43.840
of these things turned off.

fb1ed21f-fdfe-4fd9-9da0-dfb104a8fdbb-0
00:39:43.840 --> 00:39:45.520
You don't enable any of them.

37af82db-1a04-4365-b8a1-318709337a91-0
00:39:45.960 --> 00:39:48.379
Now,
if you are doing one of those exams where

37af82db-1a04-4365-b8a1-318709337a91-1
00:39:48.379 --> 00:39:51.776
you're splitting it apart,
where you're having multiple choice in

37af82db-1a04-4365-b8a1-318709337a91-2
00:39:51.776 --> 00:39:55.997
one exam and essay questions in another,
you probably actually do want to display

37af82db-1a04-4365-b8a1-318709337a91-3
00:39:55.997 --> 00:40:00.218
the multiple choice results on the screen
just so students can get that immediate

37af82db-1a04-4365-b8a1-318709337a91-4
00:40:00.218 --> 00:40:04.130
feedback and know what areas to focus on
in terms of review for their essay

37af82db-1a04-4365-b8a1-318709337a91-5
00:40:04.130 --> 00:40:05.159
portion of the exam.

1fb8886d-5ace-4f77-8c5e-cfd0b273f8f4-0
00:40:05.760 --> 00:40:09.080
Otherwise,
make sure all these things are turned off.

5917d724-d3ce-495a-b50c-35b6e0bba5d9-0
00:40:09.240 --> 00:40:14.247
Students will get an e-mail confirming
that they submitted their answers to the

5917d724-d3ce-495a-b50c-35b6e0bba5d9-1
00:40:14.247 --> 00:40:14.560
exam.

644318d7-bb7f-476e-a780-957dffcd34b4-0
00:40:14.880 --> 00:40:19.685
They don't need to see anything else
unless you want them to see what is also

644318d7-bb7f-476e-a780-957dffcd34b4-1
00:40:19.685 --> 00:40:20.240
up there.

d9f60a56-420a-462f-af0a-154fc3523c1b-0
00:40:21.000 --> 00:40:24.150
You probably want to hold all of these
until everybody's been graded,

d9f60a56-420a-462f-af0a-154fc3523c1b-1
00:40:24.150 --> 00:40:25.680
until everybody's taking the exam.

92bac8cf-922f-4862-b572-421603f208b1-0
00:40:26.000 --> 00:40:31.031
And then at that point decide, OK,
I'm going to e-mail everybody the correct

92bac8cf-922f-4862-b572-421603f208b1-1
00:40:31.031 --> 00:40:34.560
answers, what their responses were,
my feedback, all.

4ecc1684-a7f3-4719-a63f-d3e108e2fc32-0
00:40:34.600 --> 00:40:38.672
You have lots of different options here
and you can preview what those options

4ecc1684-a7f3-4719-a63f-d3e108e2fc32-1
00:40:38.672 --> 00:40:39.600
look like as well.

4398e30f-9282-4574-bee3-6ce55adb28c1-0
00:40:39.800 --> 00:40:42.882
But we generally recommend for midterms
and finals,

4398e30f-9282-4574-bee3-6ce55adb28c1-1
00:40:42.882 --> 00:40:47.623
don't send anything out until everybody's
taken the exam and all the scoring is

4398e30f-9282-4574-bee3-6ce55adb28c1-2
00:40:47.623 --> 00:40:47.920
done.

9cc978b9-c821-41f8-96e0-9446e9bc4b39-0
00:40:47.920 --> 00:40:52.116
Otherwise you just sort of open yourself
up to lots of different fun and exciting

9cc978b9-c821-41f8-96e0-9446e9bc4b39-1
00:40:52.116 --> 00:40:52.680
challenges.

d11cb156-9653-4ec6-980a-8ca5a4d5a6f5-0
00:40:53.320 --> 00:40:59.172
So those are the sort of those are the
actual options in the quiz generator tool

d11cb156-9653-4ec6-980a-8ca5a4d5a6f5-1
00:40:59.172 --> 00:41:04.953
that you want to look at and that's how
you would set them up in your exams for

d11cb156-9653-4ec6-980a-8ca5a4d5a6f5-2
00:41:04.953 --> 00:41:06.760
both midterms and finals.

a97ca8bf-53d1-46c8-ae21-06f6c6472c64-0
00:41:07.440 --> 00:41:11.720
Questions about that,
questions from any of that stuff.

6509dab5-1094-467c-94af-1faffb270bdd-0
00:41:11.840 --> 00:41:17.134
OK, all right,
so let me go back to my desktop and my

6509dab5-1094-467c-94af-1faffb270bdd-1
00:41:17.134 --> 00:41:19.880
presentation and here we go.

fd4dddf6-0da6-486e-8d70-7894194fef68-0
00:41:20.400 --> 00:41:24.236
OK, So and as I mentioned, CTL,
the instructional designers came up with

fd4dddf6-0da6-486e-8d70-7894194fef68-1
00:41:24.236 --> 00:41:28.388
this great complete guide to setting up
an exam that has all those options and

fd4dddf6-0da6-486e-8d70-7894194fef68-2
00:41:28.388 --> 00:41:30.280
everything else in even more detail.

2c34ead9-d6d0-4695-a740-3c8d37fa88e5-0
00:41:30.480 --> 00:41:32.320
It's available on the Teaching Toolkit
website.

27f8ecad-7576-429f-bba2-18cc3c54c0a7-0
00:41:32.320 --> 00:41:37.106
We'll make sure that we e-mail everybody
within a follow up that has a link to

27f8ecad-7576-429f-bba2-18cc3c54c0a7-1
00:41:37.106 --> 00:41:38.440
that document as well.

8b6c180c-7620-4101-b0a9-a0a1e4f077b6-0
00:41:39.280 --> 00:41:42.901
So the last portion I want to talk about
before we get to sort of open Q&

8b6c180c-7620-4101-b0a9-a0a1e4f077b6-1
00:41:42.901 --> 00:41:45.641
A are the adventures and pitfalls and
exam administration,

8b6c180c-7620-4101-b0a9-a0a1e4f077b6-2
00:41:45.641 --> 00:41:49.124
what to do when things go wrong or when
students present you with problems

8b6c180c-7620-4101-b0a9-a0a1e4f077b6-3
00:41:49.124 --> 00:41:49.960
because they will.

37202e6f-9b5c-49d9-ac0b-35d5267ad808-0
00:41:50.720 --> 00:41:53.274
This is simple reality of no matter how
careful you are,

37202e6f-9b5c-49d9-ac0b-35d5267ad808-1
00:41:53.274 --> 00:41:55.470
no matter how many times you administer
an exam,

37202e6f-9b5c-49d9-ac0b-35d5267ad808-2
00:41:55.470 --> 00:41:57.487
no matter how much forethought you've
given,

37202e6f-9b5c-49d9-ac0b-35d5267ad808-3
00:41:57.487 --> 00:41:59.280
there's going to be issues for students.

b8022549-2f22-43a2-9a69-b947b224dc06-0
00:41:59.320 --> 00:42:03.460
And I want to talk about some of the
really general big picture things that

b8022549-2f22-43a2-9a69-b947b224dc06-1
00:42:03.460 --> 00:42:07.600
can get that I've seen get sort of
faculty and Tasmania in trouble over and

b8022549-2f22-43a2-9a69-b947b224dc06-2
00:42:07.600 --> 00:42:08.200
over again.

8573bd71-1496-4673-a548-38719cc0fab4-0
00:42:08.680 --> 00:42:12.339
And if you have specific scenarios you
want to share with me or ask about,

8573bd71-1496-4673-a548-38719cc0fab4-1
00:42:12.339 --> 00:42:13.120
please just ask.

a1e8550d-2ec9-4179-b18b-7411d2b135c7-0
00:42:13.120 --> 00:42:14.160
I'm here to answer them.

8269de57-e2bb-43e4-9239-57de835933aa-0
00:42:14.160 --> 00:42:19.233
Amy's here to answer them and talk about
that to make sure that everybody is has

8269de57-e2bb-43e4-9239-57de835933aa-1
00:42:19.233 --> 00:42:23.744
their questions answered and their
concerns answered about this biggest

8269de57-e2bb-43e4-9239-57de835933aa-2
00:42:23.744 --> 00:42:24.120
thing.

2a7b5434-8593-4011-8f6a-3e731935ed57-0
00:42:24.120 --> 00:42:27.360
The biggest thing,
don't change the exam after it opens.

dbe8c72c-bb5c-45cd-862d-7556449cc791-0
00:42:27.360 --> 00:42:28.360
Please don't do this.

efa78dc1-fb08-4fc9-81a0-387be657ac49-0
00:42:28.360 --> 00:42:32.600
This causes all sorts of problems for
everybody and it happens every single

efa78dc1-fb08-4fc9-81a0-387be657ac49-1
00:42:32.600 --> 00:42:32.880
term.

a11e2afa-6fc7-41ce-85b0-2831e4c6881f-0
00:42:32.880 --> 00:42:35.489
There's at least one or two midterms or
finals every term,

a11e2afa-6fc7-41ce-85b0-2831e4c6881f-1
00:42:35.489 --> 00:42:38.187
even in the online courses where a
faculty members like, Oh,

a11e2afa-6fc7-41ce-85b0-2831e4c6881f-2
00:42:38.187 --> 00:42:41.240
I meant to change this or this question
is bad and I want to change.

e44b60dc-0494-4ccb-9321-65df1dd85d9d-0
00:42:41.880 --> 00:42:42.560
Don't do it.

d2bbb56d-583c-48f6-9155-a931f0dd9a67-0
00:42:42.680 --> 00:42:44.040
Resist that temptation.

ef323418-246b-4104-9bc8-2f2833004763-0
00:42:44.040 --> 00:42:45.480
It will cause you problems.

ba9c30b3-daad-4047-b5d5-045f16aa4125-0
00:42:45.720 --> 00:42:48.640
You'll end up with students who take the
exam before you make the changes.

f5be7ce6-db04-4a65-a379-7de1bcf2a9cd-0
00:42:48.640 --> 00:42:51.965
It's shocking to me,
but there are students who at 12 O 1:00

f5be7ce6-db04-4a65-a379-7de1bcf2a9cd-1
00:42:51.965 --> 00:42:55.400
AM start taking that exam right away and
you're on at 6:00 AM.

e70472ca-9d6c-474b-9875-c0419641cfd7-0
00:42:55.400 --> 00:42:58.034
You're like, oh, I'll quickly,
I'll change the exam before No,

e70472ca-9d6c-474b-9875-c0419641cfd7-1
00:42:58.034 --> 00:42:59.080
they've already taken it.

30710cc8-ac2d-49e2-b272-f253cd0c6263-0
00:42:59.440 --> 00:43:00.400
The problems are there.

3c4e719f-6b24-4ce5-a5e4-8fe098351ce4-0
00:43:00.600 --> 00:43:02.360
If you need to fix typos, that's fine.

c002f85b-ee90-4d17-a38d-5da75eed080b-0
00:43:02.360 --> 00:43:03.760
Typos are fixable.

0adf5dce-a330-47fe-a5d3-356763a3b97f-0
00:43:03.760 --> 00:43:05.440
You can change those in your questions.

808fcce8-1c39-491d-bbc1-99bcc8748248-0
00:43:05.440 --> 00:43:06.200
That's OK.

5827a8b7-f23d-4097-8d15-c9afe2b0637e-0
00:43:06.560 --> 00:43:10.835
But adding and removing questions is bad
because what you'll inevitably end up

5827a8b7-f23d-4097-8d15-c9afe2b0637e-1
00:43:10.835 --> 00:43:14.948
with our students who have different
questions than the ones you want them,

5827a8b7-f23d-4097-8d15-c9afe2b0637e-2
00:43:14.948 --> 00:43:16.680
wanted them to answer after the.

78275cdb-9f28-4d9d-b108-dc35ff6d82d9-0
00:43:18.040 --> 00:43:21.420
So if you made your changes,
changing into answers entirely is also

78275cdb-9f28-4d9d-b108-dc35ff6d82d9-1
00:43:21.420 --> 00:43:24.304
bad because again,
you'll have students who have answered

78275cdb-9f28-4d9d-b108-dc35ff6d82d9-2
00:43:24.304 --> 00:43:26.938
questions,
they'll start on the exam before you have

78275cdb-9f28-4d9d-b108-dc35ff6d82d9-3
00:43:26.938 --> 00:43:28.480
a chance to make those changes.

3891b0f1-a67f-421f-bfd3-6bad8af853e6-0
00:43:28.720 --> 00:43:31.200
Please do not change the exam after it
opens.

b11ec2c8-9bb0-4fe2-9bd8-35662f3fddb5-0
00:43:31.200 --> 00:43:35.320
It's a really bad way of managing your
exam.

990245d6-9469-4288-865c-7160ce8a780b-0
00:43:35.320 --> 00:43:39.400
It causes a lot of frustration for the
students and for you and for your TAS.

090c3698-6491-4211-bbfc-5a82c4b0391e-0
00:43:39.600 --> 00:43:42.720
So if you have a bad question that
ultimately,

090c3698-6491-4211-bbfc-5a82c4b0391e-1
00:43:42.720 --> 00:43:47.435
ultimately needs to be removed,
what you want to do instead is exclude

090c3698-6491-4211-bbfc-5a82c4b0391e-2
00:43:47.435 --> 00:43:49.560
that that question from scoring.

267a34c5-03d1-4b03-93a6-4e4711abb26c-0
00:43:49.560 --> 00:43:50.720
That's what you want to do.

5c126eb0-88b3-46dc-bec7-a8844e43e3da-0
00:43:50.920 --> 00:43:51.680
Leave it in there.

876564d0-0513-45f4-bd84-47883b68cff8-0
00:43:51.680 --> 00:43:52.800
Don't try to delete it.

c9141c91-1d33-441b-9115-08f5e72b9aa6-0
00:43:52.960 --> 00:43:55.080
Don't try to change the whole answer set
around.

0321cd44-432c-48ca-9ed9-fae9a4f0382f-0
00:43:55.240 --> 00:43:57.760
Just exclude that question from scoring.

2e1a6c50-de93-4b4a-936f-dfd0f4b8947d-0
00:43:57.760 --> 00:44:01.089
So when you edit the question,
there's an option that's highlighted on

2e1a6c50-de93-4b4a-936f-dfd0f4b8947d-1
00:44:01.089 --> 00:44:01.840
the screen here.

4a993886-53ba-45ba-85a3-db3a70b64bbf-0
00:44:01.840 --> 00:44:04.550
You can see it on the right says do you
want to exclude this question from

4a993886-53ba-45ba-85a3-db3a70b64bbf-1
00:44:04.550 --> 00:44:04.840
scoring?

4e866b49-d17e-4a4f-9a22-94a3ee56a6fc-0
00:44:05.080 --> 00:44:08.234
You say yes,
save that question and then recalculate

4e866b49-d17e-4a4f-9a22-94a3ee56a6fc-1
00:44:08.234 --> 00:44:12.400
everybody's grades and it will take that
question out of the picture.

a4298ea4-0d9f-42b7-8e5f-a9e1ab5849c9-0
00:44:12.400 --> 00:44:15.591
Now I know some people say well,
but my exam is supposed to be worth out

a4298ea4-0d9f-42b7-8e5f-a9e1ab5849c9-1
00:44:15.591 --> 00:44:16.160
of 50 points.

d575d0f2-8ab3-44f1-a9a0-801aa1fc7250-0
00:44:16.160 --> 00:44:17.200
That's okay.

a9840d8f-43d4-49a3-b596-3fcaee9725b5-0
00:44:17.480 --> 00:44:22.421
If you're using the grade book tool in
course Plus and you have an exam and you

a9840d8f-43d4-49a3-b596-3fcaee9725b5-1
00:44:22.421 --> 00:44:25.880
import those grade and it's worth say 49
points, right?

37c08fcb-13d0-437e-8954-55bd3fc7f112-0
00:44:25.880 --> 00:44:27.480
Because you had to take one question out.

4f8a6a95-565a-4cda-b932-3ecdb3506ede-0
00:44:27.640 --> 00:44:30.240
Or it's worth 47 points because you had
to take one question out.

b9088bb0-15d3-4832-ac3f-742ca0df9400-0
00:44:30.520 --> 00:44:32.440
But in the grade book you say it's worth
50 points.

a48007d8-5f3c-4af0-812e-e30b36675461-0
00:44:32.600 --> 00:44:35.680
The grade book will automatically do that
scaling conversion for you.

4dc3e152-8118-4c94-b144-2294d90763a1-0
00:44:36.000 --> 00:44:40.022
So there's no worries about am I getting
the math right and having to, you know,

4dc3e152-8118-4c94-b144-2294d90763a1-1
00:44:40.022 --> 00:44:43.200
let the computer take care of the math,
let it do that for you.

c42de2c6-69a2-48e5-a137-b6e243eafb7a-0
00:44:43.200 --> 00:44:45.960
Just take that question out,
exclude it from scoring.

0cac9557-5d48-460c-aee2-074c6958470c-0
00:44:45.960 --> 00:44:50.098
That's really the way you want to go
rather than trying to delete it after the

0cac9557-5d48-460c-aee2-074c6958470c-1
00:44:50.098 --> 00:44:50.360
fact.

4b1e367b-39aa-42ab-8998-7341e1246d00-0
00:44:50.360 --> 00:44:54.000
That will cause definite problems for you
in the exam.

19d5ef66-4a2e-43a8-aef3-e2b04e82759b-0
00:44:54.680 --> 00:44:58.840
You'll also get students who accidentally
submit their answers.

ddef2c94-4524-496c-b773-46cd7789b25a-0
00:44:58.840 --> 00:45:02.523
You know, they're like, I didn't,
I wasn't paying attention, I got panicked,

ddef2c94-4524-496c-b773-46cd7789b25a-1
00:45:02.523 --> 00:45:05.920
I submit my answers too early or I
realized I made a terrible mistake.

1b872454-7bc6-4480-82a3-0bc8fa3b24d7-0
00:45:05.920 --> 00:45:09.225
Can I please, please, please, please,
please go back into the exam for 10 more

1b872454-7bc6-4480-82a3-0bc8fa3b24d7-1
00:45:09.225 --> 00:45:09.560
minutes?

06e119fd-8ac5-4006-9bd0-8f502b97003d-0
00:45:09.760 --> 00:45:10.920
I had 10 minutes left.

18d72d60-30d9-42fe-a871-e93703c68377-0
00:45:11.080 --> 00:45:12.040
I made a mistake.

7a6a7bf7-6f5d-41cb-966d-7e18223ff631-0
00:45:12.160 --> 00:45:14.720
Can I please go back in the exam now?

550215fe-0ea4-48c9-a1c8-99d478763b60-0
00:45:14.720 --> 00:45:17.010
Of course,
this is a decision you have to make for

550215fe-0ea4-48c9-a1c8-99d478763b60-1
00:45:17.010 --> 00:45:19.480
yourself and whether not you want
students to do this.

0ffb3545-568a-4f63-b7ab-bc3679ad038a-0
00:45:19.480 --> 00:45:22.997
And I'll say right up front,
when students submit their exams,

0ffb3545-568a-4f63-b7ab-bc3679ad038a-1
00:45:22.997 --> 00:45:27.128
no matter if they've answered all the
questions or none of the questions,

0ffb3545-568a-4f63-b7ab-bc3679ad038a-2
00:45:27.128 --> 00:45:29.752
they're given a confirmation window that
says,

0ffb3545-568a-4f63-b7ab-bc3679ad038a-3
00:45:29.752 --> 00:45:32.320
Are you sure you want to submit your
answers?

bb269b0b-b7b9-4761-ae7a-395528c1fe10-0
00:45:32.440 --> 00:45:34.528
And if they've skipped,
if they've skipped questions,

bb269b0b-b7b9-4761-ae7a-395528c1fe10-1
00:45:34.528 --> 00:45:35.920
it even says you skipped question 7.

e90168bb-7c3a-407f-906d-630a0dcabfc5-0
00:45:36.200 --> 00:45:37.960
Are you sure you want to submit your
answers?

e4b84bd6-958b-4aa2-9678-c9f8e58cf83f-0
00:45:38.120 --> 00:45:41.120
So they have to go through multiple steps
to get to that point, right?

0f0de560-8405-4e7a-9989-8cccdddbe16c-0
00:45:41.600 --> 00:45:44.820
Still,
still there are students who accidentally

0f0de560-8405-4e7a-9989-8cccdddbe16c-1
00:45:44.820 --> 00:45:46.200
submit their answers.

aece1595-3d33-4ed0-bed1-247ae40de076-0
00:45:46.280 --> 00:45:48.680
Submit before they meant to,
whatever it is.

46695002-c9ee-4e7a-9f69-269d94d6b010-0
00:45:49.440 --> 00:45:54.592
What you do not want to do is clear their
answers out and let them take it all over

46695002-c9ee-4e7a-9f69-269d94d6b010-1
00:45:54.592 --> 00:45:54.960
again.

4ccf08ea-7084-4c12-9fff-eb523c143acf-0
00:45:54.960 --> 00:45:56.400
That's the wrong way to do something.

d12bc469-16de-46ef-9d7d-35bedebd2790-0
00:45:56.400 --> 00:45:58.730
Or they'll say to you,
I got disconnected from the Internet,

d12bc469-16de-46ef-9d7d-35bedebd2790-1
00:45:58.730 --> 00:45:58.960
right?

bf2ba2a8-e9cd-495b-9a21-032a187a2ed3-0
00:45:59.320 --> 00:46:01.160
But time ran out, it's past the due date.

0c734eef-6034-43ac-ae7e-13e1c7f10e79-0
00:46:01.160 --> 00:46:02.160
What do I do?

e3398326-56c5-4e54-8575-ffa555212888-0
00:46:02.440 --> 00:46:04.320
Well, don't clear the attempt.

399b52b6-eb09-4012-a0a1-9464af136b89-0
00:46:04.360 --> 00:46:06.899
Instead,
there's an option when you look at an

399b52b6-eb09-4012-a0a1-9464af136b89-1
00:46:06.899 --> 00:46:09.924
individual student's answer page in the
quiz generator,

399b52b6-eb09-4012-a0a1-9464af136b89-2
00:46:09.924 --> 00:46:13.760
there's this option that says change
answers back into an active quiz.

b9136370-b2a5-44a8-a285-8e92a2f60d13-0
00:46:14.320 --> 00:46:15.520
Do that instead.

b6e7c634-5956-49d6-a194-f67b1e25ba00-0
00:46:15.760 --> 00:46:18.633
What that does is whatever answers they
selected,

b6e7c634-5956-49d6-a194-f67b1e25ba00-1
00:46:18.633 --> 00:46:23.000
it converts them back into an active quiz
with whatever time they had left.

2664de17-ed21-45da-bb7e-da28e2d0ee7e-0
00:46:23.000 --> 00:46:24.560
So let's say it was a 90 minute quiz.

e50a532b-4957-4ead-80db-0813e6169150-0
00:46:24.760 --> 00:46:26.760
They submit it with 10 minutes still on
the clock.

dd5f3599-0e66-42cd-bab2-1ac997f629c8-0
00:46:26.880 --> 00:46:29.520
You click change answers back into an
active quiz.

429cc239-0156-4f4f-aa72-3a8931092317-0
00:46:29.680 --> 00:46:32.560
It does that and leaves those 10 minutes
on the clock for them.

d268458f-666a-4e08-b8c0-899c6f4c1f7c-0
00:46:32.680 --> 00:46:35.840
So they have those 10 minutes to complete
the the the exam.

e65a413c-70e5-4342-a13e-97191b5e2415-0
00:46:36.160 --> 00:46:41.230
Try to avoid as much as possible this
clearing answers thing that that tends to

e65a413c-70e5-4342-a13e-97191b5e2415-1
00:46:41.230 --> 00:46:44.400
be the action of first resort for so many
people.

f8abfebf-c205-4457-9e63-7c2881087460-0
00:46:44.920 --> 00:46:48.047
But that means that the student has to
take the whole exam over again,

f8abfebf-c205-4457-9e63-7c2881087460-1
00:46:48.047 --> 00:46:51.571
which is stressful for them and in some
ways gives them a very unfair advantage

f8abfebf-c205-4457-9e63-7c2881087460-2
00:46:51.571 --> 00:46:55.139
because they've seen the questions before
and could change their answers without

f8abfebf-c205-4457-9e63-7c2881087460-3
00:46:55.139 --> 00:46:55.799
you knowing it.

6af078ff-0473-418a-beb4-d1740f7d2a46-0
00:46:55.800 --> 00:47:00.144
So change answers back into an active
quiz is always the way to go where

6af078ff-0473-418a-beb4-d1740f7d2a46-1
00:47:00.144 --> 00:47:00.680
possible.

72f015bc-61de-489e-bda2-f348363f1e08-0
00:47:01.200 --> 00:47:04.364
And you know you will get students who
say they're disconnected while taking the

72f015bc-61de-489e-bda2-f348363f1e08-1
00:47:04.364 --> 00:47:04.560
exam.

4065a560-f57d-4cd1-8ae1-441ecfa78b0d-0
00:47:05.280 --> 00:47:07.360
You know you need to consider the
circumstances.

9d0e04ad-c023-4ed1-85b4-34fedcb9c008-0
00:47:07.360 --> 00:47:08.120
Do you believe them?

6f7f868c-64b7-4e04-b9f3-5fca2592a298-0
00:47:08.120 --> 00:47:11.806
Is it doesn't make sense, You know,
are you seeing that really again,

6f7f868c-64b7-4e04-b9f3-5fca2592a298-1
00:47:11.806 --> 00:47:15.334
there's an activity log,
which I'll show you in just a moment that

6f7f868c-64b7-4e04-b9f3-5fca2592a298-2
00:47:15.334 --> 00:47:19.600
shows everything the student did in the
exam and the order in which they did it.

f88e30fa-1e13-4412-9167-6acaa2809054-0
00:47:19.920 --> 00:47:22.454
And if it was like,
clearly they're just working, working,

f88e30fa-1e13-4412-9167-6acaa2809054-1
00:47:22.454 --> 00:47:24.989
working, working,
working with time stamps that show clear

f88e30fa-1e13-4412-9167-6acaa2809054-2
00:47:24.989 --> 00:47:25.720
patterns of work.

8a213672-431d-4d9c-a68a-0ec0a63ab742-0
00:47:25.720 --> 00:47:28.800
And then they submitted their answers,
They probably weren't disconnected.

ac81040b-5d60-4318-a269-2104313187de-0
00:47:28.800 --> 00:47:32.652
And you can contact CTL help and CTL help
can help you look at the raw server logs

ac81040b-5d60-4318-a269-2104313187de-1
00:47:32.652 --> 00:47:36.320
or look at the raw server logs for you
and say, were they really disconnected?

ab85542a-c985-42b9-b8a0-08da40b3ecad-0
00:47:36.720 --> 00:47:38.942
But if you want to give them,
they say I got disconnected, please,

ab85542a-c985-42b9-b8a0-08da40b3ecad-1
00:47:38.942 --> 00:47:40.800
please, please,
I need to finished before the deadline.

6f09fa62-5360-4b58-aa73-3c57aba4f588-0
00:47:41.200 --> 00:47:45.048
You can go into the special permissions
tool and increase the number of times

6f09fa62-5360-4b58-aa73-3c57aba4f588-1
00:47:45.048 --> 00:47:46.480
they have to access the quiz.

1983ec49-f0f3-46a2-8fa3-0416299ad8b7-0
00:47:46.680 --> 00:47:48.080
So again or sorry, the exam.

08f72b00-aa35-46f4-84ae-f3eb4d8c7af6-0
00:47:48.080 --> 00:47:50.723
So for most exams,
you're going to have them access it only

08f72b00-aa35-46f4-84ae-f3eb4d8c7af6-1
00:47:50.723 --> 00:47:51.120
one time.

dd198311-b09b-4a43-9b4c-a01ee88e3bbc-0
00:47:51.480 --> 00:47:55.080
If they get disconnected and they're like,
please let me back in again,

dd198311-b09b-4a43-9b4c-a01ee88e3bbc-1
00:47:55.080 --> 00:47:56.880
don't clear their whole attempt out.

4d6b5012-3a14-42b7-90f5-6fb35ebc4e09-0
00:47:56.880 --> 00:47:57.800
Don't do that.

76727c0f-876f-4ec6-bb6c-253c524b11d6-0
00:47:57.960 --> 00:48:01.448
Use the special permissions tool,
increase the number of times they can

76727c0f-876f-4ec6-bb6c-253c524b11d6-1
00:48:01.448 --> 00:48:04.452
access the quiz or exam,
and you can even lock their existing

76727c0f-876f-4ec6-bb6c-253c524b11d6-2
00:48:04.452 --> 00:48:04.840
answers.

8b3097dd-be4c-496d-9ac0-626844141bf1-0
00:48:04.840 --> 00:48:05.400
There's that option.

56cb796f-6ec7-4e5d-b782-782da8525361-0
00:48:05.400 --> 00:48:08.440
You can see right on the screen in front
of you on the special access page.

963c1c36-ce2b-4558-aaea-14e3747143f2-0
00:48:08.440 --> 00:48:12.788
So they can't go back and change,
change any answers that they've submitted

963c1c36-ce2b-4558-aaea-14e3747143f2-1
00:48:12.788 --> 00:48:15.591
thus far,
which again is a powerful tool to help

963c1c36-ce2b-4558-aaea-14e3747143f2-2
00:48:15.591 --> 00:48:17.879
them not be able to cheat on your exams.

e2ad2a83-0e2f-4361-96da-106337465fcd-0
00:48:18.720 --> 00:48:22.710
So as I mentioned,
there is a log of quiz activity or exam

e2ad2a83-0e2f-4361-96da-106337465fcd-1
00:48:22.710 --> 00:48:26.160
activity on the individual student
responses page.

ff2c8f93-cd01-4c9b-a1bb-6fdd2e5b8111-0
00:48:26.320 --> 00:48:28.818
There's this option you can see
highlighted on the screen,

ff2c8f93-cd01-4c9b-a1bb-6fdd2e5b8111-1
00:48:28.818 --> 00:48:29.920
it says View activity log.

c1482806-2407-403a-90cb-05c5b9fafc10-0
00:48:30.280 --> 00:48:33.783
And if you click on that,
that shows a log of the activity the

c1482806-2407-403a-90cb-05c5b9fafc10-1
00:48:33.783 --> 00:48:37.343
student did every time they,
when they started taking the exam,

c1482806-2407-403a-90cb-05c5b9fafc10-2
00:48:37.343 --> 00:48:41.459
every answer selection they made as
they're typing essay exams, it saves,

c1482806-2407-403a-90cb-05c5b9fafc10-3
00:48:41.459 --> 00:48:44.240
it auto saves a version of that every 30
seconds.

9bfdc81e-6621-4377-a6ab-1c235e65873d-0
00:48:44.240 --> 00:48:47.871
So you can see how they changed their
answers There you can see if they

9bfdc81e-6621-4377-a6ab-1c235e65873d-1
00:48:47.871 --> 00:48:51.200
switched answers around on exams and it
shows when if they leave.

82de031f-42a7-4de7-9176-71ff2a420363-0
00:48:51.360 --> 00:48:54.360
This is also the place where you see if
they leave the page and come back.

8264ede9-1dcb-4600-9d65-dcdb286c6632-0
00:48:54.360 --> 00:48:56.368
But this activity log can be really
useful,

8264ede9-1dcb-4600-9d65-dcdb286c6632-1
00:48:56.368 --> 00:48:58.880
especially when a student contacts you
with a problem.

c5b03d89-e55a-43ed-baa6-a0600ffd88c4-0
00:48:59.120 --> 00:49:02.639
And if you need help in interpreting what
this activity log means,

c5b03d89-e55a-43ed-baa6-a0600ffd88c4-1
00:49:02.639 --> 00:49:04.320
CTL Help is there to assist you.

e193afeb-43a7-421e-9e75-27ee66917f72-0
00:49:04.880 --> 00:49:07.800
And usually they pass it on to me and I
look at it as well.

4c3983f9-cb0c-4911-8653-c5f491f106a6-0
00:49:08.520 --> 00:49:12.206
So if you are enabling the tracking
feature that Course Plus has,

4c3983f9-cb0c-4911-8653-c5f491f106a6-1
00:49:12.206 --> 00:49:15.000
here's an example of what this looks like,
right?

e6a5a0bf-e862-4a4f-bddc-7734d7806f3d-0
00:49:15.160 --> 00:49:17.875
So we see here on the screen that in this
case,

e6a5a0bf-e862-4a4f-bddc-7734d7806f3d-1
00:49:17.875 --> 00:49:22.232
the student selected the answer for
continuous time to event analysis, blah,

e6a5a0bf-e862-4a4f-bddc-7734d7806f3d-2
00:49:22.232 --> 00:49:23.760
blah, blah, for question 2.

37ae5061-15d2-44ca-8ac5-6dbd17b724e5-0
00:49:24.160 --> 00:49:27.050
And then a little bit later,
43 seconds later,

37ae5061-15d2-44ca-8ac5-6dbd17b724e5-1
00:49:27.050 --> 00:49:31.479
the students switched away from the quiz
page and then 2 seconds later,

37ae5061-15d2-44ca-8ac5-6dbd17b724e5-2
00:49:31.479 --> 00:49:35.600
switch back to the quiz page and then
change one of their answers.

2803098a-d204-4c3c-9c1f-1d7a2e04ed8d-0
00:49:36.120 --> 00:49:38.418
So if you're concerned about academic
ethics integrity,

2803098a-d204-4c3c-9c1f-1d7a2e04ed8d-1
00:49:38.418 --> 00:49:40.840
this is the kind of stuff that you want
to be looking for.

9b117361-fee9-4f80-b9b7-3400b078c78f-0
00:49:41.040 --> 00:49:45.484
Would students switch away from the page,
come back to the page and immediately

9b117361-fee9-4f80-b9b7-3400b078c78f-1
00:49:45.484 --> 00:49:47.040
change one of their answers?

b35a3b3a-e562-4ba8-8c74-bccd654d6019-0
00:49:47.160 --> 00:49:48.880
That's something that you should be
looking out for.

bd9e830f-a15c-4482-8ce1-bddc2b08c24b-0
00:49:49.080 --> 00:49:51.527
If that is a great concern,
if you are using this feature,

bd9e830f-a15c-4482-8ce1-bddc2b08c24b-1
00:49:51.527 --> 00:49:53.560
this is the kind of thing that can help
you see.

52b083f0-ec15-4f90-8ce8-d311e3978df9-0
00:49:53.560 --> 00:49:56.378
And again,
if you need help interpreting this kind

52b083f0-ec15-4f90-8ce8-d311e3978df9-1
00:49:56.378 --> 00:49:57.760
of stuff, you can ask me.

d6ffac52-cac4-4dee-9598-1acb35fa36a6-0
00:49:57.760 --> 00:50:00.474
You can ask me to help or your
instructional designer if you have

d6ffac52-cac4-4dee-9598-1acb35fa36a6-1
00:50:00.474 --> 00:50:02.120
happened to be working with one of them.

5d4230bd-314c-4944-8de6-e02c2b83f187-0
00:50:02.800 --> 00:50:06.691
Another thing we see,
and again that the law can help with in

5d4230bd-314c-4944-8de6-e02c2b83f187-1
00:50:06.691 --> 00:50:10.080
terms of tracking is very fast completion
of answers.

59607525-069a-417f-9045-c229d0074334-0
00:50:10.400 --> 00:50:13.760
This is actually from an exam that
happened in the third term.

0307915e-38d3-4fe7-ba8a-dc9e6bcc0933-0
00:50:14.000 --> 00:50:15.960
You can see that a student answered.

9ee635f4-f1ec-4a85-b30c-252e476951f8-0
00:50:16.400 --> 00:50:22.491
It only took the student 2 seconds to
answer question 4 after answering

9ee635f4-f1ec-4a85-b30c-252e476951f8-1
00:50:22.491 --> 00:50:23.760
question three.

1de979b3-4e04-48e3-9641-303ed372bad9-0
00:50:24.520 --> 00:50:29.369
If it's not a true false question,
that's awfully fast for a student who

1de979b3-4e04-48e3-9641-303ed372bad9-1
00:50:29.369 --> 00:50:32.160
doesn't know what that question is, right?

2aa86f13-ae28-4e9c-ae16-e72dda895748-0
00:50:32.280 --> 00:50:35.822
It takes us a couple seconds to look at
something and process it and then say is

2aa86f13-ae28-4e9c-ae16-e72dda895748-1
00:50:35.822 --> 00:50:36.960
this right, is this wrong?

f256e1cc-b105-414b-be92-e2a092ba61b8-0
00:50:36.960 --> 00:50:40.680
Or even from a multiple choice list,
it takes more than two seconds to do that.

683e599e-fbbc-406a-b6f9-0839da6293a4-0
00:50:40.800 --> 00:50:44.688
Move your mouse click on the right thing
and you can see then the next question

683e599e-fbbc-406a-b6f9-0839da6293a4-1
00:50:44.688 --> 00:50:47.800
between questions 4:00 and 5:00,
there's a mere 4 second delay.

e5f3e8f0-f290-425b-8a23-38899f4d2d5e-0
00:50:47.960 --> 00:50:50.000
So this is an actual instance where
students cheated.

11988c8d-9ad4-48e3-bd85-84c10a279c64-0
00:50:50.000 --> 00:50:54.597
And this is the kind of stuff that the
tracking can help capture for us if we're

11988c8d-9ad4-48e3-bd85-84c10a279c64-1
00:50:54.597 --> 00:50:57.720
very concerned about what students are
doing in exams.

323f4670-8202-44db-97bc-bc2d91424495-0
00:50:58.480 --> 00:51:03.065
And then again, also, as I mentioned,
course plus that sort of tracking feature

323f4670-8202-44db-97bc-bc2d91424495-1
00:51:03.065 --> 00:51:07.880
also helps you see if the student access
materials while they were taking the exam.

98ecf6dd-6911-4363-8d44-5cb761a8f9bc-0
00:51:07.880 --> 00:51:10.875
So in this case,
the student while they were taking the

98ecf6dd-6911-4363-8d44-5cb761a8f9bc-1
00:51:10.875 --> 00:51:13.336
exam,
went to the main class sessions page in

98ecf6dd-6911-4363-8d44-5cb761a8f9bc-2
00:51:13.336 --> 00:51:17.348
this course and and downloaded APDF file
from the online library that they

98ecf6dd-6911-4363-8d44-5cb761a8f9bc-3
00:51:17.348 --> 00:51:21.040
probably used to help them answer other
questions at that same time.

24f4fdf5-c0e5-4a44-96f4-6f5fcadaf3bc-0
00:51:21.240 --> 00:51:24.880
The note about this is that this
information does not appear immediately.

2a55a247-9ce5-4a6d-b1cf-d62900e51a39-0
00:51:25.080 --> 00:51:28.584
So as soon as students complete an exam,
this information about the other stuff

2a55a247-9ce5-4a6d-b1cf-d62900e51a39-1
00:51:28.584 --> 00:51:30.600
they access in course plus isn't right
there.

2bd350c4-9df8-4e0d-b9be-8c7863e572b6-0
00:51:30.840 --> 00:51:35.035
Takes about up to 12 hours depending on
how many people are taking exams that day

2bd350c4-9df8-4e0d-b9be-8c7863e572b6-1
00:51:35.035 --> 00:51:37.440
for that information to appear in course
plus.

ee77138e-5959-4a3f-afcf-8df8db48fc26-0
00:51:37.560 --> 00:51:39.530
So just be advised,
if you go in right away,

ee77138e-5959-4a3f-afcf-8df8db48fc26-1
00:51:39.530 --> 00:51:42.988
you're not going to see this kind of
stuff like the second the students answer

ee77138e-5959-4a3f-afcf-8df8db48fc26-2
00:51:42.988 --> 00:51:45.440
or submit their answers,
it's not going to be in there.

8f512f2d-65c5-47cc-a3f3-0c596751f94d-0
00:51:45.880 --> 00:51:48.880
This particular thing about accessing
other materials in course plus isn't

8f512f2d-65c5-47cc-a3f3-0c596751f94d-1
00:51:48.880 --> 00:51:50.160
going to be in there right away.

5d0995dd-6c13-4688-86c4-430484d1330d-0
00:51:51.800 --> 00:51:55.257
And you know, again,
if you have questions about academic

5d0995dd-6c13-4688-86c4-430484d1330d-1
00:51:55.257 --> 00:51:58.000
ethics, if you have concerns,
you can ask me.

ffe36327-fdbd-4f6d-8b76-84e2694aa41d-0
00:51:58.000 --> 00:52:01.770
But really the person to talk to is Jan
Vernick in the Office of Academic

ffe36327-fdbd-4f6d-8b76-84e2694aa41d-1
00:52:01.770 --> 00:52:02.280
Integrity.

3946e76c-edf7-475b-a4b0-098cb10d9bb1-0
00:52:02.960 --> 00:52:06.616
Jan knows these features about as well as
I do now because he's,

3946e76c-edf7-475b-a4b0-098cb10d9bb1-1
00:52:06.616 --> 00:52:10.104
he's been backwards and forwards on this
over and over again,

3946e76c-edf7-475b-a4b0-098cb10d9bb1-2
00:52:10.104 --> 00:52:11.680
unfortunately with students.

6938387e-8b0c-4665-86b7-49339de5a5b6-0
00:52:12.240 --> 00:52:15.291
And he really can help answer those
questions and clear up Gray areas and

6938387e-8b0c-4665-86b7-49339de5a5b6-1
00:52:15.291 --> 00:52:16.240
give you good guidance.

0067a94d-6f1b-4683-be23-6b85ba21a0c4-0
00:52:16.360 --> 00:52:18.904
Probably much,
definitely much better than I or CTL help

0067a94d-6f1b-4683-be23-6b85ba21a0c4-1
00:52:18.904 --> 00:52:21.360
would ever be able to give you on what's
my next step?

37a55cd1-a3a1-4d68-b4bf-5135387aea87-0
00:52:21.360 --> 00:52:22.560
How do I really approach this?

7c9e8c87-42bf-4c65-8c4f-3bb3f918416f-0
00:52:22.560 --> 00:52:24.770
I could tell you and CTL help can tell
you, you know,

7c9e8c87-42bf-4c65-8c4f-3bb3f918416f-1
00:52:24.770 --> 00:52:27.800
this is what the data tells me and this
is what we can see from the data.

1169f3fd-511c-4502-8013-65387cd1268c-0
00:52:27.920 --> 00:52:31.480
But in terms of guidance of is this an
academic ethics issue?

5d08e800-9da2-48a1-9c27-5cd63d6b8eb6-0
00:52:31.480 --> 00:52:32.880
Should I follow up with the students?

46bc9b07-1ad9-4128-bb74-61f5d51a9d70-0
00:52:32.880 --> 00:52:34.320
Should I follow up with you?

a6af3def-d47b-4a82-acae-dcea272f175d-0
00:52:34.320 --> 00:52:37.840
Jan is really the person to go to if
you're really concerned about that.

78d69bdf-321f-4d5c-9baf-62b7ec73561d-0
00:52:37.840 --> 00:52:40.696
But again,
building a good exam with randomization,

78d69bdf-321f-4d5c-9baf-62b7ec73561d-1
00:52:40.696 --> 00:52:43.828
not just question display order using the
question bank,

78d69bdf-321f-4d5c-9baf-62b7ec73561d-2
00:52:43.828 --> 00:52:46.960
time boxing using a variety of different
question types.

9492eb44-2101-4669-b7d5-66ff7e1b4aea-0
00:52:46.960 --> 00:52:52.715
These can also be really useful and
powerful tools for mitigating any kind of

9492eb44-2101-4669-b7d5-66ff7e1b4aea-1
00:52:52.715 --> 00:52:54.560
cheating in online exams.

8d0bed18-e37c-48c9-a038-210ad38ac065-0
00:52:55.680 --> 00:53:00.324
OK,
so that's it for my adventures in exam

8d0bed18-e37c-48c9-a038-210ad38ac065-1
00:53:00.324 --> 00:53:01.080
taking.

f5c540f5-fd66-4279-9b5b-de955851b66c-0
00:53:01.640 --> 00:53:04.264
We we're at 5 minutes of 6,
but I can certainly stick around and

f5c540f5-fd66-4279-9b5b-de955851b66c-1
00:53:04.264 --> 00:53:05.920
answer questions if there's lots of them.

55bd6b69-b6f0-4e5e-9478-2d83cf136f6c-0
00:53:06.160 --> 00:53:10.071
If you have particular questions you want
to ask about the quiz generator,

55bd6b69-b6f0-4e5e-9478-2d83cf136f6c-1
00:53:10.071 --> 00:53:12.887
about online exams,
about academic ethics situations,

55bd6b69-b6f0-4e5e-9478-2d83cf136f6c-2
00:53:12.887 --> 00:53:15.600
strategies for building better questions,
I'm here.

38e5eef5-e78a-4f90-88f2-92074ab875a9-0
00:53:15.600 --> 00:53:16.280
Amy's here.

a67f9ff1-80df-46bf-bc61-9b91949ee3f2-0
00:53:16.480 --> 00:53:18.200
We'll gladly answer them for you.

a642b0bd-c4b1-4dde-9800-77a28dfd841b-0
00:53:18.200 --> 00:53:21.483
Or if anyone has sort of experiences to
share on this front,

a642b0bd-c4b1-4dde-9800-77a28dfd841b-1
00:53:21.483 --> 00:53:25.788
we'd love to hear them from all of you
because I know a number of you have used

a642b0bd-c4b1-4dde-9800-77a28dfd841b-2
00:53:25.788 --> 00:53:28.748
these tools,
have encountered issues both positive and

a642b0bd-c4b1-4dde-9800-77a28dfd841b-3
00:53:28.748 --> 00:53:31.440
negative,
and we'd love to hear from you on that.

6447fa4d-6235-4e9a-8eb0-4f4a6949024e-0
00:53:33.360 --> 00:53:34.920
Hi, this is Lori Dean again.

cc6555d6-27fd-44ae-bbcb-fa1857e0d3bc-0
00:53:34.920 --> 00:53:36.320
I have two questions.

5c4d2a01-7cbd-4b42-8b03-73d4563c2ce0-0
00:53:37.560 --> 00:53:40.240
One is I'm wondering about you.

7d9dfceb-f346-4263-8056-9ff85ab0737e-0
00:53:40.560 --> 00:53:44.769
You mentioned if there's a an issue with
a question, if everyone's taking the exam,

7d9dfceb-f346-4263-8056-9ff85ab0737e-1
00:53:44.769 --> 00:53:48.427
let's say at the same time online,
and there's an issue with a question,

7d9dfceb-f346-4263-8056-9ff85ab0737e-2
00:53:48.427 --> 00:53:49.680
He said not to change it.

4c94b821-caef-4a61-b47b-e9fefaad6e63-0
00:53:50.160 --> 00:53:53.222
Is there a way, though,
to make an announcement that everyone

4c94b821-caef-4a61-b47b-e9fefaad6e63-1
00:53:53.222 --> 00:53:57.125
taking the exam can see so that everyone
gets the Because I imagine what might

4c94b821-caef-4a61-b47b-e9fefaad6e63-2
00:53:57.125 --> 00:54:01.078
happen is a student might contact us,
but now we need to get information to all

4c94b821-caef-4a61-b47b-e9fefaad6e63-3
00:54:01.078 --> 00:54:03.400
of the students about a challenge in the
exam.

41ab6ea6-7bda-47bf-b365-4b176bd0c741-0
00:54:03.680 --> 00:54:05.040
I guess what's the best way to do that?

b97fb5cd-a02b-4d84-bb3a-b3036b6fda16-0
00:54:05.280 --> 00:54:07.600
Yeah,
that's a really tough one because you

b97fb5cd-a02b-4d84-bb3a-b3036b6fda16-1
00:54:07.600 --> 00:54:11.818
don't want students to leave the quiz or
environment if it's a midterm or final

b97fb5cd-a02b-4d84-bb3a-b3036b6fda16-2
00:54:11.818 --> 00:54:14.296
exam,
you don't want them to have their e-mail

b97fb5cd-a02b-4d84-bb3a-b3036b6fda16-3
00:54:14.296 --> 00:54:14.560
open.

b2207c0b-8646-4688-ad9d-8ef452a41bd2-0
00:54:15.040 --> 00:54:17.413
So unfortunately,
there's no way in course plus to sort of

b2207c0b-8646-4688-ad9d-8ef452a41bd2-1
00:54:17.413 --> 00:54:19.102
say,
push out a message to everyone who's

b2207c0b-8646-4688-ad9d-8ef452a41bd2-2
00:54:19.102 --> 00:54:22.200
taking the exam at that moment in time,
like a pop up thing on their screen.

e1f18940-7737-412b-b44b-3f8f7c5226eb-0
00:54:22.760 --> 00:54:25.217
Unfortunately,
probably the best thing you can do is

e1f18940-7737-412b-b44b-3f8f7c5226eb-1
00:54:25.217 --> 00:54:26.840
send an e-mail to the entire class.

7268ca23-4e8a-4a0f-80c6-d642fda35e17-0
00:54:27.480 --> 00:54:29.863
You know,
students will see it immediately after

7268ca23-4e8a-4a0f-80c6-d642fda35e17-1
00:54:29.863 --> 00:54:33.267
the fact, but during the exam,
there's really no good way to get that

7268ca23-4e8a-4a0f-80c6-d642fda35e17-2
00:54:33.267 --> 00:54:36.671
kind of messaging out to everybody
without them ultimately, you know,

7268ca23-4e8a-4a0f-80c6-d642fda35e17-3
00:54:36.671 --> 00:54:38.520
clicking outside of their exam, right?

f91b8bee-e832-4c31-b377-1f4e9346243e-0
00:54:38.880 --> 00:54:41.981
Because some faculty will say don't have
any applications open other than your web

f91b8bee-e832-4c31-b377-1f4e9346243e-1
00:54:41.981 --> 00:54:42.280
browser.

17711953-d667-4d5d-ad3d-9ba804108dfd-0
00:54:42.280 --> 00:54:43.800
That's the only thing you're allowed to
have open.

66507c95-c1b7-425e-bbc7-ad082c3b53f5-0
00:54:44.160 --> 00:54:46.240
And students will ignore that, right?

c4ee87ae-9f1e-4212-b9cd-6b9cdc13b67a-0
00:54:46.240 --> 00:54:47.960
Because like, well,
they can't see what's on my desktop.

a631db6b-c628-4f09-a62c-aae6ab58706d-0
00:54:48.240 --> 00:54:51.921
But if they suddenly get an e-mail saying
important note about exam, well, you know,

a631db6b-c628-4f09-a62c-aae6ab58706d-1
00:54:51.921 --> 00:54:54.867
they're going to click, right,
get out of the exam and over to that

a631db6b-c628-4f09-a62c-aae6ab58706d-2
00:54:54.867 --> 00:54:56.080
e-mail and read that e-mail.

0395d4aa-34a2-420a-8523-f797c6ca0b55-0
00:54:56.240 --> 00:54:59.816
And then they'll be flagged if you're
using the flagging feature as leaving the

0395d4aa-34a2-420a-8523-f797c6ca0b55-1
00:54:59.816 --> 00:55:00.040
exam.

06a617c4-aad1-4e37-b516-32005e59175e-0
00:55:00.040 --> 00:55:02.820
And then it's going to be up to you to
have that discussion with them and be

06a617c4-aad1-4e37-b516-32005e59175e-1
00:55:02.820 --> 00:55:04.120
like, well, did they really do that?

901efa37-ba77-43f4-89c6-4a81eb5f8c53-0
00:55:04.360 --> 00:55:06.560
You know,
what time do they go look at the exam?

ab2e3355-a877-46e3-a7ba-a516b3ffee28-0
00:55:06.560 --> 00:55:07.240
You know, do they?

7cc044c5-51d6-4ca1-808a-fe507dc25b65-0
00:55:08.680 --> 00:55:11.333
I wish there were a better answer for you,
Lorraine,

7cc044c5-51d6-4ca1-808a-fe507dc25b65-1
00:55:11.333 --> 00:55:14.888
but unfortunately I don't really have a
good one unless Amy or Celine,

7cc044c5-51d6-4ca1-808a-fe507dc25b65-2
00:55:14.888 --> 00:55:16.440
you can think of a good option.

8adc0a83-7799-438e-bab4-d31756eaff0e-0
00:55:16.440 --> 00:55:20.169
I just, I can't, well, I was,
I was just going to add that we also

8adc0a83-7799-438e-bab4-d31756eaff0e-1
00:55:20.169 --> 00:55:22.897
can't,
even though we might want them to take it

8adc0a83-7799-438e-bab4-d31756eaff0e-2
00:55:22.897 --> 00:55:26.015
synchronously,
we can't guarantee that they're going to

8adc0a83-7799-438e-bab4-d31756eaff0e-3
00:55:26.015 --> 00:55:27.240
take it synchronously.

a2ea46cd-8c98-4767-a5a8-d656fc50eb99-0
00:55:27.240 --> 00:55:31.355
Everything that we do online,
we have to build in the possibility for

a2ea46cd-8c98-4767-a5a8-d656fc50eb99-1
00:55:31.355 --> 00:55:32.120
asynchronous.

0f912a58-1a25-4c35-a248-6a6af0b02de5-0
00:55:33.320 --> 00:55:36.688
So that was,
that was the thing that I would add again,

0f912a58-1a25-4c35-a248-6a6af0b02de5-1
00:55:36.688 --> 00:55:40.960
waiting until the exam has been completed,
you'll get a lot of emails.

15b878d4-5db0-4b57-8976-d7c02bbb57c0-0
00:55:40.960 --> 00:55:45.138
Even some days when an e-mail comes out,
I'll get flooded with emails and I just

15b878d4-5db0-4b57-8976-d7c02bbb57c0-1
00:55:45.138 --> 00:55:46.480
wait, let the dust settle.

4c81dbc1-71e7-415b-9b56-cf832a0beaad-0
00:55:46.800 --> 00:55:51.163
And then I send a succinct communication
that addresses everybody so I don't have

4c81dbc1-71e7-415b-9b56-cf832a0beaad-1
00:55:51.163 --> 00:55:52.760
to respond to individual ones.

2b8dd631-01bd-414e-a8a7-f24cdafb685c-0
00:55:52.800 --> 00:55:55.032
And you know,
you can always say if you still have

2b8dd631-01bd-414e-a8a7-f24cdafb685c-1
00:55:55.032 --> 00:55:56.040
questions, let us know.

00ee44c8-7f2e-4200-a6ad-0ec726ff1da4-0
00:55:57.200 --> 00:55:59.984
I think actually that's a really good
point about the synchronous versus

00ee44c8-7f2e-4200-a6ad-0ec726ff1da4-1
00:55:59.984 --> 00:56:00.480
asynchronous.

fd4cef0a-e9c8-4f3b-9557-fc17d41902fc-0
00:56:00.480 --> 00:56:02.560
In my head I was thinking do it
synchronously.

529c2eb9-957c-4136-a825-d3281bba1781-0
00:56:02.800 --> 00:56:06.192
But now I'm even thinking,
especially given these particular times,

529c2eb9-957c-4136-a825-d3281bba1781-1
00:56:06.192 --> 00:56:10.183
it might not make sense because I mean,
some of the medical medical students or

529c2eb9-957c-4136-a825-d3281bba1781-2
00:56:10.183 --> 00:56:13.126
medical trained faculty or medical
trained students can't,

529c2eb9-957c-4136-a825-d3281bba1781-3
00:56:13.126 --> 00:56:16.120
can't be at all of the classes because
they get called out.

8aa90712-b0f8-495b-97e1-6a664701af46-0
00:56:16.120 --> 00:56:19.480
So I think I need to be preparing for
asynchronous administration.

27534290-c52e-48f3-87b6-c23c1d8419ac-0
00:56:19.760 --> 00:56:25.021
I think my other question though was,
I guess does it make sense at all to

27534290-c52e-48f3-87b6-c23c1d8419ac-1
00:56:25.021 --> 00:56:30.423
really have it closed book if students
realistically could also just look on

27534290-c52e-48f3-87b6-c23c1d8419ac-2
00:56:30.423 --> 00:56:35.895
their phones or use another device to
access resources that we're saying that

27534290-c52e-48f3-87b6-c23c1d8419ac-3
00:56:35.895 --> 00:56:37.720
they shouldn't ask access?

522498d2-7119-4800-877e-b981d6daead6-0
00:56:38.160 --> 00:56:39.593
Yeah,
I think that's a really good question,

522498d2-7119-4800-877e-b981d6daead6-1
00:56:39.593 --> 00:56:39.880
Lorraine.

73ddba75-826c-442c-a651-7aac202d22bf-0
00:56:39.920 --> 00:56:44.290
And I think that, you know,
we have seen success with closed book

73ddba75-826c-442c-a651-7aac202d22bf-1
00:56:44.290 --> 00:56:49.256
exams online and it's really about
designing something that is effectively

73ddba75-826c-442c-a651-7aac202d22bf-2
00:56:49.256 --> 00:56:52.302
time boxed more than anything else,
you know,

73ddba75-826c-442c-a651-7aac202d22bf-3
00:56:52.302 --> 00:56:55.680
or that asks purely questions of
synthesis, right?

bbbd106b-7203-4800-9b03-91a6ca93ba43-0
00:56:55.680 --> 00:56:56.960
That it's not just multiple choice.

57741c42-a62d-4f8b-80b9-9d2c50183458-0
00:56:56.960 --> 00:56:58.800
When you have multiple choice,
it's really easy to cheat.

eea8559a-0dc4-4c0d-a9fc-9a58eea4f2d7-0
00:56:58.800 --> 00:57:01.389
I think, you know,
because it's easy to pick up the phone

eea8559a-0dc4-4c0d-a9fc-9a58eea4f2d7-1
00:57:01.389 --> 00:57:05.050
and be looking at notes or PDF files you
have on your phone as long as you're not

eea8559a-0dc4-4c0d-a9fc-9a58eea4f2d7-2
00:57:05.050 --> 00:57:05.720
like on course.

7cd8bcf8-b2fb-4301-9442-f74700cf67e4-0
00:57:05.720 --> 00:57:08.682
Plus we're never going to know,
but I think, you know,

7cd8bcf8-b2fb-4301-9442-f74700cf67e4-1
00:57:08.682 --> 00:57:11.321
questions exams that are more essay
focused and,

7cd8bcf8-b2fb-4301-9442-f74700cf67e4-2
00:57:11.321 --> 00:57:15.468
and with a limited amount of time,
it really does make a difference in terms

7cd8bcf8-b2fb-4301-9442-f74700cf67e4-3
00:57:15.468 --> 00:57:16.599
of students cheating.

87801257-3a5c-40c1-a3ff-5715b3824653-0
00:57:16.600 --> 00:57:17.640
They just won't have the time to do it.

b74c5314-daed-41f5-974c-0867e43cd606-0
00:57:17.640 --> 00:57:21.200
They won't have the time to go look it up
and and create comprehensive exams.

2d5ade6b-0724-4c13-af95-a4c19a055b64-0
00:57:21.200 --> 00:57:22.320
Amy, what do you think about that?

83624d4a-3440-45ad-a1a2-51353e5d9d9f-0
00:57:24.600 --> 00:57:25.480
Yes, I agree.

6e35f55b-675f-4f48-8bb5-66e77299217b-0
00:57:25.920 --> 00:57:29.765
If you were worried about students going
off and, and looking up the answer,

6e35f55b-675f-4f48-8bb5-66e77299217b-1
00:57:29.765 --> 00:57:33.760
the best way to get around that would be
to design questions that aren't easily

6e35f55b-675f-4f48-8bb5-66e77299217b-2
00:57:33.760 --> 00:57:34.160
Googled.

05dc75cd-063e-4139-a823-9d6dbc90edb6-0
00:57:36.160 --> 00:57:36.360
Yeah.

571a7ef2-6185-4bee-a0f5-71b4817968b1-0
00:57:36.640 --> 00:57:38.488
And Lorraine,
just to actually get back to the

571a7ef2-6185-4bee-a0f5-71b4817968b1-1
00:57:38.488 --> 00:57:41.320
asynchronous, synchronous thing, You know,
there's definitely concerns.

9c74c3eb-be03-4147-9313-5bccdfdb92b6-0
00:57:41.360 --> 00:57:43.679
You know,
if I know for the classes and the big EPI

9c74c3eb-be03-4147-9313-5bccdfdb92b6-1
00:57:43.679 --> 00:57:46.311
classes, they're like, no,
we really want students to take

9c74c3eb-be03-4147-9313-5bccdfdb92b6-2
00:57:46.311 --> 00:57:47.560
everything at the same time.

9170ddbf-2e1f-41b4-8d76-f29553ebbbcc-0
00:57:47.560 --> 00:57:50.600
So they can't share questions,
they can't share experiences.

ca5a2671-b976-4797-9f3a-5c686c5fc7ac-0
00:57:50.600 --> 00:57:51.400
We get that.

c6d29528-6ea2-414e-a1a9-c4bdd203a472-0
00:57:52.000 --> 00:57:56.890
What we've seen some classes do is offer
like an AM and APNM option where you

c6d29528-6ea2-414e-a1a9-c4bdd203a472-1
00:57:56.890 --> 00:58:00.778
would do 2 versions of the exam,
open it two different times,

c6d29528-6ea2-414e-a1a9-c4bdd203a472-2
00:58:00.778 --> 00:58:03.600
and then students could do one or the
other.

f2d334e1-4763-4b08-8303-93b275fcba84-0
00:58:03.600 --> 00:58:06.448
And then for those who are,
and you're absolutely right, I mean,

f2d334e1-4763-4b08-8303-93b275fcba84-1
00:58:06.448 --> 00:58:09.997
I'm the classes I'm teaching right now,
I have a bunch of students who are like,

f2d334e1-4763-4b08-8303-93b275fcba84-2
00:58:09.997 --> 00:58:12.013
look,
I can't meet the deadlines because I've

f2d334e1-4763-4b08-8303-93b275fcba84-3
00:58:12.013 --> 00:58:14.511
done 72 hour shifts at the hospital and I
just you know,

f2d334e1-4763-4b08-8303-93b275fcba84-4
00:58:14.511 --> 00:58:17.359
I'm struggling to do everything like
that's cool, turn in later.

69c5aadf-5944-418f-90a4-a34b105562a4-0
00:58:17.640 --> 00:58:21.966
The quiz generator does have the special
permissions features where you can say,

69c5aadf-5944-418f-90a4-a34b105562a4-1
00:58:21.966 --> 00:58:24.637
hey, Brian,
you can take the exam on Tuesday when

69c5aadf-5944-418f-90a4-a34b105562a4-2
00:58:24.637 --> 00:58:26.400
everyone else takes it on Monday.

be7b1ca1-c98b-4c2b-a4b5-01700d7b205a-0
00:58:26.440 --> 00:58:28.737
You know,
you tell me when it's going to be OK for

be7b1ca1-c98b-4c2b-a4b5-01700d7b205a-1
00:58:28.737 --> 00:58:30.720
you to do it and everyone else would do
it.

ba092112-4e13-400d-8e95-85e87b89da20-0
00:58:30.760 --> 00:58:33.536
You know,
Monday between 10 and noon or 10 and noon

ba092112-4e13-400d-8e95-85e87b89da20-1
00:58:33.536 --> 00:58:37.701
and 5:00 and 7:00 or whatever it is,
however you set it up so you can do some

ba092112-4e13-400d-8e95-85e87b89da20-2
00:58:37.701 --> 00:58:40.531
synchronous stuff,
but it is definitely a pretty big

ba092112-4e13-400d-8e95-85e87b89da20-3
00:58:40.531 --> 00:58:42.560
challenge right now for most students.

626c0c8d-7a49-4ace-91a4-37f0fa416780-0
00:58:42.760 --> 00:58:44.567
But if you feel the need for synchronous
stuff there,

626c0c8d-7a49-4ace-91a4-37f0fa416780-1
00:58:44.567 --> 00:58:45.840
there are ways of working around that.

98622a24-c906-4217-80de-143761cff325-0
00:58:48.400 --> 00:58:49.600
Thanks, helpful answers.

a89d8913-bd06-4359-b484-7e2583be4c97-0
00:58:50.080 --> 00:58:50.760
Great, and thank you.

fc839b6f-ce83-4900-8df6-a9cda68db473-0
00:58:50.800 --> 00:58:52.520
Oh,
there's one other thing I'd like to add.

b7f1be20-a243-43a8-bc58-457d83f01630-0
00:58:53.840 --> 00:58:57.560
Part of your question was open for book
versus closed book.

9e213a6b-d731-4903-8709-4612f49543bc-0
00:58:57.960 --> 00:59:02.338
And I know some faculty are very stern
about having things closed book,

9e213a6b-d731-4903-8709-4612f49543bc-1
00:59:02.338 --> 00:59:06.655
but unless there's a pedagogical reason
why, for example, if students,

9e213a6b-d731-4903-8709-4612f49543bc-2
00:59:06.655 --> 00:59:11.581
if you're preparing them for a major exam
or something and they need to memorize

9e213a6b-d731-4903-8709-4612f49543bc-3
00:59:11.581 --> 00:59:15.351
the content, then I've,
I've worked with a lot of faculty who

9e213a6b-d731-4903-8709-4612f49543bc-4
00:59:15.351 --> 00:59:17.480
just say, you know, this is online.

be84c174-b458-4632-884d-94e28b57f80c-0
00:59:17.480 --> 00:59:19.000
We live in a digital world.

2de36da7-c62d-4114-8a12-66f9736b9d9a-0
00:59:19.960 --> 00:59:23.927
Unless it's something that they
absolutely have to know as part of that

2de36da7-c62d-4114-8a12-66f9736b9d9a-1
00:59:23.927 --> 00:59:26.793
competency,
then they allow open book knowing that,

2de36da7-c62d-4114-8a12-66f9736b9d9a-2
00:59:26.793 --> 00:59:29.603
you know,
even even I Google things sometimes that

2de36da7-c62d-4114-8a12-66f9736b9d9a-3
00:59:29.603 --> 00:59:32.800
are pertaining to instructional design
and it might work.

a05dc38d-c1d1-4fff-987a-2c6147270d7d-0
00:59:32.800 --> 00:59:38.407
So it's up to you like what part of the
competency needs to be memorized versus,

a05dc38d-c1d1-4fff-987a-2c6147270d7d-1
00:59:38.407 --> 00:59:41.800
you know, mastery of skill,
if that makes sense.

5f42bd5d-2038-4d0e-a8cf-5c7958e516e5-0
00:59:42.600 --> 00:59:43.040
Fairpoint.

7700a564-3acf-4189-9aec-9e4426160f55-0
00:59:43.160 --> 00:59:43.520
Thank you.

5b16a88e-930c-4722-9577-9b3bc5f29bee-0
00:59:46.000 --> 00:59:49.040
Other questions,
concerns from anyone who's online.

438ca820-e374-4d1e-8715-7dc7ccbf83d1-0
00:59:54.400 --> 00:59:58.440
OK, well, again, CTL is here for you.

d565ce92-8514-41f6-8428-ed290703d637-0
00:59:58.440 --> 01:00:00.040
The instructional design team is here for
you.

4e75954e-3418-4b9e-a01a-2cb69b232ed9-0
01:00:00.080 --> 01:00:00.640
I'm here for you.

f6b5ba1b-b3af-4c12-a77e-7cedfe5cb2aa-0
01:00:00.640 --> 01:00:01.480
Even believe it or not.

bb4eb78e-aa59-4e3e-9dae-2edd31d2e456-0
01:00:02.320 --> 01:00:06.431
We will follow up with the folks who are
here today with you and just send out an

bb4eb78e-aa59-4e3e-9dae-2edd31d2e456-1
01:00:06.431 --> 01:00:09.240
e-mail that has links to the documents we
talked about.

59d29d2f-b28a-4919-9cbf-54d9254f9029-0
01:00:09.840 --> 01:00:14.091
There's a bunch of other resources that
have been put together that I just

59d29d2f-b28a-4919-9cbf-54d9254f9029-1
01:00:14.091 --> 01:00:18.172
stopped sharing my screen on, but around,
you know, academic integrity,

59d29d2f-b28a-4919-9cbf-54d9254f9029-2
01:00:18.172 --> 01:00:21.120
administering your exam,
setting up a time Dropbox.

f04747a1-d165-4962-b7e8-aa20d70af64e-0
01:00:21.120 --> 01:00:23.920
Celine, who was online,
did a great video guide to that.

5ac2d6bc-3f17-46f7-bb46-e77462cbc556-0
01:00:24.520 --> 01:00:26.440
And, and it's very, very useful.

445aa938-e185-46b3-a45d-d33fc1158b18-0
01:00:26.880 --> 01:00:30.960
There is also available to you in case
you are interested.

5dda95f1-0389-4f55-8195-d74b825b8747-0
01:00:31.520 --> 01:00:35.614
There is like a faculty sandbox course
plus site that anybody can get any

5dda95f1-0389-4f55-8195-d74b825b8747-1
01:00:35.614 --> 01:00:37.440
faculty member can get access to.

fcb32f86-8f3a-4d37-b2de-4c921f0c4d6a-0
01:00:37.640 --> 01:00:40.221
If you'd like access to that site just to
play around and be like,

fcb32f86-8f3a-4d37-b2de-4c921f0c4d6a-1
01:00:40.221 --> 01:00:43.342
I want to play around with how this might
work on my quiz or playing around with

fcb32f86-8f3a-4d37-b2de-4c921f0c4d6a-2
01:00:43.342 --> 01:00:46.040
different options and what this looks
like, you can contact CTL help.

5535bea5-223f-4670-906a-f717ae36c2f1-0
01:00:46.040 --> 01:00:51.058
We will gladly give you access to that
faculty sandbox site so you can play

5535bea5-223f-4670-906a-f717ae36c2f1-1
01:00:51.058 --> 01:00:54.360
around and not mess up your own core site
at all.

5cfc4719-12b3-42ec-a8d1-22fb44eec68b-0
01:00:54.840 --> 01:00:58.009
And that's going to be a really useful
tool, not just for the quiz generator,

5cfc4719-12b3-42ec-a8d1-22fb44eec68b-1
01:00:58.009 --> 01:01:00.000
not just for exams,
but for other tools as well.

d5b54a83-b286-4f59-8033-5b169e11821f-0
01:01:00.000 --> 01:01:03.316
So if you are interested in that,
just send an e-mail to CTL help saying,

d5b54a83-b286-4f59-8033-5b169e11821f-1
01:01:03.316 --> 01:01:06.320
hey, I heard about this faculty sandbox,
can I have access please?

a34cf259-c94d-4fb9-a83e-afaab76a9133-0
01:01:06.600 --> 01:01:07.680
And we'll get you hooked up with that.

341cac18-b7f2-4cec-8fff-c657d7a931f7-0
01:01:10.440 --> 01:01:10.960
OK.

6722a907-73f0-4fac-88c4-3a8aaf3b060f-0
01:01:11.320 --> 01:01:12.640
So I think that's it for us tonight.

0e31d7c1-fee8-4158-983e-cb339cf9e6e4-0
01:01:12.640 --> 01:01:13.360
Thank you all.

78ac8ac5-4067-477e-b556-804035f103b7-0
01:01:13.360 --> 01:01:14.840
Wash your hands, stay safe.

e11832fa-a57f-4227-93fb-6c4f632991b1-0
01:01:14.840 --> 01:01:16.880
Thank you for being here and
participating.

00fc2d17-8be3-46b2-a257-35e66a97b9b3-0
01:01:16.880 --> 01:01:17.960
Hopefully this was useful to you.

8ba0cf93-32d5-479d-8546-96e4cb40703a-0
01:01:17.960 --> 01:01:22.000
Thank you, Amy,
as always for your great contributions.

d46a3536-0843-467a-86ba-3acb63bbe278-0
01:01:22.000 --> 01:01:26.520
And we'll have a recording for the of
this up on the CTL Toolkit site as well.

05ca9358-4d02-4ec2-b262-4473efa3545a-0
01:01:27.120 --> 01:01:29.760
Maybe tomorrow, maybe the next day,
we'll see, but probably tomorrow.

b3ab3024-daa9-4550-93a6-8a3c84597333-0
01:01:30.360 --> 01:01:32.040
And again,
thanks for everyone for attending.

28db886e-d0a5-48f1-bdf8-5b3d70b523b0-0
01:01:32.040 --> 01:01:35.720
Stay safe and have a great rest of your
day wherever you are.

9392f967-663e-4c27-bdc9-ce24c43d6167-0
01:01:36.720 --> 01:01:37.120
Thank you.

32cb2914-bacc-4da4-b29d-0532591afcfd-0
01:01:40.120 --> 01:01:40.440
Thanks.