No, you can't use your book for the quiz: Comparing quiz scores with and without class materials

Submitted by Norma Jimenez Hernandez on
Duration
-
Abstract

I traditionally assess whether students are reading using a 10-question multiple choice quiz per chapter.  Students asked if they could use their notes and/or books.  I allowed students in my MWF PSY230 course to use their notes/books for the quizzes while those in the T TH  section were not allowed to do so.  I kept track of how long it took students to complete the quizzes and their average quiz scores over a ten week period.  Students who used their materials averaged 25 minutes to complete the quizzes while those that were not allowed to use their materials averaged only 12 minutes to complete the quizzes.  Moreover, students that were not allowed to reference their notes/books scored significantly higher on quizzes (M=80.77%, SD=13.51) compared to those that were allowed to use such materials (M=68.48%, SD=15.23), t(63)=2.34, p<.05.  Focus groups conducted at the end of the semester revealed that students who had access to notes/books became extremely reliant on the materials to look for the answers which took more time than they expected and strongly urged me to not let future classes user their books/notes on quizzes. I agree.

Completed Full Cycle
Yes
Course Number
PSY230
Assessment of the Month

Comments

Alison England Sun, 03/01/2015 - 3:17pm

Norma~

Very interesting!  Thank you so much for conducting this research!  I am always asking myself which is the better assessment, a quiz with or without notes.  I will take this input and run with it.  Excellent!

Alison England,

PSY 101, 240 adjunct

Peter Turner Sun, 03/22/2015 - 8:30am

Norma - excellent application of the action research cycle! I think your research will cause many, including myself, to reflect on their reading review techniques. And, by agreeing with your students, I assume this means you will now stick with the "no-access to book/notes" quiz technique. This is an excellent CATS!

Becky Baranowski Mon, 03/23/2015 - 2:31pm

As a former student....I did the same thing.  I didn't study as much for open notes/book exams.  

Bronwen Steele Tue, 03/24/2015 - 1:53pm

THANK YOU, THANK YOU, THANK YOU, we have found the same in science but did not measure the time factor. I really appreciate that you nailed this down with data.

Heather Muns Tue, 03/24/2015 - 2:04pm

I always find it interesting when people automatically assume that open book tests are easier.  Not true!  Students don't read ahead when they know the quiz will be open book.  They are much better prepared when they know they won't have access to the materials.  Thank you for documenting this.  

Rachel Smith Wed, 03/25/2015 - 1:13pm

This is great!!!  Well deserved CATS of the Month

Donna Perrigo Thu, 03/26/2015 - 1:25pm

This is wonderful information!!!  

Teri Graham Thu, 03/26/2015 - 1:28pm

Thank you for this wonderful and informative data.  It is nice to have data to support our instinctual decisions :-)

Anil Kapoor Fri, 03/27/2015 - 10:35am

Wow I cant belive the results great job Norma!!

Linda Benjamin Wed, 04/15/2015 - 9:38am

Thank you for the statistics on taking quizzes with or without the notes.  Many years ago, I had an instructor that did that but found out I did better without the notes brought to class. I wonder if there are statistics out there on students test scores by taking a group test in the semester without notes versus students taking the test alone with their notes or books.

Olga Tsoudis Fri, 04/17/2015 - 9:29pm

Norma, This is an excellent assessment on what we should do in the classroom. When I used to give exams, I allowed index cards with notes. Now I realize that was not the best idea for learning. :) Thanks for sharing!

Smiles, Olga

Kanina McDonald Mon, 04/20/2015 - 3:10pm

Thank you for presenting the data - I always tell my NUR students, "NCLEX does not let you take notecards." I have at times let them write down a formula for a quiz, but it does not improve their scores. Well done - Kanina

Rachel Holmes Mon, 04/20/2015 - 6:56pm

This is such a practical assessment that relates to many of us across departments.  Thank you for taking the time to share this because I really would have thought students would do better with resources had I not read your CATS.

Cheryl Gipson Thurman Thu, 04/30/2015 - 2:48pm

In reply to by Rachel Holmes

Wow!  This is very interesting to see what the results were using the two different methods of testing.  I have one class that I am thinking about changing around how I do testing in the class.  What you said was right on because the take home exam is not as easy as some students tend to believe and they do seem to do better with taking tests in class without their notes and books.  Thanks for sharing. 

Steven Melessa Fri, 11/13/2015 - 2:17pm

This CAT is excellent.  I am going to try this in my classes.