Cumulative assessment: Does it improve students’ knowledge acquisition and retention?
DOI:
https://doi.org/10.15448/1980-6108.2018.4.31880Keywords:
educational assessment, Progress Testing, Undergraduate medical training, medical education.Abstract
AIMS: Cumulative assessment has been used as a tool to steer students’ study behavior, since it increases students’ self-study time while spreading their study time more evenly throughout the span of the course. However, little is known about the impact of cumulative assessment on students’ knowledge growth. Therefore, our study compared the growth of knowledge of students who attended a course with cumulative assessment with those with end-of-course assessment. We hypothesized that students in the cumulative assessment condition would have a higher increase in knowledge compared to students in the end-of-course assessment condition.
METHODS: This is a follow-up study of a previous randomized experiment that compared students’ performance between students who attended a course with cumulative assessment with those with end-of-course assessment. We gathered data of the first four subsequent Dutch interuniversity progress test after the experiment from 62 students. Of those, 37 students were in the end-of-course assessment condition and 25 were in the cumulative assessment condition. The questions were classified as part of the teaching block or not. To analyze students’ knowledge growth, we conducted a General Linear Model.
RESULTS: Our results demonstrated that there was a significant increase in students’ knowledge of the four subsequent progress tests. Additionally, our general linear model showed no difference between both groups, indicating that cumulative assessment and end-of-course assessment produced similar outcomes when comparing students’ knowledge growth.
CONCLUSIONS: So far, little evidence has supported the use of cumulative assessment as a tool for increasing students’ knowledge growth. The lack of finding a positive effect of cumulative assessment on knowledge retention may be explained by the repetitive character of our (spiral) curriculum.
Downloads
References
Semb GB, Ellis JA. Knowledge taught in school: What is remembered? Rev Educ Res. 1994;64(2):253-86. https://doi.org/10.3102/00346543064002253
Karpicke JD, Roediger HL. The critical importance of retrieval for learning. Science. 2008;319(5865):966-8. https://doi.org/10.1126/science.1152408
Dunlosky J, Rawson KA, Marsh EJ, Nathan MJ, Willingham DT. Improving students' learning with effective learning techniques: promising directions from cognitive and educational psychology. Psychol Sci Public Interest. 2013;14(1):4-58. https://doi.org/10.1177/1529100612453266
Ebbinghaus H. Memory: A contribution to experimental psychology (translation by H. A. Ruger, C. E. Bussenius). New York: Dover; 1964. (Reprint of book published in 1913, New York: Columbia University. Original work published in 1885, Leipzig: Duncker and Humblot.)
Roediger HL 3rd, Karpicke JD. The power of testing memory: Basic research and implications for educational practice. Perspect Psychol Sci. 2006;1(3):181-210. https://doi.org/10.1111/j.1745-6916.2006.00012.x
Larsen DP, Butler AC, Roediger HL. Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial. Med Educ. 2009;43(12):1174-81. https://doi.org/10.1111/j.1365-2923.2009.03518.x
Bekkink MO, Donders R, van Muijen GN, Ruiter DJ. Challenging medical students with an interim assessment: a positive effect on formal examination score in a randomized controlled study. Adv Health Sci Educ. 2012;17(1):27-37. https://doi.org/10.1007/s10459-011-9291-6
Custers EJ. Long-term retention of basic science knowledge: a review study. Adv Health Sci Educ. 2010;15(1):109-28. https://doi.org/10.1007/s10459-008-9101-y
Carpenter SK, Cepeda NJ, Rohrer D, Kang SHK, Pashler H. Using Spacing to Enhance Diverse Forms of Learning: Review of Recent Research and Implications for Instruction. Rev Educ Res. 2012;24(3):369-78. https://doi.org/10.1007/s10648-012-9205-z
Cepeda N, Pashler H, Vul E, Wixted J, Rohrer D. Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychol Bull. 2006;132(3):354-80. https://doi.org/10.1037/0033-2909.132.3.354
Dempster FN. The spacing effect: A case study in the failure to apply the results of psychological research. Am Psychol. 1988;43(8):627-34. https://doi.org/10.1037/0003-066X.43.8.627
Dempster FN. Effects of variable encoding and spaced presentations on vocabulary learning. J Educ Psychol. 1987;79(2):162-70. https://doi.org/10.1037/0022-0663.79.2.162
Bjork RA, Allen TW. The spacing effect: Consolidation or differential encoding? J Verbal Learn Verbal Behav. 1970;9:567-72. https://doi.org/10.1016/S0022-5371(70)80103-7
Kerfoot BP, DeWolf WC, Masser BA, Church PA, Federman DD. Spaced education improves the retention of clinical knowledge by medical students: a randomised controlled trial. Med Educ. 2007;41(1):23-31. https://doi.org/10.1111/j.1365-2929.2006.02644.x
Kerfoot BP, Fu Y, Baker H, Connelly D, Ritchey ML, Genega EM. Online spaced education generates transfer and improves long-term retention of diagnostic skills: a randomized controlled trial. J Am Coll Surg. 2010;211(3):331-7. https://doi.org/10.1016/j.jamcollsurg.2010.04.023
Yeh DD, Park YS. Improving learning efficiency of factual knowledge in medical education. J Surg Educ. 2015;72(5):882-9. https://doi.org/10.1016/j.jsurg.2015.03.012
Raman M, Mclaughlin K, Violato C, Rostom A, Allard J, Coderre S. Teaching in small portions dispersed over time enhances long-term knowledge retention. Med Teach. 2010;32(3):250-5. https://doi.org/10.3109/01421590903197019
Hintzman DL. Recognition time: Effects of recency, frequency and the spacing of repetitions. J Exp Psychol. 1969;79(1p1):192-4.
Glenberg AM. Monotonic and nonmonotonic lag effects in paired-associate and recognition memory paradigms. J Mem Lang. 1976;15(1):1-16. https://doi.org/10.1016/S0022-5371(76)90002-5
Delaney PF, Verkoeijen PP, Spirgel A. Spacing and testing effects: A deeply critical, lengthy, and at times discursive review of the literature. Psychol Learn Motiv. 2010;53:63-147. https://doi.org/10.1016/S0079-7421(10)53003-2
Carpenter SK. Testing Enhances the Transfer of Learning. Curr Dir Psychol Sci. 2012;21(5):279-83. https://doi.org/10.1177/0963721412452728
McDaniel MA, Fisher RP. Tests and test feedback as learning sources. Contemp Educ Psychol. 1991;16(2):192-201. https://doi.org/10.1016/0361-476X(91)90037-L
Roediger HL, Karpicke JD. Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention. Psychol Sci. 2006;17(3):249-55.
https://doi.org/10.1111/j.1467-9280.2006.01693.x
Roediger HL, Putnam AL, Smith MA. Ten benefits of testing and their applications to educational practice. Psychol Learn Motiv. 2011;44:1-36. https://doi.org/10.1016/B978-0-12-387691-1.00001-6
Rawson KA, Dunlosky J. Optimizing schedules of retrieval practice for durable and efficient learning: How much is enough? J Exp Psychol Gen. 2011;140(3):283-302. https://doi.org/10.1037/a0023956
Kerdijk W, Cohen-Schotanus J, Mulder BF, Muntinghe FL, Tio RA. Cumulative versus end-of-course assessment: effects on self-study time and test performance. Med Educ. 2015;49(7):709-16. https://doi.org/10.1111/medu.12756
Agarwal PK, Karpicke JD, Kang SH, Roediger HL, McDermott KB. Examining the testing effect with open-and-closed book tests. Appl Cogn Psychol. 2008;22(7):861-76. https://doi.org/10.1002/acp.1391
Metcalfe J, Kornell N, Finn B. Delayed versus immediate feedback in children's and adults' vocabulary learning. Mem Cognit. 2009;37(8):1077-87. https://doi.org/10.3758/MC.37.8.1077
Carpenter SK, Delosh EL. Application of the Testing and Spacing Effects to Name Learning. Appl Cogn Psychol. 2005;636:619-36. https://doi.org/10.1002/acp.1101
Carrier M, Pashler H. The influence of retrieval on retention. Mem Cognit. 1992;20(6):633-42. https://doi.org/10.3758/BF03202713
Day IN, van Blankenstein FM, Westenberg M, Admiraal W. A review of the characteristics of intermediate assessment and their relationship with student grades. Assess Eval High Educ. 2018;43(6):908-29. https://doi.org/10.1080/02602938.2017.1417974
Kerdijk W, Tio RA, Mulder BF, Cohen-Schotanus J. Cumulative assessment: strategic choices to influence students' study effort. BMC Med Educ. 2013;13(1):172. https://doi.org/10.1186/1472-6920-13-172
Tio RA, Schutte B, Meiboom AA, Greidanus J, Dubois EA, Bremers AJ. The progress test of medicine: the Dutch experience. Perspect Med Educ. 2016;5(1):51-5. https://doi.org/10.1007/s40037-015-0237-1
Cecilio-Fernandes D, Cohen-Schotanus J, Tio RA. Assessment programs to enhance learning. Phys Ther Rev. 2018;23(1): 17-20. https://doi.org/10.1080/10833196.2017.1341143
Cecilio-Fernandes D, Aalders WS, Bremers AJ, Tio RA, de Vries J. The Impact of Curriculum Design in the Acquisition of Knowledge of Oncology: Comparison Among Four Medical Schools. J Cancer Educ. 2018;33(5):1110-4. https://doi.org/10.1007/s13187-017-1219-2
Cecilio-Fernandes D, Aalders WS, de Vries J, Tio RA. The Impact of Massed and Spaced-Out Curriculum in Oncology Knowledge Acquisition. J Cancer Educ. 2018;33(4):922-5. https://doi.org/10.1007/s13187-017-1190-y
Schmidt HG, Van der Molen, Henk T, Te Winkel WW, Wijnen WH. Constructivist, problem-based learning does work: A meta-analysis of curricular comparisons involving a single medical school. Educ Psychol. 2009;44(4):227-49. https://doi.org/10.1080/00461520903213592
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2018 Scientia Medica
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright
The submission of originals to Scientia Medica implies the transfer by the authors of the right for publication. Authors retain copyright and grant the journal right of first publication. If the authors wish to include the same data into another publication, they must cite Scientia Medica as the site of original publication.
Creative Commons License
Except where otherwise specified, material published in this journal is licensed under a Creative Commons Attribution 4.0 International license, which allows unrestricted use, distribution and reproduction in any medium, provided the original publication is correctly cited.
