The Impact of Periodic Formative Assessments on Learning Through the Lens of the Complex Adaptive System and Social Sustainability Principles

Overview

Journal Cureus

Specialty Biomedical Engineering

Date 2023 Jul 31

PMID 37519482

Authors

Sanjukta Sahoo

Amit P Tirpude

Prabhas R Tripathy

Manisha R Gaikwad

Sanjay Giri

Affiliations

Soon will be listed here.

Abstract

Purpose: Medical institutions in India have employed different periodic formative assessment (FA) methods with variable impact. The formative evaluation must incorporate feedback to improve learning. Formative assessment has helped inexperienced students apprehend their weaknesses, make choices, prepare for summative exams, and allow teachers to identify regions wherein students may also need aid. This study attempts to quantify the impact of the weekly, monthly, and semester formative assessments and view it retrospectively through the lens of complex adaptive systems and social sustainability principles.

Methods: We used a post-exam survey and statistical analysis to compare the students' performance between the timely periodic formative assessments in a competency-based curriculum. The cohort consisted of 2018 (semester), 2019 (weekly), and 2020 (monthly) first-year medical students. Cronbach alpha, spearman's correlation coefficient, descriptive statistics, and repeated measure analysis of variance were used to explore the reliability and relationship between formative assessment and summative scores of each cohort and find any significant difference. The authors also analyzed the accordance between the FA exam performance and students' perceptions, deduced broad themes, and discussed the appropriateness and feasibility of students' suggestions for changes.

Results: A significant correlation was found only between the weekly formative assessment and summative scores (r=0.74, p=0.01). The analysis of variance established significant differences between all summative scores of respective periodic formative assessments. The weekly formative assessment showed the highest mean summative examination scores. This study helped comprehend preclinical students' apprehension after the intervention of periodic formative assessments. The students found this intervention helpful in driving and detecting gaps in learning but preferred focused feedback, clinically oriented practices, and countered mental health issues.

Conclusion: The continuous periodic formative assessment model had a valid educational impact but was not sustainable according to social sustainability principles. A complex adaptive framework can be utilized to make it sustainable.

References

Bauzon J, Alver A, Ravikumar V, Devera A, Mikhael T, Nauman R . The Impact of Educational Resources and Perceived Preparedness on Medical Education Performance. Med Sci Educ. 2021; 31(4):1319-1326. PMC: 8368717. DOI: 10.1007/s40670-021-01306-x. View

Woodruff J . Accounting for complexity in medical education: a model of adaptive behaviour in medicine. Med Educ. 2019; 53(9):861-873. DOI: 10.1111/medu.13905. View

Machado M, Ribeiro D, de Carvalho Filho M . Social justice in medical education: inclusion is not enough-it's just the first step. Perspect Med Educ. 2022; 11(4):187-195. PMC: 9391538. DOI: 10.1007/s40037-022-00715-x. View

Keshavarz N, Nutbeam D, Rowling L, Khavarpour F . Schools as social complex adaptive systems: a new way to understand the challenges of introducing the health promoting schools concept. Soc Sci Med. 2010; 70(10):1467-74. DOI: 10.1016/j.socscimed.2010.01.034. View

Santra R, Pramanik S, Mandal A, Sengupta P, Das N, Raychaudhuri P . A Study on the Performance of Medical Students in Internal Assessment and its Correlates to Final Examinations of 2(nd) MBBS Pharmacology Curriculum in a Medical College of Eastern India. J Clin Diagn Res. 2015; 8(12):HC01-2. PMC: 4316270. DOI: 10.7860/JCDR/2014/8318.5227. View

Hashmat S, Hashmat M, Amanullah F, Aziz S . Factors causing exam anxiety in medical students. J Pak Med Assoc. 2008; 58(4):167-70. View

Matheson A, Dew K, Cumming J . Complexity, evaluation and the effectiveness of community-based interventions to reduce health inequalities. Health Promot J Austr. 2009; 20(3):221-6. DOI: 10.1071/he09221. View

Cockett A, Jackson C . The use of assessment rubrics to enhance feedback in higher education: An integrative literature review. Nurse Educ Today. 2018; 69:8-13. DOI: 10.1016/j.nedt.2018.06.022. View

Rauf A, Shamim M, Aly S, Chundrigar T, Alam S . Formative assessment in undergraduate medical education: concept, implementation and hurdles. J Pak Med Assoc. 2014; 64(1):72-5. View

10.

Norcini J, Anderson M, Bollela V, Burch V, Costa M, Duvivier R . 2018 Consensus framework for good assessment. Med Teach. 2018; 40(11):1102-1109. DOI: 10.1080/0142159X.2018.1500016. View

11.

Parboteeah S, Anwar M . Thematic analysis of written assignment feedback: implications for nurse education. Nurse Educ Today. 2009; 29(7):753-7. DOI: 10.1016/j.nedt.2009.02.017. View

12.

Anderson R, Issel L, McDaniel Jr R . Nursing homes as complex adaptive systems: relationship between management practice and resident outcomes. Nurs Res. 2003; 52(1):12-21. PMC: 1993902. DOI: 10.1097/00006199-200301000-00003. View

13.

Agius N, Wilkinson A . Students' and teachers' views of written feedback at undergraduate level: a literature review. Nurse Educ Today. 2013; 34(4):552-9. DOI: 10.1016/j.nedt.2013.07.005. View

14.

Duffield K, Spencer J . A survey of medical students' views about the purposes and fairness of assessment. Med Educ. 2002; 36(9):879-86. DOI: 10.1046/j.1365-2923.2002.01291.x. View

15.

Harris P, Snell L, Talbot M, Harden R . Competency-based medical education: implications for undergraduate programs. Med Teach. 2010; 32(8):646-50. DOI: 10.3109/0142159X.2010.500703. View

16.

Singh T, Anshu , Modi J . The quarter model: a proposed approach for intraining assessment of undergraduate students in Indian medical schools. Indian Pediatr. 2012; 49(11):871-6. DOI: 10.1007/s13312-012-0215-1. View

17.

Mash B, Mayers P, Conradie H, Orayn A, Kuiper M, Marais J . How to manage organisational change and create practice teams: experiences of a South African primary care health centre. Educ Health (Abingdon). 2008; 21(2):132. View