quarta-feira, 5 de janeiro de 2011

Can Score Databanks Help Teaching?



Mendonca VRR, Andrade BB, Almeida A, Barral-Netto M (2011) 
Can Score Databanks Help Teaching? 
PLoS ONE 6(1): e15695. 
doi:10.1371/ journal.pone.0015695
Veja o artigo completo aqui

Abstract
Background
Basic courses in most medical schools assess students' performance by conferring scores. The objective of this work is to use a large score databank for the early identification of students with low performance and to identify course trends based on the mean of students' grades.
Methodology/Principal Findings
We studied scores from 2,398 medical students registered in courses over a period of 10 years. Students in the first semester were grouped into those whose ratings remained in the lower quartile in two or more courses (low-performance) and students who had up to one course in the lower quartile (high-performance). ROC curves were built, aimed at the identification of a cut-off average score in the first semesters that would be able to predict low performances in future semesters. Moreover, to follow the long-term pattern of each course, the mean of all scores conferred in a semester was compared to the overall course mean obtained by averaging 10 years of data. Individuals in the low-performance group had a higher risk of being in the lower quartile of at least one course in the second semester (relative risk 3.907; 95% CI: 3.378–4.519) and in the eighth semester (relative risk 2.873; 95% CI: 2.495–3.308). The prediction analysis revealed that an average score of 7.188 in the first semester could identify students that presented scores below the lower quartiles in both the second and eighth semesters (p<0.0001 for both AUC). When scores conferred by single courses were compared over time, three time-trend patterns emerged: low variation, upward trend and erratic pattern.
Conclusion/Significance
An early identification of students with low performance may be useful in promoting pedagogical strategies for these individuals. Evaluation of the time trend of scores conferred by courses may help departments monitoring changes in personnel and methodology that may affect a student's performance.

2 comentários:

  1. Melhor então reprovar todos com nota abaixo de 7? =)
    E qual a capacidade do score de prever o sucesso profissional? Seria interessante comparar com empregabilidade e renda após a formatura!
    Abraço e parabéns!

    ResponderExcluir
  2. Cara Theolis,
    A idéia foi justamente de não reprovar todos com nota abaixo de 7 e sim identifica-los cedo para que possam receber atenção especial que vise melhorar o desempenho.
    A relação entre desempenho no curso médico e desempenho profissional é difícil de avaliar. Pensamos nisto, mas não temos a identificação individual dos participantes com possibilidade de uso externo. Sabemos apenas tratar-se do mesmo indivíduo em todo banco (identificação interna). Para correlacionar com algo exterior precisaríamos identificação com validade externa (CPF, e.g.). É uma tarefa muito grande contatar cada um dos indivíduos para obter a autorização.

    ResponderExcluir