Two teachers independently assess the same set of
students' oral performances using an analytic rubric.
Their scores are similar for grammatical accuracy and
vocabulary but consistently diverge on the criterion
"interactional effectiveness". The school wants to improve
score consistency without removing interaction from the
construct being assessed.
Which procedure is appropriate?

Question

Two teachers independently assess the same set of
students' oral performances using an analytic rubric.
Their scores are similar for grammatical accuracy and
vocabulary but consistently diverge on the criterion
"interactional effectiveness". The school wants to improve
score consistency without removing interaction from the
construct being assessed.
Which procedure is appropriate? Alternativa A: Assign all oral assessments to one teacher so that
differences between raters no longer influence the
scores produced by the school. Ou Alternativa B: Refine the descriptors for interactional effectiveness,
conduct rater calibration with sample performances
and independently rescore comparable responses. Ou Alternativa C: Replace the analytic rubric with a grammar test
because objectively scored items provide greater
reliability than judgments of spoken performance. Ou Alternativa D: Maintain the rubric unchanged and average the two
teachers' scores, since mathematical combination
resolves differences in criterion interpretation.  Ou Alternativa E: Remove interactional effectiveness from the rubric
and calculate final scores exclusively from criteria
that already produce greater agreement.

Instituto de Apoio à Gestão Educacional · Accepted Answer

Alternativa [B] Refine the descriptors for interactional effectiveness,
conduct rater calibration with sample performances
and independently rescore comparable responses.

Two teachers independently assess the same set of students'...

Questões de assuntos semelhantes

Provas relacionadas