- 3,306
- 2,529
Andy Resnick said:Applying a metric developed in the context of a homogeneous self-selected group to a broad heterogenous population is questionable.
There is tremendous diversity among Air Force Academy cadets. Much more than in the high schools (and districts) I have taught at or attended. Your assumption of homogeneity is not just questionable, it is WRONG.
Your assumption of self-selected is somewhat true, as all the cadets chose to be at the Air Force Academy. However, many would not choose to be in Calculus or Physics.
But maybe one of the problems with public schooling is that students do not choose to be there. Teaching is much more likely to be effective if students at least care about being in (and staying in) the school, if not the specific class.
I've also used the second basic metric (how students earning a given grade in one course performed in downstream courses for which that course was a pre-requisite) to analyze data from a number of additional institutions. It may not be a perfect approach, but it is one of the best available options for assessing teaching effectiveness. If students from a given Calc 1 instructor are having a much greater problem passing Calc 2 than students from other instructors, there is a problem. Likewise, nothing like a good Algebra-based Physics class to gauge the effectiveness of the Algebra pre-requisites.
Peer-evaluations can be valuable also. But the ultimate peer evaluation (for applicable courses) should be from the teachers of downstream students judging their competence in pre-requisite material.