Evaluator Competencies: A Global Validation with Local Implications
Darlene-Russ-Eft & Robin Yap
Darlene gave the background of their presentation, that was supported by ibstpi
Robin explained ibstpi. It has 15 directors and, while based in the US, it is international. It is a non-profit organization. they have developed four books of competencies:
- Online training and teaching
- Instructional design
- Training manager
- Instructor
There are a number of organizations that have guidelines and they are often around evaluation programs that are around the large governmental agencies. ibstpi tried to look specifically at organizations and how these relate on that level.
Their call for these competencies are since executives are increasingly asked to evaluate their success, and teachers are asked, as well as funding agencies.
There is a little empirical base that is international in scope -- thus, ibstpi's work. The literature base does not necessarily reflect the work of those working in the field.
They then asked 11 international experts in evaluation, and 10 of them responded. They had 470 evaluator responses, and while most of them were from the US and Canada, this was the first time (as Darlene claimed) that a global evaluation survey and research was done.
QUESTION from me -- what do you mean by an "Evaluator?"
The lowest rated results include a demonstration of the awareness of the politics of evaluation and the pilot test data. The most significant differences include collect data & analyze and interpret data. Thus, the people who are in evaluator roles are people who manage the evaluation function, and other people are doing the data analysis and evaluation itself.
A number of useful areas for future research (see the photo I took on Flickr).
What does this all mean? This could be used by evaluators for professional development. Also, can be used to enhance the quality of the ir own academic offerings.
Questions by the audience -- do the specific competencies have different meaning in different domains? They were not interested in the government areas of policies evaluation.
Question from me -- your use of the term "evaluator" seems to imply people who have that as their title, and does this perhaps affect the respondents?
Technorati Tags: Darlene-Russ-Eft, Robin Yap, ibstpi