This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Tourmen, C. Search for Related Content Social Bookmarking                         What's this?

Evaluators' Decision Making

The Relationship Between Theory, Practice, and Experience

National Institute of Higher Education in Agronomy, Dijon, France, claire.tourmen{at}educagri.fr

How do evaluation practitioners make choices when they evaluate a program? What function do evaluation theories play in practice? In this article, I report on an exploratory study that examined evaluation practices in France. The research began with observations of practitioners' activities, with a particular focus on the phases of evaluation design. The purpose of the study was to examine the logic underlying their choices and the role that evaluation theory played in those choices. In this study, I used activity theory and ergonomics methods. I highlight various ways in which working evaluators make evaluation choices in real situations, explained by different sets of conceptual resources they hold related to their level of experience. Finally, I show how this research contributes toward clarifying the role of theories in practice and enriching an evaluation theory

Key Words: evaluation theory • evaluation practice • situated decision making • skills • training

References

• Alkin, M.C. (2004). Evaluation roots. Thousand Oaks, CA: Sage.
• Alkin, M.C., & Christie, C.A. (2004). An evaluation theory tree revisited. In M. C. Alkin (Ed.), Evaluation roots. Thousand Oaks, CA: Sage.
• Barbier, J.M. (1985). L'évaluation en formation. Paris: PUF.
• Bonniol, J.J. (1981). Déterminants et mécanismes des comportements d'évaluation d'épreuves scolaires. Thèse de Doctorat es Lettres et Sciences Humaines, Bordeaux, 1981.
• Bruner, J.S. (1990). Acts of meaning. Harvard: Harvard University Press.
• Caroli, S., & Weill-Fassina, A. (2007). En quoi différentes approches de l'activité collective des relations de services interrogent la pluralité des modèles de l'activité en ergonomie. Activités, 4, 85-98.
• Chen, T.H. (1990). Theory-driven evaluations. Newbury Park: Sage.
• Chi, T.H., Glaser, R., & Farr, M.J. (1988). The nature of expertise. Hillsdale: Laurence Erlbaum associates.
• Christie, C.A. (2003). What guides evaluation? A study of evaluation practice maps onto evaluation theory. In C. A. Christie (Ed.), The practice-theory relationship in evaluation. New directions for evaluation Vol 97 (pp. 7-35). San Francisco: Jossey-Bass.
• Christie, C.A., & Rose, M. (2003). Learning about evaluation through dialogue: Lessons from an informal discussion group. American Journal of Evaluation, 24, 235-243.[Abstract]
• Demailly, L. (2001). Evaluer les politiques éducatives. Bruxelles: De Boeck.
• Donaldson, S.I., & Lipsey, M.W. (2008). Roles for theory in contemporary evaluation practice: Developing practical knowledge. In I. Shaw, J. Greene, & M. Mark (Eds.), Handbook of evaluation. London: Sage.
• Dreyfus, M.L., Dreyfus, S.E., & Athanasiou, T. (1986). Mind over machine the power of human intuition and expertise in the era of the computer. New York: The Free Press.
• English, B. (2002). Competencies for evaluation practitioners: where to from here? Journal of the Australasian Evaluation Society, 2, 13-15.
• Fetterman, D.M., Kaftarian, S.J., & Wandersman, A. (1996). Empowerment evaluation. Knowledge and tools for self-assessment and accountability. Thousand Oaks, CA: Sage publications.
• Fitzpatrick, J.L. (2004). Exemplars as case studies: Reflections on the link between theory, practice and context. American Journal of Evaluation, 25, 541-559.[Abstract]
• Fitzpatrick, J.L., Christie, T.A., & Mark, M.M. (2008). Evaluation in action: Interviews with Expert Evaluators. Thousand Oaks, CA: Sage.
• Flyvbjerg, B., & Sampson, B. (2001). Making social science matter: why social inquiry fails and how it can succeed again. Cambridge: Cambridge University Press.
• Furubo, J.E., Rist, R.C., & Sandhahl, R. (2002). International atlas of evaluation. New Jersey: Transaction Publishers.
• Guba, E.G., & Lincoln, Y.S. (1989). Fourth generation evaluation. NewburyPark: Sage Publications.
• Hadji, C. (1989). L'évaluation, règles dujeu. Paris: ESF.
• King, J.A., Stevahn, L., Ghere, G., & Minnema, J. (2001). Toward a taxonomy of essential evaluator competencies. American Journal of Evaluation, 22, 233-235.
• Kishchuck, N., & Long, B. (1997). Rapport sur la certification professionnelle. Canada: Rapport au bureau de la SCE.
• Lave, J., & Wenger, E. (1990). Situated learning: Legitimate periperal participation. Cambridge, UK: Cambridge University Press.
• Levin-Rozalis, M., & Rosenstein, B. (2003). A mentoring approach to the one year evaluation course. American Journal of Evaluation, 24, 245-259.[Abstract]
• McGuire, M., Zorzi, R., & Perrin, B. (2002). Projet de la société canadienne d'évaluation à l'appui de la défense des intérêts et du perfectionnement professionnel, Societé Canadienne d'Evaluation. http://www.evaluation.francophonie.org.
• Mertens, D. (1994). Training evaluators: unique skills and knowledge. New Directions in Program Evaluation, 62, 17-27.
• Nadeau, M.A. (1988). L'évaluation de programme, théorie et pratique. Québec: Ed. Les Presses de l'Université Laval.
• P, Pastré. (2002). L'analyse du travail en didactique professionnelle. Revue Française de Pédagogie, 138, 9-17.
• P. Pastré., Mayen, P., & Vergnaud, G. (2006). Note de synthèse sur la didactique professionnelle. Revue Française de Pédagogie, 154, 145-198.
• Patton, M.Q. (1986). Utilization focused evaluation (2nd ed.). California: Sage.
• Piaget, J. (1955). The child's construction of reality. London: Routledge and Kegan Paul.
• Rodrigues, P. (2002). Avaliaçao da formaçao pelos participantes em entrevista de investigacao. Porto: Fundaçao Calouste Gulbenkian.
• Schön, D.A. (1983). The reflective practitioner: How professionals think in action. New York, NY: Basic Books.
• Schwandt, T. (2007). The role of practical knowledge in learning. Paper delivered at the 21st Annual Conference of the American Evaluation Association, ``Learning to evaluate, evaluating to learn.'' Baltimore, 11/08/2007.
• Shadish, W.R., Cook, T.D., & Leviton, L.C. (1991). Foundations of program evaluation theories of practice. Newbury Park: Sage publications.
• Stufflebeam, D. (1980). L'évaluation en éducation et la prise de décision. Ottawa: NHP.
• Torres, R., Preskill, H.S., & Piontek, M.E. (1996). Evaluation strategies for communicating and reporting: Enhancing learning in organisations. Thousand Oaks, CA: Sage.
• Tourmen, C., & Figari, G. (2006). La référentialisation: une façon de modéliser l'évaluation de programme, entre théorie et pratique. Vers une comparaison des approches en France et au Québec. Mesure et Evaluation en Education, 29, 5-25.
• Tourmen, C., & Toulemonde, J. (2005). Comment former à évaluer? Quelques apports de la didactique professionnelle. Education Permanente, 165, 87-99.
• Trevisan, M.S. (2004). Practical training in evaluation: a review of the literature. American Journal of Evaluation, 25, 255-272.[Abstract]
• Vergnaud, G. (1989). Learn mathematics? In Vergnaud. G, Rogalski. J, & Artique. M (Eds.), Proceedings of the 13th International Conference for the psychology of Mathematics Education. Paris: International Group for the Psychology of Mathematics Education.
• Vergnaud, G. (1990). La théorie des champs conceptuels. Recherches en didactique des mathématiques, 10, 133-170.
• Vergnaud, G. (2001, May). Forme prédicative et forme opératoire de la connaissance. In Jean Portugais (Ed.), Actes du Colloque GDM 2001 La notion de compétence en enseignement des mathématiques, analyse didactique des effets de son introduction sur les pratiques de la formation,, Montréal.
• Vermersch, P. (1996). L'entretien d'explicitation en formation initiale et en formation continue. Paris: Esf.
• Vincenti, W.G. (1990). What engineers know and how they know it. Baltimore: John Hopkins.
• Vygotsky, L.S. (1962). Thought and language. Cambridge, MA: MIT Press (Original work published 1934).
• Worthen, B.R. (1994). Is evaluation a mature profession that warrants the preparation of evaluation professionals? New Direction for Program Evaluation, 62, 3-15.

American Journal of Evaluation, Vol. 30, No. 1, 7-30 (2009)
DOI: 10.1177/1098214008327602


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Tourmen, C. Search for Related Content Social Bookmarking                         What's this?