Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

CiteULike is a free service for managing and discovering scholarly references - click here to get started.

Sign In to gain access to subscriptions and/or personal tools.
American Journal of Evaluation
This Article
Right arrow Abstract Freely available
Right arrow Free Full Text (Free PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Smits, P. A.
Right arrow Articles by Champagne, F.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

An Assessment of the Theoretical Underpinnings of Practical Participatory Evaluation

Pernelle A. Smits

University of Montréal, Québec, Canada, pernelle.smits{at}umontreal.ca

Francois Champagne

University of Montréal, Québec, Canada

This article is concerned with the underpinnings of practical participatory evaluation (PPE). Evaluation approaches have long been criticized because their results are often not used. It is believed that PPE addresses this drawback. The article focuses on the mechanisms underlying the links between activities and consequences in PPE. A PPE theory is proposed, based on learning theories and knowledge transfer theories, which comprises four key concepts and three hypotheses. The key concepts are interactive data production, knowledge coconstruction, local context of action, and instrumental use. The hypotheses articulate the relationships between these concepts. The article provides theoretical and empirical evidence to support the hypotheses discussed and present a framework for the proposed PPE theory. The importance of practitioner knowledge and participation in the PPE process in enhancing the use of results is partially supported by the literature. In general, it seems that the support is more theoretical than empirical.

Key Words: participatory evaluation • rationale • learning theory • knowledge transfer theory

References

  • Amsden, J., & VanWynsberghe, R. (2005). Community mapping as a research tool with youth. Action Research, 3, 357-381.[Abstract/Free Full Text]
  • Argyris, C. (1998). Empowerment: The emperor's new clothes. Harvard Business Review, 76(3), 98-105.[Web of Science][Medline] [Order article via Infotrieve]
  • Backer, T.E. (1991). Knowledge utilization: The third wave. Science Communication, 12, 225-240.[Abstract]
  • Baker, A., & Bruner, B. (2006). Evaluation capacity and evaluative thinking in organizations (Vol. 60). Cambridge, MA: Bruner Foundation Inc.
  • Bamberger, M., Rugh, J., & Mabry, L. (2006). Real world evaluation: Working under budget, time, data, and political constraints. Thousand Oaks, CA: Sage.
  • Beere, D. (2005). Evaluation capacity-building: A tale of value-adding. Evaluation Journal of Australasia, 5(2), 41-47.
  • Boggs, J.P. (1992). Implicit models of social knowledge use. Science Communication, 14, 29-62.[Abstract]
  • Bowen, S., & Martens, P.J. (2006). A model for collaborative evaluation of university-community partnerships. Journal of Epidemiology and Community Health, 60, 902-907.[Abstract/Free Full Text]
  • Bradley, J.E., Mayfield, M.V., Mehta, M.P., & Rukonge, A. (2002). Participatory evaluation of reproductive health care quality in developing countries. Social Science and Medicine, 55, 269-282.[CrossRef]
  • Brisolara, S. (1998). The history of participatory evaluation and current debates in the field. In E. Whitmore (Ed.), New directions for evaluation understanding and practicing participatory evaluation (Vol. 80). San Francisco: Jossey-Bass.
  • Caracelli, V.J. (2000). Evaluation use at the threshold of the twenty-first century. In V. Caracelli & H. Preskill (Eds.), New directions for evaluation (Vol. 88, pp. 99-111). San Francisco: Jossey-Bass.
  • Champagne, F., Contandriopoulos, A.-P., & Tanon, A. (2004). A program evaluation perspective on processes, practices, and decision-makers. In L. Lemieux-Charles & F. Champagne (Eds.), Using knowledge and evidence in health care: Multidisciplinary perspectives (pp. 139-171). Toronto, Ontario, Canada: University of Toronto Press.
  • Conner, R.F. (1998). Toward a social ecological view of evaluation use. American Journal of Evaluation, 19, 237-241.[Web of Science]
  • Cousins, J.B. (2001). Participatory evaluation up close. Retrieved July 20, 2007, from www.sqep.ca/archives/presentations/Cousinsb_colsqep01.pdf
  • Cousins, J.B., Clark, S., Goh, S., & Lee, L. (2005). Evaluative inquiry: Is it worth the effort? Education Canada, 45(1), 27-29.
  • Cousins, J.B., & Earl, L.M. (1992). The case for participatory evaluation. Educational Evaluation and Policy Analysis, 14, 397-418.[Abstract/Free Full Text]
  • Cousins, J.B., Goh, S., Clark, S., & Lee, L. (2004). Integrating evaluative inquiry into the organizational culture: A review and synthesis of the knowledge base. Canadian Journal of Program Evaluation, 19(2), 99-141.
  • Cousins, J.B., & Leithwood, K. (1993). Enhancing knowledge utilization as a strategy for school improvement. Knowledge: Creation, Diffusion, Utilization, 14, 305-333.[Web of Science]
  • Cousins, J.B., & Whitmore E. (1998). Framing participatory evaluation in Understanding and practicing participatory evaluation. In E. Whitemore (Ed.), New directions for evaluation (Vol. 80, pp. 5-23). San Francisco: Jossey-Bass.
  • de Lancer Julnes, P., & Holzer, M. (2001). Promoting the utilization of performance measures in public organizations: An empirical study of factors affecting adoption and implementation. Public Administration Review, 61, 693-708.[CrossRef][Web of Science]
  • Dudley, E. (1993). The critical villager-beyond community participation. London: Routledge.
  • Fetterman, D.M., Kaftarian, S., & Wandersman, A. (1996). Empowerment evaluation: Knowledge and tools for self-assessment and accountability. Thousand Oaks, CA: Sage.
  • Forss, K., Rebien, C.C., & Carlsson, J. (2002). Process use of evaluations: Types of use that precede lessons learned and feedback. Evaluation, 8, 29-45.[Abstract/Free Full Text]
  • Greene, J.G. (1988). Stakeholder participation and utilization in program evaluation. Evaluation Review, 12(2), 91-116.[Abstract/Free Full Text]
  • Guba, E.G., & Lincoln, Y.S. (1989). Fourth generation evaluation. Newbury Park, CA: Sage.
  • Holdaway, E.A. (1986). Making research matter. Alberta Journal of Educational Research, 3, 249-264.
  • Huey-Tsyh, C. (2004). Practical program evaluation: Assessing and improving planning, implementation, and effectiveness. Thousand Oaks, CA: Sage.
  • Innvaer, S., Vist, G., Trommald, M., & Oxman, A. (2002). Health policy-makers' perceptions of their use of evidence: A systematic review. Journal of Health Services Research and Policy, 7(4), 239-244.[CrossRef]
  • King, J.A. (2007). Developing evaluation capacity through process use. New Directions for Evaluation, 116, 45-59.
  • Landry, R., Amara, N., & Lamari, M. (2001). Climbing the ladder of research utilization: Evidence from social science research. Science Communication, 22, 396-422.[Abstract/Free Full Text]
  • Landry, R., Amara, N., Pablos-Mendes, A., Shademani, R. & Gold, I. (2006). The knowledge-value chain: A conceptual framework for knowledge translation in health. Bulletin of the World Health Organization, 84, 597-602.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Lemieux-Charles, L., & Champagne, F. (Eds.). (2004). Using knowledge and evidence in health care: Multidisciplinary perspectives. Toronto, Ontario, Canada: University of Toronto Press.
  • Lennie, J. (2005). An evaluation capacity-building process for sustainable community IT initiatives: Empowering and disempowering impacts. Evaluation, 11, 390-414.[Abstract]
  • Leviton, L.C. (2003). Evaluation use: Advances, challenges, and applications. American Journal of Evaluation, 24, 525-535.[Web of Science]
  • MacLellan-Wright, M.F., Patten, S., dela Cruz, A.M., & Flaherty, A. (2007). A participatory approach to the development of an evaluation framework: Process, pitfalls, and payoffs. Canadian Journal of Program Evaluation, 22(1), 99-124.
  • Morrissey, J. (2000). Indicators of citizen participation: Lessons from learning teams in rural EZ/EC communities. Community Development Journal, 35(1), 59-74.[Abstract]
  • Mueller, M.R. (1998). The evaluation of Minnesota's Early Childhood Family Education Program. American Journal of Evaluation, 19, 80-86.[Web of Science]
  • National Information Agency Society. (2004 ). Theory building in knowledge utilization: A review. Retrieved November 10, 2008, from http://www.nia.or.kr
  • Papineau, D., &. Kiely, M.C. (1996). Participatory evaluation in a community organization: Fostering stakeholder empowerment and utilization. Evaluation and Program Planning, 19, 79-93.[CrossRef][Web of Science]
  • Patton, M.Q. (1998). Discovering process use. Evaluation, 4, 225-233.[Free Full Text]
  • Preskill, H., & Torres, R.T. (2000). The learning dimension of evaluation use. New Directions for Evaluation, 88, 25-38.
  • Preskill, H., Zuckerman, B., & Matthews, B. (2003). An exploratory study of process use: Findings and implications for future research. American Journal of Evaluation, 24, 423-442.[Abstract]
  • Raby, C., & Viola, S. (2007). Modèles d'enseignement et théories d'apprentissage. Anjou, Québec, Canada: Les Éditions CEC.
  • Rebien, C.C. (1996). Participatory evaluation of development assistance: Dealing with power and facilitative learning. Evaluation, 2, 151-171.[Abstract/Free Full Text]
  • Reeve, J., & Peerbhoy, D. (2007). Evaluating the evaluation: Understanding the utility and limitations of evaluation as a tool for organizational learning. Health Education Journal, 66(2), 120-131.[Abstract/Free Full Text]
  • Rossman, G.B., & Rallis, S.F. (2000). Critical inquiry and use as action. New Directions for Evaluation, 88, 55-69.
  • Taut, S.M. (2007). Studying self-evaluation capacity building in a large international development organization. American Journal of Evaluation, 28, 45-59.[Abstract/Free Full Text]
  • Taut, S.M., & Alkin, M.C. (2003). Program staff perceptions of barriers to evaluation implementation. American Journal of Evaluation, 24, 213-226.[Abstract]
  • Taut, S.M., & Brauns, D. (2003). Resistance to evaluation: A psychological perspective. Evaluation, 9, 247-264.[Abstract]
  • Themessl-Huber, M.T., & Grutsch, M.A. (2003). The shifting locus of control in participatory evaluations. Evaluation, 9, 92-111.[Abstract]
  • Torres, R.T., & Preskill, H. (2001). Evaluation and organizational learning: Past, present, and future. American Journal of Evaluation, 22, 387-395.[Web of Science]
  • Turnbull, B. (1999). The mediating effect of participation efficacy on evaluation use. Evaluation and Program Planning, 22, 131-140.[CrossRef][Web of Science]
  • Vygotsky, L.S. (1978). Mind in society. Cambridge, MA: Harvard University Press.
  • Weaver, L., & Cousins, J.B. (2004). Unpacking the participatory process. Journal of Multidisciplinary Evaluation, 1, 19-40.
  • Weiss, C.H. (1981). Measuring the use of evaluation. In J. A. Ciarlo (Ed.), Utilizing evaluation: Concepts and measurement techniques. Beverly Hills, CA: Sage.
  • Weiss, C.H. (2000). Which links in which theories shall we evaluate? New Directions for Evaluation, 87, 35-45.
  • Williams, B., & Iman, I. (2006). Systems concepts in evaluation: An expert anthology. Point Reyes, CA: EdgePress.

American Journal of Evaluation, Vol. 29, No. 4, 427-442 (2008)
DOI: 10.1177/1098214008325023
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?



This Article
Right arrow Abstract Freely available
Right arrow Free Full Text (Free PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Smits, P. A.
Right arrow Articles by Champagne, F.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?