|
Sign In to gain access to subscriptions and/or personal tools.
|
Fidelity Criteria: Development, Measurement, and Validation
Carol T. Mowbray
School of Social Work, University of Michigan, 1080 South University, Rm 2734, Ann Arbor, MI 48109-1106, USA, cmowbray{at}umich.edu
Mark C. Holter
Gregory B. Teague
Deborah Bybee
Fidelity may be defined as the extent to which delivery of an intervention adheres to the protocol or program model originally developed. Fidelity measurement has increasing significance for evaluation, treatment effectiveness research, and service administration. Yet few published studies using fidelity criteria provide details on the construction of a valid fidelity index. The purpose of this review article is to outline steps in the development, measurement, and validation of fidelity criteria, providing examples from health and education literatures. We further identify important issues in conducting each step. Finally, we raise questions about the dynamic nature of fidelity criteria, appropriate validation and statistical analysis methods, the inclusion of structure and process criteria in fidelity assessment, and the role of program theory in deciding on the balance between adaptation versus exact replication of model programs. Further attention to the use and refinement of fidelity criteria is important to evaluation practice.
References
- Allness, D. J., & Knoedler, W. H. (1998). The PACT model of community-based treatment for persons with severe and persistent mental illnesses: A manual for PACT start-up. Arlington, VA: National Alliance for the Mentally Ill (NAMI).
- Anthony, W. A., Cohen, M., & Farkas, M. (1982). A psychiatric rehabilitation treatment program: Can I recognize one if I see one? Community Mental Health Journal, 18, 83-96.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Babor, T. F., Steinberg, K. L., McRee, B., Vendetti, J., & Carroll, K. M. (2001). Treating marijuana dependence in adults: A multi-site, randomized clinical trial. In J. M. Herrell & R. B. Straw (Eds.), Conducting multiple site evaluations in real-world settings. New Directions for Evaluation, no. 94(pp. 17-30). San Francisco, CA: Jossey-Bass.
- Bachrach, L. L. (1988). The chronic patient: On exporting and importing model programs. Hospital and Community Psychiatry, 39, 1257-1258.[Free Full Text]
- Banks, S., McHugo, G. J., Williams, V., Drake, R. E., & Shinn, M. (2001). A prospective meta-analytic approach in a multi-site study of homelessness prevention. In J. M. Herrell & R. B. Straw (Eds.), Conducting multiple site evaluations in real-world settings. New Directions for Evaluation, no. 94(pp. 45-59). San Francisco, CA: Jossey-Bass.
- Becker, D. R., Smith, J., Tanzman, B., Drake, R. E., & Tremblay, T. (2001). Fidelity of supported employment programs and employment outcomes. Psychiatric Services, 52, 834-836.[Abstract/Free Full Text]
- Berman, P. (1981). Educational change: An implementation paradigm. In R. Lehming & M. Kane (Eds.), Improving schools: Using what we know (pp. 253-286). Thousand Oaks, CA: Sage.
- Bilsker, D., & Goldner, E. M. (2002). Routine outcome measurement by mental health-care providers: Is it worth doing? The Lancet, 360, 1689-1690.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Blakely, C. H., Mayer, J. P., Gottschalk, R. G., et al. (1987). The fidelity-adaptation debate: Implications for the implementation of public sector social programs. American Journal of Community Psychology, 15, 253-268.[CrossRef][Web of Science]
- Bond, G. R., Becker, D. R., Drake, R. E., et al. (1997). A fidelity scale for the individual placement and support model of supported employment. Rehabilitation Counseling Bulletin, 40, 265-284.[Web of Science]
- Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H. W. (2000). Measurement of fidelity in psychiatric rehabilitation. Mental Health Services Research, 2(2), 75-87.[CrossRef][Medline]
[Order article via Infotrieve]
- Bond, G. R., Williams, J., Evans, L., et al. (2000). PN-44-psychiatric rehabilitation fidelity toolkit. Cambridge, MA: Human Services Research Institute.
- Brekke, J. S. (1988). What do we really know about community support programs? Strategies for better monitoring. Hospital and Community Psychiatry, 39, 946-952.[Abstract/Free Full Text]
- Brekke, J. S., & Test, M. A. (1992). A model for measuring the implementation of community support programs: Results from three sites. Community Mental Health Journal, 28, 227-247.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Centre for Evidence-Based Medicine. (2002). Levels of evidence and grades of recommendation. Oxford, England (http://minerva.minervation.com/cebm/).
- Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685-716.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Chen, H. (1990). Theory-driven evaluations. Thousand Oaks, CA: Sage.
- Clarke, G. (1998). Intervention fidelity in the psychosocial prevention and treatment of adolescent depression. Journal of Prevention and Intervention in the Community, 17, 19-33.
- Donabedian, A. (1982). The criteria and standards of quality. Ann Arbor, MI: Health Administration Press.
- Drake, R., Goldman, H., Leff, H., Lehman, A., Dixon, L., Mueser, K., & Torrey, W. (2001). Implementing evidence-based practices in routine mental health service settings. Psychiatric Services, 52, 179-182.[Abstract/Free Full Text]
- Drake, R. E., McHugo, G. J., & Becker, D. R. (1996). The New Hampshire study of supported employment for people with severe mental illness. Journal of Consulting and Clinical Psychology, 64, 391-399.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Fairweather, G. W., & Tornatzsky, L. G. (1971). Experimental methods for social policy research. New York, NY: Pergamon Press.
- Frese, F. J., Stanley, J., Kress, K., & Vogel-Scibilia, S. (2001). Integrating evidence-based practices and the recovery model. Psychiatric Services, 52, 1462-1468.[Abstract/Free Full Text]
- Friesen, B. J., Green, B. L., Kruzich, J. M., Simpson, J., et al. (2002). Guidance for program design: Addressing the mental health needs of young children and their families in early childhood education settings. Retrieved May 23, 2002, from Portland State University, Reseach & Training Center on Family Support and Children’s Mental Health Web site: http://www.rtc.pdx.edu/pgProjGuidance.php.
- Giesler, L. J., & Hodge, M. (1998). Case management in behavioral health care. International Journal of Mental Health, 27, 26-40.
- Glisson, C., & Hemmelgarn, A. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse and Neglect, 22, 401-421.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Hedeker, D., McMahon, S. D., Jason, L. A., & Salina, D. (1994). Analysis of clustered data in community psychology: With an example from a worksite smoking cessation project. American Journal of Community Psychology, 22, 595-615.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65, 821-833.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Henggeler, S. W., & Schoenwald, S. K. (1998). The MST supervisory manual: Promoting quality assurance at the clinical level. Charleston, SC: MST Institute.
- Henggeler, S. W., Schoenwald, S. K., Liao, J. G., Letourneau, E. J., & Edwards, D. L. (2002). Transporting efficacious treatments to field settings: The link between supervisory practices and therapist fidelity in MST programs. Journal of Clinical Child and Adolescent Psychology, 31, 155-167.
- Henry, W. P., Butler, S. F., Strupp, H. H., & Schacht, T. E. (1993). Effects of training in time-limited dynamic psychotherapy: Changes in therapist behavior. Journal of Consulting and Clinical Psychology, 61, 434-440.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Hermann, R. C., Finnerty, M., Provost, S., Palmer, R. H., Chan, J., Lagodmos, G., Teller, T., & Myrhol, B. J. (2002). Process measures for the assessment and improvement of quality of care for schizophrenia. Schizophrenia Bulletin, 28, 95-104.
- Hernandez, M., Gomez, A., Lipien, L., Greenbaum, P. E., et al. (2001). Use of the system-of-care practice review in the national evaluation: Evaluating the fidelity of practice to system-of-care principles. Journal of Emotional and Behavioral Disorders, 9, 43-52.[Abstract/Free Full Text]
- Hohmann, A. A., & Shear, M. K. (2002). Community-based intervention research: Coping with the "noise" of real life in study design. American Journal of Psychiatry, 159, 201-207.[Abstract/Free Full Text]
- Holden, E. W., O’Connell, S. R., Connor, T., Branna, A. M., Foster, E. M., Blau, G., & Panciera, H. (2002). Evaluation of the Connecticut Title IV-E Waiver Program: Assessing the effectiveness, implementation fidelity, and cost/benefits of a continuum of care. Children and Youth Services Review, 24, 409-430.[CrossRef]
- Holter, M. C., Mowbray, C. T., Bellamy, C., MacFarlane, P., & Dukarski, J. (in press). "Critical ingredients" of consumer run services: Results of a national survey. Community Mental Health Journal.
- Institute of Medicine. (2001). Improving the quality of long-term care. Washington, DC: National Academy Press.
- Johnsen, M., Samberg, L., Calsyn, R., Blasinsky, M., et al. (1999). Case management models for persons who are homeless and mentally ill: The ACCESS demonstration project. Community Mental Health Journal, 35, 325-346.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Kelly, J. A., Heckman, T. G., Stevenson, L. Y., & Williams, P. N. (2000). Transfer of research-based HIV prevention interventions to community service providers: Fidelity and adaptation. AIDS Education and Prevention, 12, 87-98.[Web of Science][Medline]
[Order article via Infotrieve]
- Lebow, J. (1983). Research assessing consumer satisfaction with mental health treatment: A review of findings. Evaluation and Program Planning, 6, 211-236.[CrossRef][Medline]
[Order article via Infotrieve]
- Leff, H. S., & Mulkern, V. (2002). Lessons learned about science and participation from multi-site evaluations. In J. M. Herrell & R. B. Straw (Eds.), Conducting multiple site evaluations in real-world settings. New Directions for Evaluation, no. 94 (pp. 89-100). San Francisco, CA: Jossey-Bass.
- Luborsky, L., McLellan, A. T., Diguer, L., Woody, G., & Seligman, D. A. (1997). The psychotherapist matters: Comparison of outcomes across twenty-two therapists and seven patient samples. Clinical Psychology: Science & Practice, 4, 53-65.[Web of Science]
- Lucca, A. M. (2000). A Clubhouse fidelity index: Preliminary reliability and validity results. Mental Health Services Research, 2, 89-94.[CrossRef][Medline]
[Order article via Infotrieve]
- Macias, C., Propst, R., Rodican, C., & Boyd, J. (2001). Strategic planning for ICCD clubhouse implementation: Development of the Clubhouse Research and Evaluation Screening Survey (CRESS). Mental Health Services Research, 3, 155-167.[CrossRef][Medline]
[Order article via Infotrieve]
- Malysiak, R., Duchnowski, A., Black, M., & Greeson, M. (1996). Establishing wrap around fidelity through participatory evaluation. In Proceedings of the Ninth Annual Research Conference. A System of Care for Children’s Mental Health: Expanding the Research Base.
- McGrew, J. H., Bond, G. R., Dietzen, L., & Salyers, M. (1994). Measuring the fidelity of implementation of a mental health program model. Journal of Consulting and Clinical Psychology, 62, 670-678.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- McGrew, J. H., Pescosolido, B., & Wright, E. (2003). Case managers’ perspectives on critical ingredients of assertive community treatment and on its implementation. Psychiatric Services, 54, 370-376.[Abstract/Free Full Text]
- McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999). The relationship between model fidelity and client outcomes in the New Hampshire Dual Disorders Study. Psychiatric Services, 50, 818-824.[Abstract/Free Full Text]
- Mills, S. C., & Ragan, T. J. (2000). A tool for analyzing implementation fidelity of an integrated learning system (ILS). Educational Technology Research and Development, 48, 21-41.
- Moncher, F. J., & Prinz, R. J. (1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11, 247-266.[CrossRef][Web of Science]
- Mueser, K. T., Bond, G. R., Drake, R. E., et al. (1998). Models of community care for severe mental illness: A review of research on case management. Schizophrenia Bulletin, 24, 37-74.
- National MH Advisory Council. (1999). Bridging science and service: A report by the National Advisory Mental Health Council’s Clinical Treatment and Services Research Workgroup.
- Nguyen, T. D., Attkisson, C. C., & Stegner, B. L. (1983). Assessment of patient satisfaction: Development and refinement of a service questionnaire. Evaluation and Program Planning, 6, 299-314.[CrossRef][Medline]
[Order article via Infotrieve]
- NH-Dartmouth Psychiatric Research Center. (2002, January). Implementing Evidence-Based Practices Project National Meeting. In T. Singer & P. W. Singer (Eds.), Implementing Evidence-Based Practices Project Newsletter, 1.
- Orwin, R. G. (2000). Assessing program fidelity in substance abuse health services research. Addiction, 95(Suppl. 3), S309-S327.
- Paulson, R. I., Post, R. L., Herinckx, H. A., & Risser, P. (2002). Beyond components: Using fidelity scales to measure and assure choice in program implementation and quality assurance. Community Mental Health Journal, 38, 119-128.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Price, R. H., Friedland, D. S., Choi, J., & Caplan, R. D. (1998). Job-loss and work transitions in a time of global economic change. In X. Arriaga & S. Oskamp (Eds.), Addressing community problems: Psychological research and interventions (pp. 195-222). Thousand Oaks, CA: Sage.
- Rapp, C. A. (1998). The active ingredients of effective case management: A research synthesis. Community Mental Health Journal, 34, 363-380.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Raudenbush, S., & Bryk, A. (2001). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
- Rog, D. J., & Randolph, F. L. (2002). A multi-site evaluation of supported housing: Lessons learned from cross-site collaboration. In J. M. Herrell & R. B. Straw (Eds.), Conducting multiple site evaluations in real-world settings. New Directions for Evaluation, no. 94 (pp. 61-72). San Francisco, CA: Jossey-Bass.
- Salyers, M. P., Bond, G. R., Teague, G. B., Cox, J. F., Smith, M. E., Hicks, M. L., & Koop, J. I. (in press). Is it ACT yet? Real-world examples of evaluating the degree of implementation for assertive community treatment. Journal of Behavioral Health Services and Research.
- Sechrest, L., West, S. G., Phillips, M. A., Redner, R., & Yeaton, W. (1979). Some neglected problems in evaluation research: Strength and integrity of treatments. In L. Sechrest, S. G. West, M. A. Phillips, R. Redner, & W. Yeaton (Eds.), Evaluation studies review annual (Vol. 4, pp. 15-35). Thousand Oaks, CA: Sage.
- Snijders, T., & Bosker, R. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Thousand Oaks, CA: Sage.
- Stein, L. I., & Test, M. A. (1980). An alternative to mental health treatment. I: Conceptual model, treatment program, and clinical evaluation. Archives of General Psychiatry, 37, 392-397.[Abstract/Free Full Text]
- Szulanski, G., & Winter, S. (2002). Getting it right the second time. Harvard Business Review, 80, 62-69.
- Teague, G. B. (2000). Patient perceptions of care measures. In A. J. Rush, H. A. Pincus, et al. (Eds.), Handbook of psychiatric measures (pp. 169-194). Washington, DC: American Psychiatric Association.
- Teague, G. B., Bond, G. R., & Drake, R. E. (1998). Program fidelity and Assertive Community Treatment: Development and use of a measure. American Journal of Orthopsychiatry, 68, 216-232.[Web of Science][Medline]
[Order article via Infotrieve]
- Teague, G. B., Drake, R. E., & Ackerson, T. H. (1995). Evaluating use of continuous treatment teams for persons with mental illness and substance abuse. Psychiatric Services, 46, 689-695.[Abstract/Free Full Text]
- Teague, G. B., Ganju, V., Hornik, J. A., Johnson, J. R., & McKinney, J. (1997). The MHSIP mental health report card: A consumer-oriented approach to monitoring the quality of mental health plans. Evaluation Review, 21(3), 330-341.[Abstract/Free Full Text]
- Unrau, Y. A. (2001). Using client exit interviews to illuminate outcomes in program logic models: A case example. Evaluation and Program Planning, 24, 353-361.
- Vincent, M. L., Paine-Andrews, A., Fisher, J., Devereaux, R. S., et al. (2000). Replication of a community-based multicomponent teen pregnancy prevention model: Realities and challenges. Family and Community Health, 23, 28-45.
- Weisman, A., Nuechterlein, K. H., Goldstein, M. J., & Snyder, K. S. (2000). Controllability perceptions and reactions to symptoms of schizophrenia: A within-family comparison of relatives with high and low expressed emotion. Journal of Abnormal Psychology, 109, 167-171.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Weisman, A., Tompson, M. C., Okazaki, S., Gregory, J., et al. (2002). Clinicians’ fidelity to a manual-based family treatment as a predictor of the one-year course of bipolar disorder. Family Process, 41, 123-131.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Yates, B. T. (1994). Toward the incorporation of costs, cost-effectiveness analysis, and cost-benefit analysis into clinical research. Journal of Consulting and Clinical Psychology, 62, 729-736.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Yates, B. T. (1995). Cost-effectiveness analysis, cost-benefit analysis, and beyond: Evolving models for the scientist-manager-practitioner. Clinical Psychology: Science & Practice, 2, 385-398.[Web of Science]
- Yates, B. T. (1996). Analyzing cost, procedures, processes, and outcomes in human services. Thousand Oaks, CA: Sage.
American Journal of Evaluation, Vol. 24, No. 3,
315-340 (2003)
DOI: 10.1177/109821400302400303
 CiteULike  Complore  Connotea  Del.icio.us  Digg  Reddit  Technorati  Twitter What's this?
This article has been cited by other articles:
|
|
|
|
 
S. Bisset, M. Daniel, and L. Potvin
Exploring the Intervention-- Context Interface: A Case From a School-Based Nutrition Intervention
American Journal of Evaluation,
December 1, 2009;
30(4):
554 - 571.
[Abstract]
[PDF]
|
|
|
|
|
|
|
G. R. Bond, R. E. Drake, G. J. McHugo, C. A. Rapp, and R. Whitley
Strategies for Improving Fidelity in the National Evidence-Based Practices Project
Research on Social Work Practice,
September 1, 2009;
19(5):
569 - 581.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. L. Fixsen, K. A. Blase, S. F. Naoom, and F. Wallace
Core Implementation Components
Research on Social Work Practice,
September 1, 2009;
19(5):
531 - 540.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. S. Galbraith, B. Stanton, B. Boekeloo, W. King, S. Desmond, D. Howard, M. M. Black, and J. W. Carey
Exploring Implementation and Fidelity of Evidence-Based Behavioral Interventions for HIV Prevention: Lessons Learned From the Focus on Kids Diffusion Case Study
Health Educ Behav,
June 1, 2009;
36(3):
532 - 549.
[Abstract]
[PDF]
|
|
|
|
|
|
|
D. V. Liebel, B. Friedman, N. M. Watson, and B. A. Powers
Review: Review of Nurse Home Visiting Interventions for Community-Dwelling Older Persons With Existing Disability
Med Care Res Rev,
April 1, 2009;
66(2):
119 - 146.
[Abstract]
[PDF]
|
|
|
|
|
|
|
K. Zvoch
Treatment Fidelity in Multisite Evaluation: A Multilevel Longitudinal Examination of Provider Adherence Status and Change
American Journal of Evaluation,
March 1, 2009;
30(1):
44 - 61.
[Abstract]
[PDF]
|
|
|
|
|
|
|
R. K. Noonan, J. G. Emshoff, A. Mooss, M. Armstrong, J. Weinberg, and B. Ball
Adoption, Adaptation, and Fidelity of Implementation of Sexual Violence Prevention Programs
Health Promot Pract,
January 1, 2009;
10(1_suppl):
59S - 70S.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. Shen, Huilan Yang, Honggao Cao, and C. Warfield
The Fidelity--Adaptation Relationship in Non-Evidence-Based Programs and its Implication for Program Evaluation
Evaluation,
October 1, 2008;
14(4):
467 - 481.
[Abstract]
[PDF]
|
|
|
|
|
|
|
P. R. Brandon, A. K. H. Taum, D. B. Young, F. M. Pottenger III, and T. W. Speitel
The Complexity of Measuring the Quality of Program Implementation With Observations: The Case of Middle School Inquiry-Based Science
American Journal of Evaluation,
September 1, 2008;
29(3):
235 - 250.
[Abstract]
[PDF]
|
|
|
|
|
|
|
C. L. O'Donnell
Defining, Conceptualizing, and Measuring Fidelity of Implementation and Its Relationship to Outcomes in K-12 Curriculum Intervention Research
Review of Educational Research,
March 1, 2008;
78(1):
33 - 84.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
S. Davidsdottir and P. Lisi
Effects of Deliberative Democracy on School Self-Evaluation
Evaluation,
July 1, 2007;
13(3):
371 - 386.
[Abstract]
[PDF]
|
|
|
|
|
|
|
K. Zvoch, L. E. Letourneau, and R. P. Parker
A Multilevel Multisite Outcomes-by-Implementation Evaluation of an Early Childhood Literacy Model
American Journal of Evaluation,
June 1, 2007;
28(2):
132 - 150.
[Abstract]
[PDF]
|
|
|
|
|
|
|
C. T. Mowbray, D. Bybee, M. Holter, and L. Lewandowski
Validation of a Fidelity Rating Instrument for Consumer-Operated Services
American Journal of Evaluation,
March 1, 2006;
27(1):
9 - 27.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M. Corbiere, G. R. Bond, E. M. Goldner, and T. Ptasinski
Brief Reports: The Fidelity of Supported Employment Implementation in Canada and the United States
Psychiatr Serv,
November 1, 2005;
56(11):
1444 - 1447.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
C. MacNeil and S. Mead
A Narrative Approach to Developing Standards for Trauma-Informed Peer Support
American Journal of Evaluation,
June 1, 2005;
26(2):
231 - 244.
[Abstract]
[PDF]
|
|
|
|
|
|
|
L. Faw, A. Hogue, and H. A. Liddle
Multidimensional Implementation Evaluation of a Residential Treatment Program for Adolescent Substance Abuse
American Journal of Evaluation,
March 1, 2005;
26(1):
77 - 94.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. J. Barnette and A. B. Wallis
The Missing Treatment Design Element: Continuity of Treatment When Multiple Postobservations Are Used in Time-Series and Repeated Measures Study Designs
American Journal of Evaluation,
March 1, 2005;
26(1):
106 - 123.
[Abstract]
[PDF]
|
|
|
|
|
|
|
S. Yampolskaya, T. M. Nesman, M. Hernandez, and D. Koch
Using Concept Mapping to Develop a Logic Model and Articulate a Program Theory: A Case Example
American Journal of Evaluation,
June 1, 2004;
25(2):
191 - 207.
[Abstract]
[PDF]
|
|
|
|
|
|
|
From the Editor
American Journal of Evaluation,
March 1, 2004;
25(1):
1 - 3.
[PDF]
|
|
|
|
|
