INSEAD Library

Includes bibliographical references and index

Digitized

Program Evaluation for Mental Health Methods, Strategies, and Participants Contents Preface Contributors Introduction: The Need, History, Definition, and Limits of Program Evaluation ROBERT D. COURSEY Need for program evaluation. Historical contributions. Definitions and scope of program evaluation. The role and limits of program evaluation. XV 1 SECTION I: METHODS OF PROGRAM EVALUATION Introduction to Section I A. An Introduction and Framework for Program Evaluation 1. Basic Questions and Tasks ROBERT D. COURSEY Preliminary questions about an evaluation project. Developmental tasks in program evaluation. 9 11 2. The Dimensions of an Evaluation System for Community Mental Health Centers ROGER MITCHELL 27 Introduction. Assessing evaluative capability in CMHCs (community assessment, program goals, data systems, client utilization, fiscal monitoring, outcome evaluation). Conclusion. 3. An Overview of Techniques and Models of Program Evaluation ROBERT D. COURSEY Models and techniques of program evaluation (the outcome model, goal attainment model, systems analysis, cost analytic models, descriptive and quality assurance models, planning and management methodologies, legal model). Choosing an evaluation procedure. 47 B. Agency-Wide Evaluation Procedures 4. Needs Assessment: A Strategy for Structuring Change ROGER BELL, GEORGE WARHEIT, and JOHN SCHWAB 67 Needs assessment defined. Needs assessment approaches available (key informant approach, community forum, rates tinder treatment, social indicators, survey). Conclusion. 5. Program Evaluation, Systems Theory, and Output Value Analysis: A Benefit/Cost Model JOSEPH HALPERN The systems model. Output value analysis: a benefiticost evaluation model. Translation into economic values. Outcome measures. Application of the model. 6. A Management by Objectives Approach to Program Evaluation WILLIAM PORTER 77 93 Management by objectives. Successive approximations. First approximation--program priorities and consumer satisfaction. Second approximation--staff objectives. Third approximation-- client objectives. 7. Will Goal Attainment Scaling Solve the Problems of Program Evaluation in the Mental Health Field? ROBERT SHERMAN 105 Introduction. The methodology of goal attainment scaling. 8. The Automated Tri-Informant Goal-Oriented Note: One Approach to Program Evaluation NANCY WILSON Background. Goal orientation and tri-informant approach. Procedure. Utilization of the data. Summary. 9. The Denver Community Mental Health Questionnaire: Development of a Multidimensional Program Evaluation Instrument JAMES CIARLO and JACQUELINE REIHMAN The Denver Community Mental Health Questionnaire characteristics of the measure, dimensions of outcome, initial scale development efforts, refinement of scales via cluster analysis, agreement between interviewers, validity of the DCMHQ scales, community standardization, client satisfaction). Application of the DCMHQ in evaluation. Considerations in using the DCMHQ. 105 119 131 C. Evaluation of Special Mental Health Services 10. Issues in Evaluating Children's Services JAMES WALKER and JOAN WAGNER ZINOBER Short attention span. Follow-up problems. Who is the best informant? Verbal problems. The maturation issue. Goals and objectives. 11. The Review and Evaluation of Consultation Activities in a Community Mental Health Center: Some Pitfalls and Possibilities SOLOMON CYTRYNBAUM Some problems in the analysis and review of consultation services. Overview of the CMHC consultation process and information requirements. (Inception of consultation. Events and dynamics in the consultation process. Termination and review of outcomes.) A criteria-oriented review of consultation services. 169 181 12. Evaluation of Community Action Programs: Issues and an Alternative MICHAEL BROPHY, STEPHEN MAISTO, LEIGH BURSTEIN, and ADRIAN CHAN 205 Community action programs: history and issues. Information flow and responsibility in evaluation. The alternative model-- community agency perspective. Concluding comments. 13. Evaluation of Educational and Training Programs IRWIN L. GOLDSTEIN 225 Assessment of instructional need. Derivation of objectives. Evaluation--criteria. Evaluation--experimental design. SECTION II: STRATEGIES FOR PROGRAM EVALUATION Introduction to Section II 14. Approaching Program Evaluation: Clarify Tasks MARGUERITE MCINTYRE 241 243 Accountability. Aspirations. Differentiating accountability and aspiration. Agreements for four system functions. Conclusion. 15. Starting an Internal Evaluation Program: Initial Steps JOAN WAGNER ZINOBER 253 A collaborative stance. Keeping a program focus. Administrative support. Manpower assistance. Professional interchange. Conclusion. 16. Conducting a Program Evaluation: Collaboration, Feedback, and Open-System Perspectives STANLEY MURRELL Evaluation with the Parent-Child Center. Human resource development alternatives. General guides. 17. Judging Program Evaluations: Criteria in Contexts STANLEY MURRELL and FRIEDA BROWN The demonstration context. The program development context. The accountability context. Central problems for each context. SECTION III: PARTICIPANTS IN PROGRAM EVALUATION Introduction to Section III 18. The Uses and Abuses of the Outside Evaluator GERALD A. SPECTER 259 275 285 287 Selecting an outside evaluator. Types of evaluators--recognizing their limits. Let the research begin. Use offindings. Closing comment. 19. Staff Participation in Program Evaluation ROBERT D. COURSEY, ROGER MITCHELL, and JOEL FRIEDMAN The current controversy. The broader perspective of an individual-systems approach. Some suggestions about staff participation. 20. Patient Rights in Program Evaluation JAMES W. ELLIS Introduction. Evaluation of the protection of patient's rights. (Right to treatment, intake process, right to refuse treatment, doctrine of least drastic means, civil liberties of patients, release procedures, privacy and confidentiality, legal services.) Possible use of program evaluation by the courts. Possible problems created by program evaluation. 21. Evaluation by Citizens CAROL I. WEISS, JACK MONROE, CHARLES BRAY, HOWARD DAVIS, and BARBARA HUNT Rationale for citizen involvement. Models of consumer evaluation. Recent citizen evaluation projects. Resources for the citizen evaluation team. 297 313 325 SECTION IV: FURTHER RESOURCES 22. Resources to Aid Mental Health Program Evaluation CHARLES WINDLE 339 Technical research skills (personnel, references, consultants, evaluation organizations). Supportive management environment. Data (program-specific data, comparative data, additional reference data). Financial resources. 23. An Annotated Bibliography of Readings in Program Evaluation GLEN STROBEL and JAMES SORENSEN Introduction. Literature reviews and bibliographies. Overviews. Research designs and strategies. Evaluation in the real world. Evaluation of specific programs (examples). Author Index Subject Index 389 399 351