advertisement
On The Insider: Brooke Hogan to Pose for Playboy?
Find Articles in:
all
Business
Reference
Technology
News
Sports
Health
Autos
Arts
Home & Garden
advertisement

Content provided in partnership with
Thomson / Gale

Business Services Industry

Public Policy and Program Evaluation - Review

Administrative Science Quarterly,  June, 1999  by Jennifer C. Greene

Evert Vedung. New Brunswick, NJ: Transaction, 1997. 336 pp. $34.95.

In Public Policy and Program Evaluation, Swedish political scientist Evert Vedung positions program evaluation as a highly significant, even essential tool of Western democratic decision making in the public domain. This introductory-level text is intended for students of both evaluation and public administration. It joins social science with political science by linking evaluation concepts and processes to theories and frameworks of public administration, including, for example, systems perspectives and theories of organizational change. Vedung highlights the strong "results orientation" of contemporary public decision making, from local municipalities to federal bureaucracies, and offers a practical, decision-oriented approach to evaluation designed to assist public officials in meeting these contemporary demands for "results." Vedung equally emphasizes the politicized and democratic contexts of contemporary public decision making in Western societies, and his practical conceptualization of evaluation is tempered by such political realities as interest-group influence and by such democratic ideals as pluralism.

Most Popular Articles in Business
Research and Markets : Tesco Plc - SWOT Framework Analysis
Do Us a Flavor - Ben & Jerry's Issues a Call for Euphoric New Flavors
eBay made easy: ready to start an eBay business? These 5 simple steps will ...
Katrina's lawsuit surge: a legal battle to force insurers to pay for flood ...
Wal-Mart's newest distribution center opened last month near the southwest ...
More »
advertisement

Vedung presents his conceptualization of evaluation in the service of public decision making in 15 chapters, supplemented by a glossary of evaluation concepts. The 15 chapters of the text can be divided into two principal arguments. In the first four chapters, Vedung offers his definition of evaluation and his view of the field. He defines evaluation as the "careful retrospective assessment of the merit, worth, and value of administration, output, and outcome of government interventions, which is intended to play a role in future, practical action situations" (p. 3). With this definition, he focuses his view of evaluation on retrospective assessments of public program implementation and outcomes, leaving critiques of originating policies to other fields. This definition also highlights evaluation as a practical and instrumental activity and underscores the pivotal role of valuing in evaluation. Throughout the text, Vedung discusses the valuing part of evaluation and thoughtfully acknowledges the challenges - both technical and political - of identifying appropriate criteria and standards on which to judge the program under study.

Vedung offers his view of the field of program evaluation in a fairly lengthy chapter 4. He differentiates evaluation models by their organizers or basic questions (p. 35). He offers three clusters of models: effectiveness, efficiency, and professional models. Effectiveness models address the results of interventions and can be organized around stated program goals, side effects, observed results, system components, or client or stakeholder concerns. Economic models focus on costs and benefits and can address productivity or efficiency. The lone professional model presented is peer review.

Chapter 5 introduces the substantive core of Vedung's own view of evaluation, presented as the "Eight Problems Approach to Public Policy Evaluation." Vedung appropriately avers that it is the problems or questions addressed, not the designs or methods, that provide identity to evaluation. These eight problems, which frame the remainder of the book, are (1) identifying the evaluation purpose, (2) selecting the evaluator, (3) analyzing the intervention, (4) describing the program as implemented, (5) determining the program's results, (6) explaining these results, (7) judging the program with identified criteria and standards of performance, and (8) using the evaluation in practical action situations.

In Vedung's detailed discussions of these problems, he attends especially to the problem of explanation or impact evaluation, which he views as "important, particularly for higher level decision-makers in national bodies" (p. 166). Through four separate chapters (and 90 pages), he discusses both conventional and alternative approaches to impact assessment. His critique of the randomized experiment as the premier model for public program evaluation, especially in Sweden, is balanced and persuasive. His comprehensive discussion of "process evaluation" as an alternative analytic framework for attributing results to interventions is a unique contribution of this book. Vedung's process evaluation is not an assessment of program implementation (often called process or implementation evaluation in the U.S.) nor a scientific explanation of how intended activities led to observed results (as in theory-oriented or theory-driven evaluation). Rather, Vedung presents process evaluation as a comprehensive analysis of the program in its historical, political, economic, and social context that seeks a "whole pattern of causal interdependencies" (p. 210). To guide process evaluators, Vedung offers six broad factors that include the policy history of the intervention, its implementation at multiple levels (from agency to street-level bureaucrat to beneficiary), and its location in networks of issues and influence. Vedung's championship of process evaluation exemplifies his beliefs that "evaluation researchers must . . . learn to live with the insight that public policymaking can never be transformed into science in the way desired by outright technocrats and radical experimentalists" (p. 192). More profoundly, "the demand for rational, social science like evaluation must be subordinated to the requirements of a democratic body politic" (p. 288).