According to Rossi, an evaluation must be tailored to the political and organizational context of the program
Fantastic news! We've Found the answer you've been seeking!
Question:
According to Rossi, an evaluation must be tailored to the political and organizational context of the program being evaluated, matching research procedures to the evaluation questions and circumstances as much as possible, and whatever procedures are used, to apply them at the highest possible standard feasible.
Describe at least one of the five domainslisted by Rossi (and what evaluation function is most appropriate for each. Can you cite examples where these methods were used, from your own experiences? What were the challenges? What were the results?
Transcribed Image Text:
Five Domains of Evaluation Assessment of Program Cost and Efficiency Assessment of Program Outcome/Impact Assessment of Program Process and Implementation Assessment of Program Design and Theory Voluntee Approac PUBLICATI Effective PUBLICATI Thriving Workpla PUBLICATI A Collab Use in Ex Assessment of Need for a Program Starting from the bottom, each domain builds upon the previous domain. Ideally, you would not be designing and implementing a program unless a need for a program had been identified. You would also not be able to assess program outcomes without implementing a program. It would be inappropriate to conduct an efficiency assessment without establishing that a program achieved its desired outcomes. Domain 1: Assessment of Need for a Program The first evaluation domain is needs assessment. What is a need? A need is defined as the gap between "what is" and "what should be" (Witkin & Altschuld, 1995). There are different sources of information that we can use to determine needs, such as talking with potential target audiences or knowledgeable informants, or even reviewing existing data and statistics. For example, many low-income families struggle with debt, which can create a great deal of stress and other problems. A needs assessment helps us determine whether there is a need for a program to address this issue and is typically conducted before implementing a program. The overarching evaluation question in this domain asks: Is there a need for this type of program in this context? Domain 2: Assessment of Program Design and Theory The second evaluation domain is theory assessment. A theory of change identifies components needed to accomplish a program's goal (Center for Theory of Change, 2013), while a logic model presents those components in a visual format to show the relationships between activities and outcomes (Taylor-Powell & Henert, 2008). We use theory and research to determine what content should be delivered and the most effective ways to deliver it. Before implementing a program, we need to make sure the conceptualization and design of the program reflect valid assumptions about the problem and a feasible approach to resolving it. For example, in reviewing theory and research, we determine that one promising approach to helping families with debt is providing education and hands-on practice related to developing a budget. Therefore, we develop a curriculum for delivering an educational program that includes both content information and exercises. The overarching evaluation question in this domain asks: Is the program conceptualized in a way that it should work? Domain 3: Assessment of Program Process and Implementation The third evaluation domain is implementation assessment, or process evaluation. This domain focuses on the program's operation and delivery, or its process, to determine whether a program was delivered in the way it was intended. For example, we could assess how well the hands-on budgeting activities matched the program's objectives, if we reached the desired target audience, and whether the activities were delivered as described in the curriculum. This example shows that process evaluation is useful for refining or improving a program; for this reason, it is also called formative evaluation. The overarching evaluation question in this domain asks: Was this program implemented properly and according to the plan? Domain 4: Assessment of Program Outcome and/or Impact The fourth evaluation domain is outcome and impact assessment. An outcome refers to a change in knowledge, attitudes, skills, behaviors, practices, or conditions (Taylor-Powell & Henert, 2008). Impact refers to determining whether it was the program being evaluated that caused the outcomes documented. Outcome and impact assessment require clearly defined program objectives that identify how much change is expected, in what area, by when, and for whom. For example, outcome assessment helps us determine if we reached our goal of 80 percent of program participants increasing their knowledge and skills related to developing a budget. These assessments, also called summative evaluation, are conducted after the program is completed and often for the benefit of some external audience or decision-makers. The overarching evaluation question in this domain asks: Did this program achieve its desired outcomes and have an impact on its intended targets? Domain 5: Assessment of Program Cost and Efficiency The final evaluation domain is efficiency assessment. This domain focuses on whether the benefits of the program justify the costs. For example, did the outcomes that resulted from our budgeting program outweigh the costs of providing it? There are various types of efficiency assessment. Two common analyses are cost-benefit analysis and cost-effectiveness analysis. While a form of efficiency assessment can be done before a program is implemented to determine its economic feasibility, full-scale efficiency assessment is typically conducted after you have evidence of program outcomes. Conducting efficiency assessment typically requires involvement from an economist who has expertise in these techniques. The overarching evaluation question in this domain asks: Five Domains of Evaluation Assessment of Program Cost and Efficiency Assessment of Program Outcome/Impact Assessment of Program Process and Implementation Assessment of Program Design and Theory Voluntee Approac PUBLICATI Effective PUBLICATI Thriving Workpla PUBLICATI A Collab Use in Ex Assessment of Need for a Program Starting from the bottom, each domain builds upon the previous domain. Ideally, you would not be designing and implementing a program unless a need for a program had been identified. You would also not be able to assess program outcomes without implementing a program. It would be inappropriate to conduct an efficiency assessment without establishing that a program achieved its desired outcomes. Domain 1: Assessment of Need for a Program The first evaluation domain is needs assessment. What is a need? A need is defined as the gap between "what is" and "what should be" (Witkin & Altschuld, 1995). There are different sources of information that we can use to determine needs, such as talking with potential target audiences or knowledgeable informants, or even reviewing existing data and statistics. For example, many low-income families struggle with debt, which can create a great deal of stress and other problems. A needs assessment helps us determine whether there is a need for a program to address this issue and is typically conducted before implementing a program. The overarching evaluation question in this domain asks: Is there a need for this type of program in this context? Domain 2: Assessment of Program Design and Theory The second evaluation domain is theory assessment. A theory of change identifies components needed to accomplish a program's goal (Center for Theory of Change, 2013), while a logic model presents those components in a visual format to show the relationships between activities and outcomes (Taylor-Powell & Henert, 2008). We use theory and research to determine what content should be delivered and the most effective ways to deliver it. Before implementing a program, we need to make sure the conceptualization and design of the program reflect valid assumptions about the problem and a feasible approach to resolving it. For example, in reviewing theory and research, we determine that one promising approach to helping families with debt is providing education and hands-on practice related to developing a budget. Therefore, we develop a curriculum for delivering an educational program that includes both content information and exercises. The overarching evaluation question in this domain asks: Is the program conceptualized in a way that it should work? Domain 3: Assessment of Program Process and Implementation The third evaluation domain is implementation assessment, or process evaluation. This domain focuses on the program's operation and delivery, or its process, to determine whether a program was delivered in the way it was intended. For example, we could assess how well the hands-on budgeting activities matched the program's objectives, if we reached the desired target audience, and whether the activities were delivered as described in the curriculum. This example shows that process evaluation is useful for refining or improving a program; for this reason, it is also called formative evaluation. The overarching evaluation question in this domain asks: Was this program implemented properly and according to the plan? Domain 4: Assessment of Program Outcome and/or Impact The fourth evaluation domain is outcome and impact assessment. An outcome refers to a change in knowledge, attitudes, skills, behaviors, practices, or conditions (Taylor-Powell & Henert, 2008). Impact refers to determining whether it was the program being evaluated that caused the outcomes documented. Outcome and impact assessment require clearly defined program objectives that identify how much change is expected, in what area, by when, and for whom. For example, outcome assessment helps us determine if we reached our goal of 80 percent of program participants increasing their knowledge and skills related to developing a budget. These assessments, also called summative evaluation, are conducted after the program is completed and often for the benefit of some external audience or decision-makers. The overarching evaluation question in this domain asks: Did this program achieve its desired outcomes and have an impact on its intended targets? Domain 5: Assessment of Program Cost and Efficiency The final evaluation domain is efficiency assessment. This domain focuses on whether the benefits of the program justify the costs. For example, did the outcomes that resulted from our budgeting program outweigh the costs of providing it? There are various types of efficiency assessment. Two common analyses are cost-benefit analysis and cost-effectiveness analysis. While a form of efficiency assessment can be done before a program is implemented to determine its economic feasibility, full-scale efficiency assessment is typically conducted after you have evidence of program outcomes. Conducting efficiency assessment typically requires involvement from an economist who has expertise in these techniques. The overarching evaluation question in this domain asks:
Expert Answer:
Related Book For
Introduction To Health Care Management
ISBN: 9781284081015
3rd Edition
Authors: Sharon B. Buchbinder, Nancy H. Shanks
Posted Date:
Students also viewed these general management questions
-
Planning is one of the most important management functions in any business. A front office managers first step in planning should involve determine the departments goals. Planning also includes...
-
Identify the process evaluation article that you chose and explain why you selected this example. Describe the purpose of the evaluation, the informants, the questions asked, and the results of the...
-
Which of the following is not true regarding the receivables turnover ratio? 1) It is used to assess the liquidity of receivables. 2) It has a popular variant called the average collection period. 3)...
-
A researcher is studying the amygdala (a part of the brain involved in emotion). Six participants in a particular fMRI (brain scan) study are measured for the increase in activation of their amygdala...
-
Repeat Problem 9-104 using constant specific heats at room temperature. Problem 9-104 An ideal Brayton cycle with regeneration has a pressure ratio of 10. Air enters the compressor at 300 K and the...
-
Discuss the techniques of value planning, value engineering, and value analysis.
-
On December 31, the trial balance indicates that the supplies account has a balance, prior to the adjusting entry, of $320. A physical count of the supplies inventory shows that $90 of supplies...
-
a) Differentiate (with illustration) the differences between non-blocking and blocking message passing operation. (8 marks) b) Describe THREE (3) advantages of threaded programming as compared to...
-
A hollow sphere of mass M and radius R is immersed in a tank of water (density p). The sphere would float if it were set free. The sphere is tied to the bottom of the tank by two wires which makes...
-
Practice 2 Stock market (20 points) 1. Go to the Industry Center in Yahoo Finance! 2. Choose an industry and a specific company within this industry. 3. Briefly introduce the company you chose,...
-
For the mechanical system shown: a. Find the transfer function Xo(s)/Xa(s). b. What is the time constant. Comment on the stability of the system. Let K 2 N/m, K = 1 N/m, and B = an input of xa (t) 1...
-
Consider the summary output of the following two regressions where the analysis is separated for the American and National leagues. (Some of the output is omitted to save space.) American League:...
-
Build a toy Robo advisor program that: a) Calculate the expected number of years left for your client (i.e., life expectancy). explain the logic behind the life expectancy calculation and asset...
-
The following are extracts of the Income Statement and Balance Sheet of Universal Ltd. Non-current Asset Vehicle Furniture Current Assets Inventory Receivable Balance at Bank Cash In hand Total...
-
Consider the following B- decay chain with the half-lives indicated. 210 Pb (22y) -> 210 Bi (5d) -> 210 Po A sample contains 30 Mbq of 210 Pb and 15 MBq of 210 Bi at time zero. (a) Calculate...
-
Flicker, Inc., a closely held corporation, acquired a passive activity this year. Gross income from operations of the activity was $160,000. Operating expenses, not including depreciation, were...
-
Describe three main steps to identifying EBTs.
-
(T/F) EBTs should have a direct physical representation.
-
Where do you start developing BOs for any particular EBT? What questions do you need to ask?
Study smarter with the SolutionInn App