1. Define the key concepts of validity and reliability. How are they related and not related? Support your answer with examples. What are some potential ethical "mine fields" in this area?

2. Knowing the critical importance of obtaining valid and reliable findings, suggest three technical approaches an evaluator can take to enhance validity and reliability. Briefly say why each of these approaches will enhance V and R. What should the evaluator do if these findings become extremely political?

3. The Guiding Principles of the AEA maintain that evaluators must ensure the honesty and integrity of the entire evaluation process. Apply this principle to three areas of the evaluation process.

4. We discussed that the object of evaluation or what is being evaluated is often, at first, fairly obscure, probably not intentionally, but rather because important concepts that will be under evaluation are quite abstract and complex. One tool that is quite useful in answering the "what will be evaluated" question is the ability of the evaluator to provide operational definitions of the object of evaluation. Using your own organization, identify an abstract concept (object) that might lend itself to evaluation and provide an operational definition for thisconcept. (HINT: If low employee morale were a problem, what is an operational definition of the concept "employee morale.")

5. When you are gathering data about your constituents/members/clients etc. and the data are quite sensitive, and you are not sure they will be comfortable in providing an accurate/honest answer, how might you approach collecting this sensitive data so that you increase the chances of getting accurate information and decrease making people uncomfortable. Provide a rationale for your answer and support it with examples.