Resources

Resources

Learning about evaluation

ARC is dedicated to helping programs meet their evaluation needs. Below are some links and resources we hope you will find informative and useful. If you have other questions, please feel free to contact us and we will be glad to help.

	Answers to basic questions about program evaluation
	Useful links

Questions to answer before beginning an evaluation

1. What is program evaluation?

Broadly, there are two types to consider. Process evaluations help programs assess whether their services are being provided as intended. Outcome evaluations focus more on assessing outcomes--the benefits youth are deriving. Most of our evaluations are outcome evaluations that include aspects of process evaluation that help us understand how outcomes were achieved.

2. Why do an evaluation?

Evaluation should be integral to your program's efforts to fulfill its mission. Youth programming is most likely to be effective when it is informed by current research reflecting best practices and potential outcomes. Even programming designed with careful attention to best practices is not guaranteed to be successful at implementing them. Program evaluation shows how well programming is adhering to its goals, demonstrates positive outcomes, and highlights areas for improvement. And, effective evaluation helps programs compete for funds.

3. How much evaluation do you need?

Unless fulfilling an evaluation requirement or seeking to attract government or foundation funding, programs benefit most from program evaluation done at regular intervals to ensure that services are as effective as they should be. Between full evaluations, programs should monitor the processes previous evaluation showed to be effective to ensure strengths are maintained and flaws improved.

4. Why work with an external evaluator?

Whether you decide to work with ARC or not, it is in your program's best interests to conduct an external evaluation--to at least make sure an objective expert designs and oversees it. Having your program evaluated by someone with inadequate education or experience places you at risk for serious practical and ethical problems, including: failing to identify and demonstrate positive outcomes; basing programmatic decisions on inaccurate findings; and, eroding grantor confidence by presenting untenable findings. Hiring an external evaluator can be expensive, but the costs of not doing so can be prohibitive.

[top of page]

Program Evaluation Links

The following link provides an excellent overview of why and how to do program evaluation, written expressly for program managers (from the Office of Planning, Research and Evaluation, a unit within the Administration for Children and Families):

http://www.acf.hhs.gov/programs/opre/other_resrch/pm_guide_eval/reports/pmguide/pmguide_toc.html

The following link provides a useful overview of program evaluation terms and procedures (from the Web Center for Social Research Methods):

http://www.socialresearchmethods.net/kb/intreval.htm

Resources for Mentoring Programs

Dr. Jean Rhodes provides an excellent overview of what mentoring programs should know when considering an evaluation at the following link (MENTOR/National Mentoring Partnership, 2006).

http://www.mentoring.org/program_staff/evaluation/program_evaluation.php

ARC's article on how to select surveys in the tookit, "How to Build a Successful Mentoring Program Using the Elements of Effective Practice" (MENTOR/National Mentoring Partnership, 2005).

http://www.mentoring.org/_DownloadFiles/Mentor%20Tool%20Kit_full.pdf (page 189)

[top of page]