Resources for State Agencies

New programs or activities are efforts that haven't been implemented previously or that are seeking to achieve different outcomes for an existing program.

New Program Example

Expanded programs could include more grant funding for an already existing grant, service area expansion, or change in eligibility for a program.

Expanded Service Delivery Example

An operations and infrastructure project may include new construction, staffing and organizational capacity, repair, or renovation.

Operations and Infrastructure Example

Quantity measures explain how much work was done and with whom. Quantity measures are typically numbers. Quantity measures explain the effort of grantees, contractors, and program staff. Quantity measures may also be called output measures. Examples of quantity measures are:

• The number of students participating in a class
• The number of patients seen at a clinic broken down by spoken language
• The number of mental health providers trained on an evidence-based screening practice
• The number of families served by case managers
• The number of highway miles re-painted with reflective lane markings

Quality measures explain if the work was implemented as planned and help guide improvement. Quality measures are typically percentages. Quality measures also explain the effort of grantees, contractors, and program staff.

Examples of quality measures are:

• The percentage of teachers with class sizes of less than 25
• The percentage of patients satisfied with quality of care
• The percentage of providers using screenings
• The percentage of families that receive a referral for housing services
• The percentage of highway miles re-painted in the last 2 years

Result measures explain what changed over time. Result measures may also be called outcome measures. Results measures can be either numbers or percentages.

Examples of results measures are:

• The number or percentage of students graduating high school on time
• The number or percentage of patients seen at the clinic within the past year for a preventative visit
• The percentage of providers with an increased knowledge of screening procedures
• The percentage of families that are stably housed
• The percentage of highway miles meeting national safety standards

A needs assessment in evaluation is a systematic process used to determine and prioritize the needs of a particular population or community. It involves identifying gaps between current conditions and desired conditions, with the aim of developing or refining interventions that address those needs effectively. The process often includes data collection, analysis, and community engagement to understand the specific needs, preferences, and challenges faced by the target population.

A process or implementation evaluation is a type of evaluation that examines the implementation of a program or intervention, focusing on how it was delivered, whether it was delivered as planned, and the factors that influenced its execution. The goal of a process evaluation is to understand the relationship between program activities and outcomes, identify implementation challenges, and provide insights for program improvement. Ideally, these happen on a iterative or semi-regular basis.

These types of impact evaluation are the most rigorous and require a comparison group. Access detailed descriptions of RCT and QED.

Summative evaluation is a type of evaluation conducted at the conclusion of a program or intervention to assess its overall effectiveness and outcomes. It aims to provide a conclusive judgement about a programs effectiveness, and it often involves comparing outcomes against predefined benchmarks or standards. Summative evaluation is typically used to make decisions about the continuation, expansion, or termination of a program.