Opioid Epidemic Response evaluation information
Evaluation technical assistance process
Any organization considering applying for an OER grant to fund opioid education, prevention, treatment, or recovery services is eligible for 30-minutes of technical assistance from MMB research scientists. This assistance will help applicants plan, as possible, an impact evaluation of the program or service they intend to submit as a grant proposal.
Technical assistance will primarily occur over a video conference call. MMB staff may also field a limited number of emailed questions from organizations. To ensure fairness, all evaluation-relevant questions answered during the calls and summarized email communication will be shared on this website. Public postings will not include any identifying information about the organizations receiving technical assistance or on their proposed projects. This 1-on-1 assistance will be open before the submission deadline to all applicants. Additional technical assistance will be available after the deadline for those projects considered for an evaluation.
To sign up for this evaluation technical assistance, please complete this brief form. MMB staff will reach out after survey completion to schedule a time for the technical assistance call.
Evaluation technical assistance Q & A
Q1: What kind of data are needed?
A1: In order to do impact evaluations properly we need to have data on both the group of individuals that receive the service and another group of individuals that did not receive the service.
Q2: What do you mean by "outcome measures"?
A2: Grant applicants are asked to submit a logic model with intended service goals and outcome measures. Different types of outcome measures that might be collected will broadly fall into one of three categories: short-, medium-, and long-term. For example, a program might consider knowledge gained from training a short-term outcome, incidences of administered naloxone a medium-term outcome, and mortality a long-term outcome. See here for additional support on logic models.
To support the evaluation, MMB research scientists compiled this guide on what an impact evaluation is, why they can be valuable, and what makes a viable impact evaluation. Grant applicants are encouraged to consider the information in the guide as they write their proposals and engage in evaluation technical assistance.
If an organization is funded by an OER Advisory Council grant and selected for an evaluation, they will work closely with MMB to do formal planning for the evaluation. This planning period will further explore the questions in the evaluation guide (link in above section). MMB research scientists will partner with the grantee and other stakeholders to complete the evaluation. Prior to the evaluation beginning, it is MMB’s policy to both pre-register analysis plans and publish all studies, regardless of the results.