Research & Program Evaluation Services

 
 
 

The Institute on Violence, Abuse and Trauma (IVAT) provides quality Program Evaluation services by way of research, evaluation, and consultation. Independent evaluation keeps programs accountable and can provide objective program monitoring and evidence-based recommendations. Evaluation questions are designed to demonstrate accountability, document progress, and identify ways to improve or replicate program models.

  •  Is the program using an effective program model?

  •  Are interventions effective?

  • What is the impact of the program on the target population?

  • Does the program achieve its goals?

  • Where could the program focus efforts to achieve better outcomes?  

Our evaluation process includes a diverse team that works together to design an evaluation plan and methodology tailored to individual program needs. Multiple IVAT departments may be involved in the evaluation team, including Hoʻomaluhia, Research & Program Evaluation, and Professional Clinical & Forensic Services. Depending on the project, we may involve local community or university representatives, including faculty and/or graduate students. Program evaluation service costs are determined by project.

Common Types of Program Evaluation

  • A process evaluation is a type of formative evaluation to strengthen or improve program delivery.

    • Looks at the design of the program and determines if the program activities been implemented as intended

    • Done early so improvements can be made before assessing outcomes

  • Outcome evaluations are summative (goal-based) evaluations

    • Investigates whether the program caused demonstrable effects on a specifically defined targeted population

    • Compares the actual outcome with the intended (benchmark) outcome

  • A need assessment is a type of formative evaluation to identify need and gaps in services.

    • Identifying gaps in services and using research to define what is important to the population

    • Can be done prior to implementation or to build capacity

 
 
 
 

The Evaluation Process

  • ・Define the evaluation team

    ・Determine the purpose of the evaluation, target population and program

    goals

    ・Review/define the program constructs

    ・Review/update or create the logic model

    ・Confirm feasibility, budget, and timeline

  • ・Outline the evaluation plan and develop evaluation questions

    ・Conduct a Structural Assessment

    ・Review of the evidence (annotated bibliography)

    ・Identify best-practice-based program goals and objectives

    ・Provide evidence to support that the program practices will result in

    the projected outcomes

  • ・Evaluation matrix

    ・Program description and goal statement

    ・Define the program constructs

    ・Finalize evaluation and research questions

    ・Data plan and methodology

    ・Determine measures

    ・Identify method of assessment, indicators, sources of information, and

    method of gathering data

    ・If assessment-based intervention, then, pilot sample and select

    measures

    ・Project implementation (implement design)

    ・Data collection and analysis

  • ・Summary conclusion

    ・Challenges, limitations and barriers

    ・Key recommendations and lessons learned

 

For more information, please contact nanetteb@ivatcenters.org 

 

Krystal Baba, MPA, CPS 
Outreach & Administrative Coordinator  
Hawai‘i Pacific Branch (Ho‘omaluhia), Honolulu 

 

Nanette​ ​Burton, MS 
Research, Publications, & Special Projects Manager 
Institute on Violence, Abuse & Trauma