Evaluating the Effectiveness of a Federal Suicide Prevention Effort

Case Study - Findings Analysis and Insights - Program Evaluation and Measurement - Research and Evaluation - Research Design and Execution - Veteran Health

Evaluating the Effectiveness of a Federal Suicide Prevention Effort

Posted on 03.31.25
Young depressed woman talking to lady psychologist during sessio
Young depressed woman talking to lady psychologist during sessio
Challenge

Designing and implementing a rigorous impact evaluation

SAMHSA, in collaboration with other federal agencies, is required by law to evaluate the Zero Suicide Program and report outcomes to Congress. This evaluation assesses implementation, measures performance and identifies whether the program improves quality of care and reduces suicide risk. It also informs future program planning and delivery.

The evaluation includes quantitative and qualitative data collection from up to 25 grantees. SAMHSA also provides training and technical assistance (T/TA) to help grantees participate effectively in the evaluation.

Solutions

SAMHSA partnered with Aptive to deliver mission-critical operational support and data-driven evaluation services. Aptive brought deep expertise in suicide prevention programs and used prior experience with the Zero Suicide framework to inform methodology and reduce duplication of effort.

A Comprehensive, Integrated Approach

Aptive applies a continuous improvement model informed by lived experience, inter-agency collaboration and evaluation best practices. The team works closely with grantees, evaluation experts and technical advisors to ensure high-quality, accurate data collection.

Aptive designed four core studies to collect implementation and impact data: systems change, workforce, consumer experience and impact. These multi-method studies optimize data quality and reduce burden on grantees.

The project methodology incorporates PMBOK principles, Agile and Lean Six Sigma tools, and proven planning models. Aptive applies these standards across project planning, execution and reporting.

Expert Evaluation Panel

Aptive assembled a multidisciplinary evaluation panel that advises on implementation, data analysis and reporting. Panel members bring expertise in behavioral health, suicide prevention, Veteran services and vulnerable populations including American Indian/Alaskan Native communities.

Evaluation T/TA

Aptive’s T/TA lead coordinates closely with technical assistance liaisons (TALs) and advisors to ensure consistent support across all Zero Suicide grantees. Grantees receive tiered support based on implementation readiness. The T/TA team uses newsletters, data platform updates and meetings to provide real-time guidance.

Data Management and Analysis

Aptive collects and manages all program data, maintaining strict standards for security, integrity and confidentiality. The team prepares analytic files, runs statistical programs and performs baseline and longitudinal analysis across all study areas. Data are analyzed at the grantee, site and national levels to identify trends and performance benchmarks.

A close-up shot of a stressed business woman working from home o
Results

Strengthening the national evidence base for suicide prevention

Aptive continues to deliver results that strengthen the foundation for ongoing Zero Suicide evaluation activities. The team finalized the evaluation and work plans, conducted advisory panel and grantee meetings, and refined tools to support Office of Management and Budget (OMB) clearance.

Key activities include:

  • Hosting evaluation expert and grantee meetings to refine methodology

  • Synthesizing feedback from the evaluation panel on three key studies

  • Developing and distributing the evaluation needs assessment

  • Drafting materials for OMB clearance

  • Participating in the annual Zero Suicide grantee meeting