Program Evaluation

 

GettyImages-681735120.jpg

As federal, state, and local agencies continue to test improvements to their health care systems, robust evaluations are necessary to evaluate their impact and determine best practices. Acumen has significant experience designing and implementing flexible and insightful evaluations of federal and state health care programs, specifically programs testing innovations related to payment policy and care delivery. Our group conducts a wide range of mixed methods and quantitative program evaluations to assess the programs’ impact on health care costs, standards of care and patient health and quality of life.

In our work across a range of clients, Acumen leverages a broad array of quantitative and qualitative methods and data sources, including analysis of public and commercial payer claims data, electronic health record (EHR) data, surveys, interviews, and site visits.

Case Study:

Evaluation of the Medication Management (MM) and Shared Decision Making (SDM) Health Care Innovation Awardees (2013-2017) - Prepared for the Centers for Medicare & Medicaid Services, Center for Medicare & Medicaid Innovation

As part of the Round One Health Care Innovation Awards (HCIA), CMMI awarded grants to nine programs implementing shared decision-making (SDM) and medication management (MM) innovations. These programs were aimed at delivering better care and reducing individual expenditures:

  • The HCIA SDM programs encouraged patients to become fully informed about the risks and benefits of available medical treatments and to participate in selecting treatment options.
  • The HCIA MM programs aimed to improve medication use to reduce medication-related adverse events and improve patient outcomes through medication reviews, patient education, remote monitoring pill bottles, and other mechanisms.

To evaluate the impact of these nine SDM and MM programs, Acumen and its subcontractor, Westat, conducted a four year mixed methods evaluation with rapid cycle feedback to awardees that addressed two overarching research questions:

  1. Which innovative approaches reduced health care costs while improving or maintaining the standard of care, patient health, and quality of life?
  2. Which contextual factors and mechanisms contributed to an intervention’s success?

To answer these questions, Acumen combined claims-based quantitative analysis with qualitative information obtained from surveys, interviews, and site visits, and evaluated programs across a range of criteria. In doing so, Acumen was able to identify programs that were associated with significant reductions in Medicare expenditures and improved health outcomes.

Publications

Evaluation of the Shared Decision Making (SDM) Health Care Innovation Awardees Third Annual Report, (with Kristy Piccinini and Michael Wernecke, Ekta Ghimire, Michael Alexander, Noy Birger, Mira Chaykin, Carmen Dekmezian, Riley Franks, Russell Haron-Feiertag, Anna Kamen, Krishan Kumar, Jiemin Liao, Anchi Lo, Dimitra Politi, Karina Solomonik, Yuqin Wei, Taylor White, Jason Wyman, Lucy Yao, Yanchang Zhang, Lois Olinger, Lauren Mercincavage, Shannon Fair, Stephanie Stratos, Jennifer Nooney, Stephanie Fry, Paul Weinfurter ), Report prepared by Acumen, LLC, Burlingame, CA. Centers for Medicare & Medicaid Services, 2017.

Evaluation of the Medication Management (MM) Health Care Innovation Awardees Third Annual Report, (with Kristy Piccinini and Michael Wernecke, Ekta Ghimire, Michael Alexander, Noy Birger, Mira Chaykin, Carmen Dekmezian, Riley Franks, Russell Haron-Feiertag, Anna Kamen, Krishan Kumar, Jiemin Liao, Anchi Lo, Dimitra Politi, Karina Solomonik, Yuqin Wei, Taylor White, Jason Wyman, Lucy Yao, Yanchang Zhang, Lois Olinger, Lauren Mercincavage, Shannon Fair, Stephanie Stratos, Jennifer Nooney, Stephanie Fry, Paul Weinfurter), Report prepared by Acumen, LLC, Burlingame, CA. Centers for Medicare & Medicaid Services, 2017.