Digital Health Implementation Playbook Step 11: Evaluating Success


Determine your program’s success by revisiting your goals. Focusing on the key success metrics you identified in Step 3 (Defining Success), relevant data points you’ve collected will allow you to determine whether you’ve achieved success. In addition to hard metrics, such as increased productivity and clinical outcomes, remember to consider how remote patient monitoring has impacted patient and staff satisfaction, patient behavior and compliance with treatment as a result of patients being more active in their care. If you haven’t hit your goals, determine if this is due to an issue with the remote monitoring technology, patient engagement, or the organizational implementation. Then, look for opportunities to restructure the program for improvement. If you are achieving success, compile your most compelling data to justify scaling your program for greater impact.

Goals to accomplish

  • Gather data used to track your key success metrics
  • Collect Feedback from your Implementation team
  • Determine your success by comparing this data to the pre-implementation baseline
  • If failing to meet goals, revisit your process to identify hurdles to success; rework and iterate as necessary
  • If succeeding, gather compelling success metrics into an expansion proposal
  • Consult your Core and Leadership teams to determine the program’s future
  • Align on goals for next iteration or phase of the program

Why evaluating success is important

Validate your program’s success to secure its future. In order to determine the next step for your program, you have to know how it’s performing. Use RPM-generated data to evaluate patient outcomes and engagement. Combine this with observed impacts to satisfaction, financial and operational measures to determine:

  • Whether to scale the program to expand benefits of RPM to more patients
  • How to rework the program to better perform against key metrics
  • The most persuasive measures to justify continued or expanded funding

Best practice

Measure success against your initial goals. Hold yourself accountable to the goals you set at the beginning of the project to determine if you’re achieving success. Aligning to these metrics provides objectivity and enhances buy-in since key decision-makers are already aligned with these goals. Your performance against these goals should provide clear direction on your next steps.

Avoiding a misstep

Re-evaluate and iterate to reach success. If you are not hitting your goals after your initial implementation, take the time to evaluate why the program is struggling. Rather than scrap the program entirely, go back through the previous steps to identify the root of any problems and consider if and how you can rework the program for success.

Quick tip


Practice spotlight

The implementation of any new technology can be mistaken as a linear, forward-only process. That said, organizations who support a culture of feedback and continual improvement are often far more successful. For example, when the team at AMITA Health launched RPM for ICU patients, they performed daily huddles with the physician and nursing end users to evaluate and improve the program and clinical process. In doing so, two opportunities were identified: the need for additional education for the on-site APNs and added clarity on EHR documentation among the remote physicians. In response, the APNs received additional training on the role of remote physician, which improved adoption, buy-in, and acceptance of the program. The clarification of physician documentation increased compliance with note writing and order entry to 100%, and, overall, the handoff process improved.

—Laura Messineo, System Director, TeleHealth Strategy and Development, AMITA Health



Playbook: Step 11-Lessons Learned

Now that you have completed Step 11 in the AMA Digital Health Implementation Playbook, continue with Step 12: Scaling. You can also go back to Step 10: Implementing, or visit the playbook main page to review all 12 steps.

AMA Digital Health Implementation Playbook

Download the Playbook to review all 12 steps to implement and scale remote patient monitoring in practice.