The Program Being Evaluated
Achieving Competence Today (ACT) was a program of Partnerships for Quality Education, a national initiative of the Robert Wood Johnson Foundation (RWJF). ACT tested the use of a Web-based curriculum by medical residents and graduate nursing students at more than 20 schools as a means for them to identify problems in patient care quality and collaboratively use systems-based approaches to improving care. RWJF funded ACT from May 2003 through September 2008.
About the Evaluation
In 2005, RWJF funded evaluators Michael Yedidia, Ph.D., and Colleen Gillespie, Ph.D., of Rutgers University to carry out an evaluation of ACT through a post-training survey of ACT II learners, and pre- and post-training study of ACT III learners and leaders.
The evaluators sought answers in four areas:
- How did learners assess the value of participating in the quality improvement process in the context of their training?
- What was the nature of the quality improvement projects conducted as part of ACT training? How were the projects valued by learners and leaders? How did they assess the contribution of ACT to quality improvement at their institutions?
- To what extent did learners collaborate with peers or staff from different disciplines in developing improvement projects? How did learners and leaders assess the quality of the collaborative experience? What were the factors that either facilitated or impeded effective interdisciplinary collaboration?
- What factors appeared to differentiate those health professions education programs prepared to pay $10,000 to continue participation in ACT from those that didn't?
Summary of Methods
To carry out the evaluation, Yedidia and Gillespie conducted:
- A post-training survey of the ACT II cohort of learners to elicit their assessments of the ACT training and their experience with and evaluation of quality improvement projects.
- A survey of leaders of the ACT initiatives to assess their valuation of the learning experience; their appraisal of the contribution of the projects to quality improvement at their institutions; and their estimation of the centrality of interprofessional collaboration to the ACT initiatives.
- A pre-training and post-training survey of ACT III learners and a survey of ACT III leaders (faculty preceptors, medical education or quality improvement directors) to yield data for analyzing determinants of their decisions as to whether or not to continue participation with no funding.
Knowledge and Impact
In a report on ACT submitted to RWJF in January 2007, the evaluation team reported the following:
- Learners (medical residents or graduate nursing students) commended the ACT training overall. Some 80 to 89 percent of ACT learners "strongly agreed" or "somewhat agreed" that they would recommend the initiative to others.
- Among key elements of ACT training, learners most highly rated the development of a quality improvement project. Content areas most frequently chosen by learners for their projects were:
- Effectiveness of care—providing appropriate care to those who could benefit and avoiding unnecessary care.
- Timeliness—reducing patient wait times and potentially harmful delays.
- Patient safety.
- ACT leaders (medical education or quality improvement directors, ACT preceptors and teachers) concurred with learners in their assessment of the value of learners' quality improvement projects to their institutions. More than 88 percent of leaders and learners felt they were of moderate or great value.
- Interdisciplinary collaboration was viewed, generally, as very important to the work of quality improvement, with 65 percent of leaders and 69 percent of learners holding this view. Learners, regardless of discipline, credited their ACT training with improving their outlook on two key dimensions of interdisciplinary work:
- Developing trust among collaborators.
- Becoming more aware of the limits of a single-disciplinary approach to care.
- When asked what most facilitated collaboration, learners' most prominent response was "the necessity of getting the job done."
RWJF Scholar examines neighborhood-based death rates from opiate-based painkiller overdoses, compared with heroin overdose deaths.
RWJF Nurse Faculty Scholar Jennifer Bellot writes about losing her grandmother to complications from a medical error.
RWJF Health & Society Scholar Brendan Saloner on subsidized health insurance's impact on family economics.
Learn how The Robert Wood Johnson Foundation is dedicated to building a culture of health in Risa Lavizzo-Mourey's 2014 annual message.
The County Health Rankings & Roadmaps can be put to use right away to help create a culture of health in your community.
America is not getting good value for its health care dollar. These resources explore issues of cost and value of health care.
Judith Halstead, president of the National League for Nursing, writes about the role of nursing education in realizing a transformed health ...
Developing small community homes as alternatives to nursing homes, this radical, new national model for skilled nursing care returns control...
While the need to address disparities in care is well known, few strategies for reducing disparities have been studied systematically.
RWJF Scholar puzzles out why people who do not drink alcohol are at greater risk for premature death than light to moderate drinkers.
A short distance can mean large disparities in health. Across America, babies born just a few miles apart have dramatic differences in life ...
CDC: Mixed Progress in Food Safety Efforts - FDA: Common Procedure to Remove Uterus, Uterine Fibroids Can Spread Cancer - Approximately 12M ...