home | publications | events | related links | search | about
 


Above Board: Issues in Medical Accident Investigation and Analysis

Colloquium at the Human Factors and Ergonomics Society National Conference
Tuesday, 27 September 2005, Orlando, FL

James Battles, AHRQ
Mark Bruley, ECRI
Richard Cook, MD (co-chair) University of Chicago
Jay Crowley, US FDA
Christopher Nemeth, PhD (co-chair) University of Chicago

Building on a highly successful session at HFES 2004, this colloquium examined the issues that are bear on the success or failure of medical accident investigation and analysis. In-house investigations by panels without sufficient accident analysis training and expertise do not produce results that educate their own or other institutions. Thorough, objective investigation of medical adverse events rarely happens due to the complexity of the environment, litigation, risk, and socio-political implications. Healthcare adverse event data collection and analysis relies on impartial, qualified investigators who have detailed domain knowledge and the use diverse investigation methods. This half day session reviewed the tenets of accident investigation and analysis, identified and examined obstacles to obtaining thorough, detailed, and insightful results, and compared healthcare to other high hazard sectors with regard to accident investigation criteria. It also presented participants with the description of an adverse event that will challenge them to develop their own notion of investigation needs, obstacles and strategies.  

Healthcare is unique by comparison with other high hazard sectors such as transportation and nuclear power generation. Stakes are always high because outcomes routinely have a significant effect on patient health. While other sectors strive to minimize variability through uniform, consistent operations, healthcare cannot. Healthcare operations are necessarily complex, highly variable and comprised of densely concentrated professional knowledge in order to meet the complexity, variability and uncertainty of the need for patient care. These traits make information difficult to know ahead of time. Emergencies, cancellations, unprepared or absent patients create conditions that change continually. Multiple conflicting agendas result in ill-defined team goals that can be in conflict. Information must be pooled and shared because no individual can have all of the knowledge that is necessary to coordinate activities that are distributed across so many departments. As a service sector, circumstances and activities play a significant role compared with physical evidence in understanding the circumstances of an accident.

Adverse events, or accidents, in healthcare can have significant clinical outcomes including loss of property, health (morbidity), and life (mortality). The investigation and analysis of medical accidents is intended to discover information that explains the nature and cause of what occurred in the interest of preventing or minimizing future loss. However, healthcare accidents have features that make post-event investigations particularly difficult. Thorough, objective investigation of medical adverse events rarely happens due to the complexity of the environment, litigation, risk, and socio-political implications.

Healthcare organizations have no impartial national resource on which they can rely to investigate accidents. As a result, each healthcare institution is responsible to develop its own program using the resources that are available at hand. Healthcare organizations currently create their own panels to investigate adverse events at their own facility. The “safety” programs that result in such an environment are designed to meet the approval of the hospital’s accrediting organization when it conducts a review. This arrangement amounts to a social contract that works well until an event occurs that draws attention of the public and regulatory organizations such as state medical boards. Each healthcare organization’s safety committee tends to be comprised of administrative and medical staff members who have little to no experience in systems analysis or accident investigation. Members of safety committees do not have the benefit of the same level of education, training and insight as the practitioners who are involved in an incident. Workers and managers within a system tend to view almost everything about that system as unchangeable except for the most superficial local factors. Locally-conducted analyses seem to focus on what is described as “operator error” because the panel’s scope of action is largely limited to influencing local conditions instead of broader agendas such as device design or regulatory policy. The local committee approach sheds more light on why institutions can't deal with adverse outcomes than on the nature of the events they seek to understand.  

Unfamiliarity with accident theory tends to result in committees that follow a single method such as root cause analysis to conduct their investigation. As members of accident investigation panels are employed by the institution they are investigating, it is difficult to be impartial. Investigations by such panels tend to discover information that is limited to an individual event. Information that is gathered is not shared with other medical institutions, which prevents the improvement of safe practices across other institutions. Special concerns such as organizational embarrassment and fears over the potential loss of funding can undermine investigation depth, breadth, and quality. Socio-political concerns can pre-empt even the most effective data collection effort. For that reason, healthcare adverse event investigation must be above board and conducted in an objective, impartial manner.

Reason (1997:18) has described a process of accident analysis for any complex system: start with a bad outcome, consider how and when defenses failed, establish what active failures and latent conditions were involved (for each defense that was bypassed or breached), consider what local conditions could have shaped or provoked each unsafe act, and ask what upstream factors could have contributed to each local condition. Cook, Woods, and Miller, (1998) have demonstrated the use of a parallel approach to understand the role that practitioners play in operating demand-driven complex technical systems such as healthcare. Beyond process, though, it takes deliberate effort to create the kind of environment that makes effective adverse event investigations possible. The nature of risk management encompasses a much greater range of elements than a single field of practice or even a single hospital. Failure to account for those elements ignores many of the aspects that influence how each facility operates. Insights into adverse events flow from diverse, not uniform, points of view. Rasmussen (1998) described the relationships among various disciplines that are involved in risk management. Professionals in engineering, human performance, organization and management, and the social sciences can, and should, be available in order to bring insight to the accident investigation. Each of these disciplines understands the nature of action, judgment and plans at the work and staff levels. Professionals in law, economics, sociology and political science have insight into the activities of regulators, associations and the government. Other high hazard sectors have already addressed the issue of a large scale organization to deal with adverse events. For example, the National Transportation Safety Board (NTSB) exists to examine accidents and provide findings to the benefit of all concerned with transportation. While opinions may vary regarding their methods, NTSB investigators are considered to be technically competent and have developed an organization and procedures that serve accident investigation well.  

Healthcare’s transition from closed, in-house inquiry to investigation by an external agent such as an independent board raises issues that will need to be addressed. Some of them lend themselves to discussion among those who participate in the Colloquium: How will the wide variety of healthcare organizations respond to the role of an independent investigation? How will such inquiries be protected from discovery in litigation? How will issues of patient information privacy square with the need to understand the specifics of what occurred? Who has the professional expertise that is necessary to get at the nature of what actually occurred? How will the results of the investigation be used outside the institution where the event occurred? Views among the law, government, and healthcare will each have an effect on the answers to these issues.

Healthcare forensics exists to improve healthcare practice and to remedy loss. Short-term progress in both areas relies on the evolution beyond ‘blame the operator’ to understanding health care uncertainty, complexity and scope. Long-term progress relies on the development of institutions, resources and values that collaborate to the benefit of those who seek care.

References

Cook, R., Woods, D. and Miller, C. (1998) A Tale of Two Stories: Contrasting Views of Patient Safety. National Health Care Safety Council of the National Patient Safety Foundation. Chicago: American Medical Association. 

Nemeth, C. (2005). Healthcare Forensics. In Karwowski, W. and Noy, I.(Eds.).Handbook of Human Factors in Litigation. New York: Taylor and Francis. 

Nemeth, C., Cook, R.I., Patterson, E., Donchin, Y., Rogers, M., and Ebright, P. (2004, September). Afterwords: The Quality of Medical Accident Investigation and Analyses. Proceedings of the Human Factors and Ergonomics Society National Conference, New Orleans.

Rasmussen, J. (1998). Merging Paradigms: Decision Making, Management, and Cognitive Control. In Flin,R., Salas, E., Strub, M. and Marton, L. (Eds.). Decision-Making Under Stress: Emerging Themes and Applications. Brookfield, VT: Ashgate. 67-81.

Reason, J. (1997) Managing the Risks of Organizational Accidents. Brookfield, VT: Ashgate.

 


 
    home | publications | events | related links | searchabout