Kathleen McKeown, Desmond Jordan, Steven Feiner, James Shaw, Elizabeth Chen, Shabina Ahmad, Andre Kushniruk, and Vimla Patel (2000). "A Study of Communication in the Cardiac Surgery Intensive Care Unit and its Implications for Automated Briefing." To appear in Proc. of the American Medical Informatics Association 2000 Symposium.
We present a study of the information transferred among caregivers in the context of cardiac surgery and use the study to evaluate a system, MAGIC, that we are developing for automated generation of briefings. Our framework integrates cognitive and quantitative evaluation methods and features three standards that reflect current practice in the Cardiothoracic Intensive Care Unit (CTICU). Using experimental design to compare human-generated and machine-generated briefings, we show that MAGIC's current level of performance is useful. Moreover, MAGIC could help improve information flow in the CTICU by providing a consistent set of information earlier than in current practice. The separate standards are also consistent in suggesting specific modifications that may be necessary for iterative design and further system development.