Dimensions of Ecological Validity for Usability Evaluations in Clinical Settings (bibtex)
by van Berkel, Niels, Clarkson, Matthew J., Xiao, Guofang, Dursun, Eren, Allam, Moustafa, Davidson, Brian R. and Blandford, Ann
Abstract:
The development, evaluation, and eventual deployment of novel medical devices is a complex process involving various areas of expertise. Although the need for a User Centred Design approach to the development of both hardware and software has long been established, both current regulatory guidelines and widespread evaluation approaches fail to reflect the challenges encountered during day-to-day clinical practice. As such, the results from these evaluations may not provide a realistic account of the problems encountered by users when introduced to clinical practice. In this paper, we present a case study on designing the evaluation of a novel device to support laparoscopic liver surgery. Through a reflective account of the design of our usability evaluation, we identify and describe seven primary dimensions of ecological validity encountered in clinical usability evaluations. These dimensions are: ‘user roles’, ‘environment’, ‘training’, ‘scenario’, ‘patient involvement’, ‘software’, and ‘hardware’. We analyse three recently published clinical usability evaluation articles to assess (and illustrate) the applicability and completeness of these dimensions. Finally, we discuss the compromises encountered during clinical usability evaluations and how to best report on these considerations. The framework presented here aims to further the agenda of ecologically valid evaluation practice, reflecting the constraints of medical practice.
Reference:
N. van Berkel, M. J. Clarkson, G. Xiao, E. Dursun, M. Allam, B. R. Davidson, A. Blandford, "Dimensions of Ecological Validity for Usability Evaluations in Clinical Settings", Journal of Biomedical Informatics, vol. 110, 2020, 103553.
Bibtex Entry:
@article{Berkel2020EcologicalValidity,
	Abstract = {The development, evaluation, and eventual deployment of novel medical devices is a complex process involving various areas of expertise. Although the need for a User Centred Design approach to the development of both hardware and software has long been established, both current regulatory guidelines and widespread evaluation approaches fail to reflect the challenges encountered during day-to-day clinical practice. As such, the results from these evaluations may not provide a realistic account of the problems encountered by users when introduced to clinical practice. In this paper, we present a case study on designing the evaluation of a novel device to support laparoscopic liver surgery. Through a reflective account of the design of our usability evaluation, we identify and describe seven primary dimensions of ecological validity encountered in clinical usability evaluations. These dimensions are: ‘user roles’, ‘environment’, ‘training’, ‘scenario’, ‘patient involvement’, ‘software’, and ‘hardware’. We analyse three recently published clinical usability evaluation articles to assess (and illustrate) the applicability and completeness of these dimensions. Finally, we discuss the compromises encountered during clinical usability evaluations and how to best report on these considerations. The framework presented here aims to further the agenda of ecologically valid evaluation practice, reflecting the constraints of medical practice.},
	Author = {van Berkel, Niels and Clarkson, Matthew J. and Xiao, Guofang and Dursun, Eren and Allam, Moustafa and Davidson, Brian R. and Blandford, Ann},
	Doi = {10.1016/j.jbi.2020.103553},
	Issn = "1532-0464",
	Journal = {Journal of Biomedical Informatics},
	Pages = {103553},
	Title = {Dimensions of Ecological Validity for Usability Evaluations in Clinical Settings},
	Url = {https://nielsvanberkel.com/files/publications/jbi2020a.pdf},
	Volume = {110},
	Year = {2020}}
Powered by bibtexbrowser