Heuristic evaluation of mission-critical software using a large team

Tim Buxton; Alvin Tarrell; Ann Fruhling

doi:10.1007/978-3-642-02583-9_73

Heuristic evaluation of mission-critical software using a large team

Tim Buxton, Alvin Tarrell, Ann Fruhling

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Scopus citations

Abstract

Heuristic evaluation is a common technique for assessing usability, but is most often conducted using a team of 3-5 individuals. Our project involved a team of 16 stakeholders assessing usability of a mission-critical decision support system for the US military. Data collected from so many evaluators could easily become overwhelming, so we devised a method to first filter evaluations based on agreement between evaluators, and then further prioritize findings based on their individual Frequency, Impact, and Severity scores. We termed our methodology the 'Integrated Stakeholder Usability Evaluation Process,' and believe it will be useful for other researchers conducting similar research involving heuristic evaluations with large groups.

Original language	English (US)
Title of host publication	Human-Computer Interaction
Subtitle of host publication	Interacting in Various Application Domains - 13th International Conference, HCI International 2009, Proceedings
Pages	673-682
Number of pages	10
Edition	PART 4
DOIs	https://doi.org/10.1007/978-3-642-02583-9_73
State	Published - 2009
Event	13th International Conference on Human-Computer Interaction, HCI International 2009 - San Diego, CA, United States Duration: Jul 19 2009 → Jul 24 2009

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 4
Volume	5613 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	13th International Conference on Human-Computer Interaction, HCI International 2009
Country/Territory	United States
City	San Diego, CA
Period	7/19/09 → 7/24/09

Keywords

Decision Support
Heuristic Evaluation
Usability Evaluation Methods

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-642-02583-9_73

Cite this

Buxton, T., Tarrell, A., & Fruhling, A. (2009). Heuristic evaluation of mission-critical software using a large team. In Human-Computer Interaction: Interacting in Various Application Domains - 13th International Conference, HCI International 2009, Proceedings (PART 4 ed., pp. 673-682). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5613 LNCS, No. PART 4). https://doi.org/10.1007/978-3-642-02583-9_73

Heuristic evaluation of mission-critical software using a large team. / Buxton, Tim; Tarrell, Alvin; Fruhling, Ann.
Human-Computer Interaction: Interacting in Various Application Domains - 13th International Conference, HCI International 2009, Proceedings. PART 4. ed. 2009. p. 673-682 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5613 LNCS, No. PART 4).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Buxton, T, Tarrell, A & Fruhling, A 2009, Heuristic evaluation of mission-critical software using a large team. in Human-Computer Interaction: Interacting in Various Application Domains - 13th International Conference, HCI International 2009, Proceedings. PART 4 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 4, vol. 5613 LNCS, pp. 673-682, 13th International Conference on Human-Computer Interaction, HCI International 2009, San Diego, CA, United States, 7/19/09. https://doi.org/10.1007/978-3-642-02583-9_73

Buxton T, Tarrell A, Fruhling A. Heuristic evaluation of mission-critical software using a large team. In Human-Computer Interaction: Interacting in Various Application Domains - 13th International Conference, HCI International 2009, Proceedings. PART 4 ed. 2009. p. 673-682. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 4). doi: 10.1007/978-3-642-02583-9_73

Buxton, Tim ; Tarrell, Alvin ; Fruhling, Ann. / Heuristic evaluation of mission-critical software using a large team. Human-Computer Interaction: Interacting in Various Application Domains - 13th International Conference, HCI International 2009, Proceedings. PART 4. ed. 2009. pp. 673-682 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 4).

@inproceedings{63eb46f4ee4f4889ab5d7a4b9af00275,

title = "Heuristic evaluation of mission-critical software using a large team",

abstract = "Heuristic evaluation is a common technique for assessing usability, but is most often conducted using a team of 3-5 individuals. Our project involved a team of 16 stakeholders assessing usability of a mission-critical decision support system for the US military. Data collected from so many evaluators could easily become overwhelming, so we devised a method to first filter evaluations based on agreement between evaluators, and then further prioritize findings based on their individual Frequency, Impact, and Severity scores. We termed our methodology the 'Integrated Stakeholder Usability Evaluation Process,' and believe it will be useful for other researchers conducting similar research involving heuristic evaluations with large groups.",

keywords = "Decision Support, Heuristic Evaluation, Usability Evaluation Methods",

author = "Tim Buxton and Alvin Tarrell and Ann Fruhling",

year = "2009",

doi = "10.1007/978-3-642-02583-9_73",

language = "English (US)",

isbn = "364202582X",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 4",

pages = "673--682",

booktitle = "Human-Computer Interaction",

edition = "PART 4",

note = "13th International Conference on Human-Computer Interaction, HCI International 2009 ; Conference date: 19-07-2009 Through 24-07-2009",

}

TY - GEN

T1 - Heuristic evaluation of mission-critical software using a large team

AU - Buxton, Tim

AU - Tarrell, Alvin

AU - Fruhling, Ann

PY - 2009

Y1 - 2009

N2 - Heuristic evaluation is a common technique for assessing usability, but is most often conducted using a team of 3-5 individuals. Our project involved a team of 16 stakeholders assessing usability of a mission-critical decision support system for the US military. Data collected from so many evaluators could easily become overwhelming, so we devised a method to first filter evaluations based on agreement between evaluators, and then further prioritize findings based on their individual Frequency, Impact, and Severity scores. We termed our methodology the 'Integrated Stakeholder Usability Evaluation Process,' and believe it will be useful for other researchers conducting similar research involving heuristic evaluations with large groups.

AB - Heuristic evaluation is a common technique for assessing usability, but is most often conducted using a team of 3-5 individuals. Our project involved a team of 16 stakeholders assessing usability of a mission-critical decision support system for the US military. Data collected from so many evaluators could easily become overwhelming, so we devised a method to first filter evaluations based on agreement between evaluators, and then further prioritize findings based on their individual Frequency, Impact, and Severity scores. We termed our methodology the 'Integrated Stakeholder Usability Evaluation Process,' and believe it will be useful for other researchers conducting similar research involving heuristic evaluations with large groups.

KW - Decision Support

KW - Heuristic Evaluation

KW - Usability Evaluation Methods

UR - http://www.scopus.com/inward/record.url?scp=70349085823&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70349085823&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-02583-9_73

DO - 10.1007/978-3-642-02583-9_73

M3 - Conference contribution

AN - SCOPUS:70349085823

SN - 364202582X

SN - 9783642025822

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 673

EP - 682

BT - Human-Computer Interaction

T2 - 13th International Conference on Human-Computer Interaction, HCI International 2009

Y2 - 19 July 2009 through 24 July 2009

ER -

Heuristic evaluation of mission-critical software using a large team

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this