Comparing the effectiveness and accuracy of new usability heuristics

Freddy Paz; Freddy Asrael Paz; José Antonio Pow-Sang

doi:10.1007/978-3-319-41956-5_16

Comparing the effectiveness and accuracy of new usability heuristics

Freddy Paz, Freddy Asrael Paz, José Antonio Pow-Sang

Math

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Scopus citations

Abstract

Nielsen’s usability heuristics are the most recognized assessment tool to conduct heuristic evaluations. However, in a previous study we demonstrated these principles fail to cover all aspects of usability in the emerging categories of software products. The current generation of applications is embedded of special features that are not considered by the conventional principles. For this reason, we have developed a new set of usability heuristics that provide accurate results when are used to evaluate transactional Web applications. In this paper, we present a comparative study, in which the effectiveness of our new proposal and the Nielsen’s approach are contrasted. For this purpose, two groups of students were trained in a different set of principles. Subsequently, they were requested to conduct a heuristic evaluation using the approach that was assigned. Then, the results were compared. The analysis establishes that our new proposal covers more features, is more understandable and is perceived as easy to use. Although the promising results, some improvements and more experiments are required in other scenarios.

Original language	English
Title of host publication	Advances in Human Factors and System Interactions - Proceedings of the AHFE International Conference on Human Factors and System Interactions, 2016
Editors	Isabel L. Nunes
Publisher	Springer Verlag
Pages	163-175
Number of pages	13
ISBN (Print)	9783319419558
DOIs	https://doi.org/10.1007/978-3-319-41956-5_16
State	Published - 2017
Event	International Conference on Human Factors and System Interactions, 2016 - Walt Disney World, United States Duration: 27 Jul 2016 → 31 Jul 2016

Publication series

Name	Advances in Intelligent Systems and Computing
Volume	497
ISSN (Print)	2194-5357

Conference

Conference	International Conference on Human Factors and System Interactions, 2016
Country/Territory	United States
City	Walt Disney World
Period	27/07/16 → 31/07/16

Bibliographical note

Publisher Copyright:
© Springer International Publishing Switzerland 2017.

Keywords

Comparative study
Experimental case study
Heuristic evaluation
Human computer-interaction
Usability heuristics

Access to Document

10.1007/978-3-319-41956-5_16

Cite this

Paz, F., Paz, F. A., & Pow-Sang, J. A. (2017). Comparing the effectiveness and accuracy of new usability heuristics. In I. L. Nunes (Ed.), Advances in Human Factors and System Interactions - Proceedings of the AHFE International Conference on Human Factors and System Interactions, 2016 (pp. 163-175). (Advances in Intelligent Systems and Computing; Vol. 497). Springer Verlag. https://doi.org/10.1007/978-3-319-41956-5_16

Paz, Freddy ; Paz, Freddy Asrael ; Pow-Sang, José Antonio. / Comparing the effectiveness and accuracy of new usability heuristics. Advances in Human Factors and System Interactions - Proceedings of the AHFE International Conference on Human Factors and System Interactions, 2016. editor / Isabel L. Nunes. Springer Verlag, 2017. pp. 163-175 (Advances in Intelligent Systems and Computing).

@inproceedings{347840482ee341bcbb3b996cb014c6ca,

title = "Comparing the effectiveness and accuracy of new usability heuristics",

abstract = "Nielsen{\textquoteright}s usability heuristics are the most recognized assessment tool to conduct heuristic evaluations. However, in a previous study we demonstrated these principles fail to cover all aspects of usability in the emerging categories of software products. The current generation of applications is embedded of special features that are not considered by the conventional principles. For this reason, we have developed a new set of usability heuristics that provide accurate results when are used to evaluate transactional Web applications. In this paper, we present a comparative study, in which the effectiveness of our new proposal and the Nielsen{\textquoteright}s approach are contrasted. For this purpose, two groups of students were trained in a different set of principles. Subsequently, they were requested to conduct a heuristic evaluation using the approach that was assigned. Then, the results were compared. The analysis establishes that our new proposal covers more features, is more understandable and is perceived as easy to use. Although the promising results, some improvements and more experiments are required in other scenarios.",

keywords = "Comparative study, Experimental case study, Heuristic evaluation, Human computer-interaction, Usability heuristics",

author = "Freddy Paz and Paz, {Freddy Asrael} and Pow-Sang, {Jos{\'e} Antonio}",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing Switzerland 2017.; International Conference on Human Factors and System Interactions, 2016 ; Conference date: 27-07-2016 Through 31-07-2016",

year = "2017",

doi = "10.1007/978-3-319-41956-5_16",

language = "English",

isbn = "9783319419558",

series = "Advances in Intelligent Systems and Computing",

publisher = "Springer Verlag",

pages = "163--175",

editor = "Nunes, {Isabel L.}",

booktitle = "Advances in Human Factors and System Interactions - Proceedings of the AHFE International Conference on Human Factors and System Interactions, 2016",

}

Paz, F, Paz, FA & Pow-Sang, JA 2017, Comparing the effectiveness and accuracy of new usability heuristics. in IL Nunes (ed.), Advances in Human Factors and System Interactions - Proceedings of the AHFE International Conference on Human Factors and System Interactions, 2016. Advances in Intelligent Systems and Computing, vol. 497, Springer Verlag, pp. 163-175, International Conference on Human Factors and System Interactions, 2016, Walt Disney World, United States, 27/07/16. https://doi.org/10.1007/978-3-319-41956-5_16

Comparing the effectiveness and accuracy of new usability heuristics. / Paz, Freddy; Paz, Freddy Asrael; Pow-Sang, José Antonio.
Advances in Human Factors and System Interactions - Proceedings of the AHFE International Conference on Human Factors and System Interactions, 2016. ed. / Isabel L. Nunes. Springer Verlag, 2017. p. 163-175 (Advances in Intelligent Systems and Computing; Vol. 497).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Comparing the effectiveness and accuracy of new usability heuristics

AU - Paz, Freddy

AU - Paz, Freddy Asrael

AU - Pow-Sang, José Antonio

N1 - Publisher Copyright: © Springer International Publishing Switzerland 2017.

PY - 2017

Y1 - 2017

N2 - Nielsen’s usability heuristics are the most recognized assessment tool to conduct heuristic evaluations. However, in a previous study we demonstrated these principles fail to cover all aspects of usability in the emerging categories of software products. The current generation of applications is embedded of special features that are not considered by the conventional principles. For this reason, we have developed a new set of usability heuristics that provide accurate results when are used to evaluate transactional Web applications. In this paper, we present a comparative study, in which the effectiveness of our new proposal and the Nielsen’s approach are contrasted. For this purpose, two groups of students were trained in a different set of principles. Subsequently, they were requested to conduct a heuristic evaluation using the approach that was assigned. Then, the results were compared. The analysis establishes that our new proposal covers more features, is more understandable and is perceived as easy to use. Although the promising results, some improvements and more experiments are required in other scenarios.

AB - Nielsen’s usability heuristics are the most recognized assessment tool to conduct heuristic evaluations. However, in a previous study we demonstrated these principles fail to cover all aspects of usability in the emerging categories of software products. The current generation of applications is embedded of special features that are not considered by the conventional principles. For this reason, we have developed a new set of usability heuristics that provide accurate results when are used to evaluate transactional Web applications. In this paper, we present a comparative study, in which the effectiveness of our new proposal and the Nielsen’s approach are contrasted. For this purpose, two groups of students were trained in a different set of principles. Subsequently, they were requested to conduct a heuristic evaluation using the approach that was assigned. Then, the results were compared. The analysis establishes that our new proposal covers more features, is more understandable and is perceived as easy to use. Although the promising results, some improvements and more experiments are required in other scenarios.

KW - Comparative study

KW - Experimental case study

KW - Heuristic evaluation

KW - Human computer-interaction

KW - Usability heuristics

UR - http://www.scopus.com/inward/record.url?scp=84986320281&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-41956-5_16

DO - 10.1007/978-3-319-41956-5_16

M3 - Conference contribution

AN - SCOPUS:84986320281

SN - 9783319419558

T3 - Advances in Intelligent Systems and Computing

SP - 163

EP - 175

BT - Advances in Human Factors and System Interactions - Proceedings of the AHFE International Conference on Human Factors and System Interactions, 2016

A2 - Nunes, Isabel L.

PB - Springer Verlag

T2 - International Conference on Human Factors and System Interactions, 2016

Y2 - 27 July 2016 through 31 July 2016

ER -

Paz F, Paz FA, Pow-Sang JA. Comparing the effectiveness and accuracy of new usability heuristics. In Nunes IL, editor, Advances in Human Factors and System Interactions - Proceedings of the AHFE International Conference on Human Factors and System Interactions, 2016. Springer Verlag. 2017. p. 163-175. (Advances in Intelligent Systems and Computing). doi: 10.1007/978-3-319-41956-5_16

Comparing the effectiveness and accuracy of new usability heuristics

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this