Publications

Optimising the website accessibility conformance evaluation methodology

Published in Proceedings of the 19th International Web for All Conference, 2022

The Website Accessibility Conformance Evaluation Methodology (WCAG-EM) is a methodology that guides an auditor through evaluating a website’s conformance to the Web Content Accessibility Guidelines (WCAG). In this paper, we raise some concerns present in the five stages of the WCAG-EM, including the evaluative scope, the non-probabilistic sampling approach, and the potential for bias within the selected sample. We propose a novel framework positioned parallel to the WCAG-EM, but with additional statistical-based metrics to address these concerns. These metrics consider the coverage, representativeness, complexity, popularity, freshness, and accessibility of a population of pages. We provide an overview of these metrics and discuss the possible use with three web page population-sourcing methods: server log files, breadth-first crawling, and depth-first crawling. Finally, we highlight the potential of utilising server log files as a population-sourcing method.

Recommended citation: Alexander Hambley, Yeliz Yesilada, Markel Vigo, Simon Harper. 2022. Optimising the website accessibility conformance evaluation methodology. Proceedings of the 19th International Web for All Conference. https://doi.org/10.1145/3493612.3520452

Empirical web accessibility evaluation for blind web users

Published in ACM SIGACCESS Accessibility and Computing, 2021

The project intends to produce a novel, accurate and holistic system that assesses the accessibility of an entire website based on a sample of webpages. The project also strives to bring statistical rigour to the sampling and clustering of webpages. By orchestrating pre-existing evaluative tools, alongside developer testing, we can produce a combined accessibility assessment. A major benefit to the accessibility field is the effective, large-scale evaluation of large websites. The approach strives to improve automated testing coverage by combining evaluative tools, and minimise inaccuracy through effective clustering and sampling.

Recommended citation: Alexander Hambley. 2021. Empirical web accessibility evaluation for blind web users. SIGACCESS Access. Comput. https://doi.org/10.1145/3458055.3458057