STVR 2019

Automated Visual Classification of DOM-based Presentation Failure Reports for Responsive Web Pages

Manual Classification of web pages:

For each failure reported by ReDeCheck on the new subject used in the paper, a human made manual classification is listed here. They can take on one of three classifications, True Positive (TP), False Positive (FP), and Non-Observable Issue (NOI). TPs are failures that display visual issues with the layout of the subject web page, such as overlapping elements, elements overflowing their container, element that are wrapped into a new row, and layouts that exist for only a few viewports. NOIs are failures that are detected at the DOM level but are not visually aparent during manual analysis. FPs are layouts that are considered to be as intendional design changes by the developer during manual analysis or reported by ReDeCheck in error.

The main table provides an overview of the failure, such as the web page it occurred on and its classification. For more detailed information and the screenshot produced by Verve, click on the link for the relevant failure report labled “Screenshot”.

Jump to True Positives

Jump to False Positives

Jump to Non-Observable Issues

True Positives

Non-Observable Issues

False Positives

Other Failures:

Another set of failures are part of a previous study that was manually classified and publiched at ReDeCheck.org.