Test Tool & Methodology Matrix
This page is under development and has not been approved by the working group.
Test Methodologies
Test methodologies provide step by step instructions on how to test accessibility standards. See understanding ACT consistency for details.
| Implementation | Standards | Consistent Rules | Report |
|---|---|---|---|
| Trusted Tester 5.1 |
|
0 Rules
2 Proposed Rules
|
|
Semi-automated Test Tools
Tools that combine user input and automated testing to test accessibility standards. See understanding ACT consistency for details.
| Implementation | Standards | Consistent Rules | Report |
|---|---|---|---|
| Axe DevTools Pro 4.24.5 |
|
0 Rules
3 Proposed Rules
|
|
Automated Test Tools
Automated tools test accessibility standards fully automatically. See understanding ACT consistency for details.
| Implementation | Standards | Consistent Rules | Report |
|---|---|---|---|
| Alfa 0.36.0 |
|
5 Rules
6 Proposed Rules
|
|
| Axe-core 4.4.1 |
|
7 Rules
9 Proposed Rules
|
|
Understanding ACT Consistency
Each ACT rule has examples. Vendors of test tools and methodologies run their implementations against the examples and report the outcome in a standard format. Reports are based on publicly available data.
A test tool or methodology is considered consistent when all the following are true:
- All success criteria that should fail are reported as such, and
- all examples have the expected outcome. (I.e. a failed example should not be passed or vise versa.), and
- there are outcomes for all examples.
Automated implementations may report a “cannot tell” on some, but not all examples and still be considered consistent.
A test tool or methodology is partially consistent when it meets some, but not all requirements. A partially consistent implementation can not include false positives; i.e. it failing any passed or inapplicable examples.
Some ACT Rules are “proposed”. These rules are agreed on by the Accessibility Conformance Testing (ACT) Rules Task Force, and are awaiting implementation and approval by the Accessibility Guidelines Working Group. For details, see about ACT Rules.
Add a Tool or Methodology
For information on how to add your accessibility test tool or methodology to the list of ACT implementations, visit the ACT-Rules community group website.
Disclaimer & Feedback
Inclusion of tools and methodologies in these tables does not indicate endorsement by W3C. Tools and figures are listed for informational purposes only.
Information in these pages is derived from data published by the vendors behind these tools and methodologies. Only tools and methodologies for which public data is available can be listed on this page. Tools and methodologies often have test procedures not yet described using ACT Rules. These are not included in the implementation reports.
The data is taken as-is, and is not verified by the W3C. If there are any questions or concerns about the information on these pages, open an issue on GitHub or e-mail wai@w3.org.