6 Commits

Author	SHA1	Message	Date
Phil Renaud	f34938d9f0	Percy snapshot tests (#12872) ... * Sample percy test added * Node engine up to 14.x for UI prep * Force ui test rerun * Updated config.yml * Node v upgraded to 14 for docker image * Expect length in test * Running ember tests under percy exec * Percy exec format * Percy cli added * Noop to rerun tests with updated percy_token * Evals full list and details open snapshots * Pretty legit use of assert so disable the warning * Jobs list tests * Snapshots for top-level clients, servers, ACL, topology, and storage lists * Expect caveat for Topology test * Stabilizing tests with faker seeded to 1 * Seed-stabilizing any tests with percySnapshots * Faker import * Drop unused param * Assets and test audit using an older node version * New strategy: avoid seeding, just use percyCSS to hide certain things	2022-05-05 16:05:13 -04:00
Luiz Aoqui	44277375d2	ui: update node version in GitHub Actions	2021-11-05 20:33:40 -04:00
Buck Doyle	eb1a84821a	Fix audit workflow action versions (#9877) ... This fixes the version reference error seen in this workflow failure: https://github.com/hashicorp/nomad/actions/runs/504695096 I’ve also included an update to the sticky comment action version to address this warning in the above link: marocchino/sticky-pull-request-comment@33a6cfb looks like the shortened version of a commit SHA. Referencing actions by the short SHA will be disabled soon. Please see https://docs.github.com/en/actions/learn-github-actions/security-hardening-for-github-actions#using-third-party-actions. We were previously using 33a6cfb after the maintainer merged my PR to allow the comment to be read from a file, there was no released version with that, but it’s now included in v2.0.0.	2021-01-26 09:06:22 -06:00
Buck Doyle	8847de10c2	Change to fork of audit to log flaky tests (#9518) ... This will report the names of flaky tests instead of just counting them.	2021-01-21 08:25:16 -06:00
Buck Doyle	6e7c180277	Remove minor version from audit comparison action (#8048) ... Making this less specific means we can benefit from updates to the action without needing to change the workflow, such as the bug fix in backspace/ember-test-audit-comparison-action@a87d252, which addresses the incorrect duration delta here: https://github.com/hashicorp/nomad/pull/7964#issuecomment-632351171	2020-05-26 15:34:12 -05:00
Buck Doyle	07fb795fa1	Add test-timing comparison for UI PRs (#7929) ... This runs ember-test-audit for UI PRs to compare how long the tests take for the base vs the PR. It posts or updates a comparison of times and test count. It’s somewhat slow to report back as it runs the test suite three times to even out variability in a shared environment. If we end up being unhappy with that slowness, we could try running the repetitions in parallel as well, but that would involve more changes to ember-test-audit.	2020-05-21 11:41:13 -05:00