-
Notifications
You must be signed in to change notification settings - Fork 21
Adapt the 'rpm-ostree' test suite to continue on failure #404
Adapt the 'rpm-ostree' test suite to continue on failure #404
Conversation
This changes the `rpm-ostree` test suite to use the 'continue on failure' model. Partially addresses projectatomic#375
This worked well on a pristine system, but I was getting tripped up when re-using a test sytsem. This cleans up some of the transient artifacts that can be generated by the compose. Additionally, I added a `wait_for` to make sure the HTTP server starts.
bot, retest this please |
1 similar comment
bot, retest this please |
We were seeing instances where variable values passed to `import_role` where not being respected each time it was called. I thought that each time an 'import' was done the changed variables would be respected, but that doesn't appear to be the case. Using `include_role` will allow us to dynamically load in variables each time the role is used. This is kind of troubling as we made a large switch to using `include_role` in most places, but we've not run into any problems like this yet.
This is a forward-port of functionality from projectatomic#405 which corrects an assumption about how Ansible was handling failures.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good overall. We should either move the ostree admin status test to a separate test or remove it completely and add it to the improved-sanity-test
tests/rpm-ostree/deploy_version.yml
Outdated
- name: Run ostree admin status as a quick sanity check | ||
command: ostree admin status | ||
tags: | ||
- ostree_admin_status |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can this be moved into a separate test?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Probably a good candidate for the sanity test
Oof...that was a lazy commit. Trying to use a task among the Working on a fix... |
In projectatomic#381, a sanity check for `ostree admin status` was added to the `rpm-ostree` test suite. It is probably better suited to the 'sanity' test suite so we are able to catch any regressions earlier in the testing cycle. I created a dumb role for the `ostree admin status` command since that was easier than trying to wedge it into an existing role.
928e83e
to
0da3cb7
Compare
LGTM! |
This adapts the
rpm-ostree
test suite to the continue on failure model. As part of the work, I made some slight changes to the 'compose' portion of the test suite to make it a bit more resilient.Additionally, I snuck in a change to the
.gitignore
file to ignore the.log
files that are being generated.Partially addresses #375