Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove old interpreter input when running tests #864

Merged
merged 2 commits into from
Oct 17, 2023
Merged

Conversation

Baltoli
Copy link
Contributor

@Baltoli Baltoli commented Oct 17, 2023

This PR makes a small change to the lit lines we use to run checks on interpreter output; currently they can receive partially stale input if the test suite has previously been run. The solution is simply to remove any old output from previous interpreter runs before we run them again.

Fixes #863

Copy link
Contributor

@Scott-Guest Scott-Guest left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for fixing this!

@rv-jenkins rv-jenkins merged commit fe3c99f into master Oct 17, 2023
5 checks passed
@rv-jenkins rv-jenkins deleted the fix-flaky-tests branch October 17, 2023 10:03
@Baltoli Baltoli mentioned this pull request Oct 18, 2023
rv-jenkins pushed a commit that referenced this pull request Oct 18, 2023
Similarly to
#864, this PR
addresses a flaky test that can be left in an intermediate state between
runs of the test suite. In this case, we solve the problem by cleaning
up all old `io_log.txt` files _before_ the relevant test runs, rather
than at the end.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Tests can receive stale input
3 participants