-
Notifications
You must be signed in to change notification settings - Fork 116
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update Zulip tests and re-enable #441
base: main
Are you sure you want to change the base?
Conversation
This has the update to unblock autocomplete changes: zulip/zulip-flutter#1190 flutter/flutter#143249 and with that, tests pass again on Flutter main.
Tests pass in Zulip's own CI on Flutter main, after zulip/zulip-flutter#1190, so I expect they'll pass here too. We'll have confirmation on that soon. @justinmc @Piinks I saw a mention at #437 (comment) that there was more than one upstream change these tests were blocking. I guess any others haven't yet landed, given that tests pass — what's the other PR (or PRs) involved? (I did just re-scan through Zulip's PR queue and my email, but didn't spot anything.) Happy to take updates as needed. |
There were a couple PRs that were seeing test flakes actually, @gnprice do you have a sense for how flaky some tests may be in this test suite? |
We've had a flaky test or two in the past, but I'm not aware of any right now. If you can track down the affected test runs or PRs, I'd be glad to investigate. |
(I've also now kicked off running our test suite a bunch of times in a loop, on my own machine — so if there is a flake currently present, hopefully that will find it.) |
Other than this comment #437 (comment)
|
Thanks — looking into those. |
I've investigated and I believe there are no flakes in the tests. There is an infra issue, which caused one and probably both of the failures mentioned above. I'll deal with that. The failure at #437 (comment) comes from The failure on https://github.com/flutter/flutter/pull/161091/checks quoted above is hard to pin down because the checks have been re-run since then, and there doesn't seem to be a way to get more details from GitHub (though I spent some time digging for them). Do you have a more complete log than that snippet? Lacking more info on that one, though: "5 failed" is exactly the number of tests that would fail for lack of libsqlite3.so, so with no sign of another issue it's probably that one. Then to actively search out any flakes:
|
This package is no longer included in GitHub's new version of the "ubuntu-latest" images. That causes nondeterministic failures when the runner happens to use the new version: flutter#441 (comment) The actual shared library file libsqlite3.so.0.8.6 -- in the package libsqlite3-0 -- is still installed by default anyway. This package adds the symlink at "libsqlite3.so", which is the filename some libraries apparently look for.
Fixed that infra issue by installing the package again. Also updated the PR description so it provides an accurate commit message for a squash-merge commit. |
This has the update to unblock autocomplete changes:
zulip/zulip-flutter#1190
flutter/flutter#143249
and with that, tests pass again on Flutter main.
Also install libsqlite3-dev on Linux, a package which is no longer
included in GitHub's new version of the "ubuntu-latest" images. The
lack of it causes nondeterministic failures when the runner happens
to use the new image:
#441 (comment)
The actual shared library file libsqlite3.so.0.8.6 -- in the package
libsqlite3-0 -- is still installed by default anyway. This package
adds the symlink at "libsqlite3.so", which is the filename some
libraries apparently look for.
Pre-launch Checklist
///
).If you need help, consider asking for advice on the #hackers-new channel on Discord.