fedimint: Intermittant CI failure tracking issue
We’ve had a handful of CI failure that seem to disappear when you re-run them. Making an issue to keep track of them.
lightning_gateway_pays_invoice
lightning.amount_sent()
assertion https://github.com/fedimint/minimint/runs/7213579990?check_suite_focus=true#step:6:4320
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 36 (36 by maintainers)
I’ve fixed recently bunch of flakes, I think it’s better now (thought there’s still something failing every now and then).
This issue is not very useful if over a year people report different issues.
In the future please when you find a flake, find most plausible/distinct root error/failure message and report a new issue for each different type of a flake.
@Maan2003 I think this is the same issue we patched for bitcoin rpc, now appearing in electrum since we have tests for it. See https://github.com/fedimint/fedimint/pull/675/files#diff-fbf8716fe493eff59dfa648a1b7b393abd944c21095df0947b597a068158bedaR200-R203
https://github.com/fedimint/fedimint/actions/runs/3953265674/attempts/1
Hitting a non-deterministic issue with lightning_gateway_pays_internal_invoice
https://github.com/fedimint/fedimint/actions/runs/3808388883/jobs/6478925802
Looks like something is timing out
last 10 log lines: > ---- lightning_gateway_pays_internal_invoice stdout ---- > thread ‘lightning_gateway_pays_internal_invoice’ panicked at ‘called
Result::unwrap()
on anErr
value: ClientError(MintApiError(Timeout))’, integrationtests/tests/tests.rs:456:14 > > > failures: > lightning_gateway_pays_internal_invoice > > test result: FAILED. 27 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 42.64s@NicolaLS I don’t think so because we removed the timeouts which was the issue you were hitting. Still, shouldn’t hurt to add
port-picker
to the integration tests as well…