zebra: CI failing with mounting volume error
https://github.com/ZcashFoundation/zebra/actions/runs/6382508836/job/17321768540?pr=7653#step:13:188
docker: Error response from daemon: error while mounting volume '/var/lib/docker/volumes/fully-synced-rpc-85b855b/_data': failed to mount local volume: mount /dev/sdb:/var/lib/docker/volumes/fully-synced-rpc-85b855b/_data: device or resource busy.
Error: Process completed with exit code 125.
This seems to be happening for every PR we have opened recently. We can post more links to failures and more information in this ticket.
About this issue
- Original URL
- State: closed
- Created 9 months ago
- Comments: 15 (15 by maintainers)
In a closer inspection, I’ve observed that the error is not present in every open pull request, but specifically in the one linked here.
The error is visible in the Zebra Tip JSON-RPC job, while none of the other open pull requests encounter this issue in the same job or with the specific error message.
All other pull requests pass this job and start failing in the
lightwalletd tip updatejob with a ‘The operation was canceled.’ error.So, we should pay attention only to what is happening in this specific pull request in this ticket:
zebrad-cache-7633-merge-7b222f7-v25-mainnet-tip-u-174603. You can find this information in the Find fully-synced-rpc cached state disk job.Zebra Tip JSON-RPC, but it failed only once in this particular pull request and nowhere else.I suggest deleting the possibly corrupted image from gcloud and restarting the CI for this pull request. Another image will be selected, if this was a one time issue, then the CI should pass the
Zebra Tip JSON-RPCjob.This will help us determine if the problem was related to the image, and it may also lower the priority of the ticket.
@gustavovalverde , please let me know your thoughts on this. Any additional input is welcome.
Sorry about that, I thought I had checked multiple PRs, but I might have accidentally checked the same PR multiple times.