woodpecker: Tasks won't start
Component
server
Describe the bug
None of the tasks in any repo will start currently.
This started happening about 2 days ago I think.
Unfortunately I can’t pin point where it exactly is going wrong.
The message with queue: pending right now and queue: trying to assign task are in a continous loop.
Steps to reproduce
Expected behavior
No response
System Info
next-296bd5b437
Additional context
{"level":"debug","time":"2025-03-24T14:07:12Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/session/repo.go:157","message":"dionysussg granted &{UserID:1 RepoID:11 Repo:<nil> Pull:true Push:true Admin:true Synced:1742824989 Created:1684141068 Updated:1742825228} permission to dionysussg/ci-test"}
{"level":"debug","time":"2025-03-24T14:07:12Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:419","message":"queue: trying to remove 3622"}
{"level":"error","error":"sql: no rows in result set","time":"2025-03-24T14:07:12Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/pipeline/cancel.go:60","message":"queue: evict_at_once: [3622]"}
{"level":"debug","ip":"","latency":16.324537,"method":"POST","path":"/api/repos/11/pipelines/58/cancel","status":204,"time":"2025-03-24T14:07:12Z","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36","time":"2025-03-24T14:07:12Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/logger.go:59"}
{"level":"debug","ip":"","latency":3.61538,"method":"GET","path":"/api/badges/11/status.svg","status":200,"time":"2025-03-24T14:07:14Z","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36","time":"2025-03-24T14:07:14Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/logger.go:59"}
{"level":"debug","time":"2025-03-24T14:07:14Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/api/stream.go:212","message":"log stream: connection closed"}
{"level":"debug","ip":"","latency":2766.512545,"method":"GET","path":"/api/stream/logs/11/58/14425","status":200,"time":"2025-03-24T14:07:14Z","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36","time":"2025-03-24T14:07:14Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/logger.go:59"}
{"level":"debug","time":"2025-03-24T14:07:14Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/session/repo.go:157","message":"dionysussg granted &{UserID:1 RepoID:11 Repo:<nil> Pull:true Push:true Admin:true Synced:1742824989 Created:1684141068 Updated:1742825228} permission to dionysussg/ci-test"}
{"level":"debug","ip":"","latency":97.088425,"method":"GET","path":"/api/repos/11/branches","status":200,"time":"2025-03-24T14:07:14Z","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36","time":"2025-03-24T14:07:14Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/logger.go:59"}
{"level":"debug","time":"2025-03-24T14:07:15Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/session/repo.go:157","message":"dionysussg granted &{UserID:1 RepoID:11 Repo:<nil> Pull:true Push:true Admin:true Synced:1742824989 Created:1684141068 Updated:1742825228} permission to dionysussg/ci-test"}
{"level":"error","error":"GetContentsOrList","repo":"dionysussg/ci-test","user":"dionysussg","time":"2025-03-24T14:07:15Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/services/config/forge.go:150","message":"could not get folder from forge: GetContentsOrList"}
{"level":"debug","ip":"::1","latency":0.130145,"method":"GET","path":"/healthz","status":204,"time":"2025-03-24T14:07:15Z","user-agent":"Go-http-client/1.1","time":"2025-03-24T14:07:15Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/logger.go:59"}
{"level":"debug","ip":"","latency":694.649611,"method":"POST","path":"/api/repos/11/pipelines","status":200,"time":"2025-03-24T14:07:16Z","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/logger.go:59"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/session/repo.go:157","message":"dionysussg granted &{UserID:1 RepoID:11 Repo:<nil> Pull:true Push:true Admin:true Synced:1742824989 Created:1684141068 Updated:1742825228} permission to dionysussg/ci-test"}
{"level":"debug","ip":"","latency":5.444802,"method":"GET","path":"/api/repos/11/pipelines/59","status":200,"time":"2025-03-24T14:07:16Z","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/logger.go:59"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/session/repo.go:157","message":"dionysussg granted &{UserID:1 RepoID:11 Repo:<nil> Pull:true Push:true Admin:true Synced:1742824989 Created:1684141068 Updated:1742825228} permission to dionysussg/ci-test"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/api/stream.go:207","message":"log stream: connection opened"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/session/repo.go:157","message":"dionysussg granted &{UserID:1 RepoID:11 Repo:<nil> Pull:true Push:true Admin:true Synced:1742824989 Created:1684141068 Updated:1742825228} permission to dionysussg/ci-test"}
{"level":"debug","ip":"","latency":4.917871,"method":"GET","path":"/api/repos/11/pipelines/59/config","status":200,"time":"2025-03-24T14:07:16Z","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/router/middleware/logger.go:59"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:16Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:336","message":"queue: trying to assign task: 3623 with deps []"}
{"level":"debug","time":"2025-03-24T14:07:17Z","caller":"/woodpecker/src/github.com/woodpecker-ci/woodpecker/server/queue/fifo.go:369","message":"queue: pending right now: 3623"}
Validations
- Read the docs.
- Check that there isn’t already an issue that reports the same bug to avoid creating a duplicate.
- Checked that the bug isn’t fixed in the
nextversion already [https://woodpecker-ci.org/versions]
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 17 (9 by maintainers)
Ah yeah, the
hostnamelabel is set automatically, sorry. Ill try to reproduce this locally.And if you just revert WP (server and agent) to
next-5ab0e46c21does it start working again?