incubator-devlake: The pipeline job failed with panic after run task to get data from github for my repo

Describe the bug

The pipeline job failed with panic after run task to get data from github for my repo

To Reproduce

Steps to reproduce the behavior:

  1. Go to ‘Create New Pipeline’
  2. Fill in my repo
  3. Click run
  4. See error `$run task failed with panic (github.com/merico-dev/lake/utils.(*WorkerScheduler).WaitUntilFinish:87): [context deadline exceeded (Client.Timeout or context cancellation while reading body)

I have tried twice, one is failed after 3hours, another failed after 26 minutes

Expected behavior

Should run successfully

Screenshots

image image

Additional context

Extended Logs run task failed with panic (github.com/merico-dev/lake/utils.(*WorkerScheduler).WaitUntilFinish:87): [Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=5&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=6&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=10&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=8&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=9&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=12&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=11&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=17&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=13&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=14&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=15&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79 Get “https://api.github.com/repos/milvus-io/milvus/issues/358/events?page=16&per_page=100”: context deadline exceeded (Client.Timeout exceeded while awaiting headers) github.com/panjf2000/ants/v2.(*goWorker).run.func1:71 github.com/merico-dev/lake/utils.(*WorkerScheduler).Submit.func1:79]

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Comments: 16 (8 by maintainers)

Most upvoted comments

Finding Repo id Could become easier run this query $("meta[name=octolytics-dimension-repository_id]").getAttribute('content') in your console.