polyaxon: Invalid parent directory when launch Tensorboard

Describe the bug

Tensorboard can’t display chart after lanuching Tensorboardpolyaxon run --hub tensorboard:single-run -P uuid= 75e805dad60940519397a3dde42afcf9 -w polyaxon-streams pod reports error: Invalid parent directory '/artifactsStore/aa8b1dbd1d674b08ad54042fd5da7a14'

To reproduce

  1. Run the tutorial experiment by polyaxon run -f quick-start/simple.yaml -l and get the run uuid 75e805dad60940519397a3dde42afcf9
  2. The artifacts can generate the event logs as outputs\tensorboard\train\* and outputs\tensorboard\validate\*
  3. Launch tensorboard with command olyaxon run --hub tensorboard:single-run -P uuid= 75e805dad60940519397a3dde42afcf9 -w

Expected behavior

Tensorboard chart can display the training graph.

Environment

postgresql:
  persistence:
    enabled: true
    size: 5Gi
dns:
  backend: "coredns"
intervals:
  compatibilityCheck: -1

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 15 (7 by maintainers)

Most upvoted comments

Great!

This regression was fixed. We patched the v1.5.0 containers, and we will release a new patch release v1.5.1 today.

Thank you for reporting this issue and for helping with debugging.