pipelines: Pipeline UI unable to access artifacts stored in external cloud storage

Hello, I am using light weight components as shown in this example:

But my source for confusion_matrix is coming from s3 location. I can specify use_aws_secret from kfp.aws to access data at s3://xxx inside the componenets, but Pipeline UI is not able to read data from s3. How do I provide the aws secrets to pipeline UI?

About this issue

Original URL
State: closed
Created 5 years ago
Comments: 15 (10 by maintainers)

Commits related to this issue

Make deployment scheduling behaviour configurable (#2627) * Make deployment scheduling behaviour configurable Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Preserve Pod... — committed to magdalenakuhn17/pipelines by ddelange a year ago
Extract modelmesh part in helm chart (#2704) * Extract modelmesh part in helm chart Signed-off-by: Hyeonki Hong <hhk7734@gmail.com> * Add last newline to helm chart templates Signed-off-by: Hyeonk... — committed to magdalenakuhn17/pipelines by hhk7734 a year ago

Most upvoted comments

sorry I was using kustomize. Here is the how it looks like as k8s configmap yaml.

apiVersion: v1
data:
  template.json: |-
    {
        "metadata": {
            "annotations": {
                "iam.amazonaws.com/role": "some-iam-role-name"
            }
        },
        "spec": {
            "containers": [
                {
                    "env": [
                        {
                            "name": "AWS_REGION",
                            "value": "ap-southeast-1"
                        }
                    ]
                }
            ]
        }
    }
kind: ConfigMap
metadata:
  name: tensorboard-ui-template-gfmg77c7hd

eterna2 on Nov 20, 2019