Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a V2 version of "Manipulate Kubernetes Resources as Part of a Pipeline" #3752

Open
Tracked by #3712 ...
hbelmiro opened this issue Jun 8, 2024 · 7 comments
Open
Tracked by #3712 ...

Comments

@hbelmiro
Copy link
Contributor

hbelmiro commented Jun 8, 2024

          @hbelmiro We also need to create a V2 version of ["Manipulate Kubernetes Resources as Part of a Pipeline"](https://www.kubeflow.org/docs/components/pipelines/v1/sdk/manipulate-resources/).

Its quite different in V2 as it uses the kfp[kubernetes] library:

I also note that there seem to be a few significant features missing (namely the ability to manipulate arbitrary resources, like the old v1 ResourceOp):

We could suggest people use a Python component with the kubernetes python library, but that should be a decision for the @kubeflow/pipelines leads.

Originally posted by @thesuperzapper in #3750 (comment)

@hbelmiro hbelmiro changed the title Create a V2 version of ["Manipulate Kubernetes Resources as Part of a Pipeline"](https://www.kubeflow.org/docs/components/pipelines/v1/sdk/manipulate-resources/). Create a V2 version of "Manipulate Kubernetes Resources as Part of a Pipeline" Jun 8, 2024
@hbelmiro
Copy link
Contributor Author

/area pipelines

@Mohit-Verma-1688
Copy link

Is it possible to create a resource from yaml in the Kubeflowv2 version ? I checked the links but I am not able to understand how to achieve below code in KFPV2. Thank you in advance.

deploy_step = dsl.ResourceOp(
        name="seldondeploy",
        k8s_resource=seldon_config,
        attribute_outputs={"name": "{.metadata.name}"})

@hbelmiro
Copy link
Contributor Author

@Mohit-Verma-1688 you can ask that in our Slack.

@hbelmiro
Copy link
Contributor Author

@Mohit-Verma-1688
Copy link

@hbelmiro I am sorry but I am not able to find an example to load a k8s yaml file. I am very new to Kubeflow and still trying to understand. My end goal is to use seldon deployment step in the pipeline and deploy the seldon crd yaml from KFP pipeline as mentioned in below example for v1.

https://github.com/SeldonIO/seldon-core/tree/8eb787a536b4a9470eed6230b9def4e844fceab8/examples/kubeflow

@hbelmiro
Copy link
Contributor Author

@Mohit-Verma-1688 This is not the right place to ask and discussing this here pollutes this issue.
As I said before, can you please ask in our Slack?

@rimolive
Copy link
Member

rimolive commented Jul 4, 2024

@Mohit-Verma-1688 Just to let you aware, we don't have ResourceOp support in KFPv2 and honestly I have no idea if this is still a highly demanding feature given that it's possible to create components in KFPv2 just like we did for KServe.

Usually we measure the feature demand with a 👍 in the issue description, but since this is for documentation I recommend that you open an issue in kubeflow/pipelines and ask for users to 👍 the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: To Do
Development

No branches or pull requests

3 participants