How to set Argo Workflow attributes in KFP V2 IR YAML spec?

[abhinavsarkari]

In KFP V1, pipelines conform to Argo Workflow spec. When the pipeline yaml is generated using SDK/TFX Compiler, applications have a way to set Argo attributes like 'activeDeadlineSeconds', 'ttlStrategy' in pipeline definition itself.

Now in KFP V2, the pipeline spec conforms to IR YAML. KFP SDK 2.0 generates the pipeline yaml in this format and can't set Argo specific attributes (like mentioned above).

Is there a way, either via KFP SDK or KFP backend, for applications to set the Argo attributes in the pipeline?

[Kingdumb91]

Im not sure what you mean On Jan 13, 2025 1:04 PM, abhinavs ***@***.***> wrote: In KFP V1, pipelines conform to Argo Workflow spec. When the pipeline yaml is generated using SDK/TFX Compiler, applications have a way to set Argo attributes like 'activeDeadlineSeconds', 'ttlStrategy' in pipeline definition itself. Now in KFP V2, the pipeline spec conforms to IR YAML. KFP SDK 2.0 generates the pipeline yaml in this format and can't set Argo specific attributes (like mentioned above). Is there a way, either via KFP SDK or KFP backend, for applications to set the Argo attributes in the pipeline? —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[abhinavsarkari]

@Kingdumb91
What part of the post you didn't understand?

When I create a pipeline for v1 spec, I can set argo workflow attributes like 'activeDeadlineSeconds', 'ttlStrategy' in the yaml.
In v2 spec, I can't set these attributes in the yaml as they are not part of IR spec.
So is there a way to specify these attributes in v2. My understanding is that v2 API/Service backend converts IR yaml to Argo workflow yaml. Does this backend provide any hook etc. where application can set value for these argo workflow spec attributes?