gigl.orchestration.kubeflow.cleanup_component#

KFP exit task that cancels the jobs a GiGL pipeline run launched.

The pipeline is compiled with this task in place of the email notification when ExitTask.CLEANUP is selected; see gigl.orchestration.kubeflow.kfp_pipeline.generate_pipeline().

Functions#

cleanup_child_jobs_op(job_name, resource_config_uri)

Cancel every Vertex AI, Dataflow, and Dataproc child of job_name.

Module Contents#

gigl.orchestration.kubeflow.cleanup_component.cleanup_child_jobs_op(job_name, resource_config_uri)[source]#

Cancel every Vertex AI, Dataflow, and Dataproc child of job_name.

Runs on every pipeline exit, including cancels. A run that launched nothing exits cleanly.

Parameters:

  • job_name (str) – The GiGL applied task identifier.

  • resource_config_uri (str) – URI of the resource config that gives project and region.

Return type:

None