gigl.src.validation_check.config_validator#

Attributes#

`RESOURCE_CONFIG_CHECKS_TO_SKIP_WITH_LIVE_SGS_BACKEND`
`START_COMPONENT_TO_ASSET_CHECKS_MAP`
`START_COMPONENT_TO_CLS_CHECKS_MAP`
`START_COMPONENT_TO_GRAPH_STORE_COMPATIBILITY_CHECKS`
`START_COMPONENT_TO_RESOURCE_CONFIG_CHECKS_MAP`
`START_STOP_COMPONENT_TO_CLS_CHECKS_MAP`
`START_STOP_COMPONENT_TO_RESOURCE_CONFIG_CHECKS_MAP`
`STOP_COMPONENT_TO_GRAPH_STORE_COMPATIBILITY_CHECKS_TO_SKIP`
`logger`
`parser`

Functions#

`kfp_validation_checks`(job_name, ...[, stop_after])
`materialize_composed_config_snapshots`(job_name, ...)	Write resolved config snapshots to stable GCS paths.
`resolve_configs`(source_task_config_uri, ...)	Resolve task and resource configs into self-contained protobufs.

Module Contents#

gigl.src.validation_check.config_validator.kfp_validation_checks(job_name, source_task_config_uri, start_at, source_resource_config_uri, stop_after=None)[source]#

Parameters:

job_name (str)
source_task_config_uri (gigl.common.Uri)
start_at (str)
source_resource_config_uri (gigl.common.Uri)
stop_after (Optional[str])

Return type:

tuple[snapchat.research.gbml.gbml_config_pb2.GbmlConfig, snapchat.research.gbml.gigl_resource_config_pb2.GiglResourceConfig, bool]

gigl.src.validation_check.config_validator.materialize_composed_config_snapshots(job_name, task_config, resource_config, task_config_source, resource_config_source)[source]#

Write resolved config snapshots to stable GCS paths.

Parameters:

job_name (str) – Name for the pipeline run.
task_config (snapchat.research.gbml.gbml_config_pb2.GbmlConfig) – Resolved task config protobuf.
resource_config (snapchat.research.gbml.gigl_resource_config_pb2.GiglResourceConfig) – Resolved resource config protobuf.
task_config_source (str) – Provenance label for the task config source.
resource_config_source (str) – Provenance label for the resource config source.

Returns:

The task and resource snapshot URIs.

Return type:

tuple[gigl.common.GcsUri, gigl.common.GcsUri]

gigl.src.validation_check.config_validator.resolve_configs(source_task_config_uri, source_resource_config_uri)[source]#

Resolve task and resource configs into self-contained protobufs.

Parameters:

source_task_config_uri (gigl.common.Uri)
source_resource_config_uri (gigl.common.Uri)

Return type:

tuple[snapchat.research.gbml.gbml_config_pb2.GbmlConfig, snapchat.research.gbml.gigl_resource_config_pb2.GiglResourceConfig]

gigl.src.validation_check.config_validator.RESOURCE_CONFIG_CHECKS_TO_SKIP_WITH_LIVE_SGS_BACKEND[source]#

gigl.src.validation_check.config_validator.START_COMPONENT_TO_ASSET_CHECKS_MAP[source]#

gigl.src.validation_check.config_validator.START_COMPONENT_TO_CLS_CHECKS_MAP[source]#

gigl.src.validation_check.config_validator.START_COMPONENT_TO_GRAPH_STORE_COMPATIBILITY_CHECKS[source]#

gigl.src.validation_check.config_validator.START_COMPONENT_TO_RESOURCE_CONFIG_CHECKS_MAP[source]#

gigl.src.validation_check.config_validator.START_STOP_COMPONENT_TO_CLS_CHECKS_MAP[source]#

gigl.src.validation_check.config_validator.START_STOP_COMPONENT_TO_RESOURCE_CONFIG_CHECKS_MAP[source]#

gigl.src.validation_check.config_validator.STOP_COMPONENT_TO_GRAPH_STORE_COMPATIBILITY_CHECKS_TO_SKIP[source]#

gigl.src.validation_check.config_validator.logger[source]#

gigl.src.validation_check.config_validator.parser[source]#