gigl.src.data_preprocessor.lib.ingest.bigquery#

Classes#

`BigqueryEdgeDataReference`	DataReference which stores edge data
`BigqueryNodeDataReference`	DataReference which stores node data.

Module Contents#

class gigl.src.data_preprocessor.lib.ingest.bigquery.BigqueryEdgeDataReference[source]#

Bases: gigl.src.data_preprocessor.lib.ingest.reference.EdgeDataReference

DataReference which stores edge data

yield_instance_dict_ptransform(*args, **kwargs)[source]#

Returns a PTransform whose expand method returns a PCollection of InstanceDicts, which can be subsequently ingested and transformed via Tensorflow Transform.

TODO: extend to support multiple edge types being in the same table. :param args: :param kwargs: :return:

Return type:: gigl.src.data_preprocessor.lib.types.InstanceDictPTransform

class gigl.src.data_preprocessor.lib.ingest.bigquery.BigqueryNodeDataReference[source]#

Bases: gigl.src.data_preprocessor.lib.ingest.reference.NodeDataReference

DataReference which stores node data.

yield_instance_dict_ptransform(*args, **kwargs)[source]#

Returns a PTransform whose expand method returns a PCollection of InstanceDicts, which can be subsequently ingested and transformed via Tensorflow Transform.

TODO: extend to support multiple edge types being in the same table. :param args: :param kwargs: :return:

Return type:: gigl.src.data_preprocessor.lib.types.InstanceDictPTransform