gigl.src.mocking.lib.tfrecord_io#

Attributes#

T

logger

Functions#

write_pb_tfrecord_shards_to_uri(pb_samples, uri_prefix)

Given a list of protobufs, chunk them and write them out to TFRecord files.

Module Contents#

gigl.src.mocking.lib.tfrecord_io.write_pb_tfrecord_shards_to_uri(pb_samples, uri_prefix, filename_prefix='data', chunk_size=100, sample_type_for_logging='', raise_exception_if_no_pb_samples=True)[source]#

Given a list of protobufs, chunk them and write them out to TFRecord files.

Parameters:

  • pb_samples (Sequence[google.protobuf.message.Message])

  • uri_prefix (gigl.common.Uri)

  • filename_prefix (str)

  • sample_type_for_logging (Optional[str])

  • raise_exception_if_no_pb_samples (bool)

gigl.src.mocking.lib.tfrecord_io.T[source]#
gigl.src.mocking.lib.tfrecord_io.logger[source]#