gigl.src.data_preprocessor.lib.DataPreprocessorConfig

class gigl.src.data_preprocessor.lib.data_preprocessor_config.DataPreprocessorConfig

Bases: ABC

Users should inherit from this and define the relevant specs for their preprocessing job.

Methods

__init__
get_edges_preprocessing_spec
get_nodes_preprocessing_spec
prepare_for_pipeline	This function is called at the very start of the pipeline before enumerator and datapreprocessor.

__weakref__

list of weak references to the object (if defined)

prepare_for_pipeline(applied_task_identifier: AppliedTaskIdentifier) → None

This function is called at the very start of the pipeline before enumerator and datapreprocessor. This function does not return anything. It can be overwritten to perform any operation needed before running the pipeline, such as gathering data for node and edge sources