Skip to main content
Version: 0.91

snorkelflow.client.datasources

Datasource related functions

Functions

add_active_datasources(node[, ...])Adds multiple datasources to a node and activates them all.
create_datasource(dataset, path, file_type)Create a data source.
delete_datasource(dataset, datasource_uid[, ...])Delete a data source.
get_datasources(dataset)Get all data sources for a dataset.
get_node_datasources(node[, compute_staleness])Returns the datasources for a given node.
prep_and_ingest_datasource(dataset, paths, ...)Create a data source.
put_node_datasource(node, datasource_uid, ...)Set the active state of a datasource in a node.
refresh_active_datasources(node)Refreshes the active data sources at a node.
split_datasources_by_percent(dataset, ...[, ...])Split datasources given a list of paths by percent, and optionally also stratify ground truth across splits.
update_datasource(datasource_uid, split)Update split for a data source, in all nodes that have that datasource.