Skip to main content
Version: 0.91

snorkelflow.client.datasources

Datasource related functions

Functions

add_active_datasources(node[, ...])

Adds multiple datasources to a node and activates them all.

create_datasource(dataset, path, file_type)

Create a data source.

delete_datasource(dataset, datasource_uid[, ...])

Delete a data source.

get_datasources(dataset)

Get all data sources for a dataset.

get_node_datasources(node[, compute_staleness])

Returns the datasources for a given node.

prep_and_ingest_datasource(dataset, paths, ...)

Create a data source.

put_node_datasource(node, datasource_uid, ...)

Set the active state of a datasource in a node.

refresh_active_datasources(node)

Refreshes the active data sources at a node.

split_datasources_by_percent(dataset, ...[, ...])

Split datasources given a list of paths by percent, and optionally also stratify ground truth across splits.

update_datasource(datasource_uid, split)

Update split for a data source, in all nodes that have that datasource.