Skip to main content
Version: 0.96

snorkelflow.sdk.ModelNode

class snorkelflow.sdk.ModelNode(uid, application_uid, config)

Bases: Node

ModelNode class represents a model node.

__init__​

__init__(uid, application_uid, config)

Methods

__init__(uid, application_uid, config)
get(node_uid)Fetches a node by its UID.
get_comments([username])Retreive the comments left on the current model node.
get_dataframe([split, columns])Retrieve the data being passed directly through this node.
get_ground_truth([split, user_format])Retrieve ground truth data for the current model node.
get_lfs()Retrieve a list of currently active labeling functions for the current model node.
get_model_preds([model_uid, split, ...])Retrieve model predictions and probabilities for the current model node and a given model UID.
get_tags([is_context])Retrieve tags put on the current model node.
get_training_set(training_set_uid[, split, ...])Retrieve a training set for this model node, specified by the training set UID.

Attributes

application_uidThe unique identifier for the application this node belongs to
configReturns the detailed configuration information for this node
uidThe unique identifier for this node

get_comments​

get_comments(username=None)

Retreive the comments left on the current model node. This method will return a Pandas DataFrame whose columns contain the metadata and content for the comment.

Examples​

>>> my_node.get_comments()
    comment_uid user_uid    x_uid   body    created_at      is_edited
    7           3           doc::1  hello   2023-09-26T17   False

Parameters​

NameTypeDefaultInfo
usernameOptional[str]NoneOptionally, return only a specific user’s coments. By default returns all comments.

Returns​

A Pandas DataFrame containing the comments left on the model node.

Return type​

pd.DataFrame

get_dataframe​

get_dataframe(split=None, columns=None)

Retrieve the data being passed directly through this node. Can be filtered by a split or by a subset of columns (useful for large datasets). The data can also optionally include tag and comment metadata.

This dataframe is not the same as the dataframe returned by Dataset.get_dataframe(). While Dataset.get_dataframe() returns the source data, the dataframe returned by Node.get_dataframe() has also undergone all the preprocessing/DAG transformations up to this point in the processing pipeline.

Parameters​

NameTypeDefaultInfo
splitOptional[str]NoneOptionally restrict the data retrieved to a particular split, by default None (i.e., all splits).
columnsOptional[List[str]]NoneOptionally restrict the columns returned by this function, by default None. Useful for large datasets to significantly speed up retrieval time.

Returns​

A dataframe of the data being passed directly through this node, optionally filtered by split and/or columns and indexed by x_uid. This DataFrame is the result of all preprocessing in the DAG pipeline up to this point.

Return type​

pd.DataFrame

get_ground_truth​

get_ground_truth(split=None, user_format=False)

Retrieve ground truth data for the current model node. Optionally filter by a particular split.

Parameters​

NameTypeDefaultInfo
splitOptional[str]NoneWhich data split to select, by default None (all splits). Can be one of “dev”, “train”, “valid”, or “test.
user_formatboolFalseWhether to return the ground truth in a human-readable format, by default False.

Returns​

A Pandas DataFrame mapping the data index to the ground truth label. If user_format is True, the label column will contain human-readable label names.

Return type​

pd.DataFrame

get_lfs​

get_lfs()

Retrieve a list of currently active labeling functions for the current model node.

Examples​

>>> my_node.get_lfs()
[
    LF(name='LF 1', label=3, templates=[...]),
    LF(name='LF 2', label=2, templates=[...]),
    LF(name='LF 3', label=1, templates=[...]),
]

Returns​

A list of all currently active labeling functions for the current model node.

Return type​

List[LF]

get_model_preds​

get_model_preds(model_uid=None, split=None, is_context=False, user_format=True)

Retrieve model predictions and probabilities for the current model node and a given model UID. If no model UID is provided, the most recent model’s predictions are returned.

Examples​

>>> my_node.get_model_preds()
            preds   probs
x_uid
doc::994    0       [0.543..., 0.080..., 0.37...]
doc::999    2       [0.327..., 0.201..., 0.4...]

Parameters​

NameTypeDefaultInfo
model_uidOptional[int]NoneThe UID of a trained model, by default the latest model. All trained models can be seen from the “Models” accordion in Developer Studio.
splitOptional[str]NoneOptionally filter model predictions by split, by default returns predictions for all splits. Splits can be one of “train”, “dev”, “valid”, or “test”.
is_contextboolFalseWhen True, retrieves predictions at the document level instead of the span level, by default False. Only applicable for information extraction tasks.
user_formatboolTrueWhether to return the predictions in a human-readable or compressed integer format, by default True (returning a human-readable format).

Returns​

A Pandas DataFrame of model predictions and probabilities, indexed by x_uid. If user_format is True, the preds column will contain human-readable label names.

Return type​

pd.DataFrame

get_tags​

get_tags(is_context=False)

Retrieve tags put on the current model node. For information extraction tasks, this method allows for fine-grained control over whether you want to retrieve tags at the document level or at the span level.

Examples​

>>> my_node.get_tags()
x_uid
doc::10005        [loan-err, new_tag1]
doc::10006                  [new_tag1]
doc::10198             [Key-EMP-error]
Name: tags, dtype: object

Parameters​

NameTypeDefaultInfo
is_contextboolFalseWhen True, retrieves tags at the document level instead of the span level, by default False. Only applicable for information extraction tasks.

Returns​

A Pandas Series containing the tags put on the model node, indexed by x_uid .

Return type​

pd.Series

get_training_set​

get_training_set(training_set_uid, split=None, user_format=True)

Retrieve a training set for this model node, specified by the training set UID. Allow allows for filtering the training set by a particular data split.

Examples​

>>> my_node.get_training_set(1)
            training_set_labels     training_set_probs
doc::100    stock                   [0.030..., 0.024...]

Parameters​

NameTypeDefaultInfo
training_set_uidintA training set UID, which can be found under the “Models” accordion in Developer Studio.
splitOptional[str]NoneAn optional data split to return predictions for, by default None (all splits). Can be one of “train”, “dev”, “valid”, or “test”.
user_formatboolTrueWhether to return the predictions in a human-readable or compressed integer format, by default True (returning a human-readable format).

Returns​

A Pandas DataFrame of training set predictions and probabilities, indexed by x_uid. If user_format is True, the preds column will contain human-readable label names.

Return type​

pd.DataFrame