snowflake.ml.fileset.fileset.FileSet¶

class snowflake.ml.fileset.fileset.FileSet(*, target_stage_loc: str, name: str, sf_connection: Optional[SnowflakeConnection] = None, snowpark_session: Optional[Session] = None)¶

Bases: object

A FileSet represents an immutable snapshot of the result of a query in the form of files.

Methods

delete()	Delete the FileSet directory and all the stage files in it.
files()	Get the list of stage file paths in the current FileSet.
fileset_stage_location()	Get the stage path to the current FileSet in sfc protocol.
make(*, target_stage_loc, name[, ...])	Creates a FileSet object given a SQL query.
to_snowpark_dataframe()	Convert the fileset to a snowpark dataframe.
to_tf_dataset(*, batch_size[, shuffle, ...])	Transform the Snowflake data into a ready-to-use TensorFlow tf.data.Dataset.
to_torch_datapipe(*, batch_size[, shuffle, ...])	Transform the Snowflake data into a ready-to-use Pytorch datapipe.

Attributes

name	Get the name of the FileSet.