snowflake.ml.data.data_ingestor.DataIngestor¶

class snowflake.ml.data.data_ingestor.DataIngestor(*args, **kwargs)¶

Bases: Protocol

Methods

classmethod from_ray_dataset(ray_ds: ray.data.Dataset, **kwargs: Any) → DataIngestorType¶

classmethod from_sources(session: Session, sources: Sequence[DataFrameInfo | DatasetInfo | str], **kwargs: Any) → DataIngestorType¶

to_batches(batch_size: int, shuffle: bool = True, drop_last_batch: bool = True) → Iterator[dict[str, ndarray[tuple[Any, ...], dtype[Any]]]]¶

to_pandas(limit: int | None = None) → pd.DataFrame¶

Attributes

data_sources¶