pasteur.utils.data.RawSource

class pasteur.utils.data.RawSource(files: str | list[str], save_name: str | None = None, credentials: bool = False, desc: str | None = None)

Represents a raw data source that can be downloaded.

files is a list or a single URI that points to an S3 directory, index listing, or file.

Files will be saved to <raw_directory>/<save_name> or the raw source name/dataset name if not provided.. HTTP basic auth is supported and can be enabled by setting credentials to True. description is shown by the command pasteur download and should contain licensing information.

@warning: Experimental API, subject to change.

Attributes

credentials	Alias for field number 2
desc	Alias for field number 3
files	Alias for field number 0
save_name	Alias for field number 1

Methods

count(value, /)	Return number of occurrences of value.
index(value[, start, stop])	Return first index of value.

count(value, /)

Return number of occurrences of value.

credentials: bool

Alias for field number 2

desc: str | None

Alias for field number 3

files: str | list[str]

Alias for field number 0

index(value, start=0, stop=9223372036854775807, /)

Return first index of value.

Raises ValueError if the value is not present.

save_name: str | None

Alias for field number 1