hydromt.data_adapter.DatasetAdapter#
- class hydromt.data_adapter.DatasetAdapter(path: str | Path, driver: str | None = None, filesystem: str | None = None, nodata: dict | float | int | None = None, rename: dict | None = None, unit_mult: dict | None = None, unit_add: dict | None = None, meta: dict | None = None, attrs: dict | None = None, driver_kwargs: dict | None = None, storage_options: dict | None = None, name: str = '', catalog_name: str = '', provider: str | None = None, version: str | None = None)[source]#
DatasetAdapter for non-spatial n-dimensional data.
Initiate data adapter for n-dimensional timeseries data.
This object contains all properties required to read supported files(netcdf, zarr) into a single unified Dataset, i.e.
xarray.Dataset
. In addition it keeps meta data to be able to reproduce which data is used.- Parameters:
path (
str
,Path
) – Path to data source. If the dataset consists of multiple files, the path may contain {variable}, {year}, {month} placeholders as well as path search pattern using a*
wildcard.driver (
{'netcdf', 'zarr'}
, optional) – Driver to read files with, for ‘netcdf’xarray.open_mfdataset()
. By default the driver is inferred from the file extension.filesystem (
str
, optional) – Filesystem where the data is stored (local, cloud, http etc.). If None (default) the filesystem is inferred from the path. Seefsspec.registry.known_implementations()
for all options.nodata (
float
,int
, optional) – Missing value number. Only used if the data has no native missing value. Nodata values can be differentiated between variables using a dictionary.rename (
dict
, optional) – Mapping of native data source variable to output source variable name as required by hydroMT.unit_mult (
dict
, optional) – Scaling multiplication and addition to change to map from the native data unit to the output data unit as required by hydroMT.unit_add (
dict
, optional) – Scaling multiplication and addition to change to map from the native data unit to the output data unit as required by hydroMT.meta (
dict
, optional) – Metadata information of dataset, prefably containing the following keys: - ‘source_version’ - ‘source_url’ - ‘source_license’ - ‘paper_ref’ - ‘paper_doi’ - ‘category’placeholders (
dict
, optional) – Placeholders to expand yaml entry to multiple entries (name and path) based on placeholder valuesattrs (
dict
, optional) – Additional attributes relating to data variables. For instance unit or long name of the variable.driver_kwargs – Additional key-word arguments passed to the driver.
dict – Additional key-word arguments passed to the driver.
optional – Additional key-word arguments passed to the driver.
storage_options (
dict
, optional) – Additional key-word arguments passed to the fsspec FileSystem object.name (
str
, optional) – Name of the dataset and catalog, optional.catalog_name (
str
, optional) – Name of the dataset and catalog, optional.provider (
str
, optional) – A name to identifiy the specific provider of the dataset requested. if None is provided, the last added source will be used.version (
str
, optional) – A name to identifiy the specific version of the dataset requested. if None is provided, the last added source will be used.
- __init__(path: str | Path, driver: str | None = None, filesystem: str | None = None, nodata: dict | float | int | None = None, rename: dict | None = None, unit_mult: dict | None = None, unit_add: dict | None = None, meta: dict | None = None, attrs: dict | None = None, driver_kwargs: dict | None = None, storage_options: dict | None = None, name: str = '', catalog_name: str = '', provider: str | None = None, version: str | None = None)[source]#
Initiate data adapter for n-dimensional timeseries data.
This object contains all properties required to read supported files(netcdf, zarr) into a single unified Dataset, i.e.
xarray.Dataset
. In addition it keeps meta data to be able to reproduce which data is used.- Parameters:
path (
str
,Path
) – Path to data source. If the dataset consists of multiple files, the path may contain {variable}, {year}, {month} placeholders as well as path search pattern using a*
wildcard.driver (
{'netcdf', 'zarr'}
, optional) – Driver to read files with, for ‘netcdf’xarray.open_mfdataset()
. By default the driver is inferred from the file extension.filesystem (
str
, optional) – Filesystem where the data is stored (local, cloud, http etc.). If None (default) the filesystem is inferred from the path. Seefsspec.registry.known_implementations()
for all options.nodata (
float
,int
, optional) – Missing value number. Only used if the data has no native missing value. Nodata values can be differentiated between variables using a dictionary.rename (
dict
, optional) – Mapping of native data source variable to output source variable name as required by hydroMT.unit_mult (
dict
, optional) – Scaling multiplication and addition to change to map from the native data unit to the output data unit as required by hydroMT.unit_add (
dict
, optional) – Scaling multiplication and addition to change to map from the native data unit to the output data unit as required by hydroMT.meta (
dict
, optional) – Metadata information of dataset, prefably containing the following keys: - ‘source_version’ - ‘source_url’ - ‘source_license’ - ‘paper_ref’ - ‘paper_doi’ - ‘category’placeholders (
dict
, optional) – Placeholders to expand yaml entry to multiple entries (name and path) based on placeholder valuesattrs (
dict
, optional) – Additional attributes relating to data variables. For instance unit or long name of the variable.driver_kwargs – Additional key-word arguments passed to the driver.
dict – Additional key-word arguments passed to the driver.
optional – Additional key-word arguments passed to the driver.
storage_options (
dict
, optional) – Additional key-word arguments passed to the fsspec FileSystem object.name (
str
, optional) – Name of the dataset and catalog, optional.catalog_name (
str
, optional) – Name of the dataset and catalog, optional.provider (
str
, optional) – A name to identifiy the specific provider of the dataset requested. if None is provided, the last added source will be used.version (
str
, optional) – A name to identifiy the specific version of the dataset requested. if None is provided, the last added source will be used.
Methods
__init__
(path[, driver, filesystem, nodata, ...])Initiate data adapter for n-dimensional timeseries data.
get_data
([variables, time_tuple, ...])Return a clipped, sliced and unified Dataset.
get_time_range
([ds])Get the temporal range of a dataset.
mark_as_used
()Mark the data adapter as used.
summary
()Return a dictionary summary of the data adapter.
to_dict
()Return a dictionary view of the data source.
to_file
(data_root, data_name[, time_tuple, ...])Save a dataset slice to file.
to_stac_catalog
([on_error])Convert a dataset into a STAC Catalog representation.
Attributes
data_type
Return the datatype of the addapter.
fs
Return the filesystem object .