hydromt.data_adapter.DatasetAdapter#
- class hydromt.data_adapter.DatasetAdapter(path: str | Path, driver: str | None = None, filesystem: str | None = None, nodata: dict | float | int | None = None, rename: dict | None = None, unit_mult: dict | None = None, unit_add: dict | None = None, meta: dict | None = None, attrs: dict | None = None, driver_kwargs: dict | None = None, storage_options: dict | None = None, name: str = '', catalog_name: str = '', provider: str | None = None, version: str | None = None)[source]#
DatasetAdapter for non-spatial n-dimensional data.
Initiate data adapter for n-dimensional timeseries data.
This object contains all properties required to read supported files(netcdf, zarr) into a single unified Dataset, i.e.
xarray.Dataset. In addition it keeps meta data to be able to reproduce which data is used.- Parameters:
path (
str,Path) – Path to data source. If the dataset consists of multiple files, the path may contain {variable}, {year}, {month} placeholders as well as path search pattern using a*wildcard.driver (
{'netcdf', 'zarr'}, optional) – Driver to read files with, for ‘netcdf’xarray.open_mfdataset(). By default the driver is inferred from the file extension.filesystem (
str, optional) – Filesystem where the data is stored (local, cloud, http etc.). If None (default) the filesystem is inferred from the path. Seefsspec.registry.known_implementations()for all options.nodata (
float,int, optional) – Missing value number. Only used if the data has no native missing value. Nodata values can be differentiated between variables using a dictionary.rename (
dict, optional) – Mapping of native data source variable to output source variable name as required by hydroMT.unit_mult (
dict, optional) – Scaling multiplication and addition to change to map from the native data unit to the output data unit as required by hydroMT.unit_add (
dict, optional) – Scaling multiplication and addition to change to map from the native data unit to the output data unit as required by hydroMT.meta (
dict, optional) – Metadata information of dataset, prefably containing the following keys: - ‘source_version’ - ‘source_url’ - ‘source_license’ - ‘paper_ref’ - ‘paper_doi’ - ‘category’placeholders (
dict, optional) – Placeholders to expand yaml entry to multiple entries (name and path) based on placeholder valuesattrs (
dict, optional) – Additional attributes relating to data variables. For instance unit or long name of the variable.driver_kwargs – Additional key-word arguments passed to the driver.
dict – Additional key-word arguments passed to the driver.
optional – Additional key-word arguments passed to the driver.
storage_options (
dict, optional) – Additional key-word arguments passed to the fsspec FileSystem object.name (
str, optional) – Name of the dataset and catalog, optional.catalog_name (
str, optional) – Name of the dataset and catalog, optional.provider (
str, optional) – A name to identifiy the specific provider of the dataset requested. if None is provided, the last added source will be used.version (
str, optional) – A name to identifiy the specific version of the dataset requested. if None is provided, the last added source will be used.
- __init__(path: str | Path, driver: str | None = None, filesystem: str | None = None, nodata: dict | float | int | None = None, rename: dict | None = None, unit_mult: dict | None = None, unit_add: dict | None = None, meta: dict | None = None, attrs: dict | None = None, driver_kwargs: dict | None = None, storage_options: dict | None = None, name: str = '', catalog_name: str = '', provider: str | None = None, version: str | None = None)[source]#
Initiate data adapter for n-dimensional timeseries data.
This object contains all properties required to read supported files(netcdf, zarr) into a single unified Dataset, i.e.
xarray.Dataset. In addition it keeps meta data to be able to reproduce which data is used.- Parameters:
path (
str,Path) – Path to data source. If the dataset consists of multiple files, the path may contain {variable}, {year}, {month} placeholders as well as path search pattern using a*wildcard.driver (
{'netcdf', 'zarr'}, optional) – Driver to read files with, for ‘netcdf’xarray.open_mfdataset(). By default the driver is inferred from the file extension.filesystem (
str, optional) – Filesystem where the data is stored (local, cloud, http etc.). If None (default) the filesystem is inferred from the path. Seefsspec.registry.known_implementations()for all options.nodata (
float,int, optional) – Missing value number. Only used if the data has no native missing value. Nodata values can be differentiated between variables using a dictionary.rename (
dict, optional) – Mapping of native data source variable to output source variable name as required by hydroMT.unit_mult (
dict, optional) – Scaling multiplication and addition to change to map from the native data unit to the output data unit as required by hydroMT.unit_add (
dict, optional) – Scaling multiplication and addition to change to map from the native data unit to the output data unit as required by hydroMT.meta (
dict, optional) – Metadata information of dataset, prefably containing the following keys: - ‘source_version’ - ‘source_url’ - ‘source_license’ - ‘paper_ref’ - ‘paper_doi’ - ‘category’placeholders (
dict, optional) – Placeholders to expand yaml entry to multiple entries (name and path) based on placeholder valuesattrs (
dict, optional) – Additional attributes relating to data variables. For instance unit or long name of the variable.driver_kwargs – Additional key-word arguments passed to the driver.
dict – Additional key-word arguments passed to the driver.
optional – Additional key-word arguments passed to the driver.
storage_options (
dict, optional) – Additional key-word arguments passed to the fsspec FileSystem object.name (
str, optional) – Name of the dataset and catalog, optional.catalog_name (
str, optional) – Name of the dataset and catalog, optional.provider (
str, optional) – A name to identifiy the specific provider of the dataset requested. if None is provided, the last added source will be used.version (
str, optional) – A name to identifiy the specific version of the dataset requested. if None is provided, the last added source will be used.
Methods
__init__(path[, driver, filesystem, nodata, ...])Initiate data adapter for n-dimensional timeseries data.
get_data([variables, time_tuple, ...])Return a clipped, sliced and unified Dataset.
get_time_range([ds])Get the temporal range of a dataset.
mark_as_used()Mark the data adapter as used.
summary()Return a dictionary summary of the data adapter.
to_dict()Return a dictionary view of the data source.
to_file(data_root, data_name[, time_tuple, ...])Save a dataset slice to file.
to_stac_catalog([on_error])Convert a dataset into a STAC Catalog representation.
Attributes
data_typeReturn the datatype of the addapter.
fsReturn the filesystem object .