Debian NEW package overview for kerchunk
| kerchunk_0.2.9-1_amd64.changes (click to toggle) | |
|---|---|
| Format: | 1.8 |
| Date: | Sun, 28 Dec 2025 08:17:47 +0000 |
| Source: | kerchunk |
| Binary: | python-kerchunk-doc python3-kerchunk |
| Architecture: | source all |
| Version: | 0.2.9-1 |
| Distribution: | unstable |
| Urgency: | low |
| Maintainer: | Debian GIS Project <pkg-grass-devel@lists.alioth.debian.org> |
| Changed-By: | Antonio Valentino <antonio.valentino@tiscali.it> |
| Description: | python-kerchunk-doc - Cloud-friendly access to archival data (documentation) python3-kerchunk - Cloud-friendly access to archival data |
| Closes: | 1124102 |
| Changes: | kerchunk (0.2.9-1) unstable; urgency=low * Initial release (Closes: #1124102). |
| Files: | ee239506897c27012cdc1c3ee4b81cd6 4478 python optional kerchunk_0.2.9-1.dsc 37d48624e7e1c39a79f866204090a04c 124716963 python optional kerchunk_0.2.9.orig.tar.gz 11ebcb233ec497e28816f9aa7d308b21 6788 python optional kerchunk_0.2.9-1.debian.tar.xz a11caa524e56106d5ea2948292180c7b 15504 python optional kerchunk_0.2.9-1_amd64.buildinfo f51d33ddafc9030684928e144ba9492c 712192 doc optional python-kerchunk-doc_0.2.9-1_all.deb bbbec3cc4d6806d23718105723c1a38d 466932 python optional python3-kerchunk_0.2.9-1_all.deb |
| kerchunk_0.2.9-1.dsc (click to toggle) | |
|---|---|
| Format: | 3.0 (quilt) |
| Source: | kerchunk |
| Binary: | python3-kerchunk, python-kerchunk-doc |
| Architecture: | all |
| Version: | 0.2.9-1 |
| Maintainer: | Debian GIS Project <pkg-grass-devel@lists.alioth.debian.org> |
| Uploaders: | Antonio Valentino <antonio.valentino@tiscali.it> |
| Homepage: | https://github.com/fsspec/kerchunk |
| Description: | Cloud-friendly access to archival data Kerchunk is a library that provides a unified way to represent a variety of chunked, compressed data formats (e.g. NetCDF, HDF5, GRIB), allowing efficient access to the data from traditional file systems or cloud object storage. It also provides a flexible way to create virtual datasets from multiple files. It does this by extracting the byte ranges, compression information and other information about the data and storing this metadata in a new, separate object. This means that you can create a virtual aggregate dataset over potentially many source files, for efficient, parallel and cloud-friendly *in-situ* access without having to copy or translate the originals. It is a gateway to in-the-cloud massive data processing while the data providers still insist on using legacy formats for archival storage. Features: * completely serverless architecture * metadata consolidation, so you can understand a many-file dataset (metadata plus physical storage) in a single read * read from all of the storage backends supported by fsspec, including object storage (s3, gcs, abfs, alibaba), http, cloud user storage (dropbox, gdrive) and network protocols (ftp, ssh, hdfs, smb...) * loading of various file types (currently netcdf4/HDF, grib2, tiff, fits, zarr), potentially heterogeneous within a single dataset, without a need to go via the specific driver (e.g., no need for h5py) * asynchronous concurrent fetch of many data chunks in one go, amortizing the cost of latency * parallel access with a library like zarr without any locks * logical datasets viewing many (>~millions) data files, and direct access/subselection to them via coordinate indexing across an arbitrary number of dimensions |
| Standards-Version: | 4.7.2 |
| Vcs-Browser: | https://salsa.debian.org/debian-gis-team/kerchunk |
| Vcs-Git: | https://salsa.debian.org/debian-gis-team/kerchunk.git |
| Testsuite: | autopkgtest-pkg-pybuild |
| Build-Depends: | debhelper-compat (=13), dh-sequence-python3, dh-sequence-sphinxdoc<!nodoc>, pybuild-plugin-pyproject, python3-aiohttp<!nocheck>, python3-all, python3-astropy<!nodoc>, python3-dask<!nocheck>, python3-cfgrib, python3-cftime, python3-eccodes<!nodoc>, python3-fsspec, python3-h5netcdf<!nocheck>, python3-h5py, python3-netcdf4<!nocheck>, python3-numcodecs, python3-numpy, python3-numpydoc<!nodoc>, python3-pytest<!nocheck>, python3-scipy, python3-setuptools, python3-setuptools-scm, python3-sphinx<!nodoc>, python3-sphinx-rtd-theme<!nodoc>, python3-tifffile<!nodoc>, python3-ujson, python3-xarray, python3-zarr |
| Package-List: | python-kerchunk-doc deb doc optional arch=all python3-kerchunk deb python optional arch=all |
| Files: | 37d48624e7e1c39a79f866204090a04c 124716963 kerchunk_0.2.9.orig.tar.gz 11ebcb233ec497e28816f9aa7d308b21 6788 kerchunk_0.2.9-1.debian.tar.xz |
| control file for python-kerchunk-doc_0.2.9-1_all.deb (click to toggle) | |
|---|---|
| Package: | python-kerchunk-doc |
| Source: | kerchunk |
| Version: | 0.2.9-1 |
| Architecture: | all |
| Maintainer: | Debian GIS Project <pkg-grass-devel@lists.alioth.debian.org> |
| Installed-Size: | 2464 |
| Depends: | libjs-jquery (>=3.6.0), libjs-sphinxdoc (>=8.2), sphinx-rtd-theme-common (>=3.0.2+dfsg) |
| Suggests: | www-browser |
| Section: | doc |
| Priority: | optional |
| Homepage: | https://github.com/fsspec/kerchunk |
| Description: | Cloud-friendly access to archival data (documentation)
Kerchunk is a library that provides a unified way to represent a
variety of chunked, compressed data formats (e.g. NetCDF, HDF5, GRIB),
allowing efficient access to the data from traditional file systems or
cloud object storage. It also provides a flexible way to create
virtual datasets from multiple files. It does this by extracting the
byte ranges, compression information and other information about the
data and storing this metadata in a new, separate object.
This means that you can create a virtual aggregate dataset over
potentially many source files, for efficient, parallel and
cloud-friendly *in-situ* access without having to copy or translate
the originals. It is a gateway to in-the-cloud massive data processing
while the data providers still insist on using legacy formats for
archival storage.
.
Features:
.
* completely serverless architecture
* metadata consolidation, so you can understand a many-file dataset
(metadata plus physical storage) in a single read
* read from all of the storage backends supported by fsspec,
including object storage (s3, gcs, abfs, alibaba), http, cloud user
storage (dropbox, gdrive) and network protocols (ftp, ssh, hdfs,
smb...)
* loading of various file types (currently netcdf4/HDF, grib2, tiff,
fits, zarr), potentially heterogeneous within a single dataset,
without a need to go via the specific driver (e.g., no need for
h5py)
* asynchronous concurrent fetch of many data chunks in one go,
amortizing the cost of latency
* parallel access with a library like zarr without any locks
* logical datasets viewing many (>~millions) data files, and direct
access/subselection to them via coordinate indexing across an
arbitrary number of dimensions
.
This package provides the HTML documentation for kerchunk. |
| contents of python-kerchunk-doc_0.2.9-1_all.deb (click to toggle) | |
|---|---|
drwxr-xr-x root/root 0 2025-12-28 08:17 ./ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/ -rw-r--r-- root/root 160 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/changelog.Debian.gz -rw-r--r-- root/root 1414 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/copyright drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_images/ -rw-r--r-- root/root 394242 2025-07-21 13:42 ./usr/share/doc/python-kerchunk-doc/html/_images/binary_buffer.png -rw-r--r-- root/root 126383 2025-07-21 13:42 ./usr/share/doc/python-kerchunk-doc/html/_images/multi_refs.png -rw-r--r-- root/root 65655 2025-07-21 13:42 ./usr/share/doc/python-kerchunk-doc/html/_images/output_62_2.png -rw-r--r-- root/root 28361 2025-07-21 13:42 ./usr/share/doc/python-kerchunk-doc/html/_images/output_63_2.png drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/ -rw-r--r-- root/root 5178 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/index.html drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/ -rw-r--r-- root/root 54184 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/codecs.html -rw-r--r-- root/root 151096 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/combine.html -rw-r--r-- root/root 22841 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/df.html -rw-r--r-- root/root 47870 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/fits.html -rw-r--r-- root/root 89737 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/grib2.html -rw-r--r-- root/root 108662 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/hdf.html -rw-r--r-- root/root 97732 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/hdf4.html -rw-r--r-- root/root 53819 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/netCDF3.html -rw-r--r-- root/root 21756 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/tiff.html -rw-r--r-- root/root 84756 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_modules/kerchunk/utils.html drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/ -rw-r--r-- root/root 7704 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/advanced.rst.txt -rw-r--r-- root/root 1119 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/beyond.rst.txt -rw-r--r-- root/root 2540 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/cases.rst.txt -rw-r--r-- root/root 7522 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/contributing.rst.txt -rw-r--r-- root/root 3832 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/detail.rst.txt -rw-r--r-- root/root 3588 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/index.rst.txt -rw-r--r-- root/root 2862 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/nonzarr.rst.txt -rw-r--r-- root/root 2460 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/reference.rst.txt -rw-r--r-- root/root 8351 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/reference_aggregation.rst.txt -rw-r--r-- root/root 8056 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/spec.rst.txt -rw-r--r-- root/root 3951 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/test_example.rst.txt -rw-r--r-- root/root 25182 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_sources/tutorial.rst.txt drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/ -rw-r--r-- root/root 4289 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/_sphinx_javascript_frameworks_compat.js -rw-r--r-- root/root 14685 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/basic.css -rw-r--r-- root/root 394242 2025-07-21 13:42 ./usr/share/doc/python-kerchunk-doc/html/_static/binary_buffer.png drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/css/ -rw-r--r-- root/root 323 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/documentation_options.js -rw-r--r-- root/root 286 2025-12-23 11:28 ./usr/share/doc/python-kerchunk-doc/html/_static/file.png drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/js/ -rw-r--r-- root/root 6978 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/js/versions.js -rw-r--r-- root/root 19568 2025-07-21 13:42 ./usr/share/doc/python-kerchunk-doc/html/_static/kerchunk.ico.gz -rw-r--r-- root/root 15075 2025-07-21 13:42 ./usr/share/doc/python-kerchunk-doc/html/_static/kerchunk.png -rw-r--r-- root/root 90 2025-12-23 11:28 ./usr/share/doc/python-kerchunk-doc/html/_static/minus.png -rw-r--r-- root/root 126383 2025-07-21 13:42 ./usr/share/doc/python-kerchunk-doc/html/_static/multi_refs.png -rw-r--r-- root/root 90 2025-12-23 11:28 ./usr/share/doc/python-kerchunk-doc/html/_static/plus.png -rw-r--r-- root/root 4929 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/pygments.css -rw-r--r-- root/root 23419 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/advanced.html -rw-r--r-- root/root 6866 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/beyond.html -rw-r--r-- root/root 10464 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/cases.html -rw-r--r-- root/root 20590 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/contributing.html -rw-r--r-- root/root 11476 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/detail.html -rw-r--r-- root/root 13013 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/genindex.html -rw-r--r-- root/root 14850 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/index.html -rw-r--r-- root/root 8982 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/nonzarr.html -rw-r--r-- root/root 899 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/objects.inv -rw-r--r-- root/root 103222 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/reference.html -rw-r--r-- root/root 24963 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/reference_aggregation.html -rw-r--r-- root/root 4885 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/search.html -rw-r--r-- root/root 33180 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/searchindex.js -rw-r--r-- root/root 32070 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/spec.html -rw-r--r-- root/root 15448 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/test_example.html -rw-r--r-- root/root 108394 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/tutorial.html drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc-base/ -rw-r--r-- root/root 387 2025-12-28 08:17 ./usr/share/doc-base/python-kerchunk-doc.kerchunk lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/css/badge_only.css -> ../../../../../sphinx_rtd_theme/static/css/badge_only.css lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/css/theme.css -> ../../../../../sphinx_rtd_theme/static/css/theme.css lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/doctools.js -> ../../../../javascript/sphinxdoc/1.0/doctools.js lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/Lato-Bold.ttf -> ../../../../../sphinx_rtd_theme/static/fonts/Lato-Bold.ttf lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/Lato-Bold.woff2 -> ../../../../../sphinx_rtd_theme/static/fonts/Lato-Bold.woff2 lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/Lato-BoldItalic.ttf -> ../../../../../sphinx_rtd_theme/static/fonts/Lato-BoldItalic.ttf lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/Lato-BoldItalic.woff2 -> ../../../../../sphinx_rtd_theme/static/fonts/Lato-BoldItalic.woff2 lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/Lato-Italic.ttf -> ../../../../../sphinx_rtd_theme/static/fonts/Lato-Italic.ttf lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/Lato-Italic.woff2 -> ../../../../../sphinx_rtd_theme/static/fonts/Lato-Italic.woff2 lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/Lato-Regular.ttf -> ../../../../../sphinx_rtd_theme/static/fonts/Lato-Regular.ttf lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/Lato-Regular.woff2 -> ../../../../../sphinx_rtd_theme/static/fonts/Lato-Regular.woff2 lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/RobotoSlab-Bold.woff2 -> ../../../../../sphinx_rtd_theme/static/fonts/RobotoSlab-Bold.woff2 lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/RobotoSlab-Regular.woff2 -> ../../../../../sphinx_rtd_theme/static/fonts/RobotoSlab-Regular.woff2 lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/fontawesome-webfont.eot -> ../../../../../sphinx_rtd_theme/static/fonts/fontawesome-webfont.eot lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/fontawesome-webfont.svg -> ../../../../../sphinx_rtd_theme/static/fonts/fontawesome-webfont.svg lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/fontawesome-webfont.ttf -> ../../../../../sphinx_rtd_theme/static/fonts/fontawesome-webfont.ttf lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/fontawesome-webfont.woff -> ../../../../../sphinx_rtd_theme/static/fonts/fontawesome-webfont.woff lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/fonts/fontawesome-webfont.woff2 -> ../../../../../sphinx_rtd_theme/static/fonts/fontawesome-webfont.woff2 lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/jquery.js -> ../../../../javascript/jquery/jquery.min.js lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/js/theme.js -> ../../../../../sphinx_rtd_theme/static/js/theme.js lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/language_data.js -> ../../../../javascript/sphinxdoc/1.0/language_data.js lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/searchtools.js -> ../../../../javascript/sphinxdoc/1.0/searchtools.js lrwxrwxrwx root/root 0 2025-12-28 08:17 ./usr/share/doc/python-kerchunk-doc/html/_static/sphinx_highlight.js -> ../../../../javascript/sphinxdoc/1.0/sphinx_highlight.js | |
| copyright of python-kerchunk-doc_0.2.9-1_all.deb (click to toggle) | |
|---|---|
Format: https://www.debian.org/doc/packaging-manuals/copyright-format/1.0/ Upstream-Name: kerchunk Upstream-Contact: Martin Durant <martin.durant@alumni.utoronto.ca> Source: https://github.com/fsspec/kerchunk Files: * Copyright: 2020, Intake License: Expat Files: debian/* Copyright: 2025, Antonio Valentino <antonio.valentino@tiscali.it> License: Expat License: Expat Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: . The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. . THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. | |
| control file for python3-kerchunk_0.2.9-1_all.deb (click to toggle) | |
|---|---|
| Package: | python3-kerchunk |
| Source: | kerchunk |
| Version: | 0.2.9-1 |
| Architecture: | all |
| Maintainer: | Debian GIS Project <pkg-grass-devel@lists.alioth.debian.org> |
| Installed-Size: | 3972 |
| Depends: | python3-fsspec, python3-numcodecs, python3-numpy, python3-ujson, python3-zarr, python3:any |
| Recommends: | python3-cfgrib, python3-cftime, python3-h5py, python3-scipy, python3-xarray |
| Suggests: | python3-aiohttp, python3-dask, python3-netcdf4 |
| Section: | python |
| Priority: | optional |
| Homepage: | https://github.com/fsspec/kerchunk |
| Description: | Cloud-friendly access to archival data
Kerchunk is a library that provides a unified way to represent a
variety of chunked, compressed data formats (e.g. NetCDF, HDF5, GRIB),
allowing efficient access to the data from traditional file systems or
cloud object storage. It also provides a flexible way to create
virtual datasets from multiple files. It does this by extracting the
byte ranges, compression information and other information about the
data and storing this metadata in a new, separate object.
This means that you can create a virtual aggregate dataset over
potentially many source files, for efficient, parallel and
cloud-friendly *in-situ* access without having to copy or translate
the originals. It is a gateway to in-the-cloud massive data processing
while the data providers still insist on using legacy formats for
archival storage.
.
Features:
.
* completely serverless architecture
* metadata consolidation, so you can understand a many-file dataset
(metadata plus physical storage) in a single read
* read from all of the storage backends supported by fsspec,
including object storage (s3, gcs, abfs, alibaba), http, cloud user
storage (dropbox, gdrive) and network protocols (ftp, ssh, hdfs,
smb...)
* loading of various file types (currently netcdf4/HDF, grib2, tiff,
fits, zarr), potentially heterogeneous within a single dataset,
without a need to go via the specific driver (e.g., no need for
h5py)
* asynchronous concurrent fetch of many data chunks in one go,
amortizing the cost of latency
* parallel access with a library like zarr without any locks
* logical datasets viewing many (>~millions) data files, and direct
access/subselection to them via coordinate indexing across an
arbitrary number of dimensions |
| contents of python3-kerchunk_0.2.9-1_all.deb (click to toggle) | |
|---|---|
drwxr-xr-x root/root 0 2025-12-28 08:17 ./ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/lib/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/lib/python3/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/lib/python3/dist-packages/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/ -rw-r--r-- root/root 763 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/__init__.py -rw-r--r-- root/root 35108 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/_grib_idx.py -rw-r--r-- root/root 9735 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/codecs.py -rw-r--r-- root/root 34885 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/combine.py -rw-r--r-- root/root 4686 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/df.py -rw-r--r-- root/root 9662 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/fits.py -rw-r--r-- root/root 22456 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/grib2.py -rw-r--r-- root/root 28001 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/hdf.py -rw-r--r-- root/root 16287 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/hdf4.py -rw-r--r-- root/root 11487 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/netCDF3.py -rw-r--r-- root/root 4118 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/tiff.py -rw-r--r-- root/root 19032 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/utils.py -rw-r--r-- root/root 1406 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/xarray_backend.py -rw-r--r-- root/root 2364 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk/zarr.py drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk-0.2.9.dist-info/ -rw-r--r-- root/root 7 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk-0.2.9.dist-info/INSTALLER -rw-r--r-- root/root 4393 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk-0.2.9.dist-info/METADATA -rw-r--r-- root/root 91 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk-0.2.9.dist-info/WHEEL -rw-r--r-- root/root 347 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk-0.2.9.dist-info/entry_points.txt -rw-r--r-- root/root 9 2025-12-28 08:17 ./usr/lib/python3/dist-packages/kerchunk-0.2.9.dist-info/top_level.txt drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/ drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python3-kerchunk/ -rw-r--r-- root/root 2433 2025-07-21 13:42 ./usr/share/doc/python3-kerchunk/README.md -rw-r--r-- root/root 160 2025-12-28 08:17 ./usr/share/doc/python3-kerchunk/changelog.Debian.gz -rw-r--r-- root/root 1414 2025-12-28 08:17 ./usr/share/doc/python3-kerchunk/copyright drwxr-xr-x root/root 0 2025-12-28 08:17 ./usr/share/doc/python3-kerchunk/examples/ -rw-r--r-- root/root 4343 2025-07-21 13:42 ./usr/share/doc/python3-kerchunk/examples/SDO.ipynb -rw-r--r-- root/root 3377534 2025-07-21 13:42 ./usr/share/doc/python3-kerchunk/examples/earthbigdata.ipynb -rw-r--r-- root/root 164584 2025-07-21 13:42 ./usr/share/doc/python3-kerchunk/examples/ike_chunk_compare.ipynb -rw-r--r-- root/root 109823 2025-07-21 13:42 ./usr/share/doc/python3-kerchunk/examples/ike_intake.ipynb -rw-r--r-- root/root 126360 2025-07-21 13:42 ./usr/share/doc/python3-kerchunk/examples/ike_simple.ipynb -rw-r--r-- root/root 3347 2025-07-21 13:42 ./usr/share/doc/python3-kerchunk/examples/intake_catalog.yml -rw-r--r-- root/root 39660 2025-07-21 13:42 ./usr/share/doc/python3-kerchunk/examples/nwm.ipynb | |
| copyright of python3-kerchunk_0.2.9-1_all.deb (click to toggle) | |
|---|---|
NOTE: Copyright is the same as python-kerchunk-doc (python-kerchunk-doc_0.2.9-1_all.deb). Format: https://www.debian.org/doc/packaging-manuals/copyright-format/1.0/ Upstream-Name: kerchunk Upstream-Contact: Martin Durant <martin.durant@alumni.utoronto.ca> Source: https://github.com/fsspec/kerchunk Files: * Copyright: 2020, Intake License: Expat Files: debian/* Copyright: 2025, Antonio Valentino <antonio.valentino@tiscali.it> License: Expat License: Expat Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: . The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. . THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. | |
Timestamp: 28.12.2025 / 11:02:43 (UTC)