borgstore_0.0.4-1_amd64.changes (click to toggle) | |
---|---|
Format: | 1.8 |
Date: | Mon, 30 Sep 2024 10:28:52 +0000 |
Source: | borgstore |
Binary: | python3-borgstore |
Architecture: | source all |
Version: | 0.0.4-1 |
Distribution: | unstable |
Urgency: | low |
Maintainer: | Gianfranco Costamagna <locutusofborg@debian.org> |
Changed-By: | Gianfranco Costamagna <locutusofborg@debian.org> |
Description: | python3-borgstore - Simple key/value store implementation in Python |
Closes: | 1083032 |
Changes: | borgstore (0.0.4-1) unstable; urgency=low * Initial release (Closes: #1083032) |
Files: | 5aaa0b9c87a6c2643da8e6c244e3fb5d 1883 python optional borgstore_0.0.4-1.dsc 84ea96c1adaf3fb02e3db97ab2e16e9c 22561 python optional borgstore_0.0.4.orig.tar.gz 4bb3a0bb6a52e52cdf21621f3442104d 4032 python optional borgstore_0.0.4-1.debian.tar.xz 6b407a53559be479afac4c603db9268f 7466 python optional borgstore_0.0.4-1_amd64.buildinfo e3c9e8f67ae7db76d770bfa8acb1d391 23864 python optional python3-borgstore_0.0.4-1_all.deb |
borgstore_0.0.4-1.dsc (click to toggle) | |
---|---|
Format: | 3.0 (quilt) |
Source: | borgstore |
Binary: | python3-borgstore |
Architecture: | all |
Version: | 0.0.4-1 |
Maintainer: | Gianfranco Costamagna <locutusofborg@debian.org> |
Homepage: | https://github.com/borgbackup/borgstore |
Standards-Version: | 4.7.0 |
Build-Depends: | debhelper-compat (=13), python3-setuptools, dh-python, pybuild-plugin-pyproject, python3, python3-paramiko, python3-requests, python3-types-requests |
Package-List: | python3-borgstore deb python optional arch=all |
Files: | 84ea96c1adaf3fb02e3db97ab2e16e9c 22561 borgstore_0.0.4.orig.tar.gz 4bb3a0bb6a52e52cdf21621f3442104d 4032 borgstore_0.0.4-1.debian.tar.xz |
control file for python3-borgstore_0.0.4-1_all.deb (click to toggle) | |
---|---|
Package: | python3-borgstore |
Source: | borgstore |
Version: | 0.0.4-1 |
Architecture: | all |
Maintainer: | Gianfranco Costamagna <locutusofborg@debian.org> |
Installed-Size: | 92 |
Depends: | python3-paramiko, python3-requests, python3-typeshed, python3:any |
Section: | python |
Priority: | optional |
Homepage: | https://github.com/borgbackup/borgstore |
Description: | Simple key/value store implementation in Python A key/value store implementation in Python, supporting multiple backends, data redundancy and distribution. . Keys ---- . A key (str) can look like: . - 0123456789abcdef... (usually a long, hex-encoded hash value) - Any other pure ASCII string without "/" or ".." or " ". . Namespaces ---------- . To keep stuff apart, keys should get prefixed with a namespace, like: . - config/settings - meta/0123456789abcdef... - data/0123456789abcdef... . Please note: . 1. you should always use namespaces. 2. nested namespaces like namespace1/namespace2/key are not supported. 3. the code could work without a namespace (namespace ""), but then you can't add another namespace later, because then you would have created nested namespaces. . Values ------ . Values can be any arbitrary binary data (bytes). . Store Operations ---------------- . The high-level Store API implementation transparently deals with nesting and soft deletion, so the caller doesn't have to care much for that and the Backend API can be much simpler: . - create/destroy: initialize or remove the whole store. - list: flat list of the items in the given namespace, with or without soft deleted items. - store: write a new item into the store (giving its key/value pair) - load: read a value from the store (giving its key), partial loads giving offset and/or size are supported. - info: get information about an item via its key (exists? size? ...) - delete: immediately remove an item from the store (giving its key) - move: implements rename, soft delete / undelete, move to current nesting level - stats: API call counters, time spent in API methods, data volume/throughput - latency/bandwidth emulator: can emulate higher latency (via BORGSTORE_LATENCY [us]) and lower bandwidth (via BORGSTORE_BANDWIDTH [bit/s]) than what is actually provided by the backend. . Automatic Nesting ----------------- . For the Store user, items have names like e.g.: . namespace/0123456789abcdef... namespace/abcdef0123456789... . If there are very many items in the namespace, this could lead to scalability issues in the backend, thus the Store implementation offers transparent nesting, so that internally the Backend API will be called with names like e.g.: . namespace/01/23/56/0123456789abcdef... namespace/ab/cd/ef/abcdef0123456789... . The nesting depth can be configured from 0 (= no nesting) to N levels and there can be different nesting configurations depending on the namespace. . The Store supports operating at different nesting levels in the same namespace at the same time. . Soft deletion ------------- . To soft delete an item (so its value could be still read or it could be undeleted), the store just renames the item, appending ".del" to its name. . Undelete reverses this by removing the ".del" suffix from the name. . Some store operations have a boolean flag "deleted" to choose whether they shall consider soft deleted items. . Backends -------- . The backend API is rather simple, one only needs to provide some very basic operations. . Currently, these storage backends are implemented: . - POSIX filesystems (namespaces: directories, values: in key-named files) - SFTP (access a server via sftp, namespaces: directories, values: in key-named files) - Rclone - access any of the 100s of cloud providers [rclone](https://rclone.org/) supports - (more might come in future) . MStore ------ . API of MStore is very similar to Store, but instead of directly using one backend only (like Store does), it uses multiple Stores internally to implement: . - redundancy (keep same data at multiple places) - distribution (keep different data at multiple places) . Scalability ----------- . - Count of key/value pairs stored in a namespace: automatic nesting is provided for keys to address common scalability issues. - Key size: there are no special provisions for extremely long keys (like: more than backend limitations). Usually this is not a problem though. - Value size: there are no special provisions for dealing with large value sizes (like: more than free memory, more than backend storage limitations, etc.). If one deals with very large values, one usually cuts them into chunks before storing them into the store. - Partial loads improve performance by avoiding a full load if only a part of the value is needed (e.g. a header with metadata). . Want a demo? ------------ . Run this to get instructions how to run the demo: . python3 -m borgstore . State of this project --------------------- . **API is still unstable and expected to change as development goes on.** . **There will be no data migration tools involving development/testing releases, like e.g. upgrading a store from alpha1 to alpha2 or beta13 to release.** . There are tests and they succeed for the basic functionality, so some of the stuff is already working well. . There might be missing features or optimization potential, feedback welcome! . There are a lot of possible, but still missing backends (like e.g. for cloud storage). If you want to create and support one: pull requests are welcome. . Borg? ----- . Please note that this code is currently **not** used by the stable release of BorgBackup (aka "borg"), but only by borg2 beta 10+ and master branch. |
contents of python3-borgstore_0.0.4-1_all.deb (click to toggle) | |
---|---|
drwxr-xr-x root/root 0 2024-09-30 10:28 ./ drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/ drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/lib/ drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/lib/python3/ drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/lib/python3/dist-packages/ drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/ -rw-r--r-- root/root 91 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/__init__.py -rw-r--r-- root/root 2395 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/__main__.py -rw-r--r-- root/root 32 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/_version.py drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/backends/ -rw-r--r-- root/root 84 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/backends/__init__.py -rw-r--r-- root/root 3550 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/backends/_base.py -rw-r--r-- root/root 782 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/backends/errors.py -rw-r--r-- root/root 5451 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/backends/posixfs.py -rw-r--r-- root/root 8848 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/backends/rclone.py -rw-r--r-- root/root 9342 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/backends/sftp.py -rw-r--r-- root/root 465 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/constants.py -rw-r--r-- root/root 9049 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/mstore.py -rw-r--r-- root/root 10598 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/store.py drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/utils/ -rw-r--r-- root/root 0 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/utils/__init__.py -rw-r--r-- root/root 2666 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore/utils/nesting.py drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore-0.0.0.dist-info/ -rw-r--r-- root/root 7 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore-0.0.0.dist-info/INSTALLER -rw-r--r-- root/root 6322 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore-0.0.0.dist-info/METADATA -rw-r--r-- root/root 91 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore-0.0.0.dist-info/WHEEL -rw-r--r-- root/root 10 2024-09-30 10:28 ./usr/lib/python3/dist-packages/borgstore-0.0.0.dist-info/top_level.txt drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/share/ drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/share/doc/ drwxr-xr-x root/root 0 2024-09-30 10:28 ./usr/share/doc/python3-borgstore/ -rw-r--r-- root/root 2356 2024-09-22 17:52 ./usr/share/doc/python3-borgstore/README.rst.gz -rw-r--r-- root/root 166 2024-09-30 10:28 ./usr/share/doc/python3-borgstore/changelog.Debian.gz -rw-r--r-- root/root 734 2024-09-22 17:53 ./usr/share/doc/python3-borgstore/changelog.gz -rw-r--r-- root/root 1790 2024-09-30 10:28 ./usr/share/doc/python3-borgstore/copyright |
copyright of python3-borgstore_0.0.4-1_all.deb (click to toggle) | |
---|---|
Format: https://www.debian.org/doc/packaging-manuals/copyright-format/1.0/ Upstream-Name: borgstore Source: https://pypi.python.org/pypi/borgstore Files: * Copyright: 2024 Thomas Waldmann <tw@waldmann-edv.de> License: BSD-3-clause Files: debian/* Copyright: 2024 Gianfranco Costamagna <locutusofborg@debian.org> License: BSD-3-clause License: BSD-3-clause Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met: . 1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. 2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. 3. The name of the author may not be used to endorse or promote products derived from this software without specific prior written permission. . THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. |
Timestamp: 30.09.2024 / 12:02:27 (UTC)