pithos
说明： 一种安全、快速和通用的包文件格式，用于以对象存储为中心的数据管理
(A secure, fast and versatile package file format for object storage focused data management)
(A secure, fast and versatile package file format for object storage focused data management)
文件列表:
assets/
crates/
spec/
.codecov.yml
Cargo.lock
Cargo.toml
LICENSE
crates/
spec/
.codecov.yml
Cargo.lock
Cargo.toml
LICENSE
Pithos
A secure, fast and versatile package file format for object storage focused data management
## Description
Pithos (a large ancient greek storage container) is a packaging file format for arbitrary data that enhances the use of Object Storage for (research) data management. This is done by combining multiple existing file standards with new enhancements. A format specification can be found [[here]](https://github.com/ArunaStorage/pithos/blob/master/./spec/SPECIFICATION.md).
## Features
- **Encryption**: Pithos implements fast ChaCha20-Poly1305 encryption and enables data exchange compatible to the Crypt4GH standard used for sensitive medical data.
- **Smart Compression**: Via compression probing Pithos can automatically detect and apply fast ZStandard compression for compressible data and optionally skip it when the data is incompressible.
- **Metadata**: Pithos not only includes technical metadata like file size and checksums but can also embed any semantic metadata directly in the file.
- **Indexing**: A built in index allows for fast random access of arbitrary ranges in encrypted and compressed files.
- **Tooling**: Pithos comes with a rich set of existing tools that simplify file handling and can additionally be handled with existing tools for the Crypt4GH and Zstandard file formats.
Pithos comes with two main crates, a library for programmatic use and a CLI application that uses the library:
| crate | version | docs |
| :------------------------- | :-----------------------------------------------------------------------------------------: | :------------------------------------------------------------------: |
| [pithos](https://github.com/ArunaStorage/pithos/blob/master/./crates/pithos/) | [](https://github.com/ArunaStorage/pithos/blob/master/https://crates.io/crates/pithos) | [](https://github.com/ArunaStorage/pithos/blob/master/https://docs.rs/pithos/) |
| [pithos_lib](https://github.com/ArunaStorage/pithos/blob/master/./crates/pithos_lib/) | [](https://github.com/ArunaStorage/pithos/blob/master/https://crates.io/crates/pithos_lib) | [](https://github.com/ArunaStorage/pithos/blob/master/https://docs.rs/pithos_lib/) |
For a more detailed documentation of the individual crates see [Library](https://github.com/ArunaStorage/pithos/blob/master/./crates/pithos_lib/README.md) and [CLI](https://github.com/ArunaStorage/pithos/blob/master/./crates/pithos/README.md)
近期下载者：
相关文件：
收藏者：