bigslice
所属分类：聚类算法
开发工具：GO
文件大小：2270KB
下载次数：0
上传日期：2023-05-19 00:55:45
上 传 者：
sh-1993
说明： Go编程语言的无服务器集群计算系统
(A serverless cluster computing system for the Go programming language)
文件列表:
.golangci.yml (2120, 2023-05-19)
CNAME (11, 2023-05-19)
LICENSE (11357, 2023-05-19)
accum.go (4298, 2023-05-19)
accum_test.go (1677, 2023-05-19)
analysis (0, 2023-05-19)
analysis\typecheck (0, 2023-05-19)
analysis\typecheck\typecheck.go (4504, 2023-05-19)
archive (0, 2023-05-19)
archive\tarslice (0, 2023-05-19)
archive\tarslice\tarslice.go (1966, 2023-05-19)
archive\tarslice\tarslice_test.go (1512, 2023-05-19)
cache.go (4186, 2023-05-19)
cache_test.go (14633, 2023-05-19)
cmd (0, 2023-05-19)
cmd\badfuncs (0, 2023-05-19)
cmd\badfuncs\main.go (2701, 2023-05-19)
cmd\bigslice (0, 2023-05-19)
cmd\bigslice\bigslicecmd (0, 2023-05-19)
cmd\bigslice\bigslicecmd\build.go (6525, 2023-05-19)
cmd\bigslice\bigslicecmd\cwd.go (154, 2023-05-19)
cmd\bigslice\bigslicecmd\load.go (5288, 2023-05-19)
cmd\bigslice\bigslicecmd\run.go (1323, 2023-05-19)
cmd\bigslice\build.go (875, 2023-05-19)
cmd\bigslice\ec2.go (6748, 2023-05-19)
cmd\bigslice\main.go (1611, 2023-05-19)
cmd\bigslice\run.go (532, 2023-05-19)
cmd\slicer (0, 2023-05-19)
cmd\slicer\cogroup.go (2989, 2023-05-19)
cmd\slicer\main.go (1643, 2023-05-19)
cmd\slicer\memiter.go (1623, 2023-05-19)
cmd\slicer\oom.go (1288, 2023-05-19)
cmd\slicer\reduce.go (1958, 2023-05-19)
... ...
# Bigslice
Bigslice is a serverless cluster data processing system for [Go](https://golang.org).
Bigslice exposes composable API
that lets the user express
data processing tasks in terms of a series of
data transformations that invoke user code.
The Bigslice runtime then
transparently parallelizes and distributes the work,
using the [Bigmachine](https://github.com/grailbio/bigmachine)
library to create an ad hoc cluster on a cloud provider.
- website: [bigslice.io](https://bigslice.io/)
- API documentation: [godoc.org/github.com/grailbio/bigslice](https://godoc.org/github.com/grailbio/bigslice)
- issue tracker: [github.com/grailbio/bigslice/issues](https://github.com/grailbio/bigslice/issues)
- [](https://github.com/grailbio/bigslice/actions?query=workflow%3ACI) [](https://github.com/grailbio/bigslice/actions?query=workflow%3A%22Full+Test%22)
# Developing Bigslice
Bigslice uses Go modules to capture its dependencies;
no tooling other than the base Go install is required.
```
$ git clone https://github.com/grailbio/bigslice
$ cd bigslice
$ GO111MODULE=on go test
```
If tests fail with `socket: too many open files` errors, try increasing the maximum number of open files.
```
$ ulimit -n 2000
```
近期下载者：
相关文件：
收藏者：