dsra-dcos
所属分类:其他
开发工具:Shell
文件大小:0KB
下载次数:0
上传日期:2016-05-12 18:06:34
上 传 者:
sh-1993
说明: 数据科学研究架构,数据中心操作系统,
(Data Science Research Architecture, Data Center OS,)
文件列表:
LICENSE (11358, 2016-05-12)
client/ (0, 2016-05-12)
client/Vagrantfile (1202, 2016-05-12)
client/configure.sh (1397, 2016-05-12)
client/hadoop/ (0, 2016-05-12)
client/hadoop/core-site.xml.template (1236, 2016-05-12)
client/hadoop/hdfs-site.xml.template (2908, 2016-05-12)
client/install_software.sh (3314, 2016-05-12)
client/spark/ (0, 2016-05-12)
client/spark/spark-defaults.conf (456, 2016-05-12)
client/spark/spark-env.sh (373, 2016-05-12)
coreos/ (0, 2016-05-12)
coreos/cloud-config/ (0, 2016-05-12)
coreos/cloud-config/init.yml (1613, 2016-05-12)
coreos/cloud-config/utility-cloud-config.yml (7249, 2016-05-12)
coreos/cloud-config/worker-cloud-config.yml (5292, 2016-05-12)
coreos/fleet/ (0, 2016-05-12)
coreos/fleet/bin/ (0, 2016-05-12)
coreos/fleet/bin/remove-framework.sh (1, 2016-05-12)
coreos/fleet/bin/remove-unused-containers.sh (124, 2016-05-12)
coreos/fleet/bin/reset-marathon.sh (177, 2016-05-12)
sh (243, 2016-05-12)
coreos/fleet/bin/reset-mesos-slave.sh (217, 2016-05-12)
coreos/fleet/bin/reset-zookeeper.sh (191, 2016-05-12)
coreos/fleet/bin/rolling-restart.sh (1020, 2016-05-12)
coreos/fleet/bin/shutdown-mesos.sh (384, 2016-05-12)
coreos/fleet/bin/shutdown-zookeeper.sh (91, 2016-05-12)
coreos/fleet/bin/start-mesos.sh (403, 2016-05-12)
coreos/fleet/docker-registry.service (441, 2016-05-12)
coreos/fleet/hdfs/ (0, 2016-05-12)
coreos/fleet/hdfs/datanode.service (871, 2016-05-12)
coreos/fleet/hdfs/httpfs.service (646, 2016-05-12)
coreos/fleet/hdfs/journalnode.service (795, 2016-05-12)
coreos/fleet/hdfs/namenode1.service (802, 2016-05-12)
coreos/fleet/hdfs/namenode2.service (803, 2016-05-12)
... ...
## Data Science Research Architecture, Data Center OS
### Overview
The newest version of the DSRA migrates the system to a Mesos-centric architecture. It provides
significant distributed processing capabilities out of the box, supporting a variety of
distributed frameworks. The distributed processing architecture has been abstracted for Engineers to
develop their own frameworks in a wide-range of programming languages, including Java, Python, Ruby,
C, and Go. Additional system information and examples are detailed in the [wiki](https://github.com/aglahe/dsra-dcos/wiki).
![](./docs/architecture.png)
### Future Releases
Mesos also supports deploying applications as Docker containers. Long running processes are
managed by Marathon, which can run commands across the Mesos cluster, containers deployed
from public repoitories, like DockerHub, or it can use an organization's private Docker registry.
Distributed storage is supported in the first software release, utilizing HDFS.
Future releases and updates will focus on adding more software capabilities, to include, but not limited too, the following:
* ElasticSearch
* Kafka
* HBase
* Myriad/Yarn
* Mongo
* HDFS (Federated)
* Security
### License
DSRA DCOS is licensed under the [Apache 2 License](http://www.apache.org/licenses/LICENSE-2.0)
近期下载者:
相关文件:
收藏者: