kafka-boshrelease

所属分类:中间件编程
开发工具:Shell
文件大小:0KB
下载次数:0
上传日期:2020-08-24 10:54:28
上 传 者sh-1993
说明:  卡夫卡·博什莱塞,,
(kafka-boshrelease,,)

文件列表:
.final_builds/ (0, 2019-12-14)
.final_builds/jobs/ (0, 2019-12-14)
.final_builds/jobs/kafka-manager/ (0, 2019-12-14)
.final_builds/jobs/kafka-manager/index.yml (1331, 2019-12-14)
.final_builds/jobs/kafka/ (0, 2019-12-14)
.final_builds/jobs/kafka/index.yml (1818, 2019-12-14)
.final_builds/jobs/sanity-test/ (0, 2019-12-14)
.final_builds/jobs/sanity-test/index.yml (436, 2019-12-14)
.final_builds/jobs/sanitytest/ (0, 2019-12-14)
.final_builds/jobs/sanitytest/index.yml (719, 2019-12-14)
.final_builds/license/ (0, 2019-12-14)
.final_builds/license/index.yml (515, 2019-12-14)
.final_builds/packages/ (0, 2019-12-14)
.final_builds/packages/kafka-manager/ (0, 2019-12-14)
.final_builds/packages/kafka-manager/index.yml (515, 2019-12-14)
.final_builds/packages/kafka/ (0, 2019-12-14)
.final_builds/packages/kafka/index.yml (2792, 2019-12-14)
.final_builds/packages/openjdk-8-kafka/ (0, 2019-12-14)
.final_builds/packages/openjdk-8-kafka/index.yml (515, 2019-12-14)
.final_builds/packages/openjdk-8/ (0, 2019-12-14)
.final_builds/packages/openjdk-8/index.yml (436, 2019-12-14)
.final_builds/packages/openjdk/ (0, 2019-12-14)
.final_builds/packages/openjdk/index.yml (232, 2019-12-14)
LICENSE.md (10293, 2019-12-14)
Rakefile (541, 2019-12-14)
ci/ (0, 2019-12-14)
ci/pipeline.yml (19490, 2019-12-14)
ci/release_notes.md (58, 2019-12-14)
ci/repipe (4426, 2019-12-14)
ci/scripts/ (0, 2019-12-14)
ci/scripts/bump-dependent-release (2524, 2019-12-14)
ci/scripts/export-release (1986, 2019-12-14)
ci/scripts/shipit (3309, 2019-12-14)
ci/scripts/testflight (4236, 2019-12-14)
ci/scripts/update-blob (2022, 2019-12-14)
ci/scripts/update-manifest-compiled-release (2420, 2019-12-14)
ci/scripts/update-manifest-release (2181, 2019-12-14)
ci/scripts/use-compiled-releases (1096, 2019-12-14)
... ...

# BOSH release for kafka This BOSH release and deployment manifest deploy a cluster of kafka. ## Usage This repository includes base manifests and operator files. They can be used for initial deployments and subsequently used for updating your deployments: ```plain export BOSH_ENVIRONMENT= export BOSH_DEPLOYMENT=kafka git clone https://github.com/cloudfoundry-community/kafka-boshrelease.git bosh deploy kafka-boshrelease/manifests/kafka.yml bosh run-errand sanity-test ``` If your BOSH does not have Credhub/Config Server, then remember `--vars-store` to allow generation of passwords and certificates. ### Topics You can pre-define some simple topics using an operator script `./manifests/operators/simple-topics.sh`. Th ```plain bosh deploy kafka-boshrelease/manifests/kafka.yml \ -o <(kafka-boshrelease/manifests/operators/simple-topics.sh test1 test2) ``` ### Enable SASL/SCRAM and TLS You can enable [SASL/SCRAM](https://kafka.apache.org/documentation/#security_sasl_config) using `./manifests/operators/add-jaas.yml`. `SASL_PLAINTEXT` and `SASL_TLS` are supported as a security protocol. ``` bosh deploy kafka-boshrelease/manifests/kafka.yml \ -o kafka-boshrelease/manifests/operators/enable-jaas.yml ``` You can find `admin`'s password by `credhub get -n /(director name)/kafka/jaas-admin-password`. If you want to use `SASL_TLS`, use `./manifests/operators/add-tls.yml` as well. ``` bosh deploy kafka-boshrelease/manifests/kafka.yml \ -o kafka-boshrelease/manifests/operators/enable-jaas.yml \ -o kafka-boshrelease/manifests/operators/enable-tls.yml \ -v kafka-external-host=${your-kafka-hostname-or-static-ip} \ ``` `kafka-boshrelease/manifests/operators/enable-tls.yml` is supposed to be used for single kafka instance group. To scale out the kafka cluster, change `advertised.listener` property and `kafka-tls` variable. You can use Let's Encrypt as follows: ``` bosh deploy kafka-boshrelease/manifests/kafka.yml \ -o kafka-boshrelease/manifests/operators/enable-jaas.yml \ -o kafka-boshrelease/manifests/operators/enable-tls.yml \ --var-file kafka-tls.certificate=/etc/letsencrypt/live/your-kafka.example.com/fullchain.pem \ --var-file kafka-tls.private_key=/etc/letsencrypt/live/your-kafka.example.com/privkey.pem \ --var-file kafka-ca.certificate=<(curl https://letsencrypt.org/certs/lets-encrypt-x3-cross-signed.pem.txt) \ -v kafka-external-host=your-kafka.example.com ``` ### Kafka Manager ![kafka-manager](https://github.com/cloudfoundry-community/kafka-boshrelease/raw/master/doc/kafka-manager.png) The [Yahoo Kafka Manager](https://github.com/yahoo/kafka-manager) UI is installed on each Kafka node. You can access it via port 8080. To access via http://localhost:8080, open a tunnel: ```plain bosh ssh kafka-manager/0 -- -L 8080:127.0.0.1:8080 ``` Kafka Manager requires basic auth credentials. The default `username` is `admin`, and the `password` is the `((kafka-manager-password))` value from either Credhub/Config Server, or your `--vars-store creds.yml` file. ### Update When new versions of `kafka-boshrelease` are released the `manifests/kafka.yml` file will be updated. This means you can easily `git pull` and `bosh deploy` to upgrade. ```plain export BOSH_ENVIRONMENT= export BOSH_DEPLOYMENT=kafka cd kafka-boshrelease git pull cd - bosh deploy kafka-boshrelease/manifests/kafka.yml ``` ### Development To iterate on this BOSH release, use the `create.yml` manifest when you deploy: ```plain bosh deploy manifests/kafka.yml -o manifests/operators/create.yml ```

近期下载者

相关文件


收藏者