flink-consume-produce-ek
所属分类 ：微服务
开发工具 ：Java
文件大小 ：18KB
下载次数 ：0
上传日期 ：2021-02-02 10:29:59
上 传 者 ：
sh-1993
说明： 这个FLINK项目将使用来自azure事件中心的流，并生成到不同的事件中心，配置...
文件列表 :
Dockerfile (571, 2021-02-02)yml (1511, 2021-02-02)yml (173, 2021-02-02)yaml (2835, 2021-02-02)yaml (1802, 2021-02-02)yaml (334, 2021-02-02)yml (74, 2021-02-02)yaml (1688, 2021-02-02)xml (6171, 2021-02-02)java (2138, 2021-02-02)java (284, 2021-02-02)config (275, 2021-02-02)yaml (302, 2021-02-02)properties (1793, 2021-02-02)properties (1303, 2021-02-02)
# flink-consume-produce-ek
This FLINK project will consume from an azure event-hub and produce to a different event-hub ,and the code for deploying the same in kubernetes
#Getting Started with IDE
Steps for running in IDE like Intellij,
1. Clone this repo.
2. From Intellij, navigate File->New->Project->
3. Edit the EH name in FlinkTestConsumerProducer.java and broker name & connection string in consumer.config (if required)
4. From the Maven tool window, perform the lifecycle - clean and compile.
5. Run the main class .
6. Clone the project flink-producer-ek and run the same.
#Docker image
Once you commit the code changes , an image will get generated in ACR.
#Kubernetes Deployment
Steps for running in Kubernetes(Manual steps),
1. Login to your AKS cluster using any command line tools, eg: AzureCLI or AzureCloudShell.
OR use minikube for local testing.
2. Clone/Navigate to the project directory.
3. CD Kubernetes
4. Create the resources in the following order.
a. kubectl create -f namespace.yaml
b. kubectl create -f dockersecret.yaml
c. kubectl create -f flink-configuration-configmap.yaml
d. kubectl create -f jobmanager-service.yaml
e. kubectl create -f jobmanager-deployment.yaml
f. kubectl create -f taskmanager-deployment.yaml
We could manage the above mentioned kubernetes resources and automate the deployment by using either one of the following ways in future
1.Helm Charts.
2.Kustomize.
3.Kubernetes Operator.
近期下载者 ：
相关文件 ：
收藏者 ：