nifi-loadbalancer

所属分类:云原生工具
开发工具:kotlin
文件大小:3293KB
下载次数:0
上传日期:2020-07-07 13:32:40
上 传 者sh-1993
说明:  用于NiFi的简单负载平衡处理器,包括运行状况检查
(Simple Load Balancing processor for NiFi including health checks)

文件列表:
.idea (0, 2020-07-07)
.idea\compiler.xml (597, 2020-07-07)
.idea\encodings.xml (319, 2020-07-07)
.idea\jarRepositories.xml (1746, 2020-07-07)
.idea\misc.xml (513, 2020-07-07)
.idea\uiDesigner.xml (8792, 2020-07-07)
.idea\vcs.xml (180, 2020-07-07)
nifi-LoadBalancer-nar (0, 2020-07-07)
nifi-LoadBalancer-nar\pom.xml (1722, 2020-07-07)
nifi-LoadBalancer-nar\target (0, 2020-07-07)
nifi-LoadBalancer-nar\target\.plxarc (30, 2020-07-07)
nifi-LoadBalancer-nar\target\classes (0, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF (0, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\DEPENDENCIES (1868, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\LICENSE (11358, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\NOTICE (162, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\bundled-dependencies (0, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\bundled-dependencies\annotations-13.0.jar (17536, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\bundled-dependencies\kotlin-stdlib-1.3.72.jar (1379873, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\bundled-dependencies\kotlin-stdlib-common-1.3.72.jar (179598, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\bundled-dependencies\kotlin-stdlib-jdk7-1.3.72.jar (3130, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\bundled-dependencies\kotlin-stdlib-jdk8-1.3.72.jar (15479, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\bundled-dependencies\nifi-LoadBalancer-processors-1.0-SNAPSHOT.jar (28495, 2020-07-07)
nifi-LoadBalancer-nar\target\classes\META-INF\bundled-dependencies\nifi-utils-1.9.2.jar (172753, 2020-07-07)
nifi-LoadBalancer-nar\target\maven-archiver (0, 2020-07-07)
nifi-LoadBalancer-nar\target\maven-archiver\pom.properties (130, 2020-07-07)
nifi-LoadBalancer-nar\target\maven-shared-archive-resources (0, 2020-07-07)
nifi-LoadBalancer-nar\target\maven-shared-archive-resources\META-INF (0, 2020-07-07)
nifi-LoadBalancer-nar\target\maven-shared-archive-resources\META-INF\DEPENDENCIES (1868, 2020-07-07)
nifi-LoadBalancer-nar\target\maven-shared-archive-resources\META-INF\LICENSE (11358, 2020-07-07)
nifi-LoadBalancer-nar\target\maven-shared-archive-resources\META-INF\NOTICE (162, 2020-07-07)
nifi-LoadBalancer-nar\target\nifi-LoadBalancer-nar-1.0-SNAPSHOT.nar (1629701, 2020-07-07)
nifi-LoadBalancer-nar\target\test-classes (0, 2020-07-07)
nifi-LoadBalancer-nar\target\test-classes\META-INF (0, 2020-07-07)
nifi-LoadBalancer-nar\target\test-classes\META-INF\DEPENDENCIES (1868, 2020-07-07)
nifi-LoadBalancer-nar\target\test-classes\META-INF\LICENSE (11358, 2020-07-07)
nifi-LoadBalancer-nar\target\test-classes\META-INF\NOTICE (162, 2020-07-07)
... ...

# NiFi Load Balancer Processor The purpose of this processor is to allow an administrator to route flow files to multiple downstream destinations, depending on if a given downstream destination is "alive" or not. The processor accepts dynamic properties which are used to define a system command line "health check", for example: `ping -c 1 1.2.3.4` Assuming the downstream destination is 1.2.3.4, then the above command is run every 5 seconds. As long as the command exits with a `0` return code, the destination is considered alive and accepting flow files. Should 1.2.3.4 be unreachable by ping, then the above command would return a non-zero exit code, and the Load Balancing processor will automatically stop sending flow-files to the destination. The processor allows for three load-balancing strategies: - **Round Robin** (default): The processor will send the incoming flow file to the next available destination responding to health checks - **Random**: The processor will send the incoming flow file to a randomly chosen destination responding to health checks - **Attribute Hash**: *note - this requires you to set the "Attribute Hash Field" property*. When this strategy is chosen, the processor will hash the flow flile attribute specified in the "Attribute Hash Field" property, and flow files whose attributes hash to the same value will be sent to the same destination provided said destination still responds to health checks. This strategy is effective in situations when session "stickiness" is required, e.g. sending all HTTP requests from a particular user to the same webserver backend #### Qucikstart Video Demo - Part 1: https://youtu.be/L7Wpq7nK83M - Part 2: https://youtu.be/YlwbnB4pvkk #### Installation - Download the NAR file https://github.com/dvas0004/nifi-loadbalancer/blob/master/nifi-LoadBalancer-nar/target/nifi-LoadBalancer-nar-1.0-SNAPSHOT.nar - Move the NAR file to the "lib" directory of your NiFi installation #### Advanced The property "Attribute Hash Lifetime" is only used when the loadb alancing strategy is set to "Attribute Hash", and controls for how long an attribute hash is stored in cache since it was last seen. Setting this to a lower value may save you some memory, but risks sending a flow file to the wrong destination if the time between two flow files with the same attribute hash is greater than the lifetime specified.

近期下载者

相关文件


收藏者