http-connector-for-apache-kafka
所属分类：中间件编程
开发工具：Java
文件大小：0KB
下载次数：0
上传日期：2023-08-01 09:52:39
上 传 者：
sh-1993
说明： 用于HTTP的Apache Kafka Connect接收器连接器，
(Apache Kafka Connect sink connector for HTTP,)
文件列表:
CODE_OF_CONDUCT.md (5221, 2023-12-04)
LICENSE (11395, 2023-12-04)
SECURITY.md (1444, 2023-12-04)
build.gradle (9278, 2023-12-04)
config/ (0, 2023-12-04)
config/checkstyle/ (0, 2023-12-04)
config/checkstyle/checkstyle.xml (16459, 2023-12-04)
config/checkstyle/java.header (690, 2023-12-04)
config/checkstyle/suppressions.xml (1334, 2023-12-04)
config/spotbugs-exclude.xml (333, 2023-12-04)
config/spotless-eclipse-wtp-xml.prefs (137, 2023-12-04)
docs/ (0, 2023-12-04)
docs/IETF-Badge-HTTP.png (5145, 2023-12-04)
docs/sink-connector-config-options.rst (6452, 2023-12-04)
gradle.properties (23, 2023-12-04)
gradle/ (0, 2023-12-04)
gradle/wrapper/ (0, 2023-12-04)
gradle/wrapper/gradle-wrapper.jar (59821, 2023-12-04)
gradle/wrapper/gradle-wrapper.properties (289, 2023-12-04)
gradlew (8070, 2023-12-04)
gradlew.bat (2763, 2023-12-04)
settings.gradle (53, 2023-12-04)
src/ (0, 2023-12-04)
src/integration-test/ (0, 2023-12-04)
src/integration-test/java/ (0, 2023-12-04)
src/integration-test/java/io/ (0, 2023-12-04)
src/integration-test/java/io/aiven/ (0, 2023-12-04)
src/integration-test/java/io/aiven/kafka/ (0, 2023-12-04)
src/integration-test/java/io/aiven/kafka/connect/ (0, 2023-12-04)
src/integration-test/java/io/aiven/kafka/connect/http/ (0, 2023-12-04)
... ...
# Aiven's HTTP Sink Connector for Apache Kafka
This is a sink [Apache Kafka Connect](https://github.com/Aiven-Open/http-connector-for-apache-kafka/blob/master/https://kafka.apache.org/documentation/#connect) connector that sends Kafka records over HTTP.
## Status
We consider the connector **stable** despite the major version is currently 0.
## How it works
The connector uses the POST HTTP method to deliver records.
The connector supports:
- authorization (static, OAuth2);
- setting HTTP headers;
- batching;
- delivery retries.
An example of configuration (file `connect-http-sink.json`):
```json
{
"name": "http-sink-test",
"config": {
"connector.class": "io.aiven.kafka.connect.http.HttpSinkConnector",
"topics.regex": "domain_a.*",
"http.authorization.type": "none",
"http.url": "http://httpmockserver:1080",
"batching.enabled": true,
"batch.max.size": 2,
"tasks.max": "1",
"key.converter": "org.apache.kafka.connect.storage.StringConverter",
"value.converter": "org.apache.kafka.connect.json.JsonConverter"
}
}
```
Then deploy the connector configuration against the Kafka Connect REST API with the following command:
```shell
curl -d @config/connect-http-sink.json -H "Content-Type: application/json" -X POST http://localhost:8083/connector
```
See the [configuration options](https://github.com/Aiven-Open/http-connector-for-apache-kafka/blob/master/docs/sink-connector-config-options.rst) for details.
## Development
The connector supports Java 11 or later. It uses [Gradle](https://github.com/Aiven-Open/http-connector-for-apache-kafka/blob/master/https://gradle.org/) for building and automating tasks.
To build a distribution:
```bash
./gradlew clean check distTar distZip
```
(check `build/distributions/` then).
Integration tests can be run with
```bash
./gradlew integrationTest
```
and require [Docker](https://github.com/Aiven-Open/http-connector-for-apache-kafka/blob/master/https://www.docker.com/) installed.
# Formatting
Checkstyle is used for verifying code formatting.
For misc files Spotless is used.
Both are run on Gradle `check` target. Spotless formatting can be done with
```bash
./gradlew spotlessApply
```
## License
This project is licensed under the [Apache License, Version 2.0](https://github.com/Aiven-Open/http-connector-for-apache-kafka/blob/master/LICENSE).
## Trademark
Apache Kafka, Apache Kafka Connect are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries.
近期下载者：
相关文件：
收藏者：