airflow
说明： Apache Airvlow Airflow是由社区创建的一个平台，用于以编程方式编写、调度和监控工作流
(Apache Airflow Airflow is a platform created by the community to programmatically author, schedule and monitor workflows)
(Apache Airflow Airflow is a platform created by the community to programmatically author, schedule and monitor workflows)
文件列表:
airflow.png (389191, 2023-11-21)
deploy-on-elestio.png (2461, 2023-11-21)
docker-compose.yml (11804, 2023-11-21)
elestio.yml (1393, 2023-11-21)
scripts/ (0, 2023-11-21)
scripts/postBackup.sh (24, 2023-11-21)
scripts/postInstall.sh (24, 2023-11-21)
scripts/postRestore.sh (65, 2023-11-21)
scripts/preBackup.sh (24, 2023-11-21)
scripts/preInstall.sh (208, 2023-11-21)
scripts/preRestore.sh (77, 2023-11-21)
tests/ (0, 2023-11-21)
tests/.env (1557, 2023-11-21)
tests/build.sh (111, 2023-11-21)
tests/docker-compose.yml (9291, 2023-11-21)
tests/run.sh (54, 2023-11-21)
deploy-on-elestio.png (2461, 2023-11-21)
docker-compose.yml (11804, 2023-11-21)
elestio.yml (1393, 2023-11-21)
scripts/ (0, 2023-11-21)
scripts/postBackup.sh (24, 2023-11-21)
scripts/postInstall.sh (24, 2023-11-21)
scripts/postRestore.sh (65, 2023-11-21)
scripts/preBackup.sh (24, 2023-11-21)
scripts/preInstall.sh (208, 2023-11-21)
scripts/preRestore.sh (77, 2023-11-21)
tests/ (0, 2023-11-21)
tests/.env (1557, 2023-11-21)
tests/build.sh (111, 2023-11-21)
tests/docker-compose.yml (9291, 2023-11-21)
tests/run.sh (54, 2023-11-21)
# Airflow docker-compose demo CI/CD pipeline
Example CI/CD pipeline showing how to deploy an Airflow instance to elestio.
# Once deployed ...
You can connect to your instance with the Airflow Web UI:
Host: https://[CI_CD_DOMAIN]
Login: [ADMIN_LOGIN] (set in env var)
Password: [ADMIN_PASSWORD] (set in env var)
Airflow connection details:
Host: [CI_CD_DOMAIN]
Port: 25672
Login: [ADMIN_LOGIN] (set in env var)
Password: [ADMIN_PASSWORD] (set in env var)
Service URI:
amqp://[ADMIN_LOGIN]:[ADMIN_PASSWORD]@[CI_CD_DOMAIN]:25672
# Sample usage in Node.js
First, install the NPM package: `npm install amqplib`
var amqp = require('amqplib/callback_api');
amqp.connect('amqp://[ADMIN_LOGIN]:[ADMIN_PASSWORD]@[CI_CD_DOMAIN]:25672', function(error0, connection) {
if (error0) {
throw error0;
}
connection.createChannel(function(error1, channel) {
if (error1) {
throw error1;
}
var queue = 'hello';
var msg = 'Hello World!';
channel.assertQueue(queue, {
durable: false
});
channel.sendToQueue(queue, Buffer.from(msg));
console.log(" [x] Sent %s", msg);
});
setTimeout(function() {
connection.close();
process.exit(0);
}, 500);
});
# Steps to Install Library Packages in Airflow:
There are two methods for installing the library package in Airflow.
One option is to configure the *__PIP_ADDITIONAL_REQUIREMENTS_* variable in the docker-compose file. Alternatively, utilize the custom Docker image provided at https://airflow.apache.org/docs/docker-stack/build.html.
To opt for the straightforward approach using the *__PIP_ADDITIONAL_REQUIREMENTS_* variable in docker-compose, navigate to your docker-compose file, Open Elestio dashboard > Service overview > Click on the Update CONFIG button > Once in the docker-compose file, insert the *__PIP_ADDITIONAL_REQUIREMENTS_* variable in all instances specified at https://airflow.apache.org/docs/apache-airflow/stable/docker-compose.yaml. Finally, click the "Update & Restart" button to apply the changes.
Example CI/CD pipeline showing how to deploy an Airflow instance to elestio.
# Once deployed ...
You can connect to your instance with the Airflow Web UI:
Host: https://[CI_CD_DOMAIN]
Login: [ADMIN_LOGIN] (set in env var)
Password: [ADMIN_PASSWORD] (set in env var)
Airflow connection details:
Host: [CI_CD_DOMAIN]
Port: 25672
Login: [ADMIN_LOGIN] (set in env var)
Password: [ADMIN_PASSWORD] (set in env var)
Service URI:
amqp://[ADMIN_LOGIN]:[ADMIN_PASSWORD]@[CI_CD_DOMAIN]:25672
# Sample usage in Node.js
First, install the NPM package: `npm install amqplib`
var amqp = require('amqplib/callback_api');
amqp.connect('amqp://[ADMIN_LOGIN]:[ADMIN_PASSWORD]@[CI_CD_DOMAIN]:25672', function(error0, connection) {
if (error0) {
throw error0;
}
connection.createChannel(function(error1, channel) {
if (error1) {
throw error1;
}
var queue = 'hello';
var msg = 'Hello World!';
channel.assertQueue(queue, {
durable: false
});
channel.sendToQueue(queue, Buffer.from(msg));
console.log(" [x] Sent %s", msg);
});
setTimeout(function() {
connection.close();
process.exit(0);
}, 500);
});
# Steps to Install Library Packages in Airflow:
There are two methods for installing the library package in Airflow.
One option is to configure the *__PIP_ADDITIONAL_REQUIREMENTS_* variable in the docker-compose file. Alternatively, utilize the custom Docker image provided at https://airflow.apache.org/docs/docker-stack/build.html.
To opt for the straightforward approach using the *__PIP_ADDITIONAL_REQUIREMENTS_* variable in docker-compose, navigate to your docker-compose file, Open Elestio dashboard > Service overview > Click on the Update CONFIG button > Once in the docker-compose file, insert the *__PIP_ADDITIONAL_REQUIREMENTS_* variable in all instances specified at https://airflow.apache.org/docs/apache-airflow/stable/docker-compose.yaml. Finally, click the "Update & Restart" button to apply the changes.
近期下载者：
相关文件：
收藏者：