Skip to content

Commit 40cc434

Browse files
committed
Updated readme to resolve merge conflicts
1 parent adb21b9 commit 40cc434

File tree

1 file changed

+3
-36
lines changed

1 file changed

+3
-36
lines changed

README.md

Lines changed: 3 additions & 36 deletions
Original file line numberDiff line numberDiff line change
@@ -5,30 +5,20 @@ This repository allows you to install [Apache Airflow](https://airflow.apache.or
55
## Requirements
66
- A supported operating system.
77
- MySQL or PostgreSQL database in which to store Airflow metadata.
8-
<<<<<<< HEAD
98
- RabbitMQ
109
- [Airflow Parcel](https://github.com/teamclairvoyant/apache-airflow-parcels)
1110

1211
### Currently Supported Versions of Airflow
1312
- Airflow 1.9.0
1413
- Airflow 1.10.0
15-
=======
16-
17-
### Currently Supported Versions of Airflow
18-
- Airflow 1.10
19-
>>>>>>> 11b39ebe4b384d6ad1c1735474123e5af2c8676a
2014

2115
### Currently Supported Operating Systems
2216
- CentOS/RHEL 6 & 7
2317
- Debian 8
2418
- Ubuntu 14.04, 16.04, & 18.04
2519

2620
## Installing the CSD
27-
<<<<<<< HEAD
28-
1. Download the Jar file. [Airflow 1.9.0 CSD](https://s3-us-west-2.amazonaws.com/archive.clairvoyantsoft.com/airflow/csd/AIRFLOW-1.9.0.jar)
29-
=======
3021
1. Download the Jar file. [Airflow CSD](http://archive.clairvoyantsoft.com/airflow/csd/)
31-
>>>>>>> 11b39ebe4b384d6ad1c1735474123e5af2c8676a
3222
2. Copy the jar file to the `/opt/cloudera/csd` location on the Cloudera Manager server.
3323
3. Restart the Cloudera Manager Server service. `service cloudera-scm-server restart`
3424

@@ -69,17 +59,8 @@ create_postgresql_dbs-airflow.sh --host <host_name> --user <username> --password
6959
```
7060

7161
## Roles
72-
<<<<<<< HEAD
73-
There are seven roles defined in the CSD.
74-
1. Airflow Webserver
75-
2. Airflow Scheduler
76-
3. Airflow Worker
77-
4. Airflow Flower
78-
5. Kerberos
79-
6. Gateway
80-
=======
62+
8163
There are six roles available for deployment:
82-
>>>>>>> 11b39ebe4b384d6ad1c1735474123e5af2c8676a
8364

8465
1. Webserver
8566
2. Scheduler
@@ -92,13 +73,9 @@ Webserver: Airflow Webserver role runs the Airflow Web UI. Webserver role can be
9273

9374
Scheduler: Airflow Scheduler role is used to schedule the Airflow jobs. This is limited to one instance to reduce the risk of duplicate jobs.
9475

95-
<<<<<<< HEAD
96-
Airflow Flower: Airflow Flower is used to monitor celery clusters. Multiple instances are supported
97-
=======
9876
Worker: Airflow Worker role picks jobs from the Scheduler and executes them. Multiple instances can be deployed.
9977

10078
Flower Webserver: Flower Webserver role is used to monitor Celery clusters. Celery allows for the expansion of Worker Only one instance is needed.
101-
>>>>>>> 11b39ebe4b384d6ad1c1735474123e5af2c8676a
10279

10380
Kerberos: Airflow Kerberos role is used to enable Kerberos protocol for the other Airflow roles and for DAGs. This role should exist on each host with an Airflow Worker role.
10481

@@ -155,23 +132,13 @@ make dist
155132
Update the `version` file before running `make dist` if creating a new release.
156133

157134
## Limitations:
158-
<<<<<<< HEAD
159-
1. The IP address of the RabbitMQ instance has to be manually entered during installation configuration.
160-
2. After deploying configurations, there is no alert or warning that the specific roles needs to be restarted.
161-
3. Only 'airflow.contrib.auth.backends.password_auth' mechanism is supported for Airflow user authentication.
135+
1. After deploying configurations, there is no alert or warning that the specific roles needs to be restarted.
136+
2. Only 'airflow.contrib.auth.backends.password_auth' mechanism is supported for Airflow user authentication.
162137

163138
## Future work:
164139
1. Build RabbitMQ parcel.
165140
2. Test Database connection.
166141
3. Add the support for more Airflow user authentication methods.
167-
=======
168-
1. After deploying configurations, there is no alert or warning that the specific roles needs to be restarted.
169-
2. Only 'airflow.contrib.auth.backends.password_auth' mechanism is supported for Airflow user authentication.
170-
171-
## Future work:
172-
1. Test Database connection.
173-
2. Add the support for more Airflow user authentication methods.
174-
>>>>>>> 11b39ebe4b384d6ad1c1735474123e5af2c8676a
175142

176143
## Known Errors:
177144

0 commit comments

Comments
 (0)