Home

AWS DataPipeline Manager

Welcome to the AWS DataPipeline Manager wiki! This wiki is a user guide for the AWS DataPipeline Manager, a Node.js web application for managing AWS DataPipeline jobs.

Table of Contents

• Getting Started
• Creating a New Pipeline
• Viewing Pipeline Details
• Editing Pipeline Definition
• Activating and Deactivating Pipelines
• Deleting a Pipeline

Getting Started

To get started with the AWS DataPipeline Manager, follow these steps:

1. Clone the repository to your local machine:

   git clone https://github.com/HairyDuck/aws-datapipeline-manager.git

2. Install the Node.js dependencies:

   cd aws-datapipeline-manager
   npm install

3. Configure your AWS credentials:

   Update the AWS.config.update method call in the app.js file with your AWS region and access key:

   AWS.config.update({ region: 'your_region', accessKeyId: 'your_access_key', secretAccessKey: 'your_secret_access_key' });

4. Start the server:

   node app.js

   The server will start listening on port 3000 by default. Open a web browser and navigate to http://localhost:3000 to access the application.

Creating a New Pipeline

To create a new pipeline, follow these steps:

1. Open the AWS DataPipeline Manager in a web browser.

2. Click the "Create New Pipeline" button on the home page.

3. Enter a name for the new pipeline in the "New Pipeline Name" field.

4. Click the "Create" button.

   The new pipeline will be created, and you will be redirected to the pipeline details page.

Viewing Pipeline Details

To view the details of a pipeline, follow these steps:

1. Open the AWS DataPipeline Manager in a web browser.

2. Click on the name of the pipeline you want to view on the home page.

   The pipeline details page will be displayed, showing the pipeline ID and pipeline objects in JSON format.

Editing Pipeline Definition

To edit the definition of a pipeline, follow these steps:

1. Open the AWS DataPipeline Manager in a web browser.

2. Click on the name of the pipeline you want to edit on the home page.

3. Click the "Edit Pipeline Definition" button.

4. Edit the pipeline objects in the text area.

5. Click the "Save Changes" button.

   The pipeline definition will be updated, and you will be redirected to the pipeline details page.

Deleting a Pipeline

To delete a pipeline, follow these steps:

1. Open the AWS DataPipeline Manager in a web browser.

2. Check the box next to the name of the pipeline you want to delete on the home page.

3. Click the "Delete Selected Pipelines" button.

4. Confirm