AWS Data Pipeline

AWS Data Pipeline is a web service that helps you reliably process and move data between different AWS compute and storage services, as well as on-premise data sources, at specified intervals. With AWS Data Pipeline, you can regularly access your data where itrsquo;s stored, transform and process it at scale, and efficiently transfer the results to AWS services such as Amazon S3, Amazon RDS, Amazon DynamoDB, and Amazon EMR.nAWS Data Pipeline helps you easily create complex data processing workloads that are fault tolerant, repeatable, and highly available. You donrsquo;t have to worry about ensuring resource availability, managing inter-task dependencies, retrying transient failures or timeouts in individual tasks, or creating a failure notification system. AWS Data Pipeline also allows you to move and process data that was previously locked up in on-premise data silos.

Key Links

API Paths

Activate Pipeline (GET) /?Action=ActivatePipeline OpenAPI
Add Tags (GET) /?Action=AddTags OpenAPI
Create Pipeline (GET) /?Action=CreatePipeline OpenAPI
Deactivate Pipeline (GET) /?Action=DeactivatePipeline OpenAPI
Delete Pipeline (GET) /?Action=DeletePipeline OpenAPI
Describe Objects (GET) /?Action=DescribeObjects OpenAPI
Describe Pipelines (GET) /?Action=DescribePipelines OpenAPI
Evaluate Expression (GET) /?Action=EvaluateExpression OpenAPI
Get Pipeline Definition (GET) /?Action=GetPipelineDefinition OpenAPI
List Pipelines (GET) /?Action=ListPipelines OpenAPI
Poll For Task (GET) /?Action=PollForTask OpenAPI
Put Pipeline Definition (GET) /?Action=PutPipelineDefinition OpenAPI
Query Objects (GET) /?Action=QueryObjects OpenAPI
Remove Tags (GET) /?Action=RemoveTags OpenAPI
Report Task Progress (GET) /?Action=ReportTaskProgress OpenAPI
Report Task Runner Heartbeat (GET) /?Action=ReportTaskRunnerHeartbeat OpenAPI
Set Status (GET) /?Action=SetStatus OpenAPI
Set Task Status (GET) /?Action=SetTaskStatus OpenAPI
Validate Pipeline Definition (GET) /?Action=ValidatePipelineDefinition OpenAPI