DEA-C01 Question 77
Single answerYou are tasked with designing a data pipeline to process and analyze clickstream data from a web application in near real-time. The pipeline involves ingesting data into Amazon Kinesis Data Streams, processing it using AWS Glue, and loading the results into an Amazon Redshift cluster for analytics. You need to orchestrate this pipeline to ensure that the data flows smoothly and is processed in the correct sequence. Which AWS service is best suited for orchestrating this data pipeline?
- A
AWS Step Functions
- B
AWS CloudFormation
- C
Amazon EMR
- D
Amazon S3
Show answer and explanation
Correct answer: A
Explanation
AWS Step Functions is the ideal choice for orchestrating the described data pipeline because it enables you to define workflows that coordinate the execution of multiple AWS services, including AWS Glue for data processing and Amazon Redshift for data storage. Other options like AWS CloudFormation and Amazon S3 are not designed for orchestration, while Amazon EMR is primarily used for big data processing but lacks orchestration capabilities.
- A. Correct.
AWS Step Functions is a serverless orchestration service that allows you to coordinate multiple AWS services into workflows. It is well-suited for orchestrating complex pipelines like the one described in this scenario.
- B. Incorrect.
AWS CloudFormation is used for infrastructure as code to provision and manage AWS resources. It is not designed for orchestrating data pipelines.
- C. Incorrect.
Amazon EMR is a big data processing service, but it is not used for orchestrating workflows or pipelines involving multiple AWS services.
- D. Incorrect.
Amazon S3 is a storage service and does not provide orchestration capabilities for managing workflows or data pipelines.