DEA-C01 Question 16
Select 3A company is designing a data pipeline to collect data from IoT sensors deployed in multiple locations. The data needs to be ingested into AWS in near real-time for monitoring and analytics. However, the company also wants to retain historical data for future analysis. Which combination of ingestion patterns and AWS services would best meet these requirements?
- A
Use Amazon Kinesis Data Streams to capture real-time data and configure Amazon S3 as a destination for long-term storage.
- B
Use AWS Glue to directly ingest the IoT sensor data into Amazon Redshift for both real-time monitoring and historical analysis.
- C
Use Amazon SQS to buffer incoming IoT data and periodically write the data to Amazon S3.
- D
Use AWS IoT Core to ingest real-time data, store historical data in Amazon S3, and analyze real-time data using Amazon Kinesis Data Analytics.
- E
Use Amazon Managed Streaming for Apache Kafka (Amazon MSK) to ingest real-time data and configure an Amazon S3 connector for historical data storage.
Show answer and explanation
Correct answers: A, D, E
Explanation
The scenario requires both real-time ingestion for monitoring and the retention of historical data for future analysis. Solutions using Amazon Kinesis Data Streams, AWS IoT Core, or Amazon MSK are well-suited for real-time ingestion. Coupling these services with Amazon S3 for long-term storage addresses the need for historical data retention. AWS Glue and Amazon SQS are less appropriate for real-time ingestion in this scenario.
- A. Correct.
Correct: Amazon Kinesis Data Streams is designed for real-time data ingestion, and Amazon S3 provides scalable, cost-effective storage for historical data.
- B. Incorrect.
Incorrect: AWS Glue is not suitable for real-time ingestion. It is primarily used for ETL processes and batch data processing.
- C. Incorrect.
Incorrect: While Amazon SQS can buffer data, it is not optimized for real-time ingestion or analytics pipelines, making it unsuitable for this use case.
- D. Correct.
Correct: AWS IoT Core provides a managed service for ingesting IoT data in real-time, and coupling it with Amazon S3 for historical data and Amazon Kinesis Data Analytics for real-time processing creates a comprehensive solution.
- E. Correct.
Correct: Amazon MSK is a managed service for real-time data streaming, and its integration with Amazon S3 allows for seamless historical data storage.