DEA-C01 Question 434
Select 3A company is building a data lake on AWS to store and analyze large volumes of structured and unstructured data. They are evaluating whether to use Amazon S3 with custom-built ETL pipelines or AWS Glue for their ETL processes. What are the key benefits of choosing AWS Glue (a managed service) over creating custom-built ETL pipelines using Amazon S3 (an unmanaged service)?
- A
AWS Glue automatically handles infrastructure provisioning, scaling, and maintenance.
- B
Custom-built ETL pipelines in Amazon S3 provide better integration with AWS services.
- C
AWS Glue includes built-in data cataloging capabilities to manage metadata.
- D
Custom-built ETL pipelines in Amazon S3 offer a lower operational overhead compared to AWS Glue.
- E
AWS Glue supports serverless execution, eliminating the need to manage underlying servers.
Show answer and explanation
Correct answers: A, C, E
Explanation
AWS Glue, as a managed service, provides several advantages over custom-built ETL pipelines, including automated infrastructure management, built-in metadata cataloging, and serverless execution. These features help reduce operational complexity and accelerate development. In contrast, custom ETL pipelines require significant manual effort for configuration, scaling, and maintenance, leading to higher operational overhead.
- A. Correct.
Correct. AWS Glue is a fully managed service that automatically provisions, scales, and maintains the infrastructure required for ETL jobs, reducing operational overhead.
- B. Incorrect.
Incorrect. While custom-built ETL pipelines can integrate with AWS services, they require additional manual configuration and management compared to AWS Glue.
- C. Correct.
Correct. AWS Glue includes a built-in Data Catalog, which simplifies metadata management and discovery, a feature not inherently available with custom-built ETL pipelines.
- D. Incorrect.
Incorrect. Custom-built ETL pipelines in Amazon S3 typically have a higher operational overhead because you need to design, implement, monitor, and maintain them yourself.
- E. Correct.
Correct. AWS Glue is serverless, so it abstracts away server management, allowing you to focus on the ETL logic rather than managing infrastructure.