MLS-C01 Question 49
Select 3You are working as a Machine Learning Engineer and need to schedule a daily batch inference job that processes data stored in Amazon S3 and writes the results back to another S3 bucket. The solution should be cost-effective and fully managed to reduce operational overhead. Which combination of AWS services and features will meet your requirements?
- A
Use Amazon SageMaker Processing Jobs with an EventBridge rule to trigger the job on a daily schedule.
- B
Use AWS Glue Jobs with a cron-based schedule in AWS Glue Workflow to process the data.
- C
Use Amazon SageMaker Training Jobs with a Lambda function to schedule the job daily.
- D
Use AWS Batch with a CloudWatch Events rule to schedule the job daily.
- E
Use Amazon EMR with Step Functions to orchestrate and schedule the job.
Show answer and explanation
Correct answers: A, B, D
Explanation
For scheduling batch inference jobs in a cost-effective and operationally efficient manner, Amazon SageMaker Processing Jobs with EventBridge, AWS Glue Jobs with Glue Workflows, and AWS Batch with CloudWatch Events are the most suitable choices. These solutions are fully managed, integrate seamlessly with the AWS ecosystem, and provide scheduling capabilities without requiring additional operational overhead. Options involving Amazon SageMaker Training Jobs or Amazon EMR are not ideal as they are either unsuitable for the task or introduce unnecessary complexity and cost.
- A. Correct.
Correct: Amazon SageMaker Processing Jobs can be scheduled using Amazon EventBridge rules to run on a specific schedule, making this a cost-effective and serverless option.
- B. Correct.
Correct: AWS Glue Jobs support cron-based scheduling through AWS Glue Workflows, making it a fully managed and cost-effective option for batch data processing.
- C. Incorrect.
Incorrect: Amazon SageMaker Training Jobs are designed for model training, not batch processing, and using Lambda for scheduling introduces unnecessary complexity.
- D. Correct.
Correct: AWS Batch can handle batch jobs efficiently, and schedules can be managed using CloudWatch Events (now part of EventBridge), making it a suitable option.
- E. Incorrect.
Incorrect: While Amazon EMR with Step Functions can be used to orchestrate workflows, it is generally more complex and expensive than other options for simple batch inference jobs.