A data engineer needs to schedule a workflow that runs a set of AWS Glue jobs every day. The data engineer does not require the Glue jobs to run or finish at a specific time. Which solution will run the Glue jobs in the MOST cost-effective way?
A.
Choose the FLEX execution class in the Glue job properties.
B.
Use the Spot Instance type in Glue job properties.
C.
Choose the STANDARD execution class in the Glue job properties.
D.
Choose the latest version in the GlueVersion field in the Glue job properties.
The FLEX execution class leverages spare capacity within the AWS infrastructure to run Glue jobs at a discounted price compared to the standard execution class. Since the data engineer doesn't have specific time constraints, utilizing spare capacity is ideal for cost savings.
Today's date its a checkbox in order to spare capacity and will mean we dont know when is going to finish, which is recommended to increase a timeout
A. Choose the FLEX execution class in the Glue job properties.
Explanation:
The FLEX execution class in AWS Glue allows jobs to use idle resources within the Glue service, which can significantly reduce costs compared to the STANDARD execution class. With FLEX, Glue jobs run when resources are available, which is a cost-effective approach for jobs that don't need to be completed within a specific timeframe.
A
Flex allows you to optimize your costs on your non-urgent or non-time sensitive data integration workloads such as testing, and one-time data loads. With Flex, AWS Glue jobs run on spare compute capacity instead of dedicated hardware. The start and runtimes of jobs using Flex can vary because spare compute resources aren’t readily available and can be reclaimed during the run of a job
https://aws.amazon.com/blogs/big-data/introducing-aws-glue-flex-jobs-cost-savings-on-etl-workloads/
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
pypelyncar
Highly Voted 1 year agoTonyStark0122
Highly Voted 1 year, 5 months agoGabrielSGoncalves
Most Recent 11 months, 2 weeks agok350Secops
1 year, 1 month agolucas_rfsb
1 year, 3 months agolalitjhawar
1 year, 5 months ago