Exam AWS Certified Data Engineer - Associate DEA-C01 topic 1 question 86 discussion

Exam question from Amazon's AWS Certified Data Engineer - Associate DEA-C01

Question #: 86
Topic #: 1

[All AWS Certified Data Engineer - Associate DEA-C01 Questions]

A company has a business intelligence platform on AWS. The company uses an AWS Storage Gateway Amazon S3 File Gateway to transfer files from the company's on-premises environment to an Amazon S3 bucket.

A data engineer needs to setup a process that will automatically launch an AWS Glue workflow to run a series of AWS Glue jobs when each file transfer finishes successfully.

Which solution will meet these requirements with the LEAST operational overhead?

A. Determine when the file transfers usually finish based on previous successful file transfers. Set up an Amazon EventBridge scheduled event to initiate the AWS Glue jobs at that time of day.
B. Set up an Amazon EventBridge event that initiates the AWS Glue workflow after every successful S3 File Gateway file transfer event.
C. Set up an on-demand AWS Glue workflow so that the data engineer can start the AWS Glue workflow when each file transfer is complete.
D. Set up an AWS Lambda function that will invoke the AWS Glue Workflow. Set up an event for the creation of an S3 object as a trigger for the Lambda function.

Show Suggested Answer

Suggested Answer: B 🗳️

by tgv at June 15, 2024, 9:25 a.m.

Disclaimers:

- ExamTopics website is not related to, affiliated with, endorsed or authorized by Amazon.
- Trademarks, certification & product names are used for reference only and belong to Amazon.

Comments

Submit Cancel

tgv

Highly Voted 1 year, 2 months ago

Selected Answer: B

Using EventBridge directly to trigger the AWS Glue workflow upon S3 events is straightforward and leverages AWS's event-driven architecture, requiring minimal maintenance.

upvoted 6 times

...

Tester_TKK

Most Recent 4 months ago

Selected Answer: B

EventBridge is a "bridge" for almost all AWS services

upvoted 1 times

...

andrologin

1 year, 1 month ago

Selected Answer: C

Event driven architecture with S3 file creation can only be EventBridge

upvoted 1 times

...

bakarys

1 year, 1 month ago

Selected Answer: B

Setting up an Amazon EventBridge event that initiates the AWS Glue workflow after every successful S3 File Gateway file transfer event would meet these requirements with the least operational overhead. This solution is event-driven and does not require manual intervention or reliance on a schedule that might not align with the actual completion time of the file transfers. The AWS Glue workflow is triggered automatically when a new file is added to the S3 bucket, ensuring that the AWS Glue workflow starts processing the new data as soon as it’s available.

upvoted 2 times

...

bakarys

1 year, 1 month ago

Selected Answer: D

The solution that will meet these requirements with the least operational overhead is Option D. Setting up an AWS Lambda function that will invoke the AWS Glue Workflow, and setting up an event for the creation of an S3 object as a trigger for the Lambda function, will ensure that the workflow is automatically initiated each time a file transfer is successfully completed. This approach requires minimal operational overhead as it automates the process and does not require manual intervention or scheduling based on estimated completion times. Options A and C involve manual intervention or assumptions about transfer times, which could lead to inefficiencies or inaccuracies. Option B is not feasible because Amazon EventBridge does not directly support triggering events based on S3 File Gateway file transfer events. Therefore, Option D is the most suitable solution.

upvoted 3 times

AminTriton

1 week, 4 days ago

This is incorrect. Lambda requires manual coding and S3 does have the option to trigger EventBridge. https://docs.aws.amazon.com/AmazonS3/latest/userguide/EventBridge.html

upvoted 1 times

...

PGGuy

1 year, 2 months ago

Selected Answer: B

Setting up an Amazon EventBridge event (Option B) to initiate the AWS Glue workflow after every successful S3 File Gateway file transfer event is the most efficient solution. It provides real-time automation with minimal operational overhead, ensuring that the Glue workflow starts immediately after the file transfer is complete.

upvoted 1 times

...