Exam AWS Certified Data Analytics - Specialty topic 1 question 56 discussion

D; transformation AWS Lambda function applied with stream data; before loading to s3

D: I passed the test

D as IOT rules can send info to Firehose using an action https://docs.aws.amazon.com/firehose/latest/dev/writing-with-iot.html

Correct answer is D as Kinesis Data Firehose can be used for data ingestion and storage to S3 with Lambda function for data filtering and transformation. This solution involves the least operational overhead. Option A is wrong as Kinesis Data Streams and KCLs involve operational overhead as Data Streams need to be provisioned and maintained. Option B is wrong as the solution removes the PHI after the data is stored. Option C is wrong as Kinesis Data Streams does not integrate with S3 directly and involves the operational overhead as Data Streams need to be provisioned and maintained.

Ans is D. Solution need least operational overhead, so kinesis data stream is out. option B is also out bcoz it is removing PHI data after putting the data in S3. So Option D is correct. Firehose will do the transformation via lambda to filter out the PHI data from stream and store the non-PHI in S3.

AWS Kinesis Data Firehose is required as destination is S3. Also, Lambda function should be called as a transformation from Firehose before sending data to S3.

Selected Answer: D

My Answer is D

Answer D. Its true that the answer wordings are bad and confusing. Kinesis Data Firehose can invoke your Lambda function to transform incoming source data and deliver the transformed data to destinations. You can enable Kinesis Data Firehose data transformation when you create your delivery stream.

ANSWER D: EXPLAINATION:With the keyword 'near-real-time',option A and C are filtered out as KDS is real time streaming .NOw between option B & D ,We already have transformation lambda attached to 'Firehose' by default to do the necessary transformation .

Correct D KDF uses transformation (Lambda) before writing to S3 Incorrect A Implementing Lambda to process and write data to S3 with streams is crazy. You should use KDF as KDS consumer. Shuld be least operational overhead. Incorrect B, C - security of data

Going with D, Even the reference in the answer also pointing the same (Reference: https://aws.amazon.com/blogs/big-data/persist-streaming-data-to-amazon-s3-using-amazon-kinesis-firehose-and-aws-lambda/)

D is the right answer

Badly worded answer for D, but that's the correct answer here.

Answer : D Refer : https://aws.amazon.com/blogs/compute/amazon-kinesis-firehose-data-transformation-with-aws-lambda/#:~:text=Introducing%20Firehose%20Data%20Transformations&text=When%20you%20enable%20Firehose%20data,then%20delivered%20to%20the%20destination

I think D means that the data is cleaned already before writing to s3, but the formulation is bad.

Answer is D. It's near real-time so no need to use KDS A - task can be handled much easier (less complicated) way by D then A. B - PHI data is written to S3 before removal which is not acceptable. C - KDS cannot write data to S3.