Exam AWS Certified Data Analytics - Specialty All Questions

View all questions & answers for the AWS Certified Data Analytics - Specialty exam

Exam AWS Certified Data Analytics - Specialty topic 1 question 160 discussion

Exam question from Amazon's AWS Certified Data Analytics - Specialty

Question #: 160
Topic #: 1

[All AWS Certified Data Analytics - Specialty Questions]

A company is using an AWS Lambda function to run Amazon Athena queries against a cross-account AWS Glue Data Catalog. A query returns the following error:

HIVE_METASTORE_ERROR -
The error message states that the response payload size exceeds the maximum allowed size. The queried table is already partitioned, and the data is stored in an
Amazon S3 bucket in the Apache Hive partition format.
Which solution will resolve this error?

A. Modify the Lambda function to upload the query response payload as an object into the S3 bucket. Include an S3 object presigned URL as the payload in the Lambda function response.
B. Run the MSCK REPAIR TABLE command on the queried table.
C. Create a separate folder in the S3 bucket. Move the data files that need to be queried into that folder. Create an AWS Glue crawler that points to the folder instead of the S3 bucket.
D. Check the schema of the queried table for any characters that Athena does not support. Replace any unsupported characters with characters that Athena supports.

Show Suggested Answer

Suggested Answer: A 🗳️

by rb39 at April 21, 2022, 11:04 a.m.

Disclaimers:

- ExamTopics website is not related to, affiliated with, endorsed or authorized by Amazon.
- Trademarks, certification & product names are used for reference only and belong to Amazon.

Comments

Submit Cancel

rb39

Highly Voted 3 years, 2 months ago

Selected Answer: A

A from https://aws.amazon.com/premiumsupport/knowledge-center/athena-hive-metastore-error/

upvoted 12 times

...

somenath

Highly Voted 3 years, 1 month ago

I think it is B, per the link https://aws.amazon.com/premiumsupport/knowledge-center/athena-hive-metastore-error/ It says, If your table is already partitioned, and the data is loaded in Amazon Simple Storage Service (Amazon S3) Hive partition format, then load the partitions by running a command MSCK REPAIR TABLE table_name

upvoted 6 times

CC_DC

2 years, 3 months ago

Article says, "If your table is partitioned, and your use case permits, query only the specific partition." This is not one of the 4 options. So the simple thing is maybe the use case does not permit querying the specific partition since it is not explicitly or implicitly mentioned in the question. The article also does not mention running MSCK.

upvoted 1 times

...

LocalHero

Most Recent 1 year, 7 months ago

Lambda is limitted 6MB response. so this error occuerd. Counterplan is using pre shared URL (S3). Lambda dosent back data directly to frontend. Frontend can access to data by pre shared URL(S3).

upvoted 1 times

...

pk349

2 years, 1 month ago

A: I passed the test

upvoted 2 times

...

Chelseajcole

2 years, 5 months ago

Selected Answer: A

HIVE_METASTORE_ERROR: com.facebook.presto.spi.PrestoException: java.io.IOException: Response payload size (11112222 bytes) exceeded maximum allowed payload size (6291556 bytes) To resolve this error, choose one or more of the following solutions: Upload the Lambda function's response payload as an object into an Amazon S3 bucket. Then, include this object as payload in the Lambda function response. For information on generating a presigned URL for your object, see Sharing an object with a presigned URL. If your table is partitioned, and your use case permits, query only the specific partition. Specify the spill location in Amazon S3 when you create the Lambda function. Responses that are larger than the threshold spill into the specified S3 location.

upvoted 2 times

...

bp339

2 years, 8 months ago

Selected Answer: A

https://aws.amazon.com/premiumsupport/knowledge-center/athena-hive-metastore-error/

upvoted 1 times

...

rocky48

2 years, 10 months ago

Selected Answer: A

Answer is A.

upvoted 4 times

...

somenath

3 years, 1 month ago

If the full error is HIVE_METASTORE_ERROR: com.facebook.presto.spi.PrestoException: Required Table Storage Descriptor is not populated: Then it is B. If the full error is HIVE_METASTORE_ERROR: com.facebook.presto.spi.PrestoException: java.io.IOException: Response payload size (11112222 bytes) exceeded maximum allowed payload size Then the answer is A.

upvoted 5 times

...