Exam Professional Data Engineer topic 1 question 294 discussion

Actual exam question from Google's Professional Data Engineer

Question #: 294
Topic #: 1

[All Professional Data Engineer Questions]

You work for a large ecommerce company. You are using Pub/Sub to ingest the clickstream data to Google Cloud for analytics. You observe that when a new subscriber connects to an existing topic to analyze data, they are unable to subscribe to older data. For an upcoming yearly sale event in two months, you need a solution that, once implemented, will enable any new subscriber to read the last 30 days of data. What should you do?

A. Create a new topic, and publish the last 30 days of data each time a new subscriber connects to an existing topic.
B. Set the topic retention policy to 30 days.
C. Set the subscriber retention policy to 30 days.
D. Ask the source system to re-push the data to Pub/Sub, and subscribe to it.

Show Suggested Answer

Suggested Answer: B 🗳️

by scaenruy at Jan. 4, 2024, 11:45 a.m.

Comments

Submit Cancel

raaad

Highly Voted 1 year, 5 months ago

Selected Answer: B

- Topic Retention Policy: This policy determines how long messages are retained by Pub/Sub after they are published, even if they have not been acknowledged (consumed) by any subscriber. - 30 Days Retention: By setting the retention policy of the topic to 30 days, all messages published to this topic will be available for consumption for 30 days. This means any new subscriber connecting to the topic can access and analyze data from the past 30 days.

upvoted 11 times

...

hussain.sain

Most Recent 5 months, 3 weeks ago

Selected Answer: B

B is correct. By setting the topic retention policy to 30 days, any new subscriber will be able to access the data for the past 30 days, regardless of when they connect. This solution is both cost-effective and efficient for your use case.

upvoted 1 times

...

romain773

7 months, 2 weeks ago

Option B is wrong i think (topic retention) because it only makes unconsumed messages available for 30 days. I propose option A Option A (creating a new topic and republishing the last 30 days of data for each new subscriber) is actually a better solution to ensure that new subscribers have access to the full 30-day history.

upvoted 1 times

...

romain773

7 months, 3 weeks ago

Option B is wrong (topic retention) because it only makes unconsumed messages available for 30 days. Option A (creating a new topic and republishing the last 30 days of data for each new subscriber) is actually a better solution to ensure that new subscribers have access to the full 30-day history.

upvoted 1 times

...

joao_01

1 year, 2 months ago

Its B. It could be C as well because subscription has message retention. However, in the subscription there is a maximum value for it: 7 days. Link:https://cloud.google.com/pubsub/docs/subscription-properties

upvoted 1 times