A web server sends click events to a Pub/Sub topic as messages. The web server includes an eventTimestamp attribute in the messages, which is the time when the click occurred. You have a Dataflow streaming job that reads from this Pub/Sub topic through a subscription, applies some transformations, and writes the result to another Pub/Sub topic for use by the advertising department. The advertising department needs to receive each message within 30 seconds of the corresponding click occurrence, but they report receiving the messages late. Your Dataflow job's system lag is about 5 seconds, and the data freshness is about 40 seconds. Inspecting a few messages show no more than 1 second lag between their eventTimestamp and publishTime. What is the problem and what should you do?
e70ea9e
Highly Voted 1 year, 4 months agoraaad
Highly Voted 1 year, 4 months agodatapassionate
1 year, 3 months agoRenePetersen
1 year, 2 months agodesertlotus1211
Most Recent 1 month, 1 week ago4a8ffd7
7 months, 3 weeks agoJyoGCP
1 year, 2 months agoMatt_108
1 year, 3 months agoAlex3551
1 year, 3 months ago