Exam Professional Data Engineer All Questions

View all questions & answers for the Professional Data Engineer exam

Exam Professional Data Engineer topic 1 question 69 discussion

Actual exam question from Google's Professional Data Engineer

Question #: 69
Topic #: 1

[All Professional Data Engineer Questions]

Your infrastructure includes a set of YouTube channels. You have been tasked with creating a process for sending the YouTube channel data to Google Cloud for analysis. You want to design a solution that allows your world-wide marketing teams to perform ANSI SQL and other types of analysis on up-to-date YouTube channels log data. How should you set up the log data transfer into Google Cloud?

A. Use Storage Transfer Service to transfer the offsite backup files to a Cloud Storage Multi-Regional storage bucket as a final destination.
B. Use Storage Transfer Service to transfer the offsite backup files to a Cloud Storage Regional bucket as a final destination.
C. Use BigQuery Data Transfer Service to transfer the offsite backup files to a Cloud Storage Multi-Regional storage bucket as a final destination.
D. Use BigQuery Data Transfer Service to transfer the offsite backup files to a Cloud Storage Regional storage bucket as a final destination.

Show Suggested Answer

Suggested Answer: A 🗳️

by cleroy at March 10, 2020, 1:10 p.m.

Comments

Submit Cancel

VishalB

Highly Voted 5 years ago

Correct Answer: A Destination is GCS and having multi-regional so A is the best option available. Even since BigQuery Data Transfer Service initially supports Google application sources like Google Ads, Campaign Manager, Google Ad Manager and YouTube but it does not support destination anything other than bq data set

upvoted 74 times

cloud_rider

8 months, 3 weeks ago

I differ, destination is not mentioned as GCS, it only says Google Cloud which can mean BigQuery too. And ANSI SQL also points towards this direction.

upvoted 1 times

...

henryCho

4 years, 7 months ago

What about ANSI SQL?

upvoted 7 times

Jphix

4 years, 2 months ago

I guess they are assuming that you will just query the data in Cloud Storage from BQ. The question specifically is, "How should you set up the log data transfer into Google Cloud?", not "How should you set up the querying." ANSI SQL is a distraction!

upvoted 8 times

...

nadavw

3 years, 2 months ago

use external table for it

upvoted 2 times

...

tainangao

3 years, 11 months ago

Currently, you cannot use the BigQuery Data Transfer Service to transfer data out of BigQuery. https://cloud.google.com/bigquery-transfer/docs/introduction

upvoted 10 times

phidelics

2 years, 2 months ago

You can use BQ Data transfer Service for Youtube channels mow

upvoted 4 times

...

AmmarFasih

2 years, 2 months ago

but I think now you can use BigQuery Data Transfer Service for youtube channels and many other

upvoted 3 times

...

asksathvik

3 years, 11 months ago

Kindly re-read the question,the question says Google Cloud not Cloud storage...once you master that you will understand the whole question and be able to pick the right answer which is C

upvoted 16 times

yoshik

3 years, 11 months ago

logs like stuff goes better on buckets

upvoted 4 times

...

triipinbee

3 years, 11 months ago

all the option clearly says "storage bucket", once you master that, you'll realize the correct option is A

upvoted 57 times

Rodrigo4N

2 years, 4 months ago

Gottem!

upvoted 2 times

...

HarshKothari21

2 years, 11 months ago

good one :)

upvoted 3 times

...

Ganshank

Highly Voted 5 years, 4 months ago

None of the answers make any sense. BigQuery Transfer Service is for moving data from various sources (S3, Youtube etc) into BigQuery, not Google Cloud Storage. Further, how are we supposed to use SQL to query data if it is stored in Cloud Storage?

upvoted 21 times

dambilwa

5 years, 1 month ago

Agreed! - All Options look wrong

upvoted 1 times

dambilwa

5 years, 1 month ago

Option [A] is the least worse option... for world wide teams to perform ANSI SQL Queries, it would be easier to create a ext. table or load from Multi AZ bucket... BQ Data Transfer service is used to push data in BQ, hence ruling out Option C & D

upvoted 5 times

StefanoG

3 years, 11 months ago

The best option would be to use "BigQuery Transfer Service" to upload data to BQ. But BQ is not present as a destination, so the only working option is Multi Regional GCS

upvoted 3 times

...

TNT87

4 years, 10 months ago

Kindly re-read the question,the question says Google Cloud not Cloud storage...once you master that you will understand the whole question and be able to pick the right answer which is C

upvoted 9 times

TNT87

4 years, 10 months ago

https://cloud.google.com/bigquery-transfer/docs/youtube-channel-transfer this link will help to cement the answer.

upvoted 3 times

...

theRafael7

Most Recent 2 months, 1 week ago

Selected Answer: C

I will go for C because for A it says cloud storage as the final destination and also bqts can be used for youtube channel data which are structured reports.

upvoted 1 times

...

abhaya2608

4 months, 3 weeks ago

Selected Answer: C

BigQuery Data Transfer Service automates data loading into BigQuery from various sources, including Google Cloud Storage.BigQuery is specifically designed for performing ANSI SQL and other types of analysis on large datasets. Cloud Storage can be used as a staging area, especially a multi-region bucket if the teams are worldwide

upvoted 1 times

...

oussama7

5 months ago

Selected Answer: C

BigQuery Data Transfer Service (C) is the best choice because it natively integrates with YouTube, automates data transfers, and enables seamless analysis in BigQuery.

upvoted 1 times

...

cloud_rider

8 months, 3 weeks ago

Selected Answer: C

C is the correct answer as the requirement is to transfer data to Google Cloud, which means Big Query and not GCS.

upvoted 1 times

...

SamuelTsch

9 months, 4 weeks ago

Selected Answer: A

First thing log data is usually semi-strucutred or unstrucutred data, then GCS is more suitable in this situation. Besides, you can use external table or BigLake to run BQ query directly running on GCS.

upvoted 1 times

...

baimus

10 months, 4 weeks ago

This is A, because it's "offsite backup files". You can transfer direct from Youtube to BigQuery: https://cloud.google.com/bigquery/docs/youtube-channel-transfer, but this isn't that. It's direct from some backup files to Cloud Storage, all answers mandate that fact, and all that remains is "should this be Storage Transfer, or BigQuery" - clearly this is storage transfer, and all the youtube/ANSI sql stuff is just distraction.

upvoted 1 times

...

iooj

1 year ago

Selected Answer: A

E. Use BigQuery Data Transfer Service to transfer the offsite backup files to BigQuery as a final destination.

upvoted 1 times

...

ABKR1300

1 year, 3 months ago

Using BQ data transfer we can only load data into the Bigquery storage, which means a table inside the bq dataset. What is Storage Transfer Service? Storage Transfer Service automates the transfer of data to, from, and between object and file storage systems, including Google Cloud Storage, Amazon S3, Azure Storage, on-premises data, and more. It can be used to transfer large amounts of data quickly and reliably, without the need to write any code. As per the above lines from the Google's documentation on Storage transfer service, we can go with option A. For additional info, have a look at the below link. https://cloud.google.com/storage-transfer/docs/overview?_gl=1*jaku2h*_ga*MjA5Mzc4OTM0LjE2ODQ3MzA5NzQ.*_ga_WH2QY8WWF5*MTcxNTA1OTM0OC4xODMuMS4xNzE1MDU5NTY3LjAuMC4w&_ga=2.6452401.-209378934.1684730974&_gac=1.162721358.1713078448.CjwKCAjw_e2wBhAEEiwAyFFFo4Da6-2MNQqNJuzAGSyJmCXdaPpXXiqaI0lkZYHlcln0IBbtWSJjLBoCp_4QAvD_BwE

upvoted 1 times

...

zevexWM

1 year, 4 months ago

Selected Answer: A

Correct answer: A Solution should cater a worldwide solution which makes B and D invalid. You don't use BigQuery Data transfer to move data to a bucket. So C is also invalid.

upvoted 2 times

...

AshishDhamu

1 year, 5 months ago

Selected Answer: A

BigQuery Data Transfer Service can only transfer to BigQuery not in Cloud Storage. So Ans A is correct.

upvoted 2 times

...

demoro86

1 year, 5 months ago

Selected Answer: A

No sense to use BQ data transfer serice to store the data to a storage bucket ... It is obviously A

upvoted 2 times

...

rocky48

1 year, 9 months ago

Selected Answer: C

To transfer YouTube channel data to Google Cloud for analysis, you can use the BigQuery Data Transfer Service to transfer the offsite backup files to a Cloud Storage Multi-Regional storage bucket as a final destination 1. This service allows you to automatically schedule and manage recurring load jobs for YouTube Channel reports 1. The BigQuery Data Transfer Service for YouTube Channel reports supports the following reporting options: Channel Reports (automatically loaded into BigQuery) 1. When you transfer data from a YouTube Channel into BigQuery, the data is loaded into BigQuery tables that are partitioned by date 1.

upvoted 2 times

...

ziyunxiao

1 year, 10 months ago

The correct answer is C. https://cloud.google.com/bigquery/docs/dts-introduction

upvoted 1 times

...

exnaniantwort

1 year, 11 months ago

not c The BigQuery Data Transfer Service automates data movement into [[[[ BigQuery ]]]] on a scheduled, managed basis. Your analytics team can lay the foundation for a BigQuery data warehouse without writing a single line of code. ... After you configure a data transfer, the BigQuery Data Transfer Service automatically loads data into [[[[[ BigQuery ]]]]] on a regular basis.

upvoted 2 times

...

bmquijano7

1 year, 11 months ago

Correct answer is A. At first, it's between A and C because of the term multi-regional. However, since you cannot use the BigQuery Data Transfer Service to transfer data out of BigQuery, A is the correct answer. Source: https://cloud.google.com/bigquery/docs/dts-introduction

upvoted 3 times

...

Load full discussion...