Exam Professional Data Engineer topic 1 question 258 discussion

- Cloud Data Fusion is a fully managed, code-free, GUI-based data integration service that allows you to visually connect, transform, and move data between various sources and sinks. - It supports various file formats and can write to Cloud Storage. - You can configure it to use Customer-Managed Encryption Keys (CMEK) for the buckets where it writes data.

Even though storage transfer service can be used in GUI, it does not support CMEK which is required in this question. "Storage Transfer Service does not encrypt data on your behalf, such as in customer-managed encryption keys (CMEK). We only encrypt data in transit." Ref: https://cloud.google.com/storage-transfer/docs/on-prem-security

A. Use Storage Transfer Service • ✅ GUI-based: Yes, can be set up in the Google Cloud Console. • ✅ Can move data from on-premises, AWS, or even between GCS buckets. • ✅ Works with different file types, including CSV, Parquet. • ✅ Supports writing into buckets protected with CMEK. • ✅ Best suited when you’re moving or syncing raw files into Cloud Storage

Cloud Data Fusion is a fully-managed, cloud native, enterprise data integration service for quickly building and managing data pipelines. Graphically, no coding solution.

B is answer as requirement is for GUI and sink

I acknolwedge that the question wants the answer to be B, so I'm calling it as B. I don't like this though, as can't we just create a bucket with a CMEK upfront and then use the storage transfer service? It would be easier and cheaper, and achieve the same thing. The language of "sink" strongly suggests to me they intend this to be B though, as datafusion uses that terminology, and the CMEK thing is probably indicating that datafusion can encrypt for you with CMEK.

option 8

B just because tranfer service does not support CMEK A: * GUI + encryption but no CMEK. B: * Its GUI ETL + support CMEK but not sure why you need an ETL tool for transfering something once? (No scheduling or event-driven trigger is mentioned)

B if data fusion creates the bucket. We could create the bucket and associate, in this case A is better.

A. Use Storage Transfer Service to move files into Cloud Storage. move files into Cloud Storage should be Storage Transfer Service Cloud Data Fusion is like using a tank to kill an ant

B. Use Cloud Data Fusion to move files into Cloud Storage.