Exam Professional Data Engineer topic 1 question 261 discussion

- Reduced Local Storage: By using FastExport, data is directly streamed from Teradata to BigQuery without the need for local storage, addressing your storage limitations. - Minimal Programming: BigQuery Data Transfer Service offers a user-friendly interface, eliminating the need for extensive scripting or coding.

https://cloud.google.com/bigquery/docs/migration/teradata-overview#extraction_method Lack of local storage pushes this to JDBC driver

BigQuery Data Transfer Service (DTS) supports Teradata via Teradata Parallel Transporter (TPT) in combination with the tbuild utility, which is designed for high-performance parallel data exports. This is Google’s recommended approach for Teradata migrations when local disk space is constrained and high throughput is desired.

Use BigQuery Data Transfer Service with the Teradata Parallel Transporter (TPT) tbuild utility...minimal coding

https://cloud.google.com/bigquery/docs/migration/teradata-overview#extraction_method Extraction using a JDBC driver with FastExport connection. If there are constraints on the local storage space available for extracted files, or if there is some reason you can't use TPT, then use this extraction method. In this mode, the migration agent extracts tables into a collection of AVRO files on the local file system. It then uploads these files to a Cloud Storage bucket, where they are used by the transfer job. Once the files are uploaded to Cloud Storage, the migration agent deletes them from the local file system. In this mode, you can limit the amount of space used by the AVRO files on the local file system. If this limit is exceeded, extraction is paused until space is freed up by the migration agent uploading and deleting existing AVRO files.

BigQuery Data Transfer Service (DTS): DTS automates data movement from various sources (including Teradata) to BigQuery. It handles schema conversion, data transfer, and scheduling, minimizing manual effort and programming. Teradata Parallel Transporter (TPT) tbuild: TPT is a powerful utility for high-performance data extraction from Teradata. The tbuild operator specifically creates optimized external data files. Efficiency: Combining DTS with TPT tbuild allows you to efficiently extract large volumes of data from Teradata and load it into BigQuery with minimal coding. Limited Local Storage: This approach streams data directly from Teradata to Cloud Storage, minimizing the need for temporary storage on your Teradata system.

Using TPT with the tbuild utility ensures that you can efficiently move large volumes of data directly from Teradata to BigQuery without requiring significant local storage space or extensive custom programming. This method leverages Teradata’s optimized export capabilities and integrates with Google Cloud's tools for seamless data transfer. JDBC driver with FastExport can be used, it typically requires more programming and manual setup compared to the TPT solution, and may not be as optimized for large-scale data transfers

Extraction using a JDBC driver with FastExport connection. If there are constraints on the local storage space available for extracted files, or if there is some reason you can't use TPT, then use this extraction method. https://cloud.google.com/bigquery/docs/migration/teradata-overview#extraction_method

Option A, the JDBC driver is the key to solve the limited local storage