You need to move 2 PB of historical data from an on-premises storage appliance to Cloud Storage within six months, and your outbound network capacity is constrained to 20 Mb/sec. How should you migrate this data to Cloud Storage?
A.
Use Transfer Appliance to copy the data to Cloud Storage
B.
Use gsutil cp ג€"J to compress the content being uploaded to Cloud Storage
C.
Create a private URL for the historical data, and then use Storage Transfer Service to copy the data to Cloud Storage
D.
Use trickle or ionice along with gsutil cp to limit the amount of bandwidth gsutil utilizes to less than 20 Mb/sec so it does not interfere with the production traffic
In 6 months - only 0.0290304 Petabytes will be uploaded. Right - compression might help, but we do not have any info to support the ration. Lets go for A
Physical Transfer: Transfer Appliance is a physical device provided by Google Cloud that you can use to physically transfer large volumes of data to the cloud. It allows you to avoid the limitations of network bandwidth and transfer data much faster.
Capacity: Transfer Appliance can handle large volumes of data, including the 2 PB you need to migrate, without the constraints of slow network speeds.
Efficiency: It is highly efficient for large-scale data transfers and is a practical choice for transferring multi-terabyte or petabyte-scale datasets.
it would take 34 years.
Option A no doubt.
https://cloud.google.com/static/architecture/images/big-data-transfer-how-to-get-started-transfer-size-and-speed.png
2,000,000,000,000,000 bytes = 2 Petabytes
20,000,000 bytes = 20 Megabytes
Once we do the math:
2 Petabytes / 20 Megabytes = 100,000,000 seconds forecasted to migrate the data.
100,000,000 seconds =
1,666,666.7 minutes =
27,777.8 hours =
1,157.4 days
6 months = 180 days
1,157.4 days > 180 days
Still, with such amount Transfer Appliance is recommended.
Transfer alliance is a physical device of size like cabin luggage or slightly larger.
It has Seagate/WD harddisk (these are name of companies) size varries from 100 to 480 TB.
In our case 2PB (2000 TB) accordingly. Google send you this and transfer data into it by wire connection and then upload data from this to GCS and empty the appliance.
A is the answer.
https://cloud.google.com/transfer-appliance/docs/4.0/overview
Transfer Appliance is a high-capacity storage device that enables you to transfer and securely ship your data to a Google upload facility, where we upload your data to Cloud Storage.
Problem: Transferring 2 peta data to Cloud Storage
Considerations: Bad network speed
Bad network = cannot initiate from client’s end through network. So, B, C is out
D will still be super slow. At this speed it will take 27,777 hours to transfer the data
Vote for A
A - Correct , Transfer Appliance for moving offline data, large data sets, or data from a source with limited bandwidth
https://cloud.google.com/storage-transfer/docs/overview
B - Eliminated (Not recommended for large storage). recommended for < 1TB
C - Its ONLINE, but we have bandwidth issue - So eliminated.
D - Eliminated (Not recommended for large storage). recommended for < 1TB
Correct answer is A. with little calculation we know the kind of data will require approx 19 months to transfer on 20Mbps bandwidth. Also, google recommends Transfer appliance for petabytes of data.
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
[Removed]
Highly Voted 4 years, 8 months ago[Removed]
Highly Voted 4 years, 9 months agopatitonav
Most Recent 11 months, 3 weeks agoNirca
1 year, 2 months agobarnac1es
1 year, 2 months agoarien_chen
1 year, 4 months agovaga1
1 year, 7 months agomusumusu
1 year, 10 months agoAzureDP900
1 year, 11 months agozellck
2 years agojkhong
2 years, 1 month agosumanshu
3 years, 5 months agoSteelWarrior
4 years, 2 months agoharoldbenites
4 years, 3 months agoRajuuu
4 years, 5 months agoRajokkiyam
4 years, 8 months ago