Migrating 10TB On-Premises Database to Cloud Storage
Question
Your company wants to migrate their 10-TB on-premises database export into Cloud Storage.
You want to minimize the time it takes to complete this activity, the overall cost, and database load.
The bandwidth between the on-premises environment and Google Cloud is 1 Gbps.
You want to follow Google-recommended practices.
What should you do?
Answers
Explanations
Click on the arrows to vote for the correct answer
A. B. C. D.A.
The best option to migrate a large on-premises database export into Google Cloud Storage, while minimizing cost, time, and database load, is to use the Data Transfer Appliance. This is option B.
Here's why:
Option A (Develop a Dataflow job) could work, but it might not be the most efficient method. This option requires creating a custom Dataflow pipeline, which can be complex and require significant time and resources to develop, test, and deploy. Also, Dataflow jobs require sufficient resources to execute, which could increase database load and costs.
Option C (Use a commercial partner ETL solution) may be a viable option, but it's difficult to know the exact requirements for the partner ETL solution, as there are many options available, and it could require significant costs to use. Additionally, it might take more time to implement the solution, and there could be additional costs for the partner ETL solution.
Option D (Compress the data and upload it with gsutil -m) is a valid option but might not be the most efficient. Compressing the data can help reduce the size of the data, but it might not significantly reduce the amount of time it takes to transfer the data to Cloud Storage. Additionally, multi-threaded copy could help speed up the process, but it could still take significant time to complete the transfer.
The Data Transfer Appliance is a physical device that can be sent to the customer to transfer large amounts of data quickly and securely. The appliance is designed to transfer large amounts of data, and it comes with built-in security features to protect the data during the transfer process. It is also easy to set up and use. The appliance can be connected to the on-premises environment, and the data can be transferred directly to Google Cloud Storage, which minimizes the database load and reduces the time it takes to complete the migration.
Therefore, the best option to migrate a large on-premises database export into Cloud Storage, while minimizing cost, time, and database load, is to use the Data Transfer Appliance.
