Data Migration Examples

Summary

Highlights

• Katie Morgan gives expert advice on data migration strategies. 🎓
• Learn about offline and online data transfer options. 🌐
• Discover how to handle large-scale data migrations with ease. 📊
• Find out the best practices for using provider-owned storage devices. 📦
• Insightful tips on managing transfer costs and network speeds. 💡

Key Takeaways

• Understand your data migration needs: workload type, data volume, and transfer speed are crucial factors. 🚀
• Choose offline transfer for remote locations or large data volumes using portable storage. 💽
• Opt for online transfers if speed is paramount, but be mindful of costs and network limitations. 🌐
• Provider-owned devices are recommended for extremely large datasets, offering device shipping and secure handling. 📦
• Check cloud provider specifications for compatible hardware, features, and additional benefits. 🔍

Overview

Chapters

• 00:00 - 00:30: Introduction to Data Migration The chapter introduces the concept of data migration to the cloud, presented by Katie Morgan from the IBM Cloud team. It highlights three primary factors to consider for data transfer methods: the type of workload, the volume of data, and the urgency of the transfer.
• 00:30 - 01:00: Large Scale Data Migration Options This chapter discusses options for large scale data migrations, particularly those involving terabytes to petabytes of data. It highlights that cloud providers offer a range of products and services to facilitate data transfer from one location to another. The options are generally divided into two categories: offline transfer and online transfer, with offline being especially useful for remote locations.
• 01:00 - 02:00: Offline Data Transfer - Customer-Owned Device Offline Data Transfer - Customer-Owned Device: This chapter discusses the use of offline data transfer options when high-speed internet is unavailable or expensive. It emphasizes the use of portable storage devices for transferring data, highlighting customer-owned devices such as USB sticks, external hard drives, CDs, or DVDs, which can be sent to a cloud provider's data center for data connection.
• 02:00 - 03:00: Provider-Owned Device Offline Transfer This chapter discusses the process of offline data transfer using provider-owned devices. After a device is mounted, depending on the cloud provider, data transfer is controlled either by the provider or remotely by the user. Post-transfer, the provider ships the device back or offers to destroy it. The recommendation is using a customer-owned device for transfers under 10 terabytes.
• 03:00 - 04:00: Online Data Transfer Options The chapter discusses various online data transfer options emphasizing that while there are no strict rules, generally workloads exceeding ten terabytes might require offline transfer. In such cases, cloud providers send large capacity portable storage devices to the user's location to store the data. Once the data is loaded, the device is sent back to the provider's data center where the data is offloaded.
• 04:00 - 05:30: Considerations and Recommendations This chapter discusses the process and importance of data transfer and management within cloud environments. It highlights the protocol of securely transferring data to a target environment and the responsibility of the cloud provider to wipe clean the devices post-transfer, ensuring data security and privacy. The chapter also draws comparisons to benchmarks set by customer-owned devices, which are used as a standard for capacity measurement.

Data Migration Examples Transcription

• 00:00 - 00:30 Hi there, my name is Katie Morgan and I'm with the IBM Cloud team and today I'm going to be talking about data migration. So, before you can actually start using the cloud, you'll have to first figure out how you're actually going to get your data to the cloud. In my experience, there are 3 primary factors that you should be considering when you're looking at data transfer methods. The first being the type of workload that you're moving, and the second is how much data are you moving. Thirdly, how quickly do you need the transfer to occur?
• 00:30 - 01:00 So, for large scale data migrations, and by large, I mean terabytes to petabytes worth of data, cloud providers will typically provide you with a portfolio of options such as products, services - that enable you to move your data from point A to point B. And most of these portfolios span two primary categories: offline transfer and online transfer. For offline transfer, which is great if you're in a remote location
• 01:00 - 01:30 or if you're in a place where high-speed connections just are unavailable or are just cost prohibitive to you. Offline transfer options are great because they leverage portable storage devices to move your data from point A to point B. The first being a customer-owned device. And what that looks like is you sending in your own piece of hardware whether it's a USB stick, external hard drive, CD, DVD, or something like that, to a cloud provider's data center for connection.
• 01:30 - 02:00 And once that device is mounted, depending on the cloud provider, either you will remotely control that data transfer, or they will initiate the transfer on your behalf. Once the transfer is complete, they'll ship the device back to you, or some providers actually offer to destroy the device on your behalf if that's not something that you're interested in. So, not a hard and fast rule, but we often recommend a customer-owned device transfer method for workloads that are 10 terabytes or less in size.
• 02:00 - 02:30 Again, not as strict rule, but a good rule of thumb to go by. And for workloads that exceed that ten-terabyte capacity, we'll often point people towards provider-owned device offline transfer options. And what that really looks like is your cloud provider shipping you a large capacity portable storage device to your location for you to put your data on to it and then immediately send back to the cloud provider's data center. Once it gets back to that cloud provider, they're going to immediately offload your data from that device
• 02:30 - 03:00 and into your target caught environment. Once the transfer is complete, absolutely go free and access your data while the cloud provider will securely wipe that device of your data and immediately to return the device to inventory for reuse for the next customer. So, similar to the customer-owned device, we use this as the standard benchmark for capacities
• 03:00 - 03:30 when using a provider-owned device, and that's really tens of terabytes to hundreds. It depends on the cloud provider that you're working with. Some of the devices actually span from single terabytes in capacity all the way up to a petabyte scale, it just depends on who you're working with and what you're trying to do. And finally, if you're really not looking for an offline transfer, you want to transfer data over the network, or you're really looking for that high speed technology, that's when you want to consider an online transfer option. You can write custom applications using high-speed transfer libraries
• 03:30 - 04:00 or spin up a high-speed transfer client at your location and connect it to the cloud provider's high-speed server cluster. Something to consider with online transfer, as well as offline, as I'm sure you can tell your network connections and speed significantly impact all of these options but especially the online transfer. If you're thinking that your transfer time is really going to creep up into that week-long or plus duration for a migration,
• 04:00 - 04:30 you might want to consider a combination of any of these offerings or really an offline transfer. The longer that you spend migrating using over-the-network options, the longer that it will take and the higher the cost, typically. So, if you're looking to drive down costs you definitely want to keep that in mind. And then, finally, just a couple of things that you should probably consider with some of these offerings: with the customer-owned device, definitely look at your cloud provider's web page.
• 04:30 - 05:00 They'll do a good job of outlining any hardware specifications or requirements so that you are able to send a device that's actually compatible with what they're looking for. For the provider-owned device area, you definitely want to look at their web pages and see any features and benefits that the varying devices and capacities will offer. The size of your workload will really determine what capacity you're looking for in terms of device. And then extra bells and whistles like GPS tracking or edge computing,
• 05:00 - 05:30 definitely look and see if any of those peak your interest and see if the device models match. Thanks for watching this video on data migration. If you have any questions feel free to drop us a line below, and if you like this video and want to see more then "like" and subscribe to our channel and be on the lookout for more videos just like this.