Improve slow migration speeds
under review
D
Dan Lam
We're noticing really slow transfer times with the new migration plugin (often less than 1Gb per hour). What would be a normal expectation for transfer rate? A couple of weeks back it seemed way faster, but the last week plus, it's been painfully slow.
(Even the old migration plugin has been really spotty for us lately too. It will transfer just a small bit of media before saying it's "finished" even though most of the media never made it over. So we have to re-run the migration multiple time, sometimes a dozen or more, for it to fully transfer all the media over.) I realize they are probably utilizing two totally different networks, but just a bummer that both are problematic at the moment. We're spending way more time on migrations than we did in the past.
B
Benjamin Tennant
A new migration today seems stuck... 85e5d199-7bf3-4138-adee-9576e0dd4ff1. I'm moving from GoDaddy with their "Managed WordPress Ultimate" hosting plan. I seem to be stuck at 27%
B
Benjamin Tennant
Still stuck two hours later.
Kevin Hoffman
Benjamin Tennant: Thank you for sharing. Our team has done some testing from GoDaddy using the new plugin, but we will take another look with the specific plan that you mentioned to see if we can recreate.
Kevin Hoffman
under review
We're looking to optimize the use of an alternative file transfer method that was designed to keep a migration moving when a cURL error is encountered.
Kevin Hoffman
Dan Lam Thanks for the feedback. I looked into the migration from your screenshot, and I can tell you that this transfer speed is definitely not normal. For comparison, you completed a 25 GB migration in just 50 minutes back on January 9th using the new plugin.
It looks like this specific migration encountered a cURL error partway through transferring files. When this happened, the plugin switched to an alternative file transfer method in attempt to work around the error. This alternative method results in smaller requests which allow the migration to keep moving but at a slower pace... in this case much slower.
We are taking a closer look at the conditions under which the alternative file transfer method is triggered to make sure it is only used when necessary and we revert back to the faster file transfer method whenever possible.
In addition, here are a couple of other factors that can impact speed:
- Since the migration is a background process, the proximity of the source and destination servers and quality of the connection between the two can impact speed.
- Files generally transfer faster than database tables, so a 10 GB site with a small database and many files will typically transfer faster than a 10 GB site with a large database and few files.
As I'm reviewing your past migrations, one piece of information that would be very helpful to us is the hosting provider of the source sites. Are all of your migrations from the same host or different hosts?
B
Benjamin Tennant
Kevin Hoffman: Dan and I work together and this was my migration pictured. This particular host was forpsi. I think they are based in CZ. I believe the site is based in Europe. It's not a host we generally migrate from. We migrate from a variety of servers - Bluehost, GoDaddy, Hostgator, Siteground, OVH, Crazy Domains... lots of different ones - from both the US and Europe. I wonder if it would speed things up to be migrating European customers to a WPE European data center.