MP 1,1-5,1 Slow speed migration assistant over ethernet

[wickerstick]

Copied from another post

Not sure if this is a widespread issue so please confirm is you have noticed this, migration assistant from a NAS is way too slow, not sure what could be causing this, as I've never had an issue with this before Big Sur.

My network is hardwired cat 6 throughout it house I deployed, runs into a patch panel and to a 24 port GB switch. The time machine backups are going to a Synology NAS with a bonded network and normally its pretty fast transfer rates. However, when I tried to restore my wife's account (far less data) it would only transfer at 7-8MB/s and took over 12 hours. I have far more data to transfer than her but I don't want to start it until I can figure this out, I even did a disk speed test over the network to the TM backup folder ran a little over 100MB/s so I am not sure the problem. also I have 1GB internet speed but that's WAN and it has nothing to do with the LAN speeds. here is a pic of the test on pretty full drives (89%), I'll be upgrading my NAS soon to either the DS920+ or the QNAP x53D 6 bay.

here's a screenshot of disk speed test over the network

 

[wickerstick]

@TECK or anyone that has the issue, feel free to enlighten me. If anyone else is also having issues after Big Sur update please report them here

 

[TECK]

Hi, let me tell you the setup I have now. A Dell C2100 with 196GB RAM and 12 2TB disks, connected through a 75feet CAT6 cable to my router, which is near my Mac upgraded to OpenCore Big Sur.

I'm using SMB shares, as AFP are not reliable/supported anymore. To connect the SMB share into my Mac, I use the following configuration file:

~$ sudo vi /etc/auto_media
# Automounter map for /media
/System/Volumes/Data/Users/floren/media  -fstype=smbfs  smb://floren:(password)@192.168.2.11/media
~$ sudo chmod 0600 /etc/auto_media

Then, I add the auto_media into /etc/auto_master and mount it:

~$ echo '/-                      auto_media      -nosuid' | sudo tee -a /etc/auto_master
~$ sudo automount -vc

I also disable the login security feature:

sudo defaults write /Library/Preferences/com.apple.NetworkAuthorization AllowUnknownServers -bool YES

The end-result is a /media directory mounted permanently into my User directory, with no auth nags upon a restart etc.:

Now, let's test the above setup speed, from TrueNAS to my Mac running on Big Sur, I will copy a 5GB file to my local drive through a 1Gbit LAN opening my Mac has:

$ rsync -a --progress --stats --human-readable media/Movies/8\ Mile\ \(2002\)/8\ Mile.mkv .
building file list ...
1 file to consider
8 Mile.mkv
       4.83G 100%   49.07MB/s    0:01:33 (xfer#1, to-check=0/1)

Number of files: 1
Number of files transferred: 1
Total file size: 4.83G bytes
Total transferred file size: 4.83G bytes
Literal data: 4.83G bytes
Matched data: 0 bytes
File list size: 60
File list generation time: 0.002 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 4.84G
Total bytes received: 42

sent 4.84G bytes  received 42 bytes  51.16M bytes/sec
total size is 4.83G  speedup is 1.00

This is the transfer speed I get writing the same file in Mojave:

$ rsync -a --progress --stats --human-readable media/Movies/8\ Mile\ \(2002\)/8\ Mile.mkv .
building file list ...
1 file to consider
8 Mile.mkv
       4.83G 100%   53.29MB/s    0:01:26 (xfer#1, to-check=0/1)

Number of files: 1
Number of files transferred: 1
Total file size: 4.83G bytes
Total transferred file size: 4.83G bytes
Literal data: 4.83G bytes
Matched data: 0 bytes
File list size: 74
File list generation time: 0.005 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 4.84G
Total bytes received: 42

sent 4.84G bytes  received 42 bytes  55.90M bytes/sec
total size is 4.83G  speedup is 1.00

This is the reading speed of the same file from my Mac, close to the max bandwidth available (106MB):

$ time dd if=media/file.mkv of=/dev/null bs=8k
590138+1 records in
590138+1 records out
4834417009 bytes transferred in 45.579273 secs (106066128 bytes/sec)

real    0m45.796s
user    0m0.275s
sys    0m5.864s

As you can see, I'm getting 50MB/s transfer rate, in both cases, there is no speed degradation in Big Sur.

Please tell me exactly how is your setup, related to shares, etc.

 

[wickerstick]

this possible it could have indeed been some issues with my settings, I did not change them but it is possible the DSM updates may have made some changes on there own. I had SMB, AFP and NFS enabled previously, on smb the maximum protocol was set to smb2 which I just updated to smb3. I disabled afp since I no longer need it (used to need it a long time ago) and nfs and applied default unit permissions for smb. Also deleted some archived backups, I also have r sync which I can use to test. But I can’t atm (sleeping baby) but I can test first thing in the morning, weirdly as I stated I could connect to the server and run a disk speed test and hit about the correct speed but in migration assistant is where the speed was the issue. 8MB/s~ I have tons of files I need locally stored that’s why I run a 2TB nvme atm. I can’t be down several days transferring data. I will also test Mojave and windows transfers, last time I used migration assistant I recall it almost hitting around 79MB/s I even took a photo cause I though it was pretty awesome.

I haven’t in a while but used to auto mount a few shared folders via finder>go>connect to server, then drag and drop to login items. Ill Run some additional test in the morning but I think the issue isn’t transferring files but possibly migration assistant in Big Sur. We will know more tomorrow. Thanks for also being willing to test. Maybe check restoring from a time machine backup over the network in Big Sur vs Mojave and let me know if you see any change there.

 

[TECK]

Maybe check restoring from a time machine backup

Unfortunately I do not use backups on my Macs, settings are saved into iCloud and everything else is restored through git commands from Github repos. So I can refresh quickly a Mac in no time, with a clean install. I'm sure someone else will be able to chime in their experience.

 

[h9826790]

Time Machine can be quite slow indeed, but that greatly depends on the files size (large or small files, not total files' size).

This is my TM HDD usage in the last one hour

And this the the usage in the last 24 hours

This is the last 7 days

Apparently, after Big Sur update, there was a relatively large backup, and the speed is fine. But for most of the time, in my case, there is no large files to backup. And the backup speed usualy stay below 10MB/s