marcin/nas-data-migration
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Takeaways updated

Browse source
This commit is contained in:
m-stefanski 2020-05-07 18:58:45 +02:00 committed by GitHub
parent eb6c0d1bde
commit f0c9dad17f
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
NAS_data_migration.md
View file

@ -9,11 +9,11 @@ I was trying to migrate my data from one WD MyCloud EX 2 Ultra to another. I fou
Starting with 20-25 MB/s using `scp` and `rsync`, finished with 55 MB/s using `rsync` running as daemon on source. See [Solution](#Solution) for details. Starting with 20-25 MB/s using `scp` and `rsync`, finished with 55 MB/s using `rsync` running as daemon on source. See [Solution](#Solution) for details.
### Takeaways ### Takeaways
* WD MyCloud EX2 Ultra is severely underpowered if you want to use any form of encrypted transfer, with only one core utilized
* Using `rsync` on both helps to distribute CPU load - so if you are CPU-bound, consider using `rsync://` instead of `rsync+ssh` or `scp`
* To check for network performance, start with `iperf` for throughput, then `ethtool` for hardware layer and then proceed with tuning if necessary * To check for network performance, start with `iperf` for throughput, then `ethtool` for hardware layer and then proceed with tuning if necessary
* To check drive performance: `hdparm` and `dd` for read and write speeds, before checking transfer tools * To check drive performance: `hdparm` and `dd` for read and write speeds, before checking transfer tools
* If you use `dd` to test write speeds, **try smaller block sizes**, difference between `1G` and `1M` is huge * If you use `dd` to test write speeds, **use reasonable block size**, difference between `1G` and `1M` is huge
* In this case, there is no performance difference between `scp` and `rsync`, athough if I wanted to resume broken copy process, rsync provides option to skip existing files (as a workaround in scp we can force this by removing write persmissions to already existing files)
## Initial conditions ## Initial conditions