GoFlex Net - slow file transfers March 14, 2024 01:12PM |
Registered: 8 months ago Posts: 9 |
#samba config file [global] workgroup = WORKGROUP server string = Samba Server %v netbios name = Goflex # netbios aliases = Fileserver security = user map to guest = bad user dns proxy = no # ntlm auth = yes Hosts allow = 127., 192.168.1. [6TB-A] path = /mnt/drives/6TB-A browseable = yes writeable = yes guest ok = no read only = no [6TB-B] path = /mnt/drives/6TB-B browseable = yes writeable = yes guest ok = no read only = no
hdparm -tT /dev/sda /dev/sda: Timing cached reads: 472 MB in 2.00 seconds = 235.63 MB/sec Timing buffered disk reads: 298 MB in 3.00 seconds = 99.19 MB/sec
root@debian:/mnt/drives/6TB-A# time cp /mnt/drives/4tb/bigfile . real 0m46.279s user 0m0.000s sys 0m10.886s root@debian:/mnt/drives/6TB-A# time cp bigfile /mnt/drives/4tb real 0m27.544s user 0m0.011s sys 0m8.372s
root@debian:/mnt/drives/6TB-A# iperf -c 192.168.1.2 -n 1000M -r ------------------------------------------------------------ Server listening on TCP port 5001 TCP window size: 128 KByte (default) ------------------------------------------------------------ ------------------------------------------------------------ Client connecting to 192.168.1.2, TCP port 5001 TCP window size: 43.8 KByte (default) ------------------------------------------------------------ [ 1] local 192.168.1.8 port 50382 connected with 192.168.1.2 port 5001 (icwnd/mss/irtt=14/1448/259) [ ID] Interval Transfer Bandwidth [ 1] 0.0000-10.3220 sec 1000 MBytes 813 Mbits/sec [ 2] local 192.168.1.8 port 5001 connected with 192.168.1.2 port 60652 [ ID] Interval Transfer Bandwidth [ 2] 0.0000-14.1505 sec 1000 MBytes 593 Mbits/sec
root@debian:/mnt/drives/6TB-A# iperf -c 192.168.1.2 -F bigfile ------------------------------------------------------------ Client connecting to 192.168.1.2, TCP port 5001 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 1] local 192.168.1.8 port 41738 connected with 192.168.1.2 port 5001 (icwnd/mss/irtt=14/1448/271) [ ID] Interval Transfer Bandwidth [ 1] 0.0000-20.8813 sec 488 MBytes 196 Mbits/sec
Re: GoFlex Net - slow file transfers March 14, 2024 02:47PM |
Admin Registered: 13 years ago Posts: 19,094 |
Quote
Current Windows transfer rates (copying from 6TB Goflex to anything on the network) are showing between 14MB/s and 20MB/s. Most 4K movies require higher speeds than this.
Quote
Copying to/from the CentOS hosted 4TB drive usually runs at 60-80MB/s.
Quote
Perfornance Tuning & Benchmarks
Network performance - SAMBA - NFS (various protocols)
Samba Tuning
Mount NTFS with big_writes
Re: GoFlex Net - slow file transfers March 14, 2024 02:51PM |
Admin Registered: 13 years ago Posts: 19,094 |
Quote
- dphys-swapfile installed with the swapfactor set to 5 (thinking of using HDD for swap later)
Re: GoFlex Net - slow file transfers March 14, 2024 03:08PM |
Registered: 8 months ago Posts: 9 |
Re: GoFlex Net - slow file transfers March 14, 2024 03:21PM |
Registered: 8 months ago Posts: 9 |
# where we want the swapfile to be, this is the default CONF_SWAPFILE=/mnt/drives/6TB-A/swap
Re: GoFlex Net - slow file transfers March 14, 2024 03:59PM |
Admin Registered: 13 years ago Posts: 19,094 |
Re: GoFlex Net - slow file transfers March 14, 2024 04:48PM |
Registered: 8 months ago Posts: 9 |
root@debian:/mnt/drives/6TB-A# time cp /mnt/drives/4tb/bigfile . real 0m43.359s user 0m0.012s sys 0m10.326s root@debian:/mnt/drives/6TB-A# time cp bigfile /mnt/drives/4tb real 0m29.948s user 0m0.000s sys 0m9.063s root@debian:/mnt/drives/6TB-A# iperf -c 192.168.1.2 -n 1000M -r ------------------------------------------------------------ Server listening on TCP port 5001 TCP window size: 128 KByte (default) ------------------------------------------------------------ ------------------------------------------------------------ Client connecting to 192.168.1.2, TCP port 5001 TCP window size: 43.8 KByte (default) ------------------------------------------------------------ [ 1] local 192.168.1.8 port 50442 connected with 192.168.1.2 port 5001 (icwnd/mss/irtt=14/1448/274) [ ID] Interval Transfer Bandwidth [ 1] 0.0000-10.0749 sec 1000 MBytes 833 Mbits/sec [ 2] local 192.168.1.8 port 5001 connected with 192.168.1.2 port 32942 [ ID] Interval Transfer Bandwidth [ 2] 0.0000-14.0825 sec 1000 MBytes 596 Mbits/sec root@debian:/mnt/drives/6TB-A# iperf -c 192.168.1.2 -F bigfile ------------------------------------------------------------ Client connecting to 192.168.1.2, TCP port 5001 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 1] local 192.168.1.8 port 49364 connected with 192.168.1.2 port 5001 (icwnd/mss/irtt=14/1448/281) [ ID] Interval Transfer Bandwidth [ 1] 0.0000-22.8524 sec 488 MBytes 179 Mbits/sec
[ 6.160831][ T55] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl F300) [ 6.320877][ T55] ata2.00: ATA-8: MG04ACA600E, FS3J, max UDMA/100 [ 6.327226][ T55] ata2.00: 11721045168 sectors, multi 16: LBA48 NCQ (depth 31/32) [ 6.341784][ T55] ata2.00: configured for UDMA/100This is an enterprise drive with max 6Gb transfer
Re: GoFlex Net - slow file transfers March 14, 2024 05:04PM |
Admin Registered: 13 years ago Posts: 19,094 |
>Quote
Perfornance Tuning & Benchmarks
>
> Network performance - SAMBA - NFS (various
> protocols)
>
> Samba Tuning
> Mount NTFS with big_writes
Quote
2. Set up a public share (no login credential). This is a wide open share that everybody in the network will have read/write privelege. Here I've attached my simplest smb.conf that you can use. Download it to your box, save the current one, and copy the new smb.conf to this directory
Re: GoFlex Net - slow file transfers March 14, 2024 08:04PM |
Registered: 8 months ago Posts: 9 |
[media] comment = shared media (eg. USB drives) path = /mnt/drives/6TB-A browseable = yes writeable = yes guest ok = yes
root@debian:/mnt/drives/6TB-A# hdparm -tT /dev/sda /dev/sda: Timing cached reads: 514 MB in 2.00 seconds = 257.07 MB/sec Timing buffered disk reads: 296 MB in 3.02 seconds = 98.17 MB/sec root@debian:/mnt/drives/6TB-A# time cp bigfile /mnt/drives/4tb real 0m28.630s user 0m0.012s sys 0m8.395s root@debian:/mnt/drives/6TB-A# time cp /mnt/drives/4tb/bigfile . real 1m1.690s user 0m0.009s sys 0m12.666s root@debian:/mnt/drives/6TB-A# iperf -c 192.168.1.2 -F bigfile ------------------------------------------------------------ Client connecting to 192.168.1.2, TCP port 5001 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 1] local 192.168.1.8 port 56540 connected with 192.168.1.2 port 5001 (icwnd/mss/irtt=14/1448/264) [ ID] Interval Transfer Bandwidth [ 1] 0.0000-21.4232 sec 488 MBytes 191 Mbits/sec
Re: GoFlex Net - slow file transfers March 14, 2024 09:54PM |
Admin Registered: 13 years ago Posts: 19,094 |
Quote
I have also set up a iperf server on the CentOS (gigabit Netgear XR500 router in the middle) and ran the following:
root@debian:/mnt/drives/6TB-A# iperf -c 192.168.1.2 -n 1000M -r
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 128 KByte (default)
------------------------------------------------------------
------------------------------------------------------------
Client connecting to 192.168.1.2, TCP port 5001
TCP window size: 43.8 KByte (default)
------------------------------------------------------------
[ 1] local 192.168.1.8 port 50382 connected with 192.168.1.2 port 5001 (icwnd/mss/irtt=14/1448/259)
[ ID] Interval Transfer Bandwidth
[ 1] 0.0000-10.3220 sec 1000 MBytes 813 Mbits/sec
[ 2] local 192.168.1.8 port 5001 connected with 192.168.1.2 port 60652
[ ID] Interval Transfer Bandwidth
[ 2] 0.0000-14.1505 sec 1000 MBytes 593 Mbits/sec
Re: GoFlex Net - slow file transfers March 15, 2024 04:37PM |
Registered: 8 months ago Posts: 9 |
Quote
doncharisma
My GoFlex NET has now been running a couple of weeks and seems stable enough with OpenMediaVault and my two 1TB RAID1 disks. Performance wise I’m happy enough, only bottleneck I’ve found so far is the Samba daemon which is using a lot of CPU when I copy files over the network onto the RAID array. But still I’m getting around 20MB/s which is OK.
Re: GoFlex Net - slow file transfers March 16, 2024 02:04PM |
Admin Registered: 13 years ago Posts: 19,094 |
Re: GoFlex Net - slow file transfers March 18, 2024 12:57PM |
Registered: 9 years ago Posts: 52 |
Re: GoFlex Net - slow file transfers March 18, 2024 02:08PM |
Admin Registered: 13 years ago Posts: 19,094 |
[ 26.668692] marvell-cesa f1030000.crypto: CESA device successfully registered
Quote
https://forum.doozan.com/read.php?2,23630
Hardware Cryptography
Marvell CESA (also see correction post in this thread)
Marvell CESA in kernel 4.4 performance
Hardware Cryptography cryptodev/openssl On arm5/Debian (build circa 2019)
Re: GoFlex Net - slow file transfers March 18, 2024 04:29PM |
Registered: 8 months ago Posts: 9 |
root@debian:/etc# hdparm -tT /dev/sda /dev/sda: Timing cached reads: 514 MB in 2.00 seconds = 256.88 MB/sec Timing buffered disk reads: 320 MB in 3.01 seconds = 106.29 MB/sec
/mnt/drives/6TB-A *(rw,async,insecure,no_root_squash,no_subtree_check,fsid=0,nohide)
[root@server ~]# showmount --exports 192.168.1.8 Export list for 192.168.1.8: /mnt/drives/6TB-A *
[root@server 4TB]# time cp bigfile /home/server/net real 0m35.140s user 0m0.009s sys 0m0.902s
Re: GoFlex Net - slow file transfers March 18, 2024 07:28PM |
Registered: 8 months ago Posts: 9 |
root@debian:~# hdparm -I /dev/sda | grep TRIM root@debian:~#
Re: GoFlex Net - slow file transfers March 22, 2024 06:51PM |
Registered: 9 years ago Posts: 52 |
Re: GoFlex Net - slow file transfers March 26, 2024 05:35PM |
Admin Registered: 13 years ago Posts: 19,094 |
Quote
Increase NFSD max_block_size
Reduce NFSD threads
Quote
Tried different max_block_size values.
- Default is 16384. Pretty slow.
- 65536 does a little beter, but not great
- 262144: 54MB/s
- 1048576: 60MB/s.
Re: GoFlex Net - slow file transfers April 02, 2024 05:18PM |
Registered: 8 months ago Posts: 9 |
Quote
bodhi
(THREAD - Linux Kernel 6.7.5 Kirkwood package and Debian rootfs)
Samba and nfs really need to have proper tuning to reach max potentials. I doubt we can say there is a different between Debian and Arch. I think it is actually a difference in tuning, if there is any tuning going on. My released kernel build and rootfs are basic, bare bone, and have no special tuning at all :)
Quote
almaz
(same thread)
I totally agree with Bodhi. My benchmarks were between PogoPlug and Windows PC. That's what is the most important, network speed. I didn't use dd command for testing just evarage what Windows 8.1 graph showed during transfer.
Quote
davidfpha
nfsd crashed randomly with socket errors, lowered network window size to 262144 and nfs block size to 524288, seems ok now.
/etc/init.d/nfs-kernel-server stop echo 1 > /proc/fs/nfsd/threads /etc/init.d/nfs-kernel-server start cat /proc/fs/nfsd/threads 8
Re: GoFlex Net - slow file transfers April 02, 2024 06:52PM |
Admin Registered: 13 years ago Posts: 19,094 |
# Number of servers to start up RPCNFSDCOUNT=1
/etc/init.d/nfs-kernel-server restart cat /proc/fs/nfsd/threads
Re: GoFlex Net - slow file transfers April 02, 2024 06:57PM |
Admin Registered: 13 years ago Posts: 19,094 |
Quote
These are the numbers that I stuck to. However when copying a 2Gb mkv video file to and from the CenOS 7 server, the file transfer started off at around 60MB/s but within 10 seconds ramped down to 20.