Welcome! Log In Create A New Profile

Advanced

Network performance - SAMBA - NFS

Posted by bodhi 
Network performance - SAMBA - NFS
June 29, 2016 11:01AM
All,

I'd like to gather the various threads that reported Samba and/or NFS performance benchmarks for the latest kernels (3.16 or newer). I want to track these comparing to stock OS on various Kirkwood boxes.

Please provide the links to such posts in this forum that you are aware of.

-bodhi
===========================
Wiki
latest Kirkwood kernel builds and rootfs
latest u-boot-kirkwood builds
latest Oxnas kernel builds and rootfs
latest u-boot-oxnas builds
latest MVEBU Armada kernel builds and rootfs
U-Boot & Kernel Booting process
bodhi's u-boot GitHub
bodhi's corner
Re: Network performance - SAMBA - NFS
June 29, 2016 11:17AM
As an addendum to bodhi's request, If you want to perform the test yourself and would like a standard way of doing this so we can all compare and have a baseline set to work with. Ideally you should be connected at Gbit speeds on a Gbit switch - not on wireless or 100Mbit switch.

Do the following
1)..Start with a massive and compressed file...This should be a close to 500mb file.
2)..Then find you architecture and kernel version
3)..Then mount your samba/nfs share and copy the file to and from your device (PUSH - PULL)


Create the file - called "bigfile"
dd if=/dev/urandom of=bigfile bs=512 count=1000000

Find your architecture and kernel details
uname -ar


PUSH the file to the location
time cp bigfile /mnt/samba/server/share #where /mnt/samba/server/share = your mounted share
time cp bigfile /mnt/nfs/server/share #where /mnt/nfs/server/share = your mounted share
The "time" command will tell you how long it took.

PULL the file from the location
time cp /mnt/samba/server/share/bigfile .       #where /mnt/samba/server/share = your mounted share
time cp /mnt/nfs/server/share/bigfile .              #where /mnt/nfs/server/share = your mounted share
The "time" command will tell you how long it took.

Post the results you get, bonus points if you do it like this post 6 in this thread



Edited 5 time(s). Last edit at 07/02/2016 01:34PM by Gravelrash.
Re: Network performance - SAMBA - NFS
June 29, 2016 10:40PM
And do the same but reverse the direction (pull):

time cp /mnt/samba/server/share/bigfile .       #where /mnt/samba/server/share = your mounted share
time cp /mnt/nfs/server/share/bigfile .              #where /mnt/nfs/server/share = your mounted share

Lastly, these 4 tests should be performed in a Gigabit network, with only a Gigabit switch in the middle of the 2 computers.

-bodhi
===========================
Wiki
latest Kirkwood kernel builds and rootfs
latest u-boot-kirkwood builds
latest Oxnas kernel builds and rootfs
latest u-boot-oxnas builds
latest MVEBU Armada kernel builds and rootfs
U-Boot & Kernel Booting process
bodhi's u-boot GitHub
bodhi's corner



Edited 1 time(s). Last edit at 06/29/2016 10:47PM by bodhi.
Re: Network performance - SAMBA - NFS
June 30, 2016 01:12AM
May I suggest to put these together in a script, which reports the times and the samba configuration (and other stuff which might be of interest)? A standardized output would make the collection of the data much easier.

Rainer

===========================
Blog: https://rmkrug.wordpress.com/

1 x Pogoplug E02 (pink): Logitech media server

1 x Pogoplug E02 (pink): FTP server only (throw away configuration - quick to rebuild)

1 x GoFlex Net: running OpenMediaVault
Re: Network performance - SAMBA - NFS
June 30, 2016 05:21AM
Here are the results from the

"SMB - on GoFlex Net - running OpenMediaVault - share on usb flash driver - client Mac OS X"

jury:

01:01:05 ~$ dd if=/dev/urandom of=bigfile bs=512 count=1000000
1000000+0 records in
1000000+0 records out
512000000 bytes transferred in 42.935120 secs (11924970 bytes/sec)
01:07:31 ~$ time cp bigfile /Volumes/Scans/

real	2m7.070s
user	0m0.004s
sys	0m0.607s
01:09:42 ~$ time cp /Volumes/Scans/bigfile ./bigfile.down

real	0m46.476s
user	0m0.005s
sys	0m1.198s
01:12:58 ~$

Architecture and Version of server:

root@lms:~# uname -ar
Linux lms 3.2.0-4-kirkwood #1 Debian 3.2.78-1 armv5tel GNU/Linux


Here is the config from the samba server. Stock settings, no tweaks:

#======================= Global Settings =======================
[global]
workgroup = WORKGROUP
server string = %h server
dns proxy = no
log level = 0
syslog = 0
log file = /var/log/samba/log.%m
max log size = 1000
syslog only = yes
panic action = /usr/share/samba/panic-action %d
encrypt passwords = true
passdb backend = tdbsam
obey pam restrictions = yes
unix password sync = no
passwd program = /usr/bin/passwd %u
passwd chat = *Enter\snew\s*\spassword:* %n\n *Retype\snew\s*\spassword:* %n\n *password\supdated\ssuccessfully* .
pam password change = yes
socket options = TCP_NODELAY IPTOS_LOWDELAY
guest account = nobody
load printers = no
disable spoolss = yes
printing = bsd
printcap name = /dev/null
unix extensions = yes
wide links = no
create mask = 0777
directory mask = 0777
map to guest = Bad User
use sendfile = yes
aio read size = 16384
aio write size = 16384
null passwords = no
local master = yes
time server = no
wins support = no

#======================= Share Definitions =======================
[Scans]
path = /media/6c76167f-2d6d-4453-b79b-c79a57e5e948/Scans/
guest ok = yes
read only = no
browseable = yes
inherit acls = yes
inherit permissions = no
ea support = no
store dos attributes = no
printable = no
create mask = 0755
force create mode = 0644
directory mask = 0755
force directory mode = 0755
hide dot files = yes
read list =
write list =

===========================
Blog: https://rmkrug.wordpress.com/

1 x Pogoplug E02 (pink): Logitech media server

1 x Pogoplug E02 (pink): FTP server only (throw away configuration - quick to rebuild)

1 x GoFlex Net: running OpenMediaVault



Edited 1 time(s). Last edit at 06/30/2016 12:20PM by rkrug.
Re: Network performance - SAMBA - NFS
July 02, 2016 03:22AM
uname -ar
Linux Smurfville 3.16.0-kirkwood-tld-3 #2 PREEMPT Sat Sep 27 02:01:41 PDT 2014 armv5tel GNU/Linux


NFS: Pogov4 (SATA HDD) <-> Lenovo IX2-DL (SATA HDD)
dd if=/dev/urandom of=bigfile bs=512 count=1000000
time cp bigfile /mnt/network/Backups/
real	0m35.817s
user	0m0.060s
sys	0m9.010s
time cp /mnt/network/Backups/bigfile .
real	0m27.336s
user	0m0.030s
sys	0m13.330s


SAMBA: Pogov4 (SATA HDD) <-> Lenovo IX2-DL (SATA HDD)
dd if=/dev/urandom of=bigfile bs=512 count=1000000
time cp bigfile /mnt/network/samba/
real	0m35.387s
user	0m0.070s
sys	0m9.160s
time cp /mnt/network/samba/bigfile .
real	0m26.752s
user	0m0.080s
sys	0m13.070s



Edited 1 time(s). Last edit at 07/02/2016 04:23AM by Gravelrash.
Re: Network performance - SAMBA - NFS
July 02, 2016 06:17AM
@Gravelrash,

Well done :)

Also, the HP Thin Client is probably a good test bench, since we can run stock OS and see if kernel 3.16+ can compare.


@rkrug,

Could you do the same tests Gravelrash did? can you run with kernel 3.16.0-kirkwood-tld-1 or newer? that would be a good test to compare the performance. And please use Garvelrash's format as shown above.

-bodhi
===========================
Wiki
latest Kirkwood kernel builds and rootfs
latest u-boot-kirkwood builds
latest Oxnas kernel builds and rootfs
latest u-boot-oxnas builds
latest MVEBU Armada kernel builds and rootfs
U-Boot & Kernel Booting process
bodhi's u-boot GitHub
bodhi's corner



Edited 1 time(s). Last edit at 07/02/2016 06:28AM by bodhi.
Re: Network performance - SAMBA - NFS
July 02, 2016 12:53PM
.



Edited 1 time(s). Last edit at 07/02/2016 04:32PM by Gravelrash.
Re: Network performance - SAMBA - NFS
July 02, 2016 04:31PM
uname -ar
Linux HP5325 4.6.0-kirkwood-tld-1 #1 PREEMPT Wed May 18 03:54:14 PDT 2016 armv5tel GNU/Linux


NFS: HP T5325 (USB HDD) <-> Lenovo IX2-DL (SATA HDD)
dd if=/dev/urandom of=bigfile bs=512 count=1000000
time cp bigfile /mnt/network/nfs/Backups
real	0m51.342s
user	0m0.040s
sys	0m6.800s
time cp /mnt/network/nfs/Backups/bigfile .
real	0m43.917s
user	0m0.020s
sys	0m11.450s


SAMBA: HP T5325 (USB HDD) <-> Lenovo IX2-DL (SATA HDD)
dd if=/dev/urandom of=bigfile bs=512 count=1000000
time cp bigfile /mnt/network/samba
real	0m48.287s
user	0m0.000s
sys	0m7.630s
time cp /mnt/network/samba/bigfile .
real	0m48.146s
user	0m0.030s
sys	0m9.210s


Seems slower - than the PogoV4 - but I guess thats more down to the USB HDD not being on native SATA and the protocol overhead.



Edited 1 time(s). Last edit at 07/02/2016 04:33PM by Gravelrash.
Re: Network performance - SAMBA - NFS
July 02, 2016 10:25PM
> Seems slower - than the PogoV4 - but I guess thats
> more down to the USB HDD not being on native SATA
> and the protocol overhead.

Yes, it's SATA vs USB.

-bodhi
===========================
Wiki
latest Kirkwood kernel builds and rootfs
latest u-boot-kirkwood builds
latest Oxnas kernel builds and rootfs
latest u-boot-oxnas builds
latest MVEBU Armada kernel builds and rootfs
U-Boot & Kernel Booting process
bodhi's u-boot GitHub
bodhi's corner
Re: Network performance - SAMBA - NFS
July 04, 2016 12:57PM
if i get chance this week - i will load my other HP thinclient with stock os and see where we go. Im down to two now.
Re: Network performance - SAMBA - NFS
July 04, 2016 11:01PM
@Gravelrash,

If you can run stock, it's also good to run iperf to see pure network performance difference, if any, between stock T5325 and Debian kernel 3.16+.

-bodhi
===========================
Wiki
latest Kirkwood kernel builds and rootfs
latest u-boot-kirkwood builds
latest Oxnas kernel builds and rootfs
latest u-boot-oxnas builds
latest MVEBU Armada kernel builds and rootfs
U-Boot & Kernel Booting process
bodhi's u-boot GitHub
bodhi's corner
Re: Network performance - SAMBA - NFS
June 30, 2017 09:50PM
I know this is an older topic but I figured why not post some current numbers...

NFSv3 testing

RAID1 ext4 (rw,noatime,stripe=64,data=writeback) 2x WD RED 3TB
NSA-320
Linux IQ2700i 4.11.3-kirkwood-tld-2 #1 PREEMPT Tue Jun 6 17:01:17 PDT 2017 armv5tel GNU/Linux
# cat /etc/debian_version
8.8


READ NFSv3 - 6.21GB file (Install Mac OSX El Capitan.pkg)
ethstats peak (100% CPU usage on NAS):
  egiga0:   10.54 Mb/s In   394.53 Mb/s Out -  17013.5 p/s In   32729.7 p/s Out
iStats Menu Meters (Mac Pro 2008 10.12.5):
  51.8MB/s peak - avg ~42MB/s



WRITE NFSv3 - 6.21GB file
ethstats peak (100% CPU usage on NAS load avg 9.40):
  egiga0:  260.46 Mb/s In     1.16 Mb/s Out -  21890.0 p/s In    1020.0 p/s Out
iStats Menu Meters (Mac Pro 2008 10.12.5):
  33.3MB/s peak - avg ~29MB/s

And for the 512MB "bigfile" test:
MacPro:Desktop ludacrisvp$ dd if=/dev/urandom of=bigfile bs=512 count=1000000
1000000+0 records in
1000000+0 records out
512000000 bytes transferred in 47.029512 secs (10886781 bytes/sec)

Push to NAS
MacPro:Desktop ludacrisvp$ time cp bigfile /Volumes/data/

real	0m13.919s
user	0m0.006s
sys	0m2.048s

  egiga0:  306.75 Mb/s In     1.24 Mb/s Out -  25631.3 p/s In    1125.1 p/s Out

Pull from NAS
MacPro:Desktop ludacrisvp$ time cp /Volumes/data/bigfile ./bigfile.down

real	0m10.627s
user	0m0.006s
sys	0m1.223s
  egiga0:    6.92 Mb/s In   257.74 Mb/s Out -  11142.1 p/s In   21374.0 p/s Out
Author:

Your Email:


Subject:


Spam prevention:
Please, enter the code that you see below in the input field. This is for blocking bots that try to post this form automatically. If the code is hard to read, then just try to guess it right. If you enter the wrong code, a new image is created and you get another chance to enter it right.
Message: