NFS speed on 10Gb/s RJ45

Issues related to configuring your network
hunter86_bg
Posts: 2019
Joined: 2015/02/17 15:14:33
Location: Bulgaria
Contact:

Re: NFS speed on 10Gb/s RJ45

Post by hunter86_bg » 2018/07/24 10:30:33

Did you notice any cpu or I/O bottlenecks when increasing the threads?
Edit: You may create a tmpfs(depends on your average file size) and export that and then try to read/write from the client. If you don't see any issues then it is I/O related.

Moe
Posts: 26
Joined: 2017/01/23 14:30:28

Re: NFS speed on 10Gb/s RJ45

Post by Moe » 2018/08/01 16:22:29

Thanks everyone for the tips

I tried testing with a different tool ( fio instead of dd ) , and getting much better results

The commands I'm using are like :

Code: Select all

 fio --name=read-test1 --ioengine=libaio --bs=9k --rw=read --direct=1 --iodepth=32 --runtime=60 --size=40G --group_reporting --filename=/mnt/volume/fio-read-t1
And I played with the blocksize from 9K all the way to 2M , 128k seems to give reasonable results

hunter86_bg
Posts: 2019
Joined: 2015/02/17 15:14:33
Location: Bulgaria
Contact:

Re: NFS speed on 10Gb/s RJ45

Post by hunter86_bg » 2018/08/01 20:38:37

Poor performance with small block size indicates lattency issues, while poor performance with larger block size indicates bandwidth issues (or memory if bs is too large).
If you use 'dd' you need to test with 'oflag=direct' to get the 'truth'.
Have you tried to export tmpfs-based share?

Moe
Posts: 26
Joined: 2017/01/23 14:30:28

Re: NFS speed on 10Gb/s RJ45

Post by Moe » 2018/08/02 11:24:15

hunter86_bg wrote:
2018/08/01 20:38:37
If you use 'dd' you need to test with 'oflag=direct' to get the 'truth'.
Yeah, I was using the conv=fdatasync
Have you tried to export tmpfs-based share?
No, I don't have access to the second server I was using as a client anymore, however I'm quite satisfied with what I got from NFS so far

Now I need to work on tuning a samba share :shock: :roll: :!: :?:

Post Reply