Did you notice any cpu or I/O bottlenecks when increasing the threads?
Edit: You may create a tmpfs(depends on your average file size) and export that and then try to read/write from the client. If you don't see any issues then it is I/O related.
NFS speed on 10Gb/s RJ45
-
- Posts: 2019
- Joined: 2015/02/17 15:14:33
- Location: Bulgaria
- Contact:
Re: NFS speed on 10Gb/s RJ45
Thanks everyone for the tips
I tried testing with a different tool ( fio instead of dd ) , and getting much better results
The commands I'm using are like :
And I played with the blocksize from 9K all the way to 2M , 128k seems to give reasonable results
I tried testing with a different tool ( fio instead of dd ) , and getting much better results
The commands I'm using are like :
Code: Select all
fio --name=read-test1 --ioengine=libaio --bs=9k --rw=read --direct=1 --iodepth=32 --runtime=60 --size=40G --group_reporting --filename=/mnt/volume/fio-read-t1
-
- Posts: 2019
- Joined: 2015/02/17 15:14:33
- Location: Bulgaria
- Contact:
Re: NFS speed on 10Gb/s RJ45
Poor performance with small block size indicates lattency issues, while poor performance with larger block size indicates bandwidth issues (or memory if bs is too large).
If you use 'dd' you need to test with 'oflag=direct' to get the 'truth'.
Have you tried to export tmpfs-based share?
If you use 'dd' you need to test with 'oflag=direct' to get the 'truth'.
Have you tried to export tmpfs-based share?
Re: NFS speed on 10Gb/s RJ45
Yeah, I was using the conv=fdatasynchunter86_bg wrote: ↑2018/08/01 20:38:37If you use 'dd' you need to test with 'oflag=direct' to get the 'truth'.
No, I don't have access to the second server I was using as a client anymore, however I'm quite satisfied with what I got from NFS so farHave you tried to export tmpfs-based share?
Now I need to work on tuning a samba share