NFS server perfomance tuning
flag
Messages 1 - 10 of 19 - Collapse all
/groups/adfetch?hl=en&adid=KXc7PBEAAADgOVXo6-d4KUF6F3qqGi6NFSRgCP-avRN4YT0eROC0jw
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
1.  Guy Van Sanden  
View profile  
 More options Jun 23 2004, 4:20 pm
Newsgroups: linux.gentoo.user
From: Guy Van Sanden <n...@myrealbox.com>
Date: Wed, 23 Jun 2004 22:20:09 +0200
Local: Wed, Jun 23 2004 4:20 pm
Subject: [gentoo-user] NFS server perfomance tuning
I'm running an NFS server on Gentoo (2.4).
Compared to for example scp, my nfs connections are terribly slow (6-7
minutes for the same operation that takes 3 minutes on scp).
Are there some settings I can tweak to speed things up?

I already increased the number of nfsd processes to 16.

Thanks

Guy

--
______________________________________________________________________  

  Guy Van Sanden
  http://unixmafia.port5.com  

  Registered Linux user #249404 - September 1997
______________________________________________________________________

--
gentoo-u...@gentoo.org mailing list


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
2.  lukas  
View profile  
 More options Jun 23 2004, 4:50 pm
Newsgroups: linux.gentoo.user
From: lukas <lu...@web-xs.de>
Date: Wed, 23 Jun 2004 22:50:08 +0200
Local: Wed, Jun 23 2004 4:50 pm
Subject: Re: [gentoo-user] NFS server perfomance tuning

On Wednesday 23 June 2004 22:12, Guy Van Sanden wrote:

> I'm running an NFS server on Gentoo (2.4).
> Compared to for example scp, my nfs connections are terribly slow
> (6-7 minutes for the same operation that takes 3 minutes on scp). Are
> there some settings I can tweak to speed things up?

> I already increased the number of nfsd processes to 16.

> Thanks

> Guy

Use
rsize=8192,wsize=8192
as option for the mount command on your clients.
This will increase the buffer for read and write operations to 8k and
should make things much faster.

cu

lukas

  application_pgp-signature_part
< 1K Download

    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
3.  Guy Van Sanden  
View profile  
 More options Jun 25 2004, 3:30 am
Newsgroups: linux.gentoo.user
From: Guy Van Sanden <n...@myrealbox.com>
Date: Fri, 25 Jun 2004 09:30:11 +0200
Local: Fri, Jun 25 2004 3:30 am
Subject: Re: [gentoo-user] NFS server perfomance tuning
Thanks Lukas

I have those in already, and it helped a little, but NFS keeps
underperfoming scp by a long shot.
I also have nolock and sync in my mount options.

Kind regards

Guy

--
______________________________________________________________________  

  Guy Van Sanden
  http://unixmafia.port5.com  

  Registered Linux user #249404 - September 1997
______________________________________________________________________

--
gentoo-u...@gentoo.org mailing list


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
4.  Simon Roby  
View profile  
 More options Jun 25 2004, 3:30 pm
Newsgroups: linux.gentoo.user
From: Simon Roby <shamb...@hotmail.com>
Date: Fri, 25 Jun 2004 21:30:23 +0200
Local: Fri, Jun 25 2004 3:30 pm
Subject: Re: [gentoo-user] NFS server perfomance tuning
On June 25, 2004 0326, Guy Van Sanden wrote:

> Thanks Lukas

> I have those in already, and it helped a little, but NFS keeps
> underperfoming scp by a long shot.
> I also have nolock and sync in my mount options.

Use 'async' for maximum NFS performance. 'sync' is the (slower) default.

--
gentoo-u...@gentoo.org mailing list


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
5.  Guy Van Sanden  
View profile  
 More options Jun 27 2004, 5:40 am
Newsgroups: linux.gentoo.user
From: Guy Van Sanden <n...@myrealbox.com>
Date: Sun, 27 Jun 2004 11:40:08 +0200
Local: Sun, Jun 27 2004 5:40 am
Subject: Re: [gentoo-user] NFS server perfomance tuning
Is async much more dangerous in terms of loosing data on a server crash
(loss of power etc)?

On Fri, 2004-06-25 at 21:28, Simon Roby wrote:
> On June 25, 2004 0326, Guy Van Sanden wrote:
> > Thanks Lukas

> > I have those in already, and it helped a little, but NFS keeps
> > underperfoming scp by a long shot.
> > I also have nolock and sync in my mount options.

> Use 'async' for maximum NFS performance. 'sync' is the (slower) default.

> --
> gentoo-u...@gentoo.org mailing list

--
______________________________________________________________________  

  Guy Van Sanden
  http://unixmafia.port5.com  

  Registered Linux user #249404 - September 1997
______________________________________________________________________

--
gentoo-u...@gentoo.org mailing list


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
6.  Jerry McBride  
View profile  
 More options Jun 23 2004, 5:00 pm
Newsgroups: linux.gentoo.user
From: Jerry McBride <mcbrid...@comcast.net>
Date: Wed, 23 Jun 2004 23:00:20 +0200
Local: Wed, Jun 23 2004 5:00 pm
Subject: Re: [gentoo-user] NFS server perfomance tuning
On Wednesday 23 June 2004 04:12 pm, Guy Van Sanden wrote:

> I'm running an NFS server on Gentoo (2.4).
> Compared to for example scp, my nfs connections are terribly slow (6-7
> minutes for the same operation that takes 3 minutes on scp).
> Are there some settings I can tweak to speed things up?

> I already increased the number of nfsd processes to 16.

> Thanks

> Guy

See /etc/conf.d/nfs and change rpcnfsdcount to what ever you want.

However, NFS is slow by nature. Even samba is light years faster.

--

*************************************************************************** ***
                     Registered Linux User Number 185956
              FSF Associate Member number 2340 since 05/20/2004
             Join me in chat at #linux-users on irc.freenode.net
    Buy an Xbox for $149.00, run linux on it and Microsoft loses $150.00!
     4:50pm  up 64 days, 19:32,  6 users,  load average: 0.10, 0.14, 0.09

--
gentoo-u...@gentoo.org mailing list


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
7.  Bryan Whitehead  
View profile  
 More options Jun 23 2004, 5:20 pm
Newsgroups: linux.gentoo.user
From: Bryan Whitehead <dri...@megahappy.net>
Date: Wed, 23 Jun 2004 23:20:10 +0200
Local: Wed, Jun 23 2004 5:20 pm
Subject: Re: [gentoo-user] NFS server perfomance tuning
What are you talking about? NFS is very fast!! The only limit is the
network card bandwidth.... (set asside GB as then the limit is the disk).

I can push 60-70Mbyte/sec over NFS between 2 linux machines on a GB
network... scp is the dog...

There is probably a duplex problem causing UDP packets to drop and hang
everything up (standard 2.4 does not have TCP NFS yet)...

--
Bryan Whitehead
Email:dri...@megahappy.net
WorkE:dri...@jpl.nasa.gov

--
gentoo-u...@gentoo.org mailing list


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
8.  Alan  
View profile  
 More options Jun 23 2004, 5:20 pm
Newsgroups: linux.gentoo.user
From: Alan <a...@ufies.org>
Date: Wed, 23 Jun 2004 23:20:10 +0200
Local: Wed, Jun 23 2004 5:20 pm
Subject: Re: [gentoo-user] NFS server perfomance tuning

Whoh there cowboy!  I have to respectfully disagree there.  I did some
tuning with NFS a while back and managed to get bursts of 80mb/s with
average about 60mb/s, compared to 30mb/s for samba.

Really informal and q&d benchmarks below.  I didn't bother with using
nload or whatever to get the mb/s because there can be variables due to
tcp vs udp frame sizes or something.  I'll let the time show for itself.
------------------------------------------------------
NFS:
-rw-rw-r--  1 root portage 35092228 Jun 15 23:01 linux-2.6.7.tar.bz2
phoenix distfiles # time cp linux-2.6.7.tar.bz2 /shared/

real    0m4.441s
user    0m0.003s
sys     0m0.127s

(further copying of the same file, deleting it in between, had the
'real' time down to 3.182s)

SMB (copied the slightly smaller file to account for caching):
-rw-rw-r--  1 root portage 34896138 May  9 20:16 linux-2.6.6.tar.bz2
-rw-rw-r--  1 root portage 35092228 Jun 15 23:01 linux-2.6.7.tar.bz2
phoenix distfiles # time cp linux-2.6.6.tar.bz2 /mnt/smb/naked/shared/

real    0m5.900s
user    0m0.003s
sys     0m0.338s

(further copying of the same file, deleting it in between, had the
'real' time remaining around 5.4s)
------------------------------------------------------
The secret I found was using async option instead of sync (default) and
tcp instead of udp.  

------------------------------------------------------
/etc/exports on server (naked):
/mnt/share/shared 192.168.N.0/24(all_squash,rw,async,secure,nohide,anonuid=65534,anongid=6553 3)

kernel config on server (naked):
CONFIG_NFS_FS=m
CONFIG_NFS_V3=y
# CONFIG_NFS_V4 is not set
CONFIG_NFS_DIRECTIO=y
CONFIG_NFSD=m
CONFIG_NFSD_V3=y
# CONFIG_NFSD_V4 is not set
CONFIG_NFSD_TCP=y

/etc/fstab on client (phoenix):
naked:/mnt/share/shared /mnt/nfs/shared  nfs defaults,auto,soft,rsize=8192,wsize=8192,bg,posix,nosuid,intr,tcp 0 0

kernel config on client (phoenix):
CONFIG_NFS_FS=m
CONFIG_NFS_V3=y
# CONFIG_NFS_V4 is not set
# CONFIG_NFS_DIRECTIO is not set
CONFIG_NFSD=m
CONFIG_NFSD_V3=y
# CONFIG_NFSD_V4 is not set
CONFIG_NFSD_TCP=y
------------------------------------------------------

No changes made to /etc/conf.d/nfs

Things might not be the same for others, but I found SIGNIFICANT
increases going from the default UDP to TCP, it also took far less CPU
under TCP than UDP.  Hope this info helps others.

alan

--
Alan <a...@ufies.org> - http://arcterex.net
--------------------------------------------------------------------
"There are only 3 real sports: bull-fighting, car racing and mountain
climbing. All the others are mere games."                -- Hemingway

--
gentoo-u...@gentoo.org mailing list


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
9.  Norbert Kamenicky  
View profile  
 More options Jun 23 2004, 5:40 pm
Newsgroups: linux.gentoo.user
From: Norbert Kamenicky <n...@xmedia.sk>
Date: Wed, 23 Jun 2004 23:40:07 +0200
Local: Wed, Jun 23 2004 5:40 pm
Subject: Re: [gentoo-user] NFS server perfomance tuning
Jerry McBride wrote:

  > However, NFS is slow by nature. Even samba is light years faster.

Why are u spreading this nonsence ? Are u working for Bill the devil ?

--
gentoo-u...@gentoo.org mailing list


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
10.  Eric Paynter  
View profile  
 More options Jun 23 2004, 6:20 pm
Newsgroups: linux.gentoo.user
From: "Eric Paynter" <e...@arcticbears.com>
Date: Thu, 24 Jun 2004 00:20:08 +0200
Local: Wed, Jun 23 2004 6:20 pm
Subject: Re: [gentoo-user] NFS server perfomance tuning
On Wed, June 23, 2004 2:32 pm, Norbert Kamenicky said:

> Bill the devil

lol!

--
gentoo-u...@gentoo.org mailing list


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2010 Google