vmo -a | egrep "lru|max"

You probably want to set lru_file_repage=0 ..

Rgds
Mark Taylor

On Jul 3, 4:06*pm, Mark Taylor wrote:
> vmo -a | egrep "lru|max"
>
> You probably want to set lru_file_repage=0 ..
>
> Rgds
> Mark Taylor

Thanks for the reply, I've attached the output of the vmo command
below, the lru_file_repage is already and has been for a wee while,
set to 0

lru_file_repage = 0
lru_poll_interval = 10
lrubucket = 131072
maxclient% = 90
maxfree = 1088
maxperm = 1355915
maxperm% = 90
maxpin = 1269952
maxpin% = 80
npsrpgmax = 196608
npsscrubmax = 196608
strict_maxclient = 1
strict_maxperm = 0


Any other pointers gratefully received

Regards

Ken

On 07/04/2008 11:46 AM, summeken@googlemail.com wrote:
> On Jul 3, 4:06 pm, Mark Taylor wrote:
>> vmo -a | egrep "lru|max"
>>
>> You probably want to set lru_file_repage=0 ..
>>
>> Rgds
>> Mark Taylor
>
> Thanks for the reply, I've attached the output of the vmo command
> below, the lru_file_repage is already and has been for a wee while,
> set to 0

What applications are running on the server?

lru_file_repage=0 makes sense for a dedicated RDBMS server.

You should also capture / post output of the following when you are
seeing the paging problem:

vmstat -v|grep perm
svmon -G
sar -q (if available)

cheers
Niel

On Jul 4, 1:15*pm, Niel Lambrechts wrote:
> On 07/04/2008 11:46 AM, summe...@googlemail.com wrote:
>
> > On Jul 3, 4:06 pm, Mark Taylor wrote:
> >> vmo -a | egrep "lru|max"
>
> >> You probably want to set lru_file_repage=0 ..
>
> >> Rgds
> >> Mark Taylor
>
> > Thanks for the reply, I've attached the output of the vmo command
> > below, the lru_file_repage is already and has been for a wee while,
> > set to 0
>
> What applications are running on the server?
>
> lru_file_repage=0 makes sense for a dedicated RDBMS server.
>
> You should also capture / post output of the following when you are
> seeing the paging problem:
>
> vmstat -v|grep perm
> svmon -G
> sar -q (if available)
>
> cheers
> Niel

Again, thanks for replying,

The LPAR is hosting Websphere Application Server

output as requested

vmstat -v|grep perm
5.0 minperm percentage
90.0 maxperm percentage
27.7 numperm percentage

svmon -G

size inuse free pin virtual
memory 1572864 1558268 14596 232662 1114842
pg space 3145728 3838

work pers clnt
pin 232662 0 0
in use 1114842 429835 13591

sar -q

AIX rs6pap01_grn 3 5 00C8407B4C00 07/07/08

System configuration: lcpu=4

00:00:00 runq-sz %runocc swpq-sz %swpocc
00:15:00 2.0 12 1.0 4
00:30:00 2.4 12 1.0 3
00:45:00 2.1 9 1.0 3
01:00:00 2.3 9 1.0 4
01:15:00 2.0 29 1.1 8
01:30:00 2.2 12 1.0 3
01:45:00 2.5 11 1.1 4
02:00:00 2.1 9 1.0 3
02:15:00 2.2 11 1.0 4
02:30:00 2.7 7 1.0 3
02:45:00 2.1 9 1.1 3
03:00:00 1.7 28 1.2 11
03:15:00 2.3 10 1.0 4
03:30:00 1.9 10 1.0 3
03:45:01 2.1 10 1.0 3
04:00:01 1.8 9 1.1 3
04:15:01 2.1 12 1.1 3
04:30:01 2.5 11 1.0 3
04:45:01 1.9 9 1.0 3
05:00:00 2.5 11 1.0 3
05:15:00 2.2 11 1.0 3
05:30:00 2.2 10 1.1 3
05:45:01 1.9 12 1.0 4
06:00:00 2.1 11 1.0 3
06:15:00 1.8 11 1.0 3
06:30:00 3.0 9 1.1 3
06:45:00 1.9 10 1.0 4
07:00:00 2.3 9 1.0 4
07:15:00 2.4 21 1.0 31
07:30:00 2.2 22 1.6 20
07:45:00 2.4 29 1.1 16
08:00:00 2.8 19 1.1 4
08:15:00 2.8 20 1.2 4
08:30:00 3.1 21 1.0 4
08:45:00 3.5 32 1.0 4
09:00:00 3.2 38 1.0 4
09:15:01 3.5 44 1.1 37
09:30:01 3.3 44 1.5 19

Average 2.5 16 1.1 7


Anything else I can supply?

As indicated earlier, all I really want to do is understand what is
causing this (to me) strange paging activity, I can then go to our
developer types and and capacity team to let them know. We might even
justify the addition of more memory.

Thanks in advance.

Ken

On Jul 7, 10:45 am, summe...@googlemail.com wrote:
> On Jul 4, 1:15 pm, Niel Lambrechts wrote:
>
>
>
> > On 07/04/2008 11:46 AM, summe...@googlemail.com wrote:
>
> > > On Jul 3, 4:06 pm, Mark Taylor wrote:
> > >> vmo -a | egrep "lru|max"
>
> > >> You probably want to set lru_file_repage=0 ..
>
> > >> Rgds
> > >> Mark Taylor
>
> > > Thanks for the reply, I've attached the output of the vmo command
> > > below, the lru_file_repage is already and has been for a wee while,
> > > set to 0
>
> > What applications are running on the server?
>
> > lru_file_repage=0 makes sense for a dedicated RDBMS server.
>
> > You should also capture / post output of the following when you are
> > seeing the paging problem:
>
> > vmstat -v|grep perm
> > svmon -G
> > sar -q (if available)
>
> > cheers
> > Niel
>
> Again, thanks for replying,
>
> The LPAR is hosting Websphere Application Server
>
> output as requested
>
> vmstat -v|grep perm
> 5.0 minperm percentage
> 90.0 maxperm percentage
> 27.7 numperm percentage
>
> svmon -G
>
> size inuse free pin virtual
> memory 1572864 1558268 14596 232662 1114842
> pg space 3145728 3838
>
> work pers clnt
> pin 232662 0 0
> in use 1114842 429835 13591
>
> sar -q
>
> AIX rs6pap01_grn 3 5 00C8407B4C00 07/07/08
>
> System configuration: lcpu=4
>
> 00:00:00 runq-sz %runocc swpq-sz %swpocc
> 00:15:00 2.0 12 1.0 4
> 00:30:00 2.4 12 1.0 3
> 00:45:00 2.1 9 1.0 3
> 01:00:00 2.3 9 1.0 4
> 01:15:00 2.0 29 1.1 8
> 01:30:00 2.2 12 1.0 3
> 01:45:00 2.5 11 1.1 4
> 02:00:00 2.1 9 1.0 3
> 02:15:00 2.2 11 1.0 4
> 02:30:00 2.7 7 1.0 3
> 02:45:00 2.1 9 1.1 3
> 03:00:00 1.7 28 1.2 11
> 03:15:00 2.3 10 1.0 4
> 03:30:00 1.9 10 1.0 3
> 03:45:01 2.1 10 1.0 3
> 04:00:01 1.8 9 1.1 3
> 04:15:01 2.1 12 1.1 3
> 04:30:01 2.5 11 1.0 3
> 04:45:01 1.9 9 1.0 3
> 05:00:00 2.5 11 1.0 3
> 05:15:00 2.2 11 1.0 3
> 05:30:00 2.2 10 1.1 3
> 05:45:01 1.9 12 1.0 4
> 06:00:00 2.1 11 1.0 3
> 06:15:00 1.8 11 1.0 3
> 06:30:00 3.0 9 1.1 3
> 06:45:00 1.9 10 1.0 4
> 07:00:00 2.3 9 1.0 4
> 07:15:00 2.4 21 1.0 31
> 07:30:00 2.2 22 1.6 20
> 07:45:00 2.4 29 1.1 16
> 08:00:00 2.8 19 1.1 4
> 08:15:00 2.8 20 1.2 4
> 08:30:00 3.1 21 1.0 4
> 08:45:00 3.5 32 1.0 4
> 09:00:00 3.2 38 1.0 4
> 09:15:01 3.5 44 1.1 37
> 09:30:01 3.3 44 1.5 19
>
> Average 2.5 16 1.1 7
>
> Anything else I can supply?
>
> As indicated earlier, all I really want to do is understand what is
> causing this (to me) strange paging activity, I can then go to our
> developer types and and capacity team to let them know. We might even
> justify the addition of more memory.
>
> Thanks in advance.
>
> Ken


I would say that this is rather normal. AIX is discarding filecache
pages from memory to be used for application usage.
And since it's filecache it's not beeing paged to pageingspace and
therefore no pagein.

//Jesper

On Jul 11, 12:28*pm, JesperBergh wrote:
> On Jul 7, 10:45 am, summe...@googlemail.com wrote:
>
>
>
>
>
> > On Jul 4, 1:15 pm, Niel Lambrechts wrote:
>
> > > On 07/04/2008 11:46 AM, summe...@googlemail.com wrote:
>
> > > > On Jul 3, 4:06 pm, Mark Taylor wrote:
> > > >> vmo -a | egrep "lru|max"
>
> > > >> You probably want to set lru_file_repage=0 ..
>
> > > >> Rgds
> > > >> Mark Taylor
>
> > > > Thanks for the reply, I've attached the output of the vmo command
> > > > below, the lru_file_repage is already and has been for a wee while,
> > > > set to 0
>
> > > What applications are running on the server?
>
> > > lru_file_repage=0 makes sense for a dedicated RDBMS server.
>
> > > You should also capture / post output of the following when you are
> > > seeing the paging problem:
>
> > > vmstat -v|grep perm
> > > svmon -G
> > > sar -q (if available)
>
> > > cheers
> > > Niel
>
> > Again, thanks for replying,
>
> > The LPAR is hosting Websphere Application Server
>
> > output as requested
>
> > *vmstat -v|grep perm
> > *5.0 minperm percentage
> > *90.0 maxperm percentage
> > *27.7 numperm percentage
>
> > svmon -G
>
> > * * * * * * * *size * * *inuse * * * free * * * *pin * *virtual
> > memory * * *1572864 * *1558268 * * *14596 * * 232662 * *1114842
> > pg space * *3145728 * * * 3838
>
> > * * * * * * * *work * * * pers * * * clnt
> > pin * * * * *232662 * * * * *0 * * * * *0
> > in use * * *1114842 * * 429835 * * *13591
>
> > sar -q
>
> > AIX rs6pap01_grn 3 5 00C8407B4C00 * *07/07/08
>
> > System configuration: lcpu=4
>
> > 00:00:00 runq-sz %runocc swpq-sz %swpocc
> > 00:15:00 * * 2.0 * * *12 * * 1.0 * * * 4
> > 00:30:00 * * 2.4 * * *12 * * 1.0 * * * 3
> > 00:45:00 * * 2.1 * * * 9 * * 1.0 * * * 3
> > 01:00:00 * * 2.3 * * * 9 * * 1.0 * * * 4
> > 01:15:00 * * 2.0 * * *29 * * 1.1 * * * 8
> > 01:30:00 * * 2.2 * * *12 * * 1.0 * * * 3
> > 01:45:00 * * 2.5 * * *11 * * 1.1 * * * 4
> > 02:00:00 * * 2.1 * * * 9 * * 1.0 * * * 3
> > 02:15:00 * * 2.2 * * *11 * * 1.0 * * * 4
> > 02:30:00 * * 2.7 * * * 7 * * 1.0 * * * 3
> > 02:45:00 * * 2.1 * * * 9 * * 1.1 * * * 3
> > 03:00:00 * * 1.7 * * *28 * * 1.2 * * *11
> > 03:15:00 * * 2.3 * * *10 * * 1.0 * * * 4
> > 03:30:00 * * 1.9 * * *10 * * 1.0 * * * 3
> > 03:45:01 * * 2.1 * * *10 * * 1.0 * * * 3
> > 04:00:01 * * 1.8 * * * 9 * * 1.1 * * * 3
> > 04:15:01 * * 2.1 * * *12 * * 1.1 * * * 3
> > 04:30:01 * * 2.5 * * *11 * * 1.0 * * * 3
> > 04:45:01 * * 1.9 * * * 9 * * 1.0 * * * 3
> > 05:00:00 * * 2.5 * * *11 * * 1.0 * * * 3
> > 05:15:00 * * 2.2 * * *11 * * 1.0 * * * 3
> > 05:30:00 * * 2.2 * * *10 * * 1.1 * * * 3
> > 05:45:01 * * 1.9 * * *12 * * 1.0 * * * 4
> > 06:00:00 * * 2.1 * * *11 * * 1.0 * * * 3
> > 06:15:00 * * 1.8 * * *11 * * 1.0 * * * 3
> > 06:30:00 * * 3.0 * * * 9 * * 1.1 * * * 3
> > 06:45:00 * * 1.9 * * *10 * * 1.0 * * * 4
> > 07:00:00 * * 2.3 * * * 9 * * 1.0 * * * 4
> > 07:15:00 * * 2.4 * * *21 * * 1.0 * * *31
> > 07:30:00 * * 2.2 * * *22 * * 1.6 * * *20
> > 07:45:00 * * 2.4 * * *29 * * 1.1 * * *16
> > 08:00:00 * * 2.8 * * *19 * * 1.1 * * * 4
> > 08:15:00 * * 2.8 * * *20 * * 1.2 * * * 4
> > 08:30:00 * * 3.1 * * *21 * * 1.0 * * * 4
> > 08:45:00 * * 3.5 * * *32 * * 1.0 * * * 4
> > 09:00:00 * * 3.2 * * *38 * * 1.0 * * * 4
> > 09:15:01 * * 3.5 * * *44 * * 1.1 * * *37
> > 09:30:01 * * 3.3 * * *44 * * 1.5 * * *19
>
> > Average * * *2.5 * * *16 * * 1.1 * * * 7
>
> > Anything else I can supply?
>
> > As indicated earlier, all I really want to do is understand what is
> > causing this (to me) strange paging activity, I can then go to our
> > developer types and and capacity team to let them know. We might even
> > justify the addition of more memory.
>
> > Thanks in advance.
>
> > Ken
>
> I would say that this is rather normal. AIX is discarding filecache
> pages from memory to be used for application usage.
> And since it's filecache it's not beeing paged to pageingspace and
> therefore no pagein.
>
> //Jesper- Hide quoted text -
>
> - Show quoted text -


Thanks for replying (apologies for the delay in response, other things
and continuing to monitor).

In our case we see this paging activity (using nmon) as paging to
paging space not to file system, and we have never seen in subsequent
page in activity.
I should point out that if there is any performance implications they
are not being reported, this was only spotted as part of our normal
monitoring and we can't explain why there is all this page out (to
paging space according to nmon) activity without any other paging
activity.

Thanks for taking the time to reply.

Ken

its not fs cache .. po is pages paging out to paging space ..

Your avm is 4.5GB'ish, so you should be ok with lru_file_repage=0 ..
someone hasnt set defps=0 have they ? or set PSALLOC ? are you running
bespoke Java apps ? sometimes Java devlopers set some weird stuff that
causes paging .. ah, just seen WAS in your post above .. check with
the devlopers to see what they have been doing with paging space
allocation for thier apps ..

Rgds
Mark Taylor

On Jul 16, 10:27*am, Mark Taylor wrote:
> its not fs cache .. po is pages paging out to paging space ..
>
> Your avm is 4.5GB'ish, so you should be ok with lru_file_repage=0 ..
> someone hasnt set defps=0 have they ? or set PSALLOC ? are you running
> bespoke Java apps ? sometimes Java devlopers set some weird stuff that
> causes paging .. ah, just seen WAS in your post above .. check with
> the devlopers to see what they have been doing with paging space
> allocation for thier apps ..
>
> Rgds
> Mark Taylor

Again, thanks for replying
defps=1, PSALLOC is not set (as far as I can discover)
We are coming to the same conclusion, the 'problem' is something to do
with Java, this is a WAS box, with lots of bespoke code, we're already
talking to our developer types to see if they'll admit to anything.

Thanks for taking the time to reply.

Ken