Am I running out of perm space since its always 99% used? - Websphere

This is a discussion on Am I running out of perm space since its always 99% used? - Websphere ; Running Websphere 5.1.1.13 on Unix Sun 5.8 with 2 cpus 2 gig ram using Sun JVM 1.4 Running applciation that has a calc process that runs on app server that is taking 30 mins regardless of whether we cut data ...

+ Reply to Thread
Results 1 to 3 of 3

Thread: Am I running out of perm space since its always 99% used?

  1. Am I running out of perm space since its always 99% used?

    Running Websphere 5.1.1.13 on Unix Sun 5.8 with 2 cpus 2 gig ram using Sun JVM
    1.4

    Running applciation that has a calc process that runs on app server that is
    taking 30 mins regardless of whether we cut data range, should take 4-5 mins.
    Adding more memory to the Xmx settings has no effect.

    Did a verobse garbage collections and saw the following

    compacting perm gen total 39168K, used 39009K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7218410, 0xf7218600,
    0xf7240000)

    Perm gen space is always at 99% used never changes, number of k changes but
    always 99%. Is this normal for the perm space? Using system default.

    also eden always goes from 99% used to 0% after first GC

    here is the log file


    0.000: [Full GC {Heap before GC invocations=0:
    Heap
    def new generation total 802816K, used 16853K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 2% used [0x74c00000, 0x75c75670, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 0K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xacc00000, 0xacc00200,
    0xf4c00000)
    compacting perm gen total 8192K, used 8191K [0xf4c00000, 0xf5400000,
    0xf8c00000)
    the space 8192K, 99% used [0xf4c00000, 0xf53ffff0, 0xf5400000, 0xf5400000)
    0.013: [Tenured: 0K->862K(1179648K), 0.1584514 secs] 16853K->862K(1982464K),
    [Perm : 8191K->8191K(8192K)] Heap after GC invocations=1:
    Heap
    def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 862K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xaccd79f0, 0xaccd7a00,
    0xf4c00000)
    compacting perm gen total 8192K, used 8191K [0xf4c00000, 0xf5400000,
    0xf8c00000)
    the space 8192K, 99% used [0xf4c00000, 0xf53ffff0, 0xf5400000, 0xf5400000)
    } , 0.1721542 secs]
    1.005: [Full GC {Heap before GC invocations=1:
    Heap
    def new generation total 802816K, used 9813K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 1% used [0x74c00000, 0x755956b8, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 862K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xaccd79f0, 0xaccd7a00,
    0xf4c00000)
    compacting perm gen total 12288K, used 12287K [0xf4c00000, 0xf5800000,
    0xf8c00000)
    the space 12288K, 99% used [0xf4c00000, 0xf57fff70, 0xf5800000,
    0xf5800000)
    1.006: [Tenured: 862K->1306K(1179648K), 0.2251506 secs]
    10676K->1306K(1982464K), [Perm : 12287K->12287K(12288K)] Heap after GC
    invocations=2:
    Heap
    def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 1306K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xacd46938, 0xacd46a00,
    0xf4c00000)
    compacting perm gen total 12288K, used 12287K [0xf4c00000, 0xf5800000,
    0xf8c00000)
    the space 12288K, 99% used [0xf4c00000, 0xf57fff70, 0xf5800000,
    0xf5800000)
    } , 0.2260271 secs]
    2.432: [Full GC {Heap before GC invocations=2:
    Heap
    def new generation total 802816K, used 12945K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 1% used [0x74c00000, 0x758a46c8, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 1306K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xacd46938, 0xacd46a00,
    0xf4c00000)
    compacting perm gen total 16384K, used 16383K [0xf4c00000, 0xf5c00000,
    0xf8c00000)
    the space 16384K, 99% used [0xf4c00000, 0xf5bffff8, 0xf5c00000,
    0xf5c00000)
    2.433: [Tenured: 1306K->2077K(1179648K), 0.2939680 secs]
    14252K->2077K(1982464K), [Perm : 16383K->16383K(16384K)] Heap after GC
    invocations=3:
    Heap
    def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 2077K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xace07550, 0xace07600,
    0xf4c00000)
    compacting perm gen total 16384K, used 16383K [0xf4c00000, 0xf5c00000,
    0xf8c00000)
    the space 16384K, 99% used [0xf4c00000, 0xf5bffff8, 0xf5c00000,
    0xf5c00000)
    } , 0.2948505 secs]
    3.655: [Full GC {Heap before GC invocations=3:
    Heap
    def new generation total 802816K, used 10621K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 1% used [0x74c00000, 0x7565f528, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 2077K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xace07550, 0xace07600,
    0xf4c00000)
    compacting perm gen total 20480K, used 20479K [0xf4c00000, 0xf6000000,
    0xf8c00000)
    the space 20480K, 99% used [0xf4c00000, 0xf5ffffb8, 0xf6000000,
    0xf6000000)
    3.656: [Tenured: 2077K->1970K(1179648K), 0.5016663 secs]
    12698K->1970K(1982464K), [Perm : 20479K->20442K(20480K)] Heap after GC
    invocations=4:
    Heap
    def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 1970K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xacdec9b8, 0xacdeca00,
    0xf4c00000)
    compacting perm gen total 20480K, used 20442K [0xf4c00000, 0xf6000000,
    0xf8c00000)
    the space 20480K, 99% used [0xf4c00000, 0xf5ff6960, 0xf5ff6a00,
    0xf6000000)
    } , 0.5027088 secs]
    6.673: [Full GC {Heap before GC invocations=4:
    Heap
    def new generation total 802816K, used 9580K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 1% used [0x74c00000, 0x7555b100, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 1970K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xacdec9b8, 0xacdeca00,
    0xf4c00000)
    compacting perm gen total 24576K, used 24575K [0xf4c00000, 0xf6400000,
    0xf8c00000)
    the space 24576K, 99% used [0xf4c00000, 0xf63ffff0, 0xf6400000,
    0xf6400000)
    6.674: [Tenured: 1970K->3152K(1179648K), 0.4940012 secs]
    11550K->3152K(1982464K), [Perm : 24575K->24575K(24576K)] Heap after GC
    invocations=5:
    Heap
    def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 3152K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xacf14390, 0xacf14400,
    0xf4c00000)
    compacting perm gen total 24576K, used 24575K [0xf4c00000, 0xf6400000,
    0xf8c00000)
    the space 24576K, 99% used [0xf4c00000, 0xf63ffff0, 0xf6400000,
    0xf6400000)
    } , 0.4948833 secs]
    11.193: [Full GC {Heap before GC invocations=5:
    Heap
    def new generation total 802816K, used 19193K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 2% used [0x74c00000, 0x75ebe618, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 3152K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xacf14390, 0xacf14400,
    0xf4c00000)
    compacting perm gen total 28672K, used 28671K [0xf4c00000, 0xf6800000,
    0xf8c00000)
    the space 28672K, 99% used [0xf4c00000, 0xf67fffa8, 0xf6800000,
    0xf6800000)
    11.194: [Tenured: 3152K->6843K(1179648K), 0.6876721 secs]
    22346K->6843K(1982464K), [Perm : 28671K->28671K(28672K)] Heap after GC
    invocations=6:
    Heap
    def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 6843K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xad2aee78, 0xad2af000,
    0xf4c00000)
    compacting perm gen total 28672K, used 28671K [0xf4c00000, 0xf6800000,
    0xf8c00000)
    the space 28672K, 99% used [0xf4c00000, 0xf67fffa8, 0xf6800000,
    0xf6800000)
    } , 0.6892408 secs]
    23.597: [Full GC {Heap before GC invocations=6:
    Heap
    def new generation total 802816K, used 101111K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 14% used [0x74c00000, 0x7aebdf00, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 6843K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 0% used [0xacc00000, 0xad2aee78, 0xad2af000,
    0xf4c00000)
    compacting perm gen total 32768K, used 32768K [0xf4c00000, 0xf6c00000,
    0xf8c00000)
    the space 32768K, 100% used [0xf4c00000, 0xf6c00000, 0xf6c00000,
    0xf6c00000)
    23.602: [Tenured: 6843K->15921K(1179648K), 1.4730392 secs]
    107955K->15921K(1982464K), [Perm : 32768K->32768K(32768K)] Heap after GC
    invocations=7:
    Heap
    def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 15921K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 1% used [0xacc00000, 0xadb8c778, 0xadb8c800,
    0xf4c00000)
    compacting perm gen total 32768K, used 32768K [0xf4c00000, 0xf6c00000,
    0xf8c00000)
    the space 32768K, 100% used [0xf4c00000, 0xf6c00000, 0xf6c00000,
    0xf6c00000)
    } , 1.4781818 secs]
    2156.095: [Full GC {Heap before GC invocations=7:
    Heap
    def new generation total 802816K, used 151689K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 22% used [0x74c00000, 0x7e0224e8, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 15921K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 1% used [0xacc00000, 0xadb8c778, 0xadb8c800,
    0xf4c00000)
    compacting perm gen total 36864K, used 36862K [0xf4c00000, 0xf7000000,
    0xf8c00000)
    the space 36864K, 99% used [0xf4c00000, 0xf6fffaa8, 0xf6fffc00,
    0xf7000000)
    2156.102: [Tenured: 15921K->21133K(1179648K), 1.7472031 secs]
    167611K->21133K(1982464K), [Perm : 36862K->36829K(36864K)] Heap after GC
    invocations=8:
    Heap
    def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 21133K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 1% used [0xacc00000, 0xae0a3688, 0xae0a3800,
    0xf4c00000)
    compacting perm gen total 36864K, used 36829K [0xf4c00000, 0xf7000000,
    0xf8c00000)
    the space 36864K, 99% used [0xf4c00000, 0xf6ff7698, 0xf6ff7800,
    0xf7000000)
    } , 1.7555309 secs]
    2283.402: [GC {Heap before GC invocations=8:
    Heap
    def new generation total 802816K, used 688127K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebffde0, 0x9ec00000)
    from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 21133K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 1% used [0xacc00000, 0xae0a3688, 0xae0a3800,
    0xf4c00000)
    compacting perm gen total 38912K, used 38811K [0xf4c00000, 0xf7200000,
    0xf8c00000)
    the space 38912K, 99% used [0xf4c00000, 0xf71e6f90, 0xf71e7000,
    0xf7200000)
    2283.403: [DefNew: 688127K->80029K(802816K), 1.0793836 secs]
    709261K->101163K(1982464K) Heap after GC invocations=9:
    Heap
    def new generation total 802816K, used 80029K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 69% used [0xa5c00000, 0xaaa27788, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 21133K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 1% used [0xacc00000, 0xae0a3688, 0xae0a3800,
    0xf4c00000)
    compacting perm gen total 38912K, used 38811K [0xf4c00000, 0xf7200000,
    0xf8c00000)
    the space 38912K, 99% used [0xf4c00000, 0xf71e6f90, 0xf71e7000,
    0xf7200000)
    } , 1.0802494 secs]
    2556.902: [GC {Heap before GC invocations=9:
    Heap
    def new generation total 802816K, used 768157K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebffff0, 0x9ec00000)
    from space 114688K, 69% used [0xa5c00000, 0xaaa27788, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 21133K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 1% used [0xacc00000, 0xae0a3688, 0xae0a3800,
    0xf4c00000)
    compacting perm gen total 38912K, used 38857K [0xf4c00000, 0xf7200000,
    0xf8c00000)
    the space 38912K, 99% used [0xf4c00000, 0xf71f26d8, 0xf71f2800,
    0xf7200000)
    2556.903: [DefNew: 768157K->57374K(802816K), 1.5037351 secs]
    789291K->129910K(1982464K) Heap after GC invocations=10:
    Heap
    def new generation total 802816K, used 57374K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 50% used [0x9ec00000, 0xa2407878, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 72535K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 6% used [0xacc00000, 0xb12d5f88, 0xb12d6000,
    0xf4c00000)
    compacting perm gen total 38912K, used 38857K [0xf4c00000, 0xf7200000,
    0xf8c00000)
    the space 38912K, 99% used [0xf4c00000, 0xf71f26d8, 0xf71f2800,
    0xf7200000)
    } , 1.5047427 secs]
    2948.221: [GC {Heap before GC invocations=10:
    Heap
    def new generation total 802816K, used 745502K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebfffc8, 0x9ec00000)
    from space 114688K, 50% used [0x9ec00000, 0xa2407878, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 72535K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 6% used [0xacc00000, 0xb12d5f88, 0xb12d6000,
    0xf4c00000)
    compacting perm gen total 38912K, used 38860K [0xf4c00000, 0xf7200000,
    0xf8c00000)
    the space 38912K, 99% used [0xf4c00000, 0xf71f3030, 0xf71f3200,
    0xf7200000)
    2948.222: [DefNew: 745502K->17918K(802816K), 0.9751439 secs]
    818037K->133153K(1982464K) Heap after GC invocations=11:
    Heap
    def new generation total 802816K, used 17918K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 15% used [0xa5c00000, 0xa6d7f8d0, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 115235K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 9% used [0xacc00000, 0xb3c88d58, 0xb3c88e00,
    0xf4c00000)
    compacting perm gen total 38912K, used 38860K [0xf4c00000, 0xf7200000,
    0xf8c00000)
    the space 38912K, 99% used [0xf4c00000, 0xf71f3030, 0xf71f3200,
    0xf7200000)
    } , 0.9760031 secs]
    3120.413: [GC {Heap before GC invocations=11:
    Heap
    def new generation total 802816K, used 706046K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebfff68, 0x9ec00000)
    from space 114688K, 15% used [0xa5c00000, 0xa6d7f8d0, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 115235K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 9% used [0xacc00000, 0xb3c88d58, 0xb3c88e00,
    0xf4c00000)
    compacting perm gen total 39168K, used 38967K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf720df08, 0xf720e000,
    0xf7240000)
    3120.413: [DefNew: 706046K->68293K(802816K), 1.5127820 secs]
    821281K->183528K(1982464K) Heap after GC invocations=12:
    Heap
    def new generation total 802816K, used 68293K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 59% used [0x9ec00000, 0xa2eb1698, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 115235K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 9% used [0xacc00000, 0xb3c88d58, 0xb3c88e00,
    0xf4c00000)
    compacting perm gen total 39168K, used 38967K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf720df08, 0xf720e000,
    0xf7240000)
    } , 1.5136550 secs]
    3186.565: [GC {Heap before GC invocations=12:
    Heap
    def new generation total 802816K, used 756421K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebffff0, 0x9ec00000)
    from space 114688K, 59% used [0x9ec00000, 0xa2eb1698, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 115235K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 9% used [0xacc00000, 0xb3c88d58, 0xb3c88e00,
    0xf4c00000)
    compacting perm gen total 39168K, used 38997K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7215470, 0xf7215600,
    0xf7240000)
    3186.565: [DefNew: 756421K->10327K(802816K), 1.1199313 secs]
    871656K->175022K(1982464K) Heap after GC invocations=13:
    Heap
    def new generation total 802816K, used 10327K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 9% used [0xa5c00000, 0xa6615ff8, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 38997K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7215470, 0xf7215600,
    0xf7240000)
    } , 1.1208153 secs]
    3951.961: [GC {Heap before GC invocations=13:
    Heap
    def new generation total 802816K, used 698451K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebfee20, 0x9ec00000)
    from space 114688K, 9% used [0xa5c00000, 0xa6615ff8, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39009K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7218410, 0xf7218600,
    0xf7240000)
    3951.974: [DefNew: 698451K->14050K(802816K), 0.1505777 secs]
    863145K->178745K(1982464K) Heap after GC invocations=14:
    Heap
    def new generation total 802816K, used 14050K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 12% used [0x9ec00000, 0x9f9b8b08, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39009K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7218410, 0xf7218600,
    0xf7240000)
    } , 0.1635907 secs]
    3982.626: [GC {Heap before GC invocations=14:
    Heap
    def new generation total 802816K, used 702177K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebff9d8, 0x9ec00000)
    from space 114688K, 12% used [0x9ec00000, 0x9f9b8b08, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39036K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf721f100, 0xf721f200,
    0xf7240000)
    3982.627: [DefNew: 702177K->13567K(802816K), 0.1945802 secs]
    866871K->178261K(1982464K) Heap after GC invocations=15:
    Heap
    def new generation total 802816K, used 13567K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 11% used [0xa5c00000, 0xa693fdb0, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39036K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf721f100, 0xf721f200,
    0xf7240000)
    } , 0.1954354 secs]
    3997.123: [GC {Heap before GC invocations=15:
    Heap
    def new generation total 802816K, used 701693K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebff820, 0x9ec00000)
    from space 114688K, 11% used [0xa5c00000, 0xa693fdb0, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39038K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf721f9a8, 0xf721fa00,
    0xf7240000)
    3997.124: [DefNew: 701693K->3561K(802816K), 0.0587354 secs]
    866387K->168255K(1982464K) Heap after GC invocations=16:
    Heap
    def new generation total 802816K, used 3561K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 3% used [0x9ec00000, 0x9ef7a6b0, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39038K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf721f9a8, 0xf721fa00,
    0xf7240000)
    } , 0.0597378 secs]
    4104.193: [GC {Heap before GC invocations=16:
    Heap
    def new generation total 802816K, used 691689K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebfffd8, 0x9ec00000)
    from space 114688K, 3% used [0x9ec00000, 0x9ef7a6b0, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39060K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7225328, 0xf7225400,
    0xf7240000)
    4104.193: [DefNew: 691689K->81840K(802816K), 0.8434562 secs]
    856383K->246534K(1982464K) Heap after GC invocations=17:
    Heap
    def new generation total 802816K, used 81840K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 71% used [0xa5c00000, 0xaabec1f0, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39060K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7225328, 0xf7225400,
    0xf7240000)
    } , 0.8443356 secs]
    4285.776: [GC {Heap before GC invocations=17:
    Heap
    def new generation total 802816K, used 769968K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebfffd0, 0x9ec00000)
    from space 114688K, 71% used [0xa5c00000, 0xaabec1f0, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39074K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7228950, 0xf7228a00,
    0xf7240000)
    4285.777: [DefNew: 769968K->56806K(802816K), 1.2062011 secs]
    934662K->273912K(1982464K) Heap after GC invocations=18:
    Heap
    def new generation total 802816K, used 56806K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 49% used [0x9ec00000, 0xa2379a50, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 217106K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 18% used [0xacc00000, 0xba004858, 0xba004a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39074K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7228950, 0xf7228a00,
    0xf7240000)
    } , 1.2070780 secs]
    4557.069: [GC {Heap before GC invocations=18:
    Heap
    def new generation total 802816K, used 744933K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebffbb0, 0x9ec00000)
    from space 114688K, 49% used [0x9ec00000, 0xa2379a50, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 217106K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 18% used [0xacc00000, 0xba004858, 0xba004a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229010, 0xf7229200,
    0xf7240000)
    4557.070: [DefNew: 744933K->86620K(802816K), 0.9305466 secs]
    962039K->303727K(1982464K) Heap after GC invocations=19:
    Heap
    def new generation total 802816K, used 86620K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 75% used [0xa5c00000, 0xab0973c0, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 217106K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 18% used [0xacc00000, 0xba004858, 0xba004a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229010, 0xf7229200,
    0xf7240000)
    } , 0.9314256 secs]
    4938.863: [GC {Heap before GC invocations=19:
    Heap
    def new generation total 802816K, used 774748K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebffff8, 0x9ec00000)
    from space 114688K, 75% used [0xa5c00000, 0xab0973c0, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 217106K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 18% used [0xacc00000, 0xba004858, 0xba004a00,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229098, 0xf7229200,
    0xf7240000)
    4938.863: [DefNew: 774748K->19649K(802816K), 1.0088472 secs]
    991855K->280050K(1982464K) Heap after GC invocations=20:
    Heap
    def new generation total 802816K, used 19649K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 17% used [0x9ec00000, 0x9ff30478, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229098, 0xf7229200,
    0xf7240000)
    } , 1.0097098 secs]
    5324.768: [GC {Heap before GC invocations=20:
    Heap
    def new generation total 802816K, used 707773K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebff328, 0x9ec00000)
    from space 114688K, 17% used [0x9ec00000, 0x9ff30478, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229120, 0xf7229200,
    0xf7240000)
    5324.769: [DefNew: 707773K->20454K(802816K), 0.7317651 secs]
    968175K->280855K(1982464K) Heap after GC invocations=21:
    Heap
    def new generation total 802816K, used 20454K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 17% used [0xa5c00000, 0xa6ff98f8, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229120, 0xf7229200,
    0xf7240000)
    } , 0.7332405 secs]
    5665.834: [GC {Heap before GC invocations=21:
    Heap
    def new generation total 802816K, used 708582K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebfffe0, 0x9ec00000)
    from space 114688K, 17% used [0xa5c00000, 0xa6ff98f8, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229338, 0xf7229400,
    0xf7240000)
    5665.835: [DefNew: 708582K->106693K(802816K), 2.2014550 secs]
    968983K->367094K(1982464K) Heap after GC invocations=22:
    Heap
    def new generation total 802816K, used 106693K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 93% used [0x9ec00000, 0xa54316a0, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229338, 0xf7229400,
    0xf7240000)
    } , 2.2023328 secs]
    5749.002: [GC {Heap before GC invocations=22:
    Heap
    def new generation total 802816K, used 794821K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebffff8, 0x9ec00000)
    from space 114688K, 93% used [0x9ec00000, 0xa54316a0, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229378, 0xf7229400,
    0xf7240000)
    5749.002: [DefNew: 794821K->29936K(802816K), 2.4289501 secs]
    1055222K->382280K(1982464K) Heap after GC invocations=23:
    Heap
    def new generation total 802816K, used 29936K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 26% used [0xa5c00000, 0xa793c3a0, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 352343K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 29% used [0xacc00000, 0xc2415f90, 0xc2416000,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229378, 0xf7229400,
    0xf7240000)
    } , 2.4298457 secs]
    5835.362: [GC {Heap before GC invocations=23:
    Heap
    def new generation total 802816K, used 718064K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 99% used [0x74c00000, 0x9ebfffc0, 0x9ec00000)
    from space 114688K, 26% used [0xa5c00000, 0xa793c3a0, 0xacc00000)
    to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    tenured generation total 1179648K, used 352343K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 29% used [0xacc00000, 0xc2415f90, 0xc2416000,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229388, 0xf7229400,
    0xf7240000)
    5835.363: [DefNew: 718064K->58149K(802816K), 1.1834101 secs]
    1070408K->410493K(1982464K) Heap after GC invocations=24:
    Heap
    def new generation total 802816K, used 58149K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    from space 114688K, 50% used [0x9ec00000, 0xa24c9588, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 352343K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 29% used [0xacc00000, 0xc2415f90, 0xc2416000,
    0xf4c00000)
    compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    0xf8c00000)
    the space 39168K, 99% used [0xf4c00000, 0xf7229388, 0xf7229400,
    0xf7240000)
    } , 1.1842837 secs]
    6732.782: [Full GC {Heap before GC invocations=24:
    Heap
    def new generation total 802816K, used 593584K [0x74c00000, 0xacc00000,
    0xacc00000)
    eden space 688128K, 77% used [0x74c00000, 0x956e2da0, 0x9ec00000)
    from space 114688K, 50% used [0x9ec00000, 0xa24c9588, 0xa5c00000)
    to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    tenured generation total 1179648K, used 352343K [0xacc00000, 0xf4c00000,
    0xf4c00000)
    the space 1179648K, 29% used [0xacc00000, 0xc2415f90, 0xc2416000,
    0xf4c00000)
    compacting perm gen total 39680K, used 39574K [0xf4c00000, 0xf72c0000,
    0xf8c00000)
    the space 39680K, 99% used [0xf4c00000, 0xf72a5a30, 0xf72a5c00,
    0xf72c0000)
    6732.787: [Tenured[Unloading class sun.reflect.GeneratedFieldAccessor12]

  2. Re: Am I running out of perm space since its always 99% used?

    On Apr 25, 9:59 pm, mist...@mail.com (Mistton) wrote:
    > Running Websphere 5.1.1.13 on Unix Sun 5.8 with 2 cpus 2 gig ram using Sun JVM
    > 1.4
    >
    > Running applciation that has a calc process that runs on app server that is
    > taking 30 mins regardless of whether we cut data range, should take 4-5 mins.
    > Adding more memory to the Xmx settings has no effect.
    >
    > Did a verobse garbage collections and saw the following
    >
    > compacting perm gen total 39168K, used 39009K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7218410, 0xf7218600,
    > 0xf7240000)
    >
    > Perm gen space is always at 99% used never changes, number of k changes but
    > always 99%. Is this normal for the perm space? Using system default.
    >
    > also eden always goes from 99% used to 0% after first GC
    >
    > here is the log file
    >
    > 0.000: [Full GC {Heap before GC invocations=0:
    > Heap
    > def new generation total 802816K, used 16853K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 2% used [0x74c00000, 0x75c75670, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 0K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xacc00000, 0xacc00200,
    > 0xf4c00000)
    > compacting perm gen total 8192K, used 8191K [0xf4c00000, 0xf5400000,
    > 0xf8c00000)
    > the space 8192K, 99% used [0xf4c00000, 0xf53ffff0, 0xf5400000, 0xf5400000)
    > 0.013: [Tenured: 0K->862K(1179648K), 0.1584514 secs] 16853K->862K(1982464K),
    > [Perm : 8191K->8191K(8192K)] Heap after GC invocations=1:
    > Heap
    > def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 862K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xaccd79f0, 0xaccd7a00,
    > 0xf4c00000)
    > compacting perm gen total 8192K, used 8191K [0xf4c00000, 0xf5400000,
    > 0xf8c00000)
    > the space 8192K, 99% used [0xf4c00000, 0xf53ffff0, 0xf5400000, 0xf5400000)} , 0.1721542 secs]
    >
    > 1.005: [Full GC {Heap before GC invocations=1:
    > Heap
    > def new generation total 802816K, used 9813K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 1% used [0x74c00000, 0x755956b8, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 862K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xaccd79f0, 0xaccd7a00,
    > 0xf4c00000)
    > compacting perm gen total 12288K, used 12287K [0xf4c00000, 0xf5800000,
    > 0xf8c00000)
    > the space 12288K, 99% used [0xf4c00000, 0xf57fff70, 0xf5800000,
    > 0xf5800000)
    > 1.006: [Tenured: 862K->1306K(1179648K), 0.2251506 secs]
    > 10676K->1306K(1982464K), [Perm : 12287K->12287K(12288K)] Heap after GC
    > invocations=2:
    > Heap
    > def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 1306K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xacd46938, 0xacd46a00,
    > 0xf4c00000)
    > compacting perm gen total 12288K, used 12287K [0xf4c00000, 0xf5800000,
    > 0xf8c00000)
    > the space 12288K, 99% used [0xf4c00000, 0xf57fff70, 0xf5800000,
    > 0xf5800000)} , 0.2260271 secs]
    >
    > 2.432: [Full GC {Heap before GC invocations=2:
    > Heap
    > def new generation total 802816K, used 12945K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 1% used [0x74c00000, 0x758a46c8, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 1306K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xacd46938, 0xacd46a00,
    > 0xf4c00000)
    > compacting perm gen total 16384K, used 16383K [0xf4c00000, 0xf5c00000,
    > 0xf8c00000)
    > the space 16384K, 99% used [0xf4c00000, 0xf5bffff8, 0xf5c00000,
    > 0xf5c00000)
    > 2.433: [Tenured: 1306K->2077K(1179648K), 0.2939680 secs]
    > 14252K->2077K(1982464K), [Perm : 16383K->16383K(16384K)] Heap after GC
    > invocations=3:
    > Heap
    > def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 2077K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xace07550, 0xace07600,
    > 0xf4c00000)
    > compacting perm gen total 16384K, used 16383K [0xf4c00000, 0xf5c00000,
    > 0xf8c00000)
    > the space 16384K, 99% used [0xf4c00000, 0xf5bffff8, 0xf5c00000,
    > 0xf5c00000)} , 0.2948505 secs]
    >
    > 3.655: [Full GC {Heap before GC invocations=3:
    > Heap
    > def new generation total 802816K, used 10621K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 1% used [0x74c00000, 0x7565f528, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 2077K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xace07550, 0xace07600,
    > 0xf4c00000)
    > compacting perm gen total 20480K, used 20479K [0xf4c00000, 0xf6000000,
    > 0xf8c00000)
    > the space 20480K, 99% used [0xf4c00000, 0xf5ffffb8, 0xf6000000,
    > 0xf6000000)
    > 3.656: [Tenured: 2077K->1970K(1179648K), 0.5016663 secs]
    > 12698K->1970K(1982464K), [Perm : 20479K->20442K(20480K)] Heap after GC
    > invocations=4:
    > Heap
    > def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 1970K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xacdec9b8, 0xacdeca00,
    > 0xf4c00000)
    > compacting perm gen total 20480K, used 20442K [0xf4c00000, 0xf6000000,
    > 0xf8c00000)
    > the space 20480K, 99% used [0xf4c00000, 0xf5ff6960, 0xf5ff6a00,
    > 0xf6000000)} , 0.5027088 secs]
    >
    > 6.673: [Full GC {Heap before GC invocations=4:
    > Heap
    > def new generation total 802816K, used 9580K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 1% used [0x74c00000, 0x7555b100, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 1970K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xacdec9b8, 0xacdeca00,
    > 0xf4c00000)
    > compacting perm gen total 24576K, used 24575K [0xf4c00000, 0xf6400000,
    > 0xf8c00000)
    > the space 24576K, 99% used [0xf4c00000, 0xf63ffff0, 0xf6400000,
    > 0xf6400000)
    > 6.674: [Tenured: 1970K->3152K(1179648K), 0.4940012 secs]
    > 11550K->3152K(1982464K), [Perm : 24575K->24575K(24576K)] Heap after GC
    > invocations=5:
    > Heap
    > def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 3152K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xacf14390, 0xacf14400,
    > 0xf4c00000)
    > compacting perm gen total 24576K, used 24575K [0xf4c00000, 0xf6400000,
    > 0xf8c00000)
    > the space 24576K, 99% used [0xf4c00000, 0xf63ffff0, 0xf6400000,
    > 0xf6400000)} , 0.4948833 secs]
    >
    > 11.193: [Full GC {Heap before GC invocations=5:
    > Heap
    > def new generation total 802816K, used 19193K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 2% used [0x74c00000, 0x75ebe618, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 3152K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xacf14390, 0xacf14400,
    > 0xf4c00000)
    > compacting perm gen total 28672K, used 28671K [0xf4c00000, 0xf6800000,
    > 0xf8c00000)
    > the space 28672K, 99% used [0xf4c00000, 0xf67fffa8, 0xf6800000,
    > 0xf6800000)
    > 11.194: [Tenured: 3152K->6843K(1179648K), 0.6876721 secs]
    > 22346K->6843K(1982464K), [Perm : 28671K->28671K(28672K)] Heap after GC
    > invocations=6:
    > Heap
    > def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 6843K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xad2aee78, 0xad2af000,
    > 0xf4c00000)
    > compacting perm gen total 28672K, used 28671K [0xf4c00000, 0xf6800000,
    > 0xf8c00000)
    > the space 28672K, 99% used [0xf4c00000, 0xf67fffa8, 0xf6800000,
    > 0xf6800000)} , 0.6892408 secs]
    >
    > 23.597: [Full GC {Heap before GC invocations=6:
    > Heap
    > def new generation total 802816K, used 101111K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 14% used [0x74c00000, 0x7aebdf00, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 6843K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 0% used [0xacc00000, 0xad2aee78, 0xad2af000,
    > 0xf4c00000)
    > compacting perm gen total 32768K, used 32768K [0xf4c00000, 0xf6c00000,
    > 0xf8c00000)
    > the space 32768K, 100% used [0xf4c00000, 0xf6c00000, 0xf6c00000,
    > 0xf6c00000)
    > 23.602: [Tenured: 6843K->15921K(1179648K), 1.4730392 secs]
    > 107955K->15921K(1982464K), [Perm : 32768K->32768K(32768K)] Heap after GC
    > invocations=7:
    > Heap
    > def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 15921K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 1% used [0xacc00000, 0xadb8c778, 0xadb8c800,
    > 0xf4c00000)
    > compacting perm gen total 32768K, used 32768K [0xf4c00000, 0xf6c00000,
    > 0xf8c00000)
    > the space 32768K, 100% used [0xf4c00000, 0xf6c00000, 0xf6c00000,
    > 0xf6c00000)} , 1.4781818 secs]
    >
    > 2156.095: [Full GC {Heap before GC invocations=7:
    > Heap
    > def new generation total 802816K, used 151689K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 22% used [0x74c00000, 0x7e0224e8, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 15921K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 1% used [0xacc00000, 0xadb8c778, 0xadb8c800,
    > 0xf4c00000)
    > compacting perm gen total 36864K, used 36862K [0xf4c00000, 0xf7000000,
    > 0xf8c00000)
    > the space 36864K, 99% used [0xf4c00000, 0xf6fffaa8, 0xf6fffc00,
    > 0xf7000000)
    > 2156.102: [Tenured: 15921K->21133K(1179648K), 1.7472031 secs]
    > 167611K->21133K(1982464K), [Perm : 36862K->36829K(36864K)] Heap after GC
    > invocations=8:
    > Heap
    > def new generation total 802816K, used 0K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 21133K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 1% used [0xacc00000, 0xae0a3688, 0xae0a3800,
    > 0xf4c00000)
    > compacting perm gen total 36864K, used 36829K [0xf4c00000, 0xf7000000,
    > 0xf8c00000)
    > the space 36864K, 99% used [0xf4c00000, 0xf6ff7698, 0xf6ff7800,
    > 0xf7000000)} , 1.7555309 secs]
    >
    > 2283.402: [GC {Heap before GC invocations=8:
    > Heap
    > def new generation total 802816K, used 688127K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebffde0, 0x9ec00000)
    > from space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 21133K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 1% used [0xacc00000, 0xae0a3688, 0xae0a3800,
    > 0xf4c00000)
    > compacting perm gen total 38912K, used 38811K [0xf4c00000, 0xf7200000,
    > 0xf8c00000)
    > the space 38912K, 99% used [0xf4c00000, 0xf71e6f90, 0xf71e7000,
    > 0xf7200000)
    > 2283.403: [DefNew: 688127K->80029K(802816K), 1.0793836 secs]
    > 709261K->101163K(1982464K) Heap after GC invocations=9:
    > Heap
    > def new generation total 802816K, used 80029K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 69% used [0xa5c00000, 0xaaa27788, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 21133K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 1% used [0xacc00000, 0xae0a3688, 0xae0a3800,
    > 0xf4c00000)
    > compacting perm gen total 38912K, used 38811K [0xf4c00000, 0xf7200000,
    > 0xf8c00000)
    > the space 38912K, 99% used [0xf4c00000, 0xf71e6f90, 0xf71e7000,
    > 0xf7200000)} , 1.0802494 secs]
    >
    > 2556.902: [GC {Heap before GC invocations=9:
    > Heap
    > def new generation total 802816K, used 768157K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebffff0, 0x9ec00000)
    > from space 114688K, 69% used [0xa5c00000, 0xaaa27788, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 21133K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 1% used [0xacc00000, 0xae0a3688, 0xae0a3800,
    > 0xf4c00000)
    > compacting perm gen total 38912K, used 38857K [0xf4c00000, 0xf7200000,
    > 0xf8c00000)
    > the space 38912K, 99% used [0xf4c00000, 0xf71f26d8, 0xf71f2800,
    > 0xf7200000)
    > 2556.903: [DefNew: 768157K->57374K(802816K), 1.5037351 secs]
    > 789291K->129910K(1982464K) Heap after GC invocations=10:
    > Heap
    > def new generation total 802816K, used 57374K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 50% used [0x9ec00000, 0xa2407878, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 72535K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 6% used [0xacc00000, 0xb12d5f88, 0xb12d6000,
    > 0xf4c00000)
    > compacting perm gen total 38912K, used 38857K [0xf4c00000, 0xf7200000,
    > 0xf8c00000)
    > the space 38912K, 99% used [0xf4c00000, 0xf71f26d8, 0xf71f2800,
    > 0xf7200000)} , 1.5047427 secs]
    >
    > 2948.221: [GC {Heap before GC invocations=10:
    > Heap
    > def new generation total 802816K, used 745502K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebfffc8, 0x9ec00000)
    > from space 114688K, 50% used [0x9ec00000, 0xa2407878, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 72535K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 6% used [0xacc00000, 0xb12d5f88, 0xb12d6000,
    > 0xf4c00000)
    > compacting perm gen total 38912K, used 38860K [0xf4c00000, 0xf7200000,
    > 0xf8c00000)
    > the space 38912K, 99% used [0xf4c00000, 0xf71f3030, 0xf71f3200,
    > 0xf7200000)
    > 2948.222: [DefNew: 745502K->17918K(802816K), 0.9751439 secs]
    > 818037K->133153K(1982464K) Heap after GC invocations=11:
    > Heap
    > def new generation total 802816K, used 17918K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 15% used [0xa5c00000, 0xa6d7f8d0, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 115235K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 9% used [0xacc00000, 0xb3c88d58, 0xb3c88e00,
    > 0xf4c00000)
    > compacting perm gen total 38912K, used 38860K [0xf4c00000, 0xf7200000,
    > 0xf8c00000)
    > the space 38912K, 99% used [0xf4c00000, 0xf71f3030, 0xf71f3200,
    > 0xf7200000)} , 0.9760031 secs]
    >
    > 3120.413: [GC {Heap before GC invocations=11:
    > Heap
    > def new generation total 802816K, used 706046K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebfff68, 0x9ec00000)
    > from space 114688K, 15% used [0xa5c00000, 0xa6d7f8d0, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 115235K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 9% used [0xacc00000, 0xb3c88d58, 0xb3c88e00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 38967K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf720df08, 0xf720e000,
    > 0xf7240000)
    > 3120.413: [DefNew: 706046K->68293K(802816K), 1.5127820 secs]
    > 821281K->183528K(1982464K) Heap after GC invocations=12:
    > Heap
    > def new generation total 802816K, used 68293K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 59% used [0x9ec00000, 0xa2eb1698, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 115235K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 9% used [0xacc00000, 0xb3c88d58, 0xb3c88e00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 38967K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf720df08, 0xf720e000,
    > 0xf7240000)} , 1.5136550 secs]
    >
    > 3186.565: [GC {Heap before GC invocations=12:
    > Heap
    > def new generation total 802816K, used 756421K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebffff0, 0x9ec00000)
    > from space 114688K, 59% used [0x9ec00000, 0xa2eb1698, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 115235K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 9% used [0xacc00000, 0xb3c88d58, 0xb3c88e00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 38997K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7215470, 0xf7215600,
    > 0xf7240000)
    > 3186.565: [DefNew: 756421K->10327K(802816K), 1.1199313 secs]
    > 871656K->175022K(1982464K) Heap after GC invocations=13:
    > Heap
    > def new generation total 802816K, used 10327K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 9% used [0xa5c00000, 0xa6615ff8, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 38997K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7215470, 0xf7215600,
    > 0xf7240000)} , 1.1208153 secs]
    >
    > 3951.961: [GC {Heap before GC invocations=13:
    > Heap
    > def new generation total 802816K, used 698451K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebfee20, 0x9ec00000)
    > from space 114688K, 9% used [0xa5c00000, 0xa6615ff8, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39009K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7218410, 0xf7218600,
    > 0xf7240000)
    > 3951.974: [DefNew: 698451K->14050K(802816K), 0.1505777 secs]
    > 863145K->178745K(1982464K) Heap after GC invocations=14:
    > Heap
    > def new generation total 802816K, used 14050K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 12% used [0x9ec00000, 0x9f9b8b08, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39009K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7218410, 0xf7218600,
    > 0xf7240000)} , 0.1635907 secs]
    >
    > 3982.626: [GC {Heap before GC invocations=14:
    > Heap
    > def new generation total 802816K, used 702177K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebff9d8, 0x9ec00000)
    > from space 114688K, 12% used [0x9ec00000, 0x9f9b8b08, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39036K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf721f100, 0xf721f200,
    > 0xf7240000)
    > 3982.627: [DefNew: 702177K->13567K(802816K), 0.1945802 secs]
    > 866871K->178261K(1982464K) Heap after GC invocations=15:
    > Heap
    > def new generation total 802816K, used 13567K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 11% used [0xa5c00000, 0xa693fdb0, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39036K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf721f100, 0xf721f200,
    > 0xf7240000)} , 0.1954354 secs]
    >
    > 3997.123: [GC {Heap before GC invocations=15:
    > Heap
    > def new generation total 802816K, used 701693K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebff820, 0x9ec00000)
    > from space 114688K, 11% used [0xa5c00000, 0xa693fdb0, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39038K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf721f9a8, 0xf721fa00,
    > 0xf7240000)
    > 3997.124: [DefNew: 701693K->3561K(802816K), 0.0587354 secs]
    > 866387K->168255K(1982464K) Heap after GC invocations=16:
    > Heap
    > def new generation total 802816K, used 3561K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 3% used [0x9ec00000, 0x9ef7a6b0, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39038K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf721f9a8, 0xf721fa00,
    > 0xf7240000)} , 0.0597378 secs]
    >
    > 4104.193: [GC {Heap before GC invocations=16:
    > Heap
    > def new generation total 802816K, used 691689K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebfffd8, 0x9ec00000)
    > from space 114688K, 3% used [0x9ec00000, 0x9ef7a6b0, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39060K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7225328, 0xf7225400,
    > 0xf7240000)
    > 4104.193: [DefNew: 691689K->81840K(802816K), 0.8434562 secs]
    > 856383K->246534K(1982464K) Heap after GC invocations=17:
    > Heap
    > def new generation total 802816K, used 81840K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 71% used [0xa5c00000, 0xaabec1f0, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39060K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7225328, 0xf7225400,
    > 0xf7240000)} , 0.8443356 secs]
    >
    > 4285.776: [GC {Heap before GC invocations=17:
    > Heap
    > def new generation total 802816K, used 769968K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebfffd0, 0x9ec00000)
    > from space 114688K, 71% used [0xa5c00000, 0xaabec1f0, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 164694K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 13% used [0xacc00000, 0xb6cd5938, 0xb6cd5a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39074K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7228950, 0xf7228a00,
    > 0xf7240000)
    > 4285.777: [DefNew: 769968K->56806K(802816K), 1.2062011 secs]
    > 934662K->273912K(1982464K) Heap after GC invocations=18:
    > Heap
    > def new generation total 802816K, used 56806K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 49% used [0x9ec00000, 0xa2379a50, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 217106K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 18% used [0xacc00000, 0xba004858, 0xba004a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39074K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7228950, 0xf7228a00,
    > 0xf7240000)} , 1.2070780 secs]
    >
    > 4557.069: [GC {Heap before GC invocations=18:
    > Heap
    > def new generation total 802816K, used 744933K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebffbb0, 0x9ec00000)
    > from space 114688K, 49% used [0x9ec00000, 0xa2379a50, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 217106K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 18% used [0xacc00000, 0xba004858, 0xba004a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229010, 0xf7229200,
    > 0xf7240000)
    > 4557.070: [DefNew: 744933K->86620K(802816K), 0.9305466 secs]
    > 962039K->303727K(1982464K) Heap after GC invocations=19:
    > Heap
    > def new generation total 802816K, used 86620K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 75% used [0xa5c00000, 0xab0973c0, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 217106K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 18% used [0xacc00000, 0xba004858, 0xba004a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229010, 0xf7229200,
    > 0xf7240000)} , 0.9314256 secs]
    >
    > 4938.863: [GC {Heap before GC invocations=19:
    > Heap
    > def new generation total 802816K, used 774748K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebffff8, 0x9ec00000)
    > from space 114688K, 75% used [0xa5c00000, 0xab0973c0, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 217106K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 18% used [0xacc00000, 0xba004858, 0xba004a00,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229098, 0xf7229200,
    > 0xf7240000)
    > 4938.863: [DefNew: 774748K->19649K(802816K), 1.0088472 secs]
    > 991855K->280050K(1982464K) Heap after GC invocations=20:
    > Heap
    > def new generation total 802816K, used 19649K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 17% used [0x9ec00000, 0x9ff30478, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229098, 0xf7229200,
    > 0xf7240000)} , 1.0097098 secs]
    >
    > 5324.768: [GC {Heap before GC invocations=20:
    > Heap
    > def new generation total 802816K, used 707773K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebff328, 0x9ec00000)
    > from space 114688K, 17% used [0x9ec00000, 0x9ff30478, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229120, 0xf7229200,
    > 0xf7240000)
    > 5324.769: [DefNew: 707773K->20454K(802816K), 0.7317651 secs]
    > 968175K->280855K(1982464K) Heap after GC invocations=21:
    > Heap
    > def new generation total 802816K, used 20454K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 17% used [0xa5c00000, 0xa6ff98f8, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229120, 0xf7229200,
    > 0xf7240000)} , 0.7332405 secs]
    >
    > 5665.834: [GC {Heap before GC invocations=21:
    > Heap
    > def new generation total 802816K, used 708582K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebfffe0, 0x9ec00000)
    > from space 114688K, 17% used [0xa5c00000, 0xa6ff98f8, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229338, 0xf7229400,
    > 0xf7240000)
    > 5665.835: [DefNew: 708582K->106693K(802816K), 2.2014550 secs]
    > 968983K->367094K(1982464K) Heap after GC invocations=22:
    > Heap
    > def new generation total 802816K, used 106693K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 93% used [0x9ec00000, 0xa54316a0, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229338, 0xf7229400,
    > 0xf7240000)} , 2.2023328 secs]
    >
    > 5749.002: [GC {Heap before GC invocations=22:
    > Heap
    > def new generation total 802816K, used 794821K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebffff8, 0x9ec00000)
    > from space 114688K, 93% used [0x9ec00000, 0xa54316a0, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 260401K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 22% used [0xacc00000, 0xbca4c480, 0xbca4c600,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229378, 0xf7229400,
    > 0xf7240000)
    > 5749.002: [DefNew: 794821K->29936K(802816K), 2.4289501 secs]
    > 1055222K->382280K(1982464K) Heap after GC invocations=23:
    > Heap
    > def new generation total 802816K, used 29936K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 26% used [0xa5c00000, 0xa793c3a0, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 352343K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 29% used [0xacc00000, 0xc2415f90, 0xc2416000,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229378, 0xf7229400,
    > 0xf7240000)} , 2.4298457 secs]
    >
    > 5835.362: [GC {Heap before GC invocations=23:
    > Heap
    > def new generation total 802816K, used 718064K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 99% used [0x74c00000, 0x9ebfffc0, 0x9ec00000)
    > from space 114688K, 26% used [0xa5c00000, 0xa793c3a0, 0xacc00000)
    > to space 114688K, 0% used [0x9ec00000, 0x9ec00000, 0xa5c00000)
    > tenured generation total 1179648K, used 352343K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 29% used [0xacc00000, 0xc2415f90, 0xc2416000,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229388, 0xf7229400,
    > 0xf7240000)
    > 5835.363: [DefNew: 718064K->58149K(802816K), 1.1834101 secs]
    > 1070408K->410493K(1982464K) Heap after GC invocations=24:
    > Heap
    > def new generation total 802816K, used 58149K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 0% used [0x74c00000, 0x74c00000, 0x9ec00000)
    > from space 114688K, 50% used [0x9ec00000, 0xa24c9588, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 352343K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 29% used [0xacc00000, 0xc2415f90, 0xc2416000,
    > 0xf4c00000)
    > compacting perm gen total 39168K, used 39076K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7229388, 0xf7229400,
    > 0xf7240000)} , 1.1842837 secs]
    >
    > 6732.782: [Full GC {Heap before GC invocations=24:
    > Heap
    > def new generation total 802816K, used 593584K [0x74c00000, 0xacc00000,
    > 0xacc00000)
    > eden space 688128K, 77% used [0x74c00000, 0x956e2da0, 0x9ec00000)
    > from space 114688K, 50% used [0x9ec00000, 0xa24c9588, 0xa5c00000)
    > to space 114688K, 0% used [0xa5c00000, 0xa5c00000, 0xacc00000)
    > tenured generation total 1179648K, used 352343K [0xacc00000, 0xf4c00000,
    > 0xf4c00000)
    > the space 1179648K, 29% used [0xacc00000, 0xc2415f90, 0xc2416000,
    > 0xf4c00000)
    > compacting perm gen total 39680K, used 39574K [0xf4c00000, 0xf72c0000,
    > 0xf8c00000)
    > the space 39680K, 99% used [0xf4c00000, 0xf72a5a30, 0xf72a5c00,
    > 0xf72c0000)
    > 6732.787: [Tenured[Unloading class sun.reflect.GeneratedFieldAccessor12]



    Do thread dumps, run the dumps through threadanalyzer...


  3. Re: Am I running out of perm space since its always 99% used?

    On Apr 26, 4:59 am, mist...@mail.com (Mistton) wrote:
    > Running Websphere 5.1.1.13 on Unix Sun 5.8 with 2 cpus 2 gig ram using Sun JVM
    > 1.4
    >
    > Running applciation that has a calc process that runs on app server that is
    > taking 30 mins regardless of whether we cut data range, should take 4-5 mins.
    > Adding more memory to the Xmx settings has no effect.
    >
    > Did a verobse garbage collections and saw the following
    >
    > compacting perm gen total 39168K, used 39009K [0xf4c00000, 0xf7240000,
    > 0xf8c00000)
    > the space 39168K, 99% used [0xf4c00000, 0xf7218410, 0xf7218600,
    > 0xf7240000)
    >
    > Perm gen space is always at 99% used never changes, number of k changes but
    > always 99%. Is this normal for the perm space? Using system default.


    I would definitely increase the permsize (-XX:PermSize=64m -
    XX:MaxPermSize=64m would be a good start). I'd rather see at least 40%
    free space in the perm size when the application is fully loaded as
    serialization and reflection can still add classes to the permanent
    heap.

    > also eden always goes from 99% used to 0% after first GC


    That's normal behavior: eden contains new (young) objects. After every
    GC the objects are checked. The objects that are still in use are put
    in the survivor spaces, the objects that aren't in use are discarded.

    [...]
    > 0.000: [Full GC {Heap before GC invocations=0:

    [...]

    That's a lot of full GCs, probably because your perm size is set too
    low. For high volume, critical applications, I would start panicing if
    I see more than 1 full GC a day (we have about 1 in a week for some
    applications or even lower).

    Wkr,
    Sven Vermeulen


+ Reply to Thread