views:

110

answers:

3

As an example lets say that I set the JVM's maximum heap to 4GB. However, once my application reaches about 3GB, the OS starts to swap some memory to disk. At this point there are several objects already out of scope, and instead of requesting more memory the JVM could first garbage collect old objects. In terms of performance it would be better to have garbage-collection run than to do memory swapping. Is the JVM garbage-collection smart about situations like this or is it completely unaware of it? Can we somehow tune the JVM to address this situation?

I know that there's a chance that the garbage-collection will run before we reach the 3GB and therefore we never actually need to swap memory but that doesn't really answer my question.

EDIT: lets assume that my machine has more than 4GB of memory but sometimes there are other applications taking some of that memory leaving me with less than 4GB. I would rather not have to reduce the maximum heapsize given that most of the times I will have the 4GB but I was wondering if the GC would be smart enough in the other situations.

+2  A: 

The GC is unaware of this situation. You should not specify a heap that's bigger then the free amount of memory on your machine. The solution is to reduce the heapsize, and make sure no other programs eats all memory.

Actually do not think there is a easy way even in C to check if the process is swapping (Maybe there is, if so, please add a comment).

UnixShadow
well, in C you are managing the memory allocation yourself so you should never have data in memory that you don't need any more. Assuming that you are doing a good job a reclaiming the memory you're not using any more, if the OS is swapping, it means that there's no more unused memory. That's not necessarily true for java.
Mario
+1  A: 

[...] the memory layout of run-time data areas, the garbage-collection algorithm used, and any internal optimization of the Java virtual machine instructions (for example, translating them into machine code) are left to the discretion of the implementor. (Java Virtual Machine Specification, Chapter 3)

There is no such thing like a Java garbage collection. The java virtual machine specification tells that each jvm implementation needs to provide gc but how it's done is left to the implementor.

Technically it would at least be a challenge. Because we would not want to trigger gc on the fact that some pages have been swapped to virtual memory but we would want to trigger gc when the memory management is about to swap jvm pages to virtual memory. And I doubt that such information/notification is available in a computer system.

"OS to JVM: Hey, better clean up now before I swap some of your heap to virtual memory" - "JVM to OS: OK, please don't swap, starting to clean up now, tell you when finished" - 1457ms later - "JVM to OS: thanks for you patience, cleaned up as much as possible, you may continue swapping now)

Andreas_D
Thanks for the response. You are absolutely right, I should have been more clean. I had Sun's JVM in mind but it would be equally interesting to know if there's an implementation where this would be possible.
Mario
+2  A: 

The JVM is blissfully unaware of the underlaying OS memory management. I remember attending a JavaOne session about GC optimization not long ago and the speaker emphasized that you should always ensure that there is plenty of free memory (RAM, not swap) for the JVM to run, as to avoid paging at all costs, so never assign more memory to the JVM than what you have available at a given time in your system. Even more so, because of the way some GC collection algorithms work, it could have a huge performance penalty if the memory blocks they are collecting are paged.

So never give more memory to the JVM than what you have physically available in your system or if you expect memory consumption to increase over time because of some external processes then assign a heap space that will ensure that it will never be paged. And if you can't satisfy these conditions, well then you need more RAM :)

Update: did a little searching in SO and I found this. Here kdgregory argues that paging shouldn't be an issue because of the way GC works, but he is considering paging due to normal conditions, i.e. memory not being touched for a while, which is not your case, because you would be running out of memory and you will definitely start paging. Also, in case you are running some Linux flavor check John Ferminella's answer and his great blog post explaining how to understand and tune the swap in Linux.

teto