cassandra-stress experiencing "java.lang.OutOfMemoryError: Java heap space" error

Question

I am trying to insert records in cassandra using cassandra-stress tool.

cassandra-stress -d xx.xx.xx.xx -t 500 -c 1 -S 10240000

But I keep running into the following error:

Exception in thread "Thread-159" java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOf(Unknown Source)
        at java.lang.AbstractStringBuilder.expandCapacity(Unknown Source)
        at java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown Source)
        at java.lang.AbstractStringBuilder.append(Unknown Source)
        at java.lang.StringBuilder.append(Unknown Source)
        at org.apache.cassandra.stress.util.Operation.multiplyString(Operation.java:211)
        at org.apache.cassandra.stress.util.Operation.generateValues(Operation.java:92)
        at org.apache.cassandra.stress.operations.Inserter.run(Inserter.java:45)
        at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:275)

I tried increasing the heap by changing java invocation in /usr/bin/cassandra-stress :

$JAVA -server -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -Xms8033M -Xmx8033M -Xmn400M -cp $CLASSPATH org.apache.cassandra.stress.Stress $@

Please note, cassandra itself is not showing any errors.

I have a quad-core machine with 32 GB running running Ubuntu 12.04.3 LTS(GNU/Linux 3.2.0-55-generic x86_64).

Peter Lawrey · Accepted Answer · 2013-12-04 08:57:01Z

1

If you have 32 GB I would try something closer to the amount of memory you have. I would also try a much larger eden size. For a high load system I would use some thing like this.

-Xmn8g -Xmx24g

You can also set the minimum if you like but it might not help.

If you monitor the system with these setting you might find you don't need that much memory and you can reduce it. If this is still too much you need to reduce you stress test or get a bigger box.

answered Dec 4, 2013 at 8:57

Peter Lawrey

535k83 gold badges770 silver badges1.2k bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Bhaskar Singhal Over a year ago

Thanks for the reply. These settings will increase the usage of physical memory not the java heap. I am monitoring usage using jconsole, and the java heap usage doesn't change.

Peter Lawrey Over a year ago

@BhaskarSinghal These options will significantly change the size of the heap. If you see not change, they haven't been applied correctly. What size of young generation do you see? It should be 8 GB.

Bhaskar Singhal Over a year ago

Thanks @Peter changing heap size etc didn't work. I just changed the application code to reduce the heap required.

Peter Lawrey Over a year ago

@BhaskarSinghal Reducing the memory requirement is always the best option, though it can be harder if you are using a application outside your control.

Nikem · Accepted Answer · 2013-12-05 06:04:13Z

0

It really seems to be the case that your heap is inadequate for your usage. So do follow Peter advice. But just in case, you can try to run cassandra-stress with Plumbr, to make sure that it does not leak memory.

answered Dec 5, 2013 at 6:04

Nikem

5,7944 gold badges36 silver badges60 bronze badges

1 Comment

Bhaskar Singhal Over a year ago

Thanks @Nikem changing heap size etc didn't work. I just changed the application code to reduce the heap required.

Collectives™ on Stack Overflow

cassandra-stress experiencing "java.lang.OutOfMemoryError: Java heap space" error

2 Answers 2

4 Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

4 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related