Increase Java Memory For Pentaho Data Integration


Pentaho runs inside a Java virtual machine, and hence is bound by the properties of that VM.
These optimisations can apply to just about any Java application, including the Pentaho BI Server and GUI tools.
Method to increase memory allocation:
Open the file spoon.sh or spoon.bat in a text editor
Look for a section that looks like this:


# ******************************************************************
# ** Set java runtime options                                     **
# ** Change 256m to higher values in case you run out of memory.  **
# ******************************************************************

OPT="-Xmx256m -cp $CLASSPATH -Djava.library.path=$LIBPATH -DKETTLE_HOME=$KETTLE_HOME -DKETTLE_REPOSITORY=$KETTLE_REPOSITORY -DKETTLE_USER=$KETTLE_USER -DKETTLE_PASSWORD=$KETTLE_PASSWORD -DKETTLE_PLUGIN_PACKAGES=$KETTLE_PLUGIN_PACKAGES"
Change the -Xmx parameter to alter the maximum heap size, e.g. -Xmx1024m

Comments

  1. cacoFebruary 24, 2012 at 6:14 PM

    Thanks!
    This was very useful

    ReplyDelete
  2. w00teMay 8, 2012 at 10:31 PM

    That's alot easier than I'd have guessed. Thank you! :)

    ReplyDelete
  3. UnknownMarch 3, 2014 at 12:57 AM

    Well, actually that would increase only the memory used by the Spoon Designer... You must also do the same to kitchen.sh and pan.sh (or kitchen.bat and pan.bat) because kitchen and pan are who make the tough job in a data integration process in Pentaho. Good post man

    ReplyDelete
  4. AnonymousJuly 17, 2014 at 9:53 PM

    Best approach seems to be setting export PENTAHO_DI_JAVA_OPTIONS="-Xmx1024m -XX:MaxPermSize=256m" as an env variable.

    This way all scripts and ui use this one.

    ReplyDelete
  5. UnknownMay 18, 2016 at 8:44 PM

    Its not working if I increase the size from 1024 to 2048. Its giving JVM fatal error message.

    ReplyDelete
    Replies
    1. Jugal DhrangadhariaMay 19, 2016 at 10:42 AM

      What is the error, I guess ur memory couldn't take/find 2 GB RAM free hence the JVM fatal error.

      Delete
  6. AnonymousJanuary 20, 2017 at 12:45 AM

    What is the maximum limit to increase the memory ?

    ReplyDelete
  7. Jugal DhrangadhariaJanuary 20, 2017 at 5:54 PM

    it depends how much ram ur system has free

    ReplyDelete
  8. AnonymousJanuary 23, 2017 at 8:58 PM

    Worked.. Great info !!

    ReplyDelete
  9. AnonymousApril 5, 2017 at 2:10 AM

    Nice Guide, congratulations, just a question, where I can change the java memory in the kitchen in the version 7, in the kitchen or pan files there is no command line related to the memory..., or it takes the same as the spoon configuration?

    ReplyDelete

Post a Comment

Popular posts from this blog

Null pointer exception in tmap

You might have faced a common error in Talend i.e. the  NullPointerException in tMap "Exception in component tMap_1 java.lang.NullPointerException" Solutions: 1) Make sure your columns are nullable when you define the schema. 2) The NullPointerException indicate there are some null value on lookup table, so you need to deal with the null value on corresponding columns on expression filed of tmap, for example: !Relational.ISNULL(row13.abc)? row13.xyz:row13.sss:null
Read more

Different Match Models in tMap with example

Unique Match:     (Also called Last match) If several matches are found in the Inner Join, i.e. the last row matching the explicit join as well as the filter will be added to the output flow. First Match: If several matches are found in the Inner Join, i.e. the first row matching the explicit join as well as the filter will be added to the output flow. All Match: If several matches are found in the Inner Join, i.e. rows matching the explicit join as well as the filter, all of them will be added to the output flow Example: deptid   sales 1           1000 2           2000 3           3000 2           5000 3           6000 Outputs: 1. Unique match deptid   sales 1           1000 2           5000 3           6000 2. All matches deptid  ...
Read more