Error trying to import

[Ballistix]

Hi guys, just trying the software out and fell over at a first hurdle for us.

We are trying to important 1.2 Million emails! (Bigish gaming site) and the server falls over with this...

500 Servlet Exception
java.lang.OutOfMemoryError: Java heap space
at org.apache.commons.fileupload.disk.DiskFileItem.get(DiskFileItem.java:303)
at org.apache.struts.upload.CommonsMultipartRequestHandler$CommonsFormFile.getFileData(CommonsMultipartRequestHandler.java:555)
at org.agnitas.web.ImportWizardForm.parseFirstline(ImportWizardForm.java:1012)
at org.agnitas.web.ImportWizardForm.validate(ImportWizardForm.java:279)
at org.apache.struts.chain.commands.servlet.ValidateActionForm.validate(ValidateActionForm.java:58)
at org.apache.struts.chain.commands.AbstractValidateActionForm.execute(AbstractValidateActionForm.java:120)
at org.apache.struts.chain.commands.ActionCommandBase.execute(ActionCommandBase.java:51)
at org.apache.commons.chain.impl.ChainBase.execute(ChainBase.java:190)
at org.apache.commons.chain.generic.LookupCommand.execute(LookupCommand.java:304)
at org.apache.commons.chain.impl.ChainBase.execute(ChainBase.java:190)
at org.apache.struts.chain.ComposableRequestProcessor.process(ComposableRequestProcessor.java:283)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1913)
at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:462)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:154)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:92)
at com.caucho.server.dispatch.ServletFilterChain.doFilter(ServletFilterChain.java:106)
at org.springframework.orm.hibernate3.support.OpenSessionInViewFilter.doFilterInternal(OpenSessionInViewFilter.java:174)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:70)
at org.ajaxanywhere.AAFilter.doFilter(AAFilter.java:46)
at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:70)
at org.agnitas.web.filter.SerializeRequestFilter.doFilter(SerializeRequestFilter.java:29)
at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:70)
at org.agnitas.web.filter.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:51)
at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:70)
at com.caucho.server.webapp.WebAppFilterChain.doFilter(WebAppFilterChain.java:178)
at com.caucho.server.dispatch.ServletInvocation.service(ServletInvocation.java:229)
at com.caucho.server.http.HttpRequest.handleRequest(HttpRequest.java:268)
at com.caucho.server.port.TcpConnection.run(TcpConnection.java:389)
at com.caucho.util.ThreadPool.runTasks(ThreadPool.java:507)
at com.caucho.util.ThreadPool.run(ThreadPool.java:433)
at java.lang.Thread.run(Thread.java:619)



Any ideas?!

It's running on Windows 2000

Cheers
T

[maschoff]

You have 2 possibilities:

1. Split your list and import it slice by slice

2. Put more RAM into your machine

[Ballistix]

Hi, Yikes.

OK, is there a way to increase the stack space that JAVA is using to mitigate this maybe?

If so do you know how?

Regards,
Tony

[Ballistix]

Nobody know how to do this?

Shame! We really like this software.

T

[lord_alan]

Hi there,

I think this is what you need:

http://www.caucho.com/resin-3.0/perform ... tuning.xtp

I think you need to see the httpd.sh script in bin/scripts for how to add the appropriate parameters to the JVM on startup.

HTH

Alan

[Ballistix]

Hi Alan, we've moved on and we are creating an ODBC export feature from our SQL 2000 database to the EMM MySql Database.

One thing we need to be sure of is that we don't break the tables on the MySQL store. We've already got them talking and just need to see what the import routine does and where it puts data...can anyone point me to which file I need to look at for the import routine that Java uses in EMM?

Regards,
T