Page 1 of 1

Error trying to import

Posted: Thu Oct 16, 2008 3:00 pm
by Ballistix
Hi guys, just trying the software out and fell over at a first hurdle for us.

We are trying to important 1.2 Million emails! (Bigish gaming site) and the server falls over with this...

500 Servlet Exception
java.lang.OutOfMemoryError: Java heap space
at org.apache.commons.fileupload.disk.DiskFileItem.get(DiskFileItem.java:303)
at org.apache.struts.upload.CommonsMultipartRequestHandler$CommonsFormFile.getFileData(CommonsMultipartRequestHandler.java:555)
at org.agnitas.web.ImportWizardForm.parseFirstline(ImportWizardForm.java:1012)
at org.agnitas.web.ImportWizardForm.validate(ImportWizardForm.java:279)
at org.apache.struts.chain.commands.servlet.ValidateActionForm.validate(ValidateActionForm.java:58)
at org.apache.struts.chain.commands.AbstractValidateActionForm.execute(AbstractValidateActionForm.java:120)
at org.apache.struts.chain.commands.ActionCommandBase.execute(ActionCommandBase.java:51)
at org.apache.commons.chain.impl.ChainBase.execute(ChainBase.java:190)
at org.apache.commons.chain.generic.LookupCommand.execute(LookupCommand.java:304)
at org.apache.commons.chain.impl.ChainBase.execute(ChainBase.java:190)
at org.apache.struts.chain.ComposableRequestProcessor.process(ComposableRequestProcessor.java:283)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1913)
at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:462)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:154)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:92)
at com.caucho.server.dispatch.ServletFilterChain.doFilter(ServletFilterChain.java:106)
at org.springframework.orm.hibernate3.support.OpenSessionInViewFilter.doFilterInternal(OpenSessionInViewFilter.java:174)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:70)
at org.ajaxanywhere.AAFilter.doFilter(AAFilter.java:46)
at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:70)
at org.agnitas.web.filter.SerializeRequestFilter.doFilter(SerializeRequestFilter.java:29)
at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:70)
at org.agnitas.web.filter.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:51)
at com.caucho.server.dispatch.FilterFilterChain.doFilter(FilterFilterChain.java:70)
at com.caucho.server.webapp.WebAppFilterChain.doFilter(WebAppFilterChain.java:178)
at com.caucho.server.dispatch.ServletInvocation.service(ServletInvocation.java:229)
at com.caucho.server.http.HttpRequest.handleRequest(HttpRequest.java:268)
at com.caucho.server.port.TcpConnection.run(TcpConnection.java:389)
at com.caucho.util.ThreadPool.runTasks(ThreadPool.java:507)
at com.caucho.util.ThreadPool.run(ThreadPool.java:433)
at java.lang.Thread.run(Thread.java:619)



Any ideas?!

It's running on Windows 2000

Cheers
T

Posted: Thu Oct 16, 2008 3:59 pm
by maschoff
You have 2 possibilities:

1. Split your list and import it slice by slice

2. Put more RAM into your machine

Posted: Thu Oct 16, 2008 4:16 pm
by Ballistix
Hi, Yikes. :)

OK, is there a way to increase the stack space that JAVA is using to mitigate this maybe?

If so do you know how?

Regards,
Tony

Posted: Mon Oct 20, 2008 12:05 pm
by Ballistix
Nobody know how to do this?

Shame! We really like this software.

T

Posted: Mon Oct 20, 2008 1:05 pm
by lord_alan
Hi there,

I think this is what you need:

http://www.caucho.com/resin-3.0/perform ... tuning.xtp

I think you need to see the httpd.sh script in bin/scripts for how to add the appropriate parameters to the JVM on startup.

HTH

Alan

Posted: Mon Oct 20, 2008 1:38 pm
by Ballistix
Hi Alan, we've moved on and we are creating an ODBC export feature from our SQL 2000 database to the EMM MySql Database.

One thing we need to be sure of is that we don't break the tables on the MySQL store. We've already got them talking and just need to see what the import routine does and where it puts data...can anyone point me to which file I need to look at for the import routine that Java uses in EMM?

Regards,
T