Mailings not finishing

Use this forum for questions regarding adoption and functionality of OpenEMM

Moderator: moderator

cjscully
Posts: 14
Joined: Wed Apr 14, 2010 2:14 am
Contact:

Mailings not finishing

Post by cjscully »

I've gotten Openemm installed configured and tested. The first mailing completed successfully.

Now I have two mailings that just won't complete. (see screenshots below) The list being used for all mailings was imported from a MS SQL database via CSV. It took two tries to get the import done. I had something come up during the process that pulled me away from my desk and when I returned the session had expired without completing the import. I had to restart the server and try again. That import was successful.

My guess is that the reason these mailings won't complete is due to one or more corrupted records from that first attempt but I'm not sure. I could be barking up a completely wrong tree on this.

Whether it's corrupted records or not, I want to make sure that my current and future mailings complete. How would I go about debugging this and/or prevent it from continuing to happen?

Image
Image
FlashBack
Posts: 6
Joined: Tue Apr 27, 2010 5:47 pm

Post by FlashBack »

The number of emails sent on the screenshots is actually referring to the number of emails that were put into the mail queue. Whenever you start a mailing the produced mails are written into the folder "var/spool/META" in blocks (i. e. 5000 per block). That is why the number of sent mails are also counted in blocks when you check the progress of the mailing.

It seems that in your case an error occurs when extracting the last block of mails into the queue. You should check your logfiles in "var/log" for error messages. Since the executable "xmlback" is responsible for putting mails in the queue the corresponding log file <date>-xmlback.log may contain an error message.
cjscully
Posts: 14
Joined: Wed Apr 14, 2010 2:14 am
Contact:

Post by cjscully »

Thank you for the reply. I had checked the standard logs in /var/log before posting this. I didn't realize there was a separate set of logs in /home/openemm/var/log.

There are 4 <date>-mailer-xmlback.log files in there corresponding to the dates of these two mailings. Each as one error message, but I don't understand the messages. Here is the message from the most recent one generated on 5/8.

[08.05.2010 10:24:39] 21538 NOTICE/deinit: mail creation: 0;1;1;9;13;W;9;0;1;1205;4654207
FlashBack
Posts: 6
Joined: Tue Apr 27, 2010 5:47 pm

Post by FlashBack »

The line you posted just contains a notice about the mail creation. Is there also a line containing an error message?
cjscully
Posts: 14
Joined: Wed Apr 14, 2010 2:14 am
Contact:

Post by cjscully »

Here are the entire contents of the xmlback.log files I have:
for 20100425:
[25.04.2010 18:15:09] 6745 NOTICE/deinit: mail creation: 0;1;1;6;7;A;1;0;1;1;1370
[25.04.2010 18:15:13] 6748 NOTICE/deinit: mail creation: 0;1;1;6;8;T;1;0;1;2;2735
[25.04.2010 18:17:04] 6770 NOTICE/deinit: mail creation: 0;1;1;6;9;W;1;0;1;2;2672

for 20100426:

[26.04.2010 13:38:33] 11503 NOTICE/deinit: mail creation: 0;1;1;7;10;W;1;0;1;2;4123
[26.04.2010 13:38:33] 11504 NOTICE/deinit: mail creation: 0;1;1;7;10;W;2;0;0;1;1107
[26.04.2010 13:38:33] 11504 NOTICE/deinit: mail creation: 0;1;1;7;10;W;2;0;1;5;10213
[26.04.2010 18:33:55] 12722 NOTICE/deinit: mail creation: 0;1;1;8;11;T;1;0;0;1;1945
[26.04.2010 18:33:55] 12722 NOTICE/deinit: mail creation: 0;1;1;8;11;T;1;0;1;4;15558
[26.04.2010 18:39:47] 12751 NOTICE/deinit: mail creation: 0;1;1;8;12;W;1;0;0;1;1936
[26.04.2010 18:39:47] 12751 NOTICE/deinit: mail creation: 0;1;1;8;12;W;1;0;1;4;15522
[26.04.2010 18:39:53] 12752 NOTICE/deinit: mail creation: 0;1;1;8;12;W;2;0;1;5000;19371079
[26.04.2010 18:42:58] 12781 NOTICE/deinit: mail creation: 0;1;1;8;12;W;3;0;1;3239;12558496

for 20100507:
[07.05.2010 19:36:37] 18030 NOTICE/deinit: mail creation: 0;1;1;10;14;W;5;0;1;3815;14737626

for 20100508:
[08.05.2010 10:24:39] 21538 NOTICE/deinit: mail creation: 0;1;1;9;13;W;9;0;1;1205;4654207

If none of those are error messages, could the error be logged in one of the other log files?
cjscully
Posts: 14
Joined: Wed Apr 14, 2010 2:14 am
Contact:

Post by cjscully »

I just re-checked these mailings for the first time since my original post and whatever the problem was seems to have sorted itself out and the mailings have finished going out.

Here's what I show now:
Image

Image

Now the big question that still remains is why would these mailings take 12 days and 9 days to get out so few messages?
maschoff
Site Admin
Posts: 2597
Joined: Thu Aug 03, 2006 10:20 am
Location: Munich, Germany
Contact:

Post by maschoff »

My hunch: Mails from your IP were probably blocked by some ISPs which slows down processing of the queue and gives the impression that nothing is going forward. Quite often ISPs use to block IPs only temporarily and probably have lifted the block which lead to resumption of queue processing.
OpenEMM Maintainer
cjscully
Posts: 14
Joined: Wed Apr 14, 2010 2:14 am
Contact:

Post by cjscully »

Probably right.
cjscully
Posts: 14
Joined: Wed Apr 14, 2010 2:14 am
Contact:

Post by cjscully »

ma wrote:My hunch: Mails from your IP were probably blocked by some ISPs which slows down processing of the queue and gives the impression that nothing is going forward. Quite often ISPs use to block IPs only temporarily and probably have lifted the block which lead to resumption of queue processing.
It's been a while since this occurred but seems to be occurring again. Is there anything that can be changed configuration wise to have the blocked messages re-queued at the back so that the rest of the mailing can go out?

<date>-xmlback.log still has no errors in it. Only mail creation notices.
Post Reply