Outgoing mails on RightToKnow are occasionally getting stuck in the queue and not going out

[mlandauer]

(The description is a little vague because I'm not sure of the underlying cause)

This has happened twice so far. The first time, about 3 weeks ago, the email stopped going out for a few days https://oaf.slack.com/archives/C2JF5EBHR/p1620347768019300?thread_ts=1620265719.016500&cid=C2JF5EBHR. It "magically fixed itself" because the server was rebooted. Looking back through the postfix logs it looked like postfix was having trouble talking to DNS and so it couldn't send out the mail and everything was stuck in a big queue.

The second time this happened, 3 days ago, @benrfairless restarted the postfix service and things worked again.

Front conversations

[mlandauer]

The next time this happens @benrfairless and you notice it, could you please take a copy of recent postfix logs and check that the network on the server to the outside world is working before you restart postfix again. That would really help in diagnosing the problem

[benrfairless]

Will do @mlandauer.

Can we put any monitoring via New Relic on the Postfix queue to identify when the queue gets too big? This will help me work out when I need to login and look at the issue.

When I restarted the services last time the server could successfully query DNS.

[benrfairless]

This has started happening again:

Jun 11 13:42:11 ip-172-31-43-31 postfix/pickup[4865]: 865404022E: uid=1001 from=<[email protected]> Jun 11 13:42:11 ip-172-31-43-31 postfix/cleanup[15173]: 865404022E: message-id=<[email protected]> Jun 11 13:42:11 ip-172-31-43-31 postfix/qmgr[1536]: 865404022E: from=<[email protected]>, size=1749, nrcpt=1 (queue active) Jun 11 13:42:11 ip-172-31-43-31 postfix/smtp[15175]: 865404022E: to=<[email protected]>, relay=dibp-ibmail1.msng.telstra.com.au[58.162.18.53]:25, delay=0.27, delays=0.01/0/0.24/0.02, dsn=5.0.0, status=bounced (host dibp-ibmail1.msng.telstra.com.au[58.162.18.53] said: 550 #5.1.0 Address rejected. (in reply to RCPT TO command)) Jun 11 13:42:11 ip-172-31-43-31 postfix/bounce[15714]: 865404022E: sender non-delivery notification: CA39D412E0 Jun 11 13:42:11 ip-172-31-43-31 postfix/qmgr[1536]: 865404022E: removed