On Sunday 27 February 2022 we upgraded our SpamTitan service to a new server. As well as faster, more modern hardware, new appliance uses a new version of FreeBSD under the hood which brings many performance and security enhancements.
While we do not anticipate any disruption to service, there are two potential issues to be aware of:
- The source IP address of SMTP connections from our SpamTitan server has changed. If you are running your own email server and previously had 22.214.171.124 configured explicitly in your firewall, please update this to 126.96.36.199 in order to continue receiving clean email. Our SpamTitan server will queue your mail for up to 3 days. The old IP address will continue to accept inbound SMTP connections on port 25 for 14 days, after which it will be disabled.
- Unfortunately it has not been possible to migrate the existing Spam Quarantine, so if you need to access any mail that was quarantined prior to 27 February you will need to log in at https://ams2-spamtitan.anu.net/ in order to release it from your quarantine.
If you have any questions or concerns, please do not hesitate to drop us an email to email@example.com.
Update 19:35 BST: the upgrade has been completed successfully. We have done extensive testing to ensure maximum backwards compatibility with the old mail server including all supported protocols and authentication methods. We are monitoring the new system carefully for any problems or warnings. If you have any difficulties accessing your email please do not hesitate to contact support.
Update 19:00 BST: we are going to start the migration to the new mail server shortly. We expect a disruption in access to POP3, IMAP and SMTP services to last approximately 30-45 minutes. Any mail sent to you during this time will be queued and delivered to your mailbox when the migration is complete. We’ll post an update here on completion.
Update 2016-09-09 07:30: We plan to go live with the upgraded mail server tonight around 19:00 BST.
Update 00:05 CET: Due to unforeseen circumstances (a software incompatibility on the new system) we have had to postpone the upgrade of our POP3/IMAP service. We’ll run further tests tomorrow and reschedule the upgrade once we’re happy the issue has been resolved.
Update 23:40 CET: Upgrade is currently in progress. We’ll update here when complete.
Update 2016-09-04 09:00: We’re ready to go with the anticipated performance upgrade of our POP3/IMAP service. Unfortunately this does require that we temporarily shut down the live server to synchronise changed data over to the new server. This will happen late tonight (Sunday 4th September).
Update 2016-08-24 10:30: The server has been stable overnight and this morning. We can see that all services (IMAP, POP3, webmail etc) are functioning normally for most clients. We have had no new email complaints regarding the outstanding issue above today. The changes we made to the mail server configuration have made a significant impact in lowering the load – that said we have pushed the upgrade of the mail server up in our priority list and expect the hardware to be at our datacenter by the end of August and for the mail server to be upgraded early September.
Update 16:00: We have made some changes to the mail server which have brought the load down drastically – things should be functioning reasonably well now. We are keeping an eye on things to ensure this remains the case.
We have become aware of problems with our mail server over the past few days relating to IMAP / POP3 connections. This will also affect webmail as that connects to the server via IMAP.
This is being caused by high load on the server. We are currently investigating the reason behind it.
We have a major upgrade to our mail server planned in September which we will put up on our blog soon. This will give the server a boost in speed and performance and should eliminate many of the issues that we have faced recently.
Update 12:17 CET: failover to backup systems is complete, all alerts on our systems are now clear. If you are still experiencing any issues please contact support with details and we’ll look in to it right away.
Update 10:30 CET: we are making progress on failing over to our backup network switches with many customers now fully up and running.
09:26 CET: we are experiencing a partial outage in our Amsterdam 2 datacenter due to a local network failure. We’re working on switching to a backup network.