NinerNet Communications™
System Status

Server and System Status

Primary NinerNet website down

15 February 2018 10:29:34 +0000

We are aware of an issue with our main company website and some of the services directly connected to it (such as parked pages) that has started within the last 24 hours. We have not yet identified the cause of this problem, but we are working on finding it and fixing it.

This does not affect any client websites, nor does it affect email. It also does not affect most websites on sub-domains of niner.net — e.g., status.niner.net.

If you are having trouble accessing something that is on the root niner.net (or www.niner.net) domain, please email support.201802@niner.net and we will help you.

We apologise for this inconvenience.

NC023 and NC027: Maintenance complete

19 January 2018 03:30:26 +0000

Server NC023 was down for maintenance between 03:00 and 03:18 and server NC027 was down for maintenance between 03:02 and 03:15, and both have been successfully updated with current patches. This phase of the maintenance protects against Meltdown; further maintenance for protection against Spectre will take place when patches for it have been developed.

Updates will be posted here.

NC031: Maintenance complete

18 January 2018 08:33:02 +0000

Server NC031 was down for maintenance between 07:00 and 07:19, and has been successfully updated with current patches. This phase of the maintenance protects against Meltdown; further maintenance for protection against Spectre will take place when patches for it have been developed.

Updates will be posted here.

NC023 and NC027: Emergency server maintenance

18 January 2018 02:54:25 +0000

Per our previous blog post, the next of our servers to undergo updating are NC023 (the relay server) and NC027 (the primary mail server). The maintenance windows for each are two hours’ long, but we expect that each server will be down for much less than that.

The maintenance window for both starts at:

Please click the link above to determine when this will be in your time zone.

During the maintenance you will not be able to send or receive email. Incoming email to your domain will be held on the sending servers until our mail server is back online, and will then be delivered to your accounts. No email will be lost.

Please note that email to NinerNet will also be down during the maintenance on server NC027.

NC031: Emergency server maintenance

17 January 2018 14:03:35 +0000

Per our previous blog post, the first of our servers to undergo updating is NC031, on which most clients’ website are hosted. The maintenance window is two hours’ long, but we expect that the server will be down for much less than that.

The maintenance window starts at:

Please click the link above to determine when this will be in your time zone.

Please note that the NinerNet website will also be down during the maintenance on server NC031.

Meltdown and Spectre hardware vulnerabilities

17 January 2018 13:58:43 +0000

As you may have heard and read in the news since the beginning of January, major vulnerabilities in very widely used computer hardware (not software) were discovered in mid-2017 by security researchers in Austria, Germany, the United States and Australia, and were publicised on 3 January. Fixes to mitigate some of the vulnerabilities are now being released, and further mitigating measures are under active development where such mitigation is possible.

To this end we will be applying patches to our servers starting tomorrow (18 January) that will necessitate some down time. Due to the nature and scale of this problem — illustrated by the answer to the question, “Am I affected by the vulnerability?” being a simple, “Most certainly, yes” — these patches cannot be delayed or scheduled for a more convenient time. Also, as work continues on ways to mitigate some of the vulnerabilities, there are some updates to the operating systems on our servers that are yet to be developed that will need to be applied in the future. As further related maintenance takes place we will link back to this post.

Following this blog post we will post the details of the first server to undergo patching.

Further details on these vulnerabilities can be read at the following links:

If you have any questions or concerns, please feel free to contact us. Thank-you for your patience.

NC027: Spam clean-up update

28 December 2017 12:27:23 +0000

We have cleaned up the mail server (NC027) after yet another email account was compromised. This necessitated shutting down the mail server between 22:39 and 22:52 UTC yesterday (27 September) while we cleaned up the mess.

This has resulted in the mail server being blacklisted by at least one large mail provider and restrictions put in place by others. The email account in question has been disabled pending resolution of the root cause of this issue, and we are diverting outgoing email to some major mail providers via our relay server until restrictions on our primary mail server’s IP address expire. However, it may still be a few hours more until some outgoing mail is delivered normally without delay.

These incidents usually arise after a client’s computer has been infected with a virus. The virus then sends the email password back to the person or organisation controlling the virus, and they then use that information to compromise that email account on the mail server, using it to send thousands of spams from the account. Please ensure that you install, use and update an anti-virus program on your computers and any other devices to ensure that this doesn’t happen to your email account.

At this time NC027’s IP address is not listed in any of the major blacklists (which operate on an automated basis to remove blacklisted IP addresses once no spam is seen from them), but we will (as always) monitor this and, where necessary, make manual submissions to the smaller, niche blacklists and to ISPs and other mail providers to have our IP address de-listed where that is possible. Manual processes like these can take a couple of days, however.

NC027: Yet another spam outbreak

27 December 2017 22:41:47 +0000

We have temporarily shut down the mail server (NC027) while we clean up tens of thousands of spams from another compromised email account. We will have it back online as soon as possible.

NC027: Spam and delayed delivery

23 December 2017 03:11:45 +0000

Two email accounts on two separate domains on the mail server (NC027) were compromised in the last 24 hours and were used to send out thousands of spam emails. This has resulted in the mail server being blacklisted by at least one large mail provider and restrictions put in place by others. The two email accounts in question have been disabled pending resolution of the root cause of this issue, and we are diverting outgoing email to major mail providers via our relay server until restrictions on our primary mail server’s IP address expire. However, it may still be a few hours more until some outgoing mail is delivered normally without delay.

These incidents usually arise after a client’s computer has been infected with a virus. The virus then sends the email password back to the person or organisation controlling the virus, and they then use that information to compromise that email account on the mail server, using it to send thousands of spams from the account. Please ensure that you install, use and update an anti-virus program on your computers and any other devices to ensure that this doesn’t happen to your email account.

At this time NC027’s IP address is not listed in any of the major blacklists (which operate on an automated basis to remove blacklisted IP addresses once no spam is seen from them), but we will (as always) monitor this and, where necessary, make manual submissions to the smaller, niche blacklists and to ISPs and other mail providers to have our IP address de-listed where that is possible. Manual processes like these can take a couple of days, however.

NC020: Server networking issues

17 December 2017 12:27:45 +0000

Due to a misconfiguration of server NC020 by data centre personnel in response to a networking request from NinerNet that resulted from a change in one of their policies, this server stopped processing email properly earlier today. This resulted in some instability and the rebooting of the server three times between 07:22 and 08:06 UTC.

These problems affected only email processed for NinerNet domains, not any client email. However, because there are still a few client websites hosted on this server, including this status blog, these sites would have been down and up for some time this morning.

We have corrected the networking issue and have remonstrated with the data centre over the issue. We apologise for any inconvenience caused and will endeavour to ensure that this does not happen again.

NinerNet home page

Systems at a Glance:


SystemStatusPing
NC020OperationalPing
NC023OperationalPing
NC024InternalPing
NC027OperationalPing
NC028InternalPing
NC031OperationalPing
NC033OperationalPing

Subscriptions:

RSS icon. RSS

Twitter icon. Twitter

General Information:

This blog provides information about the status of NinerNet Communications systems. Dates and times of posts to this blog are in the UTC time zone, and dates and times given for events are also in the UTC time zone, although conversions may be offered for some time zones common to our clients. Please use the World Time Server to ensure accurate conversion of dates and times to your own time zone.

Search:

 

Recent Posts:

Archives:

Categories:

Links

Tags:

.co.zm domains .com.zm domains .zam.co domains browser warnings connection issues database dns dos attack dot-zm domains down time email delivery ftp hardware mailing lists mail relay migration nameservers performance phplist reboot smtp spam spamassassin ssl ssl certificate tls tls certificate web server

Resources:

On NinerNet: