System Status Archive
We keep the history of customer-affecting incidents here. Please see the current system status if you are experiencing problems with PKR Internet services.
Update: 2008-04-18 01:00:00 EDT
An extended power outage (3 hours) caused customer web servers to be unreachable for a time. All systems are operational now.
Update: 2008-03-10 12:43:00 EDT
All systems are operational. The routing issues with our upstream provider have stabilized.
Update: 2008-03-10 12:06:00 EDT
We are currently experiencing routing irregularities due to a problem with our upstream provider. You may experience difficulties reaching your site. We are following up with our provider to resolve the issue.
Update: 2007-09-24 04:22:00 EDT
All systems are currently operational. The home directories are back online with no loss of user data.
Update: 2007-09-24 02:02:00 EDT
User home directories are currently unavailable. Operator error caused the server hosting these directories to fail to mount the volume containing the home directories when we restarted a system at approximately 23:00 on Saturday, September 22nd. You may notice a spike in the spam in your mailbox, since spam filtering relies on user home directories being available.
Update: 2006-10-18 16:44:00 EDT
All systems are currently operational.
However, earlier today, around 3 PM EDT, we experienced a power outage at headquarters. This caused hosted customer sites to be unavailable for a period of approximately 40 minutes.
Update: 2006-08-24 10:40:00 EDT
All systems are currently operational.
However, two recent events may have caused reachability problems for our servers. Early this morning, around 2 AM EDT, our upstream provider did scheduled maintenance that caused an outage of about 15 minutes. This morning, around 8:55 AM EDT, our upstream provider experienced routing issues that caused sporadic connectivity problems.
Update: 2006-08-01 01:43:00 EDT
All systems are currently operational.
However, between about 12:00 EDT and 12:45 EDT today our authentication system was not responding to login requests, due to an expired security certificate. This resulted in login attempts being rejected during that window.
Update: 2006-07-05 12:54:00 EDT
Early on the morning of July 5th, 2006, our upstream provider had some problems resulting in our primary servers being unreachable from about 3 AM to 10 AM.
Update: 2006-02-20 11:07:00 EST
All systems are currently operational.
Please call Richard Bullington-McGuire at (703) 271-0607 or (571) 236-0938 to get a new password for your account if you have not done so already.
On Monday, February 13, 2006 at approximately 20:00 EST, we removed cauldron.pkrinternet.com (the main web and mail server for our customers) in response to a security incident. As of the evening of Wednesday, February 15 2006, web service and mail service were restored.
Update: 2006-02-16 03:52:00 EST
All public facilities are now operational again. We will be contacting every customer by phone this afternoon between 1:30 and 5:00 to reset passwords and answer questions regarding this incident.
Update: 2006-02-15 22:11:00 EST
Both incoming and outgoing mail are working. The web mail program works.. Retrieving mail through IMAPS and POP3S works, too.
Update: 2006-02-15 17:30:00 EST
Incoming email is now working, and the server is accepting a large number of messages. Next up: testing mail retrieval.
Update: 2006-02-15 12:48:00 EST
Public web sites should now be fully operational. We are still working on restoring mail service and user login services.
Due to the nature of the security incident, it has become prudent to lock all accounts by disabling the current passwords. You will need to contact PKR Internet by phone at (703) 271-0607 to get your password reset.
Update: 2006-02-15 09:26:00 EST
We're currently moving the data into place in preparation for bringing the system back onto the public Internet.
Update: 2006-02-15 00:35:00 EST
The operating system installation is complete, and the data is being copied back onto the server. Our current ETA for availability of web service is Wednesday, 2006-02-15 by 11:00:00 EST. The ETA for restoration of mail service is 17:00:00 EST.
Update: 2006-02-14 21:17:00 EST
The operating system installation is underway.
Update: 2006-02-14 18:12:00 EST
To complete the operating system upgrade required to secure the system, we need to download some additional installation CD-ROM images. This will delay the recovery by a few hours.
Update: 2006-02-14 16:03:00 EST
The backup of cauldron.pkrinternet.com is now complete, and we are about to reload the operating system and restore service. We will first restore web service, then email service, then open the system to new modifications.
Update: 2006-02-14 10:54:00 EST
This service is currently down for maintenance. Please try your request again later. We are working on resolving a serious problem with cauldron.pkrinternet.com. Thank you for your patience while we work to restore service.
