Current FASnet Status: FASNET IS CURRENTLY OPERATING NORMALLY

Last FASnet status update: 2012-04-10 at 10:06 AM

FASnet Status Notifications

[10 April 2012 - Due to a power outage may FASNET services, though operating, were unavailable because the network was down in Applied Science Building which traffic is routed through.  At approximately 9:45AM power was restored and FASNET services were agaln available.  All services now appear to be fully operational.  If you are having difficulty please E-Mail gripe@fas.sfu.ca

[29 December 2011 2:08PM - Due to an ongoing denial of service attack FASnet is currently experiencing network problems and we are working hard to restore service.

Update 3:27PM - We have determined the machine(s) causing the problem and are working to rectify them as quickly as we can.  An update should be provided again shortly.

Update 5:45PM - The connections for all machines involved with the DoS attack have been identified.  The switch ports for those machines have now been disabled and the network has settled down now.  Since this is an uplink to another switch there may be intermittent outages while we track down the exact offending machine(s), but these outages should be short 1-2 minutes at most.

Update: 7:15PM - FASNET network services have now been fully restored.  The system is operating normally.

[12 December 2011 11:44am - FASnet is currently experiencing network problems and we are working hard to restore service.

[25 November 2011] 9:30PM - FASNET is currently experiencing DNS problems and we are working hard to restore service. UPDATE: 10:30PM - DNS services have returned to normal.

[24 November 2011] oak.fas.sfu.ca crashed due to CPU / memory exhaustion.  The machine was rebooted and is again servicing requests.

[8 November 2011] FASnet is operating normally, however, due to network connectivity issues, services offered from the Surrey campus are offline until further notice.

[19 October 2011] Guide for adding printer from new print server for Windows 7 and Windows XP machines, this is Windows print server and supports 32bit and 64bit Windows machines. Document can be picked up here or by fallowing link Adding Printer Windows 7 on http://www.sfu.ca/itservices/technical/fasnet/documentation/how-to_guides.html

*** SFU will never request users to provide or confirm their Computing ID or password information by email or any website.  Please ignore all messages requesting Computing ID or password information, no matter how authentic they may appear ***

[11 September 2011] The file server bluebell.fas.sfu.ca is currently experiencing service issues due to a full disk.  We are working hard to correct the problem and expect to have services restored shortly.  UPDATE: 1:15PM.  bluebell is now back online and servicing requests

[02 September 2011] The CS and ENSC home directory server dumbo will be rebooted between 8:00am and 9:00am.

[01 September 2011] The CS and ENSC home directory server dumbo will be rebooted between 8:00am and 9:00am.  UPDATE: Rescheduled due to complications

[ 30 August 2011] The remote access server dumbcane.fas.sfu.ca crashed due to a user oversubscribing the machine.  The machine has been rebooted and the user notified.

[24 August 2011] The new Windows terminal server ts1.fas.sfu.ca is currently experiencing problems with profile information.  We are working hard to correct the issue as quickly as possible.  UPDATE: We believe we've solved the profile problem.

[22 August 2011] The Sun cpu servers dogwood.fas.sfu.ca, css.css.sfu.ca and warrior.math.sfu.ca have been retired.  Please use the CentOS Linux cpu servers oak.fas.sfu.ca and dumbcane.fas.sfu.ca.  The Windows terminal server ts.fas.sfu.ca has been replaced by ts1.fas.sfu.ca.

[21 August 2011] FASnet semester maintenance from 8am to 6pm.  Solaris, Windows and Linux workstations may be patched between evening of Friday Aug 19 to the morning of Monday Aug 22. 

[30 June 2011] FASnet router replacement will affect Internet access between 6:30am and 8:00am.

[15 June 2011]  The remote access server oak.fas.sfu.ca needed to be rebooted at 9:95AM due to over subscription and several "Out of Memory" error conditions which caused many services to not behave properly.  Services on oak.fas.sfu.ca were restored at 9:30AM.

[13 June 2011]  A problem with one barracuda spam filter caused some emails to be queued for most of the day on Saturday June 11, 2011 and not delivered until late in the day.  The mail servers were rebooted late  Saturday and the queued email was quickly cleared out.  They haven't yet determined what the cause of the server problem was but the system admins will be figuring it out today.

[12 June 2011]  There is likely a problem with one barracuda spam filter caused some emails to be queued for most of the day and not delivered for quite some time.  IT Services Mail administrators have been notified and they are working to resolve the issue.

[24 May 2011]  A problem with one barracuda spam filter caused some emails to be queued for most of the day and not delivered until late in the day.

[8 May 2011] The FASnet home directory file server dumbo will be rebooted between 8:00am and 9:00am.

[1 May 2011] FASnet semester maintenance from 8:00am to 6:00pm

[8 Apr 2011] FASnet web servers were down from 3:00am until 11:00am due to a hardware problem.

[24 Mar 2011] A firmware update on a core switch is set for 7:45am to 8:00am.  There will be a temporary disruption in network connectivity.  Please save your work and logout before the maintenance period.

[2 Mar 2011] Math/Stat server chuskawn crashed at about 5:40pm on Tue Mar 1.  Rebooted this morning at about 8:00am.  Please check your FASnet accounts for email messages which are not forwarded while the server was down.

[ 19 Jan 2011 ] DNS services were temporarily disrupted this morning due to a zone configuration problem. The configuration error was corrected and FASNet DNS services restored.

[ 5 Jan 2011 ] Print services were temporarily disrupted this morning due to a full hard disk. Space was made available and services restored.

[ 23 Dec 2010 ] Home directory file server updates are completed. FASNet is now operating normally.

[ 23 Dec 2010 ] Home directory file server will be rebooted between 7:00am and 8:00am. Most workstations
will hang during the reboot.

[ 20 Dec 2010 ] The cpu server dogwood.fas.sfu.ca was rebooted because of a power supply problem.

[ 20 Dec 2010 ] The cpu server stawlmihq.fas.sfu.ca/warrior was rebooted to complete patch updates.

[ 19 Dec 2010 ] FASnet semester maintenance between 8:00am and 6:00pm. FASnet servers will be patched and rebooted. Sun workstations will be patched on the morning of Monday December 20, 2010. CentOS workstations will be patched on Friday December 17th, 2010.

[ 7 Dec 2010 ] Stawlmihq.fas.sfu.ca/warrior was reinstalled with Solaris 10. Please email gripe@fas.sfu.ca if you see any problem.

[ 29 Aug 2010 ] FASnet semester maintenance between 8:00am and 6:00pm. FASnet servers will be patched and rebooted. Sun workstations will be patched on the morning of Monday August 30. CentOS workstations will be patched on the Sept 4 weekend.

[ 6 Aug 2010 ] FASnet network outage between 7:00am and 7:30am. Files and internet access will be affected for some FASnet hosts.

[ 6 Aug 2010 ] FASnet file server maintenance between 8:00am and 10:00am. CS and ENSC home directories will be down.

[ 24 Jun 2010 ] FASnet outage from 2:30pm to 4:30pm due to routing loop created in one lab.

[ 16 May 2010 ] SFU Burnaby campus power outage from 8am-6pm.  SFU campus network and wireless network will be down.

[ 2 May 2010 ] FASnet semester maintenance scheduled.  Servers and workstations will be rebooted during the day.

[26 April 2010]  Air conditioning in ASB has been restored.  All servers are running.

[25 April 2010]  The air conditioners in ASB failed in the morning.  Some ENSC lab servers, license server and other servers went down during the day.  Facilities was unable to restore air conditioning.

[ 28 Mar 2010 ] The file server for CS, ENSC and RRG home directories was rebooted at 9:30am.

[ 21 Mar 2010 ] The Solaris and Linux /usr/local file server was down from 1:30am until 11:50am.

[7 Mar 2010] CS/ENSC/FAS home directory file server down from 5:00-10:00am

[ 5 Mar 2010] CS/ENSC/FAS home directory file server down from 2:30-9:30am.

[ 29 January 2010] FASnet scheduled network maintenance between 5:00pm and 6:00pm.

[ 14 January 2010] A FASnet router failure affected connectivity between 10:30am and 10:30pm.

[ 12 January 2010] The RT (gripe) server crashed yesterday. All requests sent on Monday were recreated in the RT (gripe) database and new requests numbers were sent to users. Please use the new request numbers in communications with RT(gripe).

[ 6 January 2010] The cpu server css.css.sfu.ca will be rebooted on Monday January 11, 2010 at 12:01am.

[ 20 December 2009] Home directories have been moved. Some workstations have users logged in and are mounting old home directories. They need to be rebooted.

[ 20 December 2009] Solaris and CentOS workstations patched.

[ 20 December 2009] FASnet semester maintenance from 8:00am to 6:00pm. Network and servers may be down during the maintenance period.

[ 28 September 2009] The FAS Login node oak.fas.sfu.ca was rebooted due to severe over subscription of memory from users jobs. This caused the machine to thrash to the point where the only way to get it back into operation was to reboot. The system has been rebooted and is known to be operating normally.

[ 13 September 2009] The /gruvi/home filesystem problem is fixed.

[ 1 September 2009] *** Solaris workstations patching rescheduled to Tue Sept 1 early in the morning. Workstations will be rebooted

[ 27 August 2009] Two network topology loops were discovered in the FASNet switch configuration. This loop caused a massive broadcast storm leading to intermittent availability of all FAS Network services. The loops were corrected and all systems are now considered fully operational.

[ 23 August 2009] FASnet semester maintenance for Sunday Aug 23. There will be intermittent server and network outages between 8:00am and 6:00pm.

[ 20 Aug 2009 ] FASnet web servers down. Restored from backups. The file server lilac hung and was rebooted.

[26 July 2009] The Samba server bluebell was rebooted to update drivers

[ 26 July 2009] The file server lilac hung and was rebooted

[ 26 July 2009] The Mathematics and Statistics file server was moved and was down between 8:00am and 10:00am.

[ 9 July 2009] The Samba server bluebell has a disk error and crashed on Fri July 3. The new server had performance problems but is now operating normally.

[28 June 2009] The RT ticketing system is down for maintenance. Emailed help requests during the outage will be queued for entry after service is restored. Urgent requests may be submitted via voicemail at 778-835-0742.

[28 May 2009] The Samba server bluebell was overloaded at about 10am and rebooted as a work-around to restore service.

[ 3 May 2009] A switch failure affected file servers. The network connections have been moved to a backup switch.

[ 26 April 2009 ] FASnet semester maintenance between 9:00am and 6:00pm

[ 12 April 2009 ] FASnet mail server maintenance between 8:00am and 9:00am

[ 15 February 2009 ] FASnet mail server maintenance has been cancelled.

[ 10 December 2008 ] Dogwood.fas.sfu.ca was hung and rebooted this morning at 10:20am.

[ 6 December 2008 ] An air conditioning problem in ASB at about 4:30pm caused power to be shut off to ASB server rooms. The down servers affected unix hosts on FASnet. The problems were fixed at around 7:15pm and servers were up by 8:45pm.

[ 27 November 2008 ] A misconfigured host affected the 199.60.16.xxx subnet from 3:30pm until 5:30pm.

[ 21 November 2008 ] Power problems on campus affected the layer 2 switches and FASnet between 9:00pm and 11:00pm.

[ 14 November 2008 ] The DMZ2 VLAN was down from 5:30 PM last night (November 13th, 2008) until 10:50 AM this morning, due to a router problem. This affected all hosts on the 199.60.18.* network. The problem is now fixed.

[ 23 October 2008 ] There was an air conditioning failure last night in the ASB 10818 machine room. This caused the room to overheat and the power went out at around 1:00 AM. As this server room houses our “lilac” fileserver, all FASnet Unix and Linux machines hung, because they depend on NFS mounts from lilac. The air conditioning was fixed and power restored at 9:35 AM this morning. E-mail and web servers which depend on NFS mounts from lilac were also hung during this time period, along with all Math and Stat servers.

[ 8 September 2008 ] The FAS web server had a hardware problem and was down from about 5:15am until 10:00am.

[ 20 August 2008 ] webmail.fas has been temporarily resurrected on a CentOS Linux machine, until replacement parts for the Solaris machine can be acquired and installed. The SSL certificate is the same, and the webmail interface should work pretty much the same was as before. Minor differences in appearance are due to some FASnet customizations not being done on this temporary installation.

[ 19 August 2008 ] Our webmail server (https://webmail.fas.sfu.ca) has suffered a hardware failure. Users are asked to read their mail with an IMAP client such as Thunderbird until the service can be restored.

[ 17 August 2008 ] FASnet semester maintenance from 9:00am until 12:00noon.

[ 30 May 2008 ] The Campus IT Services people found a problem with a Gigabit/second ethernet transceiver in the layer-2 network switch that connects TASC1 to TASC2. They replaced the transceiver today at around 1:20 PM, and FASnet has been okay since then. Hopefully, the network problems that have been ongoing for the last few days are now fixed.

[ 28 May 2008 ] We’re continue to investigate the problem with FASnet network connectivity. The problem seems related to the amount of network traffic. Please do not run network testing software to check on the status of the network.

[ 27 May 2008 ] An intermittent connectivity problem occurred throughout the day. Problem devices on the network were fixed as well as a problem with one OTS switch in the layer 2 network.

[ 20 May 2008 ] A power problem at SFU on Sunday May 18 causes a switch component to fail and affected FASnet connectivity to TASC 1 and ASB. There were network outages between 12:00noon until 6:00pm. All connections were restored at 10:00am today.

[ 27 April 2008 ] FASnet semester maintenance has completed. The mail server os upgrade was backed out and rebooted several times to clear errors. If you sent email before 7:00pm please resend them. Dogwood was reinstalled and online at 7:45pm. Css will be patched at a later date.

[ 2 April 2008 ] Matlab license crashed due to signal 39 at 11:54am. Restarted at 12:40pm.

[ 1 April 2008 ] Workstations on FASnet experienced intermittent connectivity to servers from Monday evening to about 9:00am today because of heavy network traffic from the backup system. We are reconfiguring the backup system to reduce the impact of system backups on FASnet.

[ 30 March 2008 ] The Sun NAS file server was shutdown at about 1:30pm and was back in service by 2:00pm. Filesystems and quota problems were corrected. The server oak.fas.sfu.ca has NFS problems and was rebooted. Workstations with NFS problems after the outage should be rebooted.

[ 23 March 2008 ] The license server was rebooted at approximately 5:00pm.

[ 22 March 2008 ] The Sun NAS had a hardware error at 1:58pm which affected /ensc/EULER and /ensc/GAUSS. Sun is working on recovering the data.

[ 21 March 2008 ] The mail system was down from 12:00am until 6:40pm because the mail spool directories were 100 percent full from email spam and a mail loop in a FASnet account.

[ 13 February 2008 ] The campus SpamAssassin server was down, intermittently, from shortly after midnight until 8:30 PM. This caused timeouts associated with our mailserver trying to contact the SpamAssassin server, resulting in slowing mail delivery by up to 10 minutes. Incoming spam was not flagged and therefore not filtered by processes which depend on the SpamAssassin flags.

[ 14 January 2008 ] A Gbit/sec module on a network switch in an ASB wiring closet failed at 23:13 on Sunday night (January 13th). This caused the network to be down in the ASB 10818 server room, as well as in a few other locations in the ASB, until the connections on the failed module were moved to other switches at 9:30 AM on Monday morning. During this time, various services were unavailable, including the Math & Stats home directories, the main FASnet printer server, and the license servers for software such as Matlab and CMC software. Due to the Math & Stat home directories being unavailable, our mailserver was impacted, and response times were very slow. Any Math & Stats users who have a .forward will have to check their FASnet mail spool file for e-mail that came in during the outage.

[ 23 December 2007 ] FASnet semester maintenance today. Most services are backup up. Dogwood’s disk drive failed and some services will need to be restored.

[ 29 November 2007 ] OTS schedule router change for TASC 1 between 5:00pm and 5:30pm. Internet and FASnet access will be down.

[ 26 October 2007 ] One head on the Sun NAS cluster crashed at about 7:20pm. All filesystems failed over to the other head. The failed head was rebooted and both heads patched with latest updates by 10:00pm.

[ 25 September 2007 ] The Sun NAS fileserver crashed at 11:04 AM due to an intermittent bug. It was back in service at 11:40 AM.

[ 30 August 2007 ] A power problem on an OTS switch in ASB disconnected TASC 1 and ASB from FASnet between 2:57pm and 3:30pm.

[ 27 August 2007 ] Problem with the new FASnet web servers affected web service.

[ 10 August 2007] FASnet links to ASB and TASC 1 went down because of a UPS failure this morning. The links were back up at 9:34am.

[ 7 August 2007] SFU Burnaby campus phone numbers have been converted to 778-782-xxxx numbers. Where xxxx is the last four digits of your current number. Calls on campus can be made using the numbers 2xxxx.

[ 02 August 2007 ] The Sun NAS fileserver crashed at 8:04 PM. We got it working again at 11:15 PM.

[ 31 July 2007 ] The Samba server bluebell was rebooted at 11:00am because of slow performance and lock problems.

[ 22 July 2007 ] The Sun NAS maintenance service is complete. Please email gripe if you encounter any problems.

[ 10 July 2007 ] FASnet links to TASC 1 and the Shrum Classroom Building were down after the OTS switch upgrade. The Sun NAS crashed at about 8:40am. Services were restored at about 10:00am.

[ 30 June 2007 ] Sun NAS crashed overnight and was rebooted at about 10:40am.

[ 22 June 2007 ] Sun NAS crashed overnight and was rebooted this morning at about 8:20am.

[ 18 June 2007 ] FASnet mail server was down between 9:37am and 10:56am.

[ 17 June 2007 ] FASnet web servers were rebooted between 7:30 and 7:40am.

[ 7 June 2007 ] FASnet was down today from 7:05am until 10:00am because of a problem with the FASnet router and TASC 2 switches. It went down again between 10:20am and 10:40am when it appears that one of the Cisco switch modules failed.

[ 28 May 2007 ] The repairs to the Sun NAS seems to be working. Please email gripe@fas.sfu.ca if you encounter any problem.

[ 26 May 2007 ] The Sun NAS fileserver crashed this morning at about 8:30am This is where all the home directories are. We’ve upgrade the server firmware and mounted the filesystems one by one. It seems to be stable now. We’ll continue to monitor it’s status.

[ 25 May 2007 ] A power problem in the ASB east wiring closet rebooted some switches at about 12:45pm. One switch failed to reboot correctly. A user misconfigured network loop hung FASnet when the failed switch was rebooted at about 2:30pm.