All Systems Operational

Uptime over the past 90 days. View historical uptime.
Login Operational
90 days ago
99.32 % uptime
Today
Storage Operational
90 days ago
97.27 % uptime
Today
high,low Operational
90 days ago
99.96 % uptime
Today
bmh,bmm Operational
90 days ago
99.96 % uptime
Today
bgpu Operational
90 days ago
99.96 % uptime
Today
gpuh,gpum Operational
90 days ago
99.96 % uptime
Today
Email Operational
90 days ago
100.0 % uptime
Today
Virtualization Operational
90 days ago
100.0 % uptime
Today
Proxmox Virtualization Nodes Operational
90 days ago
100.0 % uptime
Today
Slurm Operational
90 days ago
95.55 % uptime
Today
Software Operational
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Jul 7, 2026

No incidents reported today.

Jul 6, 2026
Quobyte is down due to another partial power failure in the Data Center
Resolved - Admins have brought Quobyte back online after the partial Data Center power outage.
Jul 6, 17:19 PDT
Update - We have brought the Quobyte file system up and are working on rebuilding data volumes.
Jul 6, 09:00 PDT
Update - Admins are on-site waiting for campus facilities.
Jul 5, 15:32 PDT
Identified - Power has partially failed in the Data Center, which has brought Quobyte down again. Non-Quoybte (i.e., NFS storage mounted in /group/) is still working correctly.

Staff are in contact with the Data Center Operators, and Facilities is being scheduled to investigate the power issue.
Jul 5, 10:19 PDT
Jul 5, 2026
Jul 4, 2026

No incidents reported.

Jul 3, 2026

No incidents reported.

Jul 2, 2026

No incidents reported.

Jul 1, 2026

No incidents reported.

Jun 30, 2026
Farm's nas-12-3 having disk issues
Resolved - nas-12-3 managed to rebuild data onto the new drives over the weekend, so it is no longer teetering on the brink of catastrophic data loss. At this point it is fully back in service and will be closely monitored for additional issues.
Jun 30, 14:49 PDT
Identified - Farm's nas-12-3 is having critical disk issues and is currently unavailable. This is impacting all users with home directories still in the adamgrp legacy free-tier storage as well as the expired emoniergrp and spatial03 shares. Admins are evaluating options.
Jun 28, 10:25 PDT
Jun 29, 2026

No incidents reported.

Jun 28, 2026
Storage Mounts on Farm are unavailable
Resolved - These storage mounts became operational when the login node was rebooted.
Jun 28, 10:05 PDT
Identified - Some storage mounts, including Quobyte mounts, are not accessible from the Farm login node and some compute. System administrators will need to reboot the login node.
Jun 26, 09:35 PDT
Jun 27, 2026

No incidents reported.

Jun 26, 2026
Jun 25, 2026

No incidents reported.

Jun 24, 2026
Power outage at DC is causing Quobyte File Storage to be inaccessible.
Resolved - Power has been restored to the data center row. A breaker went bad in the power panel. System administrators have restored Quobyte to full functionality.
Jun 24, 12:37 PDT
Investigating - Facilities has been called to reset the breaker that powers the Quobyte clustered storage. Data Center operators have been unable to restore power.
Jun 23, 17:10 PDT
Jun 23, 2026
Home directories not automounting on nodes from Slurm jobs
Resolved - A configuration change for Slurm has been implemented that resolves this issue. All user home directories will now mount correctly within Slurm jobs.
Jun 23, 12:13 PDT
Identified - Farm nodes are not correctly automounting user's home directories when new jobs are submitted to that node. This causes the launched jobs to fail. Admins are investigating.
Jun 23, 11:22 PDT
← Incident History Powered by Atlassian Statuspage