» Published on Wed, 09 Oct 2024 15:35:00 +0000

• Resolved

  Blackboard Email Notification Failures An update has been posted We are proactively monitoring email issues and noticed that we experienced an outage for about 30 minutes at around 9:30 am EST. Emails should now be back up and running.

  While we continue to work towards final resolution of the hardware failure impacting emails, we may experience some periods of email delays or outage. We are monitoring all activity, during this period and for the foreseeable future and if we notice outages we will quickly work to mitigate the risks.

  » Updated Thu, 10 Oct 2024 14:21:00 +0000

• Update

  We continue to monitor the email sending infrastructure as we work towards final resolution of the hardware failure impacting email notifications. At this time, there should be minimal email notification failures.

  For administrators receiving user’s email notifications, these notifications should be decreasing as email notifications recover. We are planning to release a fix that will prevent these retried notifications from being received by the administrator as part of the next maintenance update on Thursday, October 10th.

  » Updated Wed, 09 Oct 2024 22:48:00 +0000

• Update

  Update We have completed mitigations for the email notification failures. We are continuing to monitor as we work towards final resolution.

  For the user email notifications being received by administrators, we expect to see fewer of these as email notifications recover. We plan to roll out further fixes as part of the maintenance release on Thursday, October 10th. Posted 14 hours ago. Oct 09, 2024 - 12:57 EDT Update For the email notification issue where administrators were incorrectly BCC’d on user emails, this issue has been fixed and is scheduled to be deployed to Production by this Thursday, October 10th.

  For the sporadic email send failures, we have identified the issue. We are in the process of mitigating the issue. A further update will be provided as more information becomes available and as we make progress.

  Thank you for your continued patience. Posted 15 hours ago. Oct 09, 2024 - 11:13 EDT Update For the email notification issue where administrators were incorrectly Bcc’d on user email, this issue has been fixed and is scheduled to be deployed to Production by this Thursday. Also, the resolution of the ongoing infrastructure issue remains in progress, a further update will be provided as more information becomes available. Posted 20 hours ago. Oct 09, 2024 - 07:09 EDT Update Our teams are continuing to investigate and resolve infrastructure issues resulting in sporadic email notification failures. In addition, we are working on a fix for administrators receiving user's notification emails, and expect this fix to be included in an upcoming maintenance release.

  Thank you for your continued patience as we address these issues. Posted 1 day ago. Oct 09, 2024 - 00:26 EDT Update For the unexpected behavior sending certain notification emails, multiple teams are continuing to investigate the issue. For the issue with administrators receiving user's notification emails, our Development team is working on code changes. Posted 1 day ago. Oct 08, 2024 - 18:01 EDT Monitoring Further investigations have identified the email notification issue was due to the infrastructure becoming unresponsive. Email infrastructure has been restarted to resolve the issue. Posted 2 days ago. Oct 08, 2024 - 10:25 EDT Update Multiple teams continue to investigate earlier reports of email notification failures. A further update will be provided as more information becomes available. Posted 2 days ago. Oct 07, 2024 - 18:28 EDT

  » Updated Wed, 09 Oct 2024 07:44:00 +0000

• Investigating

  We are aware of some ongoing email notification failures. We are investigating and will provide updates as more information is available.

  » Updated Wed, 09 Oct 2024 15:35:00 +0000