Identified - A handful of customers have reported problems resetting their Service Desk passwords. The upstream issue has been identified and will be rectified as soon as possible. Thank you for your patience while this resolved.
Nov 30, 2023 - 15:09 AEDT
GovCMS: Content management and website hosting for the Australian government. Managed by the Department of Finance with service delivery partners Salsa Digital and amazee.io
Completed -
The scheduled maintenance has been completed.
Nov 27, 14:41 AEDT
Update -
Deployment of D10 3.5.0 to production is now completed. The deployment block has now been lifted. We've kicked off non-production deployments, and they will run through the night and into tomorrow.
Nov 21, 14:40 AEDT
In progress -
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 21, 06:00 AEDT
Scheduled -
Advice - Who is affected: GovCMS Drupal 10 (D10) community. - Distribution was updated on Monday 20 November 2023. - PaaS deployments schedules are not impacted. - No modules were added/removed from the distribution. - No outages are expected to websites during the deployment process. - The D10 distribution will continue to be supported after this update. - If you have any concerns, raise a ticket at https://www.govcms.support
Solr Reindex Advice - Websites with Solr Search configured are required to be manually updated during the deployment - Search indexes will be rebuilt immediately with minimal customer impact. - We anticipate that the Solr enabled sites will have finished their deployments and had their search indexes rebuilt by 11:00AM-12:00PM (AEDT). - More importantly, your website’s search function will only be unavailable for a short period of manual reindexing during this time.
Deployment schedule plan: - Commence from 6am Tuesday 21 November 2023 and will be conducted throughout the daytime. - Production branches completed by 10am Wednesday 22 November 2023 - Non-Production branches completed by 10am Thursday 23 November 2023
❗ IMPORTANT NOTICE 1: Deployments during maintenance window - During the scheduled maintenance window, ALL D10 SaaS deployments will be blocked while we deploy to the D10 Production branches. - While the production block is on, you will still be able to develop and deploy to non-production feature branches. - PaaS deployments schedules are not impacted.
❗ IMPORTANT NOTICE 2: Update local environments - Ensure you update your local environments to the latest release. Not rebasing your codebase results in mismatched database configuration causing errors in forklifts and deployments.
❗ IMPORTANT NOTICE 3: For customers with configuration management enabled - The latest configuration from your production database has been created for you in GitLab in a branch called action-required/latest-config-export. - You need to review and test the changes in the merge request. Once you are satisfied, please check the “Delete source branch” box and click “Merge”. - This MUST be done before any new commits. - All subsequent deployments will be blocked in the CI pipeline until this merge request branch is deleted - Not merging the latest configuration provided could result in your new database configuration reverting to an older version when you next deploy, potentially causing issues for your website. - If no merge request is lodged after a release then no configuration has changed and no further action is required.
Information for PaaS customers If you use the GovCMS D10 distribution: - You should aim to apply this update to your distribution as soon as possible. - Updated files will be available from https://github.com/govCMS/GovCMS/releases/tag/3.5.0 - If you manage your own distribution, this core release should have been assessed and addressed.
Nov 14, 13:42 AEDT
Resolved -
This incident has been resolved.
Nov 17, 06:24 AEDT
Update -
A fix was applied last night to prevent this occurring again. We will monitor for a bit longer today to ensure things are running smoothly.
Nov 16, 05:40 AEDT
Monitoring -
This has been stable for the last 3 hours, we will continue to monitor and investigate
Nov 15, 18:00 AEDT
Investigating -
We are seeing intermittent timeouts to GitLab (both the web UI and SSH). We are investigating.
Nov 15, 15:45 AEDT