DC3HAM shared infrastructure services Issue on 29th May 2024

UPDATE 2024-05-29 17:41 CEST

mitigation is still ongoing as large volumes have to be moved. we continue to work 24×7


Dear Customer,

We are experiencing temporary downtimes of shared infrastructure services like Gitlab, Harbor, Rancher. Customer environments are not affected directly however in some cases e.g. some deployments are not possible. investigations have been difficult but we are are working with highest priority on the mitigation of the problem.

Best regards
Your CONVOTIS Munich Managed Service Team

DC3HAM Network Maintenance on 13th June 2024 by Colt

Dear Customer,

Pease be informed about the following  scheduled network maintenance by our carrier Colt.

Colt intends to carry out internal maintenance within its network. This has been designated as ESSENTIAL. The nature of this work is to carry out fiber cable work. Work is required to perform infrastructure maintenance to ensure the continued integrity of the network.
During the maintenance window you will experience one period of outage, with maximum duration of 7 hours.

The maintenance is scheduled for :

Start End
2024-06-13 21:00 GMT (Greenwich Mean Time) 2024-06-14 04:00 GMT (Greenwich Mean Time)
2024-06-13 23:00 CEST (Central European Summer Time) 2024-06-14 06:00 CEST (Central European Summer Time)

Colt would like to apologize for any inconvenience caused by this maintenance.

We will test the systems after the maintenance window and inform you about the status.

Best regards
Your MCON Managed Service Team

Patch Scheduling Changed for all Regions – System Upgrades MCON Managed Systems

Dear Customer,

In order to keep our server systems updated and secure, we are applying patches on a regular basis.

Starting from April 2024, we introduce a new patch schedules in order to provide more testing time on the non-PROD environments.

  1. Patching for APAC region
    • DEV environment:
      • on Monday of the 1st full week
      • at 16:00PM (UTC+8 timezone)
    • QA/STAGE environment:
      • on Wednesday of the 1st full week
      • at 22:00PM (UTC+8 timezone)
    • PROD/LIVE environment:
      • on Friday of the 1st full week
      • at 01:00AM (UTC+8 timezone)
  2. Patching for EMEA region
    • DEV environment:
      • on Monday of the 2nd full week
      • at 09:00 (UTC+1 timezone)
    • QA/STAGE environment:
      • on Wednesday of the 2nd full week
      • at 15:00PM (UTC+1 timezone)
    • PROD/LIVE environment:
      • on Thursday of the 2nd full week
      • at 22:00PM (UTC+1 timezone)
  3. Patching for American region
      • DEV environment:
        • on Monday of the 3rd full week
        • at 16:00PM (UTC-5 timezone)
      • QA/STAGE environment:
        • on Wednesday of the 3rd full week
        • at 09:00AM (UTC-5 timezone)
      • PROD/LIVE environment:
        • on Friday of the 3rd full week
        • at 03:00AM (UTC-5 timezone)

If we don’t receive any feedback, we assume that you agree with the next scheduled update and will perform the update as planned.

PS: For any maintenance announcements and status, please view status.mcon-group.info.

Best regards,
Your MCON Managed Services Team

Announcement Housekeeping Activities MCON Managed Systems between 26th December 2022 and 6th January 2023

Dear Customer,

The end of the year is approaching – we do not wish you Happy Holidays yet. But want to inform you about our housekeeping activities which will take place during the holiday season where you will probably be on leave.

Of course our 24×7 operations, monitoring and incident management will continue as usual.
However, between 26th December 2022 and 6th January 2023, we will focus on our housekeeping tasks and not execute non critical change requests.

In urgent cases please send us a ticket as usual to service@mcon-group.support

Best regards,
Your MCON Managed Services Team 

Finished: DC3HAM Maintenance on 21st October 2022 by Lumen

Dear customer,

according to our announcement below, the scheduled network maintenance by our carrier Lumen was finished. All systems are up and running.

However if you encounter any problem please contact:
service@mcon-group.support.

Best regards
Your MCON Managed Services Team

Announcement from 17th October 2022:
Dear Customer,

please be informed about the following  scheduled network maintenance by our carrier Lumen.

Lumen intends to carry out internal maintenance within its network. This has been designated as ESSENTIAL. The nature of this work is to perform a Black Building Test. Lumen will be performing the annual black building test. This activity has been scheduled to validate all documented and authorised processes and procedures pertinent to electrical load transfers following a total commercial power failure to our Gateway facility and to ensure the back up systems are fully functional. The test will be arranged into several phases. Lumen M&E and the specialist M&E contractors will be available on-site to support this activity. All generator (EPG) and associated back up equipment will be fully tested prior to this maintenance and a call will be placed to the mains supplier to ensure there are no events on their network. During the maintenance period you will NOT experience any outage. This notification is sent to you for COURTESY PURPOSES ONLY.

Lumen would like to apologize for any inconvenience caused by this maintenance.

The maintenance is scheduled for : 
2022-10-21 00:00 CEST (Central European Summer Time)    2022-10-21 03:00 CEST (Central European Summer Time)

We will test the systems after the maintenance window and inform you about the status.

Best regards
Your MCON Managed Service Team 

DC3HAM Maintenance on 21st October 2022 by Lumen

Dear Customer,

please be informed about the following  scheduled network maintenance by our carrier Lumen.

Lumen intends to carry out internal maintenance within its network. This has been designated as ESSENTIAL. The nature of this work is to perform a Black Building Test. Lumen will be performing the annual black building test. This activity has been scheduled to validate all documented and authorised processes and procedures pertinent to electrical load transfers following a total commercial power failure to our Gateway facility and to ensure the back up systems are fully functional. The test will be arranged into several phases. Lumen M&E and the specialist M&E contractors will be available on-site to support this activity. All generator (EPG) and associated back up equipment will be fully tested prior to this maintenance and a call will be placed to the mains supplier to ensure there are no events on their network. During the maintenance period you will NOT experience any outage. This notification is sent to you for COURTESY PURPOSES ONLY.

Lumen would like to apologize for any inconvenience caused by this maintenance.

The maintenance is scheduled for : 
2022-10-21 00:00 CEST (Central European Summer Time)    2022-10-21 03:00 CEST (Central European Summer Time)

We will test the systems after the maintenance window and inform you about the status.

Best regards
Your MCON Managed Service Team 

Microsoft Exchange Server Vulnerabilities

Dear customer,

We are working on the aftermath of the massive exchange vulnerability that was made public this week, we also had exchange servers of customers actively attacked, fortunately it looks as if no data was stolen and no further servers were compromised. The servers do not have webshells or similar installed, however, we are purging and reinstalling all components that were involved.

We are also reviewing all network activity.

We are allocating a lot of resources to this, therefore please understand if reaction times are a little slower for the coming 1-2 weeks.
With the history of massive breaches, also and especially in cyber security companies, we are also reviewing our security and network infrastructure, the results will be share with you in a way that we might encourage changes in your architecture as well.

Best regards,
Your MCON Managed Services Team

Patchtime managament 2021 Region America and APAC

Dear customer,

year 2020 is ending and we want to wish you a happy new year 2021!

We also want to inform you about some changes in our regular security patching which needs to be done as there are many systems in many time zones meanwhile.

In order to give each system the attention which it may need after patching we will patch by region on different days.

Europe Region: we will keep the current patching, means

    • QA systems will be patched on Thursday after 2nd Tuesday each month
    • Production systems will be patched on Friday after 2nd Tuesday each month

America Region:

    • QA: On the 3rd Tuesday of each month
    • Production: The 3rd Tuesday to Wednesday night of each month

APAC Region:

    • QA: On Thursday after each 3. Tuesday of the month
    • Production: The Thursday to Friday night after each 3. Tuesday of the month

As usual patching of production systems will take place in the first hours of the day, e.g. “Friday” usually means from Friday 0 am to 5 am within the respective time zone. Patching of Development systems take place at 10 AM, QA / Stage systems take place at 2 PM.

We will send upfront notifications with exact dates as usual, however per region in future. If you have systems in several regions then you will receive several notifications.The dates for patching in Europe will stay the same as before.

We reserve the right to move patch dates, e.g. due to national holidays or later availability of upstream patches,

All the best
Your MCON Managed Services Team