login


Google Sign inLinkedIn Sign in

Don't have an account? 

Surviving an All-Hands Fire with No One On-Site

Remote
Health / Stress / Burn-Out
Delegate

24 October, 2018

Didier was faced with putting out a colossal fire under extremely challenging circumstances. He needed to orchestrate a resolution with a team that was, for that day only, working remotely. From this experience, he found some valuable lessons.

Problem

I was called in as an Escalation Manager for a fire issue at a US datacenter during a banking holiday in France. As you can imagine, it was not an easy task for me to reach everyone. Additionally, these were all remote workers. Regardless of the impossible circumstances, I was determined to solve the issue and take control of the situation.

Actions taken

My very first task was to produce internal communication about the incident and orchestrate people to do things in the correct order. For example, there could be server restarts if the network had not been not checked. I developed a roadmap for this issue which laid out the steps people should take. Most engineers were in France it was not possible to get people directly in the US datacenter. Luckily, one network guy was there and available to operate. Once people had actions and the order, all was clear and quick. The issue was handled efficiently and in as timely manner.

Lessons learned

This was the first time in my career that I had to lead all people involved remotely for this type of critical issue. To make things worse, I was not able to not send people to the office. I had to accept the situation. The context was different and thus, so was the method. This failure made me think a lot and I realized - among other things - that both onsite workers and those working remotely can be efficient and productive. I found the remote workers to be less stressful than if we'd been at the office (maybe due to my presence). Ultimately, the result was considered a success at the postmortem. From this story, I have learned to never ask to come back to the office during such an issue.


Related stories

Managing and Supporting Remote Teams - From an All-Remote Company
10 July

Wayne Haber, Director of Engineering at Gitlab, gives a series of strategies to keep remote teams running smoothly.

Remote
Wayne Haber

Wayne Haber

Director of Engineering at GitLab

How to Effectively Communicate on Slack
6 July

Shridharan Muthu, VP of Engineering at Zoosk, discusses effective communication using Slack including a recommended framework that entails three simple tips to make the most of the tool.

Internal Communication
Remote
Productivity
Shridharan Muthu

Shridharan Muthu

VP of Engineering, Backend Applications at Zoosk

Improving Collaboration Between Engineering and Product Across Time Zones
6 July

Shridharan Muthu, VP of Engineering at Zoosk, describes how to make communication effective between PMs and engineers when they are located in different time zones and have very little overlap.

Collaboration
Internal Communication
Reorganization
Remote
Shridharan Muthu

Shridharan Muthu

VP of Engineering, Backend Applications at Zoosk

An Acquisition Across Time Zones
6 July

Shridharan Muthu, VP of Engineering at Zoosk, speaks of the time his company was acquired by another org in a time zone half a world away, listing issues and providing solutions to how he overcame the time disparity while transferring product knowledge.

Reorganization
Internal Communication
Motivation
Remote
Shridharan Muthu

Shridharan Muthu

VP of Engineering, Backend Applications at Zoosk

Cultivating a Relationship Between Collocated and Remote Teams
3 July

Arjun Rao, Director of Engineering at Place Exchange, highlights three ways that induce a genial, positive, and flourishing atmosphere between collocated teams and their remote, contracted, or outsourced counterparts.

Remote
Collaboration
Company Culture
Arjun Rao

Arjun Rao

Director of Engineering at Place Exchange

You're a great engineer.
Become a great engineering leader.

Plato (platohq.com) is the world's biggest mentorship platform for engineering managers & product managers. We've curated a community of mentors who are the tech industry's best engineering & product leaders from companies like Facebook, Lyft, Slack, Airbnb, Gusto, and more.