Last week Melbourne’s rail network ground to a halt after the main control centre was evacuated due to a false alarm – the latest in a growing list of similar outages. So why is Melbourne’s rail control centre so vulnerable to these kind of issues, when other cities seem to keep on ticking?
In the beginning
Way back in the beginning of railways there was no such thing as a central rail control centre – staff at railway stations pulled mechanical levers to direct trains.
Some levers moved the tracks to direct trains where they needed to go, while others operated semaphore signals to tell train drivers whether to stop or go.
The coming of electricity removed the need for as many staff – trains could be automatically detected by the signalling system, with electric motors and coloured light signals taking over from human muscle.
Improvements to electronics made the lever frames themselves redundant, with push button controls allowing remotely located staff to control trains over a widely dispersed network.
Melbourne moved into this modern age with the opening of the ‘Metrol’ train control facility in the 1980s. Located in a specially built facility on Batman Avenue, the brown brick bunker was for more secure than the timber signal boxes that it replaced.
When commissioned in 1980, Metrol had three responsibilities:
- operation of the electronic passenger information displays at city stations,
- communications with station staff, signal boxes and train drivers, and
- directing trains through Flinders Street Station, Spencer Street Station and the City Loop.
In the years that followed the scope of control expanded to cover the area bounded by Clifton Hill, East Richmond, Richmond, and South Kensington stations.
Sowing the seeds of failure
In the late 1990s the decision was made to cover over the Jolimont rail yards, requiring the demolition of the original Metrol site to make way for Federation Square. The existing control systems from the 1980s were relocated to a ‘temporary’ site in the Melbourne CBD, pending their replacement by a modern system by June 2001. Originally costed at $11 million, the cost had grown to $18 million by the time the ‘Train Management Facility’ project was abandoned in 2003.
A second attempt at rejuvenating the now aging system was made in 2006, along with building a backup train control facility, when $88 million was made available in the State Government’s ‘Meeting Our Transport Challenges’ package. Completion was due in 2010 but again delays were encountered, with the modern ‘Train Control Management System’ not taking over until late 2014.
And the failures begin
The first failure of note occurred in June 2005, when a leaking air conditioner flooded the control room and forced trains to stop running:
A simple leak in an air-conditioning hose stopped Melbourne’s trains in their tracks yesterday. The evacuation of a flooded control centre halted city services for two hours.
Up to 30,000 metropolitan and country passengers were stranded and 66 trains cancelled during the afternoon crisis. Dozens of trains sat empty at City Loop platforms. Another 21 trains were cancelled after services restarted and delays lasted into the evening peak period.
The chaos began at 11.40am, when water gushed through the hose into the Metrol control centre on Collins Street, from which Connex runs the train network. As the centre was evacuated, trains were ordered to stop at the nearest station and were stranded for two hours.
Mr Hughes said an investigation was under way. “The management of the problem was fine, our emergency response and our shutdown process worked fine,” he said. “But we’ve got to examine what happened and what re-engineering we might do to make sure it doesn’t happen again.”
October 2014 saw a different issue shut down the control room.
A false fire alarm briefly shut down Melbourne’s entire train network this morning, resulting in flow-on delays.
Metro Trains said an alarm sounded in the building housing the train control centre in the CBD before 10:00am (AEDT).
Trains were halted for about 15 minutes and resumed when it was determined to be a false alarm.
But June 2015 saw the same issue reoccur.
Melbourne’s train operator Metro has apologised to commuters after the city’s rail service was brought to a standstill by a false alarm in the control centre during the morning peak period.
There were delays of up to 40 minutes across the system this morning after the Flinders Street control centre was evacuated due to an alarm at 8:30am.
About 100 trains were stopped and staff were evacuated.
It was quickly determined it was a false alarm and within 18 minutes trains started running again.
The cause of the issue – another water leak.
Metro’s operations director Ron Bria apologised to Metro commuters but said safety was paramount.
“There was a water leak that made its way into the fire panel which made the alarm go into a default position, evacuating the building,” he said.
Mr Bria said a backup did not kick in because that took 50 minutes but the situation was sorted within 15 minutes.
He said communications with building maintenance was usually made before to check if it was a false alarm but because it was a default system, the entire building was ordered out.
The water leak was not on a Metro floor.
But this time around the backup train control centre was an option.
Public Transport Victoria (PTV) chief executive Mark Wild said they did not switch to the back-up control centre because it was faster to get staff back into the main control centre. following the false alarm.
It takes about 50 minutes to get the back-up control centre up and operational.
“When you know it’s going to be a relatively minor delay due to a false alarm, which we were pretty sure this was, it’s best just to re-populate the existing centre and get the system going again, rather than starting up the back-up centre,” Mr Wild said.
“I think Metro are always in that difficult thing about whether they start up the permanent back-up centre or just wait to go back in.”
He said he thought Metro had made the right call by waiting to go back into the existing centre.
History never repeats? Another false alarm caused the November 2016 outage.
Metro Trains say they are “very sorry” after a false alarm brought down Melbourne’s entire train system last night.
The alarm caused the Metro Trains control centre to be evacuated, causing all trains to grind to a halt. The blame was laid on a power fault.
Metro Trains managing director Andrew Lezala said a power fault caused the alarm to activate.
Mr Lezala said that the building’s backup power supply also failed.
“We immediately dispatched a crew then to our other centre,” he told 3AW.
Notice a common theme?
Fixing the problem
When originally built in the 1980s, Melbourne’s train control centre was a bunker that could keep on ticking away despite what the rest of the city threw at it.
Today it is just a room full of computers sitting in an anonymous CBD office block. Sure – backup power supplies allow it to ride out a short power outage, but as soon as a tenant on another floor burns their toast and sets off the fire alarm, it’s everyone out until the all clear is given.
The only solution is to heed the lessons of the past and move Melbourne’s train control centre back into a purpose built secure facility, with redundant systems built in and a management team ready to fix any minor issue before it becomes a major one.
While I was writing this post many others came to the same conclusion – Rail meltdown ignites calls to move network control centre to secure location from The Age.