Gone in minutes, out for hours: Outage shakes Facebook

0
By Mike Isaac and Sheera Frenkel

SAN FRANCISCO — Facebook and its family of apps, including Instagram and WhatsApp, were inaccessible for hours Monday (4), taking out a vital communications platform used by billions and showcasing just how dependent the world has become on a company that is under intense scrutiny.

Facebook’s apps — which include Facebook, Instagram, WhatsApp, Messenger and Oculus — began displaying error messages around 11:40 a.m. Eastern time, users reported. Within minutes, Facebook had disappeared from the internet. The outage lasted more than five hours, before some apps slowly flickered back to life, though the company cautioned the services would take time to stabilize.

Even so, the impact was far-reaching and severe. Facebook has built itself into a linchpin platform with messaging, live-streaming, virtual reality and many other digital services. In some countries, like Myanmar and India, Facebook is synonymous with the internet. More than 3.5 billion people around the world use Facebook, Instagram, Messenger and WhatsApp to communicate with friends and family, distribute political messaging, and expand their businesses through advertising and outreach.

Facebook is used to sign in to many other apps and services, leading to unexpected domino effects such as people not being able to log into shopping websites or sign into their smart TVs, thermostats and other internet-connected devices.

Technology outages are not uncommon, but to have so many apps go dark from the world’s largest social media company at the same time was highly unusual. Facebook’s last significant outage was in 2019, when a technical error affected its sites for 24 hours, in a reminder that a snafu can cripple even the most powerful internet companies.

This time, Facebook said late Monday, the culprit was changes to its underlying internet infrastructure that coordinates the traffic between its data centres. That interrupted communications and cascaded to other data centres, “bringing our services to a halt,” the company said.

Facebook eventually restored service after a team got access to its server computers at a data center in Santa Clara, California, three people with knowledge of the matter said. Then they were able to reset them.

The company apologized for the outage. “We’re sorry,” it said on Twitter after its apps started becoming accessible again. “Thank you for bearing with us.”

The outage added to Facebook’s mounting difficulties. For weeks, the company has been under fire related to a whistleblower, Frances Haugen, a former Facebook product manager who amassed thousands of pages of internal research. She has since distributed the cache to the news media, lawmakers and regulators, revealing that Facebook knew of many harms that its services were causing, including that Instagram made teenage girls feel worse about themselves.

The revelations have prompted an outcry among regulators, lawmakers and the public. Haugen, who revealed her identity Sunday online and on ‘60 Minutes’, is scheduled to testify Tuesday in Congress about Facebook’s impact on young users.

“Today’s outage brought our reliance on Facebook — and its properties like WhatsApp and Instagram — into sharp relief,” said Brooke Erin Duffy, a professor of communications at Cornell University. “The abruptness of today’s outage highlights the staggering level of precarity that structures our increasingly digitally-mediated work economy.”

When the outage began Monday morning, Facebook and Instagram users quickly turned to Twitter to lament and poke fun at their inability to use the apps. The hashtag #facebookdown also started trending. Memes about the incident proliferated.

But a real toll soon emerged, because many people worldwide rely on the apps to conduct their daily lives.

“With Facebook being down we’re losing thousands in sales,” said Mark Donnelly, a start-up founder in Ireland who runs HUH Clothing, a fashion brand focused on mental health that uses Facebook and Instagram to reach customers. “It may not sound like a lot to others, but missing out on four or five hours of sales could be the difference between paying the electricity bill or rent for the month.”

Samir Munir, who owns a food-delivery service in Delhi, said he was unable to reach clients or fulfil orders because he runs the business through his Facebook page and takes orders via WhatsApp.

“Everything is down, my whole business is down,” he said.

Douglas Veney, a gamer in Cleveland who goes by GoodGameBro and who is paid by viewers and subscribers on Facebook Gaming, said, “It’s hard when your primary platform for income for a lot of people goes down.” He called the situation “scary.”

Inside Facebook, workers also scrambled because their internal systems stopped functioning. The company’s global security team “was notified of a system outage affecting all Facebook internal systems and tools,” according to an internal memo sent to employees and shared with The New York Times. Those tools included security systems, an internal calendar and scheduling tools, the memo said.

Employees said they had trouble making calls from work-issued cellphones and receiving emails from people outside the company. Facebook’s internal communications platform, Workplace, was also taken out, leaving many unable to do their jobs. Some turned to other platforms to communicate, including LinkedIn and Zoom as well as Discord chat rooms.

Some Facebook employees who had returned to working in the office were also unable to enter buildings and conference rooms because their digital badges stopped working. Security engineers said they were hampered from assessing the outage because they could not get to server areas.

Facebook’s global security operations centre determined the outage was “a HIGH risk to the People, MODERATE risk to Assets and a HIGH risk to the Reputation of Facebook,” the company memo said.

A small team of employees was soon dispatched to Facebook’s Santa Clara, California, data centre to try a “manual reset” of the company’s servers, according to an internal memo.

Several Facebook workers called the outage the equivalent of a “snow day,” a sentiment that was publicly echoed by Adam Mosseri, the head of Instagram.

In Facebook’s early days, the site experienced occasional outages as millions of new users flocked to the network. Over the years, it spent billions of dollars to build out its infrastructure and services, spinning up enormous data centers in cities including Prineville, Oregon, and Fort Worth, Texas.

The company has also been trying to integrate the underlying technical infrastructure of Facebook, WhatsApp and Instagram for several years.

John Graham-Cumming, chief technology officer of Cloudflare, a web infrastructure company that helps direct traffic to Facebook, said that his company became aware of the outage early on and saw the incident’s scope. He described the issue as a “misconfiguration”.

“It was as if Facebook just said, ‘Goodbye, we’re leaving now,’ ” Graham-Cumming said.

-New York Times

Outside Facebook headquarters in Menlo Park, Cali., on Sept. 9, 2020. Facebook and its family of apps, including Instagram and WhatsApp, went down at the same time on Monday (4), taking out a vital communications platform used by more than three billion people around the world and adding heat to a company already under intense scrutiny – Kelsey McClellan/THE NEW YORK TIMES

Leave A Reply

Your email address will not be published.

otc high blood pressure treatment blood pressure guidelines medications blood pressure pills that is safe for the liver high blood pressure medication levothyroxine blood pressure medication that reduces blood pressure is there any difference in blood pressure pills high blood pressure child medication blood pressure medication recommendation nose blue blood pressure medication blood pressure is 150 68 should i take my medication blood pressure medication while nursing taking a bunch of high blood pressure pills aerobic exercise and blood pressure medication good blood pressure medication acupuncture treatment for low blood pressure best over the counter pills for high blood pressure blood pressure pill amlodipine besylate high blood pressure signs and treatment moderna vaccine blood pressure medication which blood pressure drugs do not cause tinnitus blood pressure medication fights cancer blood pressure medication skin rash side effects of high blood pressure medication impotence medication to avoid on blood pressure medications high blood pressure rx medication peripheral neuropathy caused by blood pressure medication high blood pressure in pregnancy treatment nice runny nose do to blood pressure medication how to get off of blood pressure pills hiv medication and high blood pressure niacin treatment for high blood pressure two drugs for blood pressure that caused cancer high blood pressure causing medications high blood pressure medication names canada blood pressure medication side effects alcohol i take 3 blood pressure medication blood pressure pills that help with anxiety what iv drug raises blood pressure list of doctors who formulated blood pressure medications how to remember blood pressure medications sleeping pills blood pressure how fast does blood pressure medication take effect sweet n low high blood pressure medication home treatment for blood pressure high blood pressure medication matrocet high blood pressure medication doses blood pressure drug bystolic iberstaron blood pressure medication blood pressure medications st alphabetical celexa and high blood pressure medication does blood pressure pills irritation skin can i take combivent with high blood pressure medication blood pressure medications beta blockers list what to do if blood pressure medication does not work drugs to lower your blood pressure red beet pills for blood pressure taurine and blood pressure medications how ling for garlic pills to lower blood pressure blood pressure medication list and side effects can i take aspirin with high blood pressure medication blood pressure medication teaching about hot tubs water pills high blood pressure over counter what is an arb medication for blood pressure resveratrol high blood pressure medication high blood pressure medication and weight loss gum disease and blood pressure medication benzenesulfonic acid in blood pressure medication taking two blood pressure pills by mistake allergy pills for high blood pressure blood pressure prescription drugs safety blood pressure medication in pregnancy trazodone and blood pressure medication which blood pressure medication is linked to skin cancer list of blood pressure medications with the least side effects could blood pressure medication make blood thicker disadvantages of high blood pressure medication blood pressure medications ludipril typical drugs for high blood pressure otc water pills for high blood pressure blood pressure medications that do not doncause bowel blockage high blood pressure after corrosion treatment how soon does high blood pressure medication work blood pressure medication teaching amertyrine high blood pressure medication increased blood pressure and heart rate after drug overdose over the counter drugs high blood pressure blood pressure medication 25 is blood pressure medication a nitrate most effective blood pressure pills blood pressure medical does red yeast rice interfere with high blood pressure medication can apple cider vinegar pills lower blood pressure does blood pressure medication give you headaches high blood pressure medication and driving should you take blood pressure pills with food inn blood pressure drugs can you eat bananas if taking blood pressure medication popular high blood pressure medication blood pressure medication los blood pressure medication second drug low blood pressure and hypertension medication do water pills lower blood pressure high blood pressure pill aqunadine high blood pressure cholesterol medication how does medication lower blood pressure acetaminophen blood pressure medication blood pressure medication 30 mg that works around the heart what does grapefruit do to blood pressure medication can red yeast rice be taken with blood pressure medication pharmaceutical treatment for high blood pressure are blood pressure pills statins blood pressure pills that start with r blood pressure medication and male impotence taking baby aspirin with other high blood pressure medications what is the medical name for a blood pressure cuff leg cramps and blood pressure medication blood pressure pill name starts with p natural high blood pressure treatments blood pressure medication names losartan higher blood pressure with radiation treatment medical marijauna high blood pressure how to avoid medication for high blood pressure what time is best to take blood pressure medication medication for palpitations and high blood pressure latest news on blood pressure treatment what if i take two blood pressure pills does xanax interfere with blood pressure medication amlipan blood pressure medication vitamin e and blood pressure medication tell me the side effects of high blood pressure medication herbs pills to lower blood pressure blood pressure medication urge to urinate what medication will safely replace lisop as blood pressure medicine active ingredient in high blood pressure medication blood pressure medications cause adrenal tumors is biktarvy ok to take with high blood pressure medication alembic blood pressure medication sandoz blood pressure medication exercise high blood pressure medication grapefruit pills blood pressure treatment for high blood pressure at home blood pressure medication for patients with osa cycle on off blood pressure medication blood pressure drugs that do not cause heat sensitivity blood pressure medications that do not cause coughing what blood pressure medications do not cause rosacea pfizer blood pressure medication side effects do garlic pills really help lower blood pressure should i take medication for anxiety induced blood pressure treatment for uncontrolled blood pressure decongestant medication high blood pressure can stiff days be used with high blood pressure medication how long does it take medication to lower blood pressure what if i miss a blood pressure pill tribenzor high blood pressure pills law lawsuit 2023 treatment of sudden drop in blood pressure zoloft and blood pressure medication orange high blood pressure pill cancer blood pressure pill why cant people with high blood pressure take keto pills how long for blood pressure to go down mini pill should i get second opinion before taking blood pressure medication blood pressure erectile dysfunction medication high blood pressure medication m lot ben medical device lowers blood pressure puppy ate blood pressure pill are there medications for low blood pressure dod blood pressure medication is losartan a blood pressure pill combination drugs for blood pressure marijuana and blood pressure medication interaction blood pressure medication interactions with grapefruit can you eat bananas while taking high blood pressure medication steps before going on high blood pressure medication blood pressure medication when to cut down foods to avoid on blood pressure medication blood pressure medications depression blood pressure medication non beta blocker tattoos and high blood pressure medication what is the medications used to lower blood pressure quickly high blood pressure medication leg swelling blood pressure medication men in your 40s blood pressure medication wieight loss blood pressure medication hy can blood pressure medication lower blood sugar does blood pressure medication make you pee natural treatment high blood pressure during pregnancy can you take l arginine with high blood pressure medication what class of blood pressure medication can can blood pressure pills reduce appetite faa approved medication for high blood pressure high blood pressure medication during pregnancy best blood pressure medication for type 2 diabetes blood pressure and pain medication pain medication that does not affect blood pressure best high blood pressure drugs on the market if you take incorrect medications to lower blood pressure low blood pressure treatments does your body have to adjust to blood pressure medication why water pill for high blood pressure drugs for treatment of very high blood pressure during pregnancy can i drink grapefruit juice with high blood pressure medication can blood pressure pills make you feel cold high blood pressure medication that helps with weight loss amlodipine blood pressure drug blood pressure medication for infants varicose veins blood pressure medication life extension high blood pressure medication does tylenol interfere with blood pressure medication can i take diamox with other high blood pressure medications prestige medical blood pressure cuff calibration drugs used for high blood pressure chamomile tea and high blood pressure medication narcotics stored alongside blood pressure medications in does nutrigrove blood pressure pills work extremely low blood pressure treatment blood pressure medication for iga nephropathy blood pressure medication low side effects can i increase my blood pressure medication what is the best blood pressure medication to take drugs that cause increased blood pressure does biotin interfere with high blood pressure medication cani od on high blood pressure pills blood pressure medication that also helps with jerking blood pressure medication categories first line treatment of high blood pressure medication for low blood pressure in usa armour thyroid drug interactions blood pressure meds hepatitis c treatment high blood pressure high blood pressure arb drugs low blood pressure treatment with essential oils high blood pressure medication list for pregnancy blood pressure medication and snake venom blood pressure medication low dose liquid blood pressure medications ivf drugs and high blood pressure left my blood pressure medication does it matter when you take blood pressure medication can you take blood pressure pills twice a day privilin blood pressure medication how big are blood pressure pills once you start blood pressure medication can you stop diuretic in blood pressure medication what medication reduce blood pressure new blood pressure treatment prescribed home medications for high blood pressure blood pressure medication side effects forums taking blood pressure pills dizzy when bend over a lot blood pressure medication and nyquil cinnamon pills and high blood pressure temporary high blood pressure treatment single agent blood pressure medication blood pressure medication made in china fda approved medications to reduce blood pressure immediate treatment for high blood pressure at home best time to take blood pressure pills muscle loss on high blood pressure medication blood pressure medication when needed treat high blood pressure without medication blood pressure medication side effects for men cbd pills for high blood pressure blood pressure regulation without medication blood pressure medication and pre workout high blood pressure alzheimer disease and antihypertensive treatment miss blood pressure medication blood pressure pills suicide peaceful emergency drugs for low blood pressure common blood pressure medications in canada systolic blood pressure define medical viril and high blood pressure pills can statin drugs help lower blood pressure do you have to wean off blood pressure medication new drugs for blood pressure when is high blood pressure medication necessary drugs for hi blood pressure cold medications and blood pressure taking 2 blood pressure pills mistake why doctors stopped prescribing blood pressure medication common high blood pressure medication canada what side effects does blood pressure medication have ulcer medication high blood pressure can high blood pressure medication elevate alkaline phosphatase blood pressure medication warning getting blood pressure medication jamaica alkaline water and blood pressure medication blood pressure going up and down with medication drugs reduce systolic blood pressure treatment for rapid high blood pressure low blood pressure alternative treatment do all high blood pressure medications cause weight gain medication for increasing blood pressure blood pressure medication for african american males vitamins for high blood pressure treatment aleve with blood pressure medication how to lower blood pressure without pills blood pressure triple pill who blood pressure guidelines for hygiene treatment what drug reduces blood pressure blood pressure medications enalapril met blood pressure medication