The Disarray Inside Boeing's 737 Factory Before the Door Plug Blowout(wsj.com)
wsj.com
The Disarray Inside Boeing's 737 Factory Before the Door Plug Blowout
https://www.wsj.com/business/airlines/disarray-boeing-factory-door-plug-blowout-f063e27e
13 comments
https://archive.ph/WYdVW
Lots of details on how they kept pressure up, skipped on important checks and procedure because it might slow things down, production numbers were way lower than planned ...
But is there any definite source or elements about why the numbers were so down ? Were the projection unrealistic ? And if yes was it because they pulled them out of their ass or because they needed the unrealistic high ones to get the sales ? Or were the numbers realistic but working with so many externalized subcontrators slowing things down ? I think I read something about, eg how they had to refuse so many of spirits' produce that it was slowing everything down, but by that much ?
Another reason could be that the plane was harder to produce than expected but while I could buy that for the 787 I don't see how it can be remotely true for the MAXes, they were supposed to be a known quantities.
But is there any definite source or elements about why the numbers were so down ? Were the projection unrealistic ? And if yes was it because they pulled them out of their ass or because they needed the unrealistic high ones to get the sales ? Or were the numbers realistic but working with so many externalized subcontrators slowing things down ? I think I read something about, eg how they had to refuse so many of spirits' produce that it was slowing everything down, but by that much ?
Another reason could be that the plane was harder to produce than expected but while I could buy that for the 787 I don't see how it can be remotely true for the MAXes, they were supposed to be a known quantities.
One major reason for the pressure was the ebb and (still ongoing flow) of of demand for jet airplanes.
During the pandemic air traffic was hit hard and the entire industry (which is much larger than Airbus and Boeing) started to prepare for a slowing down, including firing staff, retiring products and such.
That slow down never really happened, instead there was a massive upswing in demand. Both Airbus and Boeing are currently racing to build as many planes as they can, as their customers are begging them to give them planes as soon as possible and as many as they can.
This is exactly the kind of situation in which mistakes happen. Boeing and their suppliers needed to rehire staff and train them while having a huge pressure to get planes out of their factories. Somewhat funnily both Airbus and their suppliers have a much harder time firing staff, due to stricter EU employment regulations, meaning that they unintentionally were better off when demand started up again, nevertheless Airbus and suppliers are currently hiring massively as well.
During the pandemic air traffic was hit hard and the entire industry (which is much larger than Airbus and Boeing) started to prepare for a slowing down, including firing staff, retiring products and such.
That slow down never really happened, instead there was a massive upswing in demand. Both Airbus and Boeing are currently racing to build as many planes as they can, as their customers are begging them to give them planes as soon as possible and as many as they can.
This is exactly the kind of situation in which mistakes happen. Boeing and their suppliers needed to rehire staff and train them while having a huge pressure to get planes out of their factories. Somewhat funnily both Airbus and their suppliers have a much harder time firing staff, due to stricter EU employment regulations, meaning that they unintentionally were better off when demand started up again, nevertheless Airbus and suppliers are currently hiring massively as well.
> Somewhat funnily both Airbus and their suppliers have a much harder time firing staff, due to stricter EU employment regulations, meaning that they unintentionally were better off when demand started up again, nevertheless Airbus and suppliers are currently hiring massively as well.
I don't think stability is unintentional. You can see how France economically always "lags behind" other economies in good times, but is also barely affected in bad times. On average, over time, it just performs like the rest of the EU.
I don't think stability is unintentional. You can see how France economically always "lags behind" other economies in good times, but is also barely affected in bad times. On average, over time, it just performs like the rest of the EU.
Sure, the goal of these employment laws is to create stability at the cost of a more dynamic market (Startups are very hard to do in the EU for some of those reasons). Although at the time Airbus would have liked to lay of many more employees, but couldn't. Which ultimately benefitted them.
Also, such labor laws exist in Germany as well which is Airbuses other big country.
Also, such labor laws exist in Germany as well which is Airbuses other big country.
> Startups are very hard to do in the EU for some of those reasons
The biggest obstacle is not employment laws or environmental or other compliance crap. The biggest obstacle is getting funding, Europe doesn't have the sheer amounts of "dumb money" that the US has due to their pension/401k system.
The biggest obstacle is not employment laws or environmental or other compliance crap. The biggest obstacle is getting funding, Europe doesn't have the sheer amounts of "dumb money" that the US has due to their pension/401k system.
And before, there was huge flows of money because USA didn't have to rebuild from war and instead spent on defense like crazy - which filtered down to building wider and wider rings of industry along Route 128, Silicon Valley, LA, etc.
GP means it's not what 'Airbus and their suppliers' intended; the regulation stopped them from intended redundancies, which ended up being an advantage but not by their hand, forced on them.
1) Their supplier network was a mess post-COVID, 2) they wouldn't budge on pricing, and 3) Boeing internal forecasts are, even in good times, generally worse than a coin toss.
Wait, that last bit isn't quite right. Internal forecasts are generally flexible, rather than random, to adjust for the mood of the Overlord of the day. So if you get a stretch where the boss is feeling tetchy, forecasts suddenly start turning pretty good. It doesn't help that, at least anecdotally, the forecasting group's all been former executive assistants and people who were kicked out of systems engineering. Generally people on their way to somewhere else.
Working anywhere in the Boeing procurement group is a career death sentence, there is just no scenario where you win that fight. The price is never low enough, the suppliers are never getting enough money, and eventually you're going to be the scapegoat for a shortfall somewhere, whether it be cash or off-spec parts or PWAs stuffed full of tinsel and compressed dander.
Wait, that last bit isn't quite right. Internal forecasts are generally flexible, rather than random, to adjust for the mood of the Overlord of the day. So if you get a stretch where the boss is feeling tetchy, forecasts suddenly start turning pretty good. It doesn't help that, at least anecdotally, the forecasting group's all been former executive assistants and people who were kicked out of systems engineering. Generally people on their way to somewhere else.
Working anywhere in the Boeing procurement group is a career death sentence, there is just no scenario where you win that fight. The price is never low enough, the suppliers are never getting enough money, and eventually you're going to be the scapegoat for a shortfall somewhere, whether it be cash or off-spec parts or PWAs stuffed full of tinsel and compressed dander.
So how do you even fix a problem like this?
It seems the company had some procedures in place, particularly the documentation of "removals," but the line employees didn't follow that process in this case. One reason appears to be the tremendous pressure they were under to get planes out of the factories.
The article also mentions a possible lack of experience, since some of the workers could be very new to the company...though they could also have been quite experienced as well.
It is so, so very hard to evaluate risk and causation.
It seems the company had some procedures in place, particularly the documentation of "removals," but the line employees didn't follow that process in this case. One reason appears to be the tremendous pressure they were under to get planes out of the factories.
The article also mentions a possible lack of experience, since some of the workers could be very new to the company...though they could also have been quite experienced as well.
It is so, so very hard to evaluate risk and causation.
>So how do you even fix a problem like this?
Slow down production, increase oversight and focus on training. Make sure that many employees stay for a long time and that they are encouraged to share their knowledge with new hires.
Slow down production, increase oversight and focus on training. Make sure that many employees stay for a long time and that they are encouraged to share their knowledge with new hires.
Also: (re) foster an environment where people can highlight issues without being ignored or even harassed for it. Once people start noticing that their reports about potential issues are ignored or makes colleagues act differently towards them, it's game over.
Well, if they rushed a plane through due to pressure to get planes done quickly, then that shows that pressure works. So just apply it differently.
Dig a little deeper and you should come across some backstory that details how the company purged itself of most of it's senior engineering, machining, and inspection staff. Pretty much anyone with the experience to spot a problem and the balls to say something got the chop. Boeing senior management decided to take a page from the private equity playbook and tried to run one of the most complex manufacturing concerns on the planet like a fast food restaurant, with predictable results.
On the lines themselves, word on the street is that the powers-that-be greatly relaxed the "greeenlight" process post-COVID, which is a way to get a job outside your specific job code. To remove the Boeing-speak, they made it easier for the janitor to be the electrician. The really cool thing about greenlighters is that they never make quite as much money, and there is a substantial period - as long as two years - where they keep making their janitor salaries while they're doing the higher spec work. Win-win!
Here's the article on MSN: https://www.msn.com/en-us/money/companies/the-disarray-insid...
Side question: does anyone know how msn seems so impossible to scrape? What’s the magic they’re doing that other sites aren’t?
For starters, everything loads via javascript. I have JS enabled, but use uBlock Origin, and the page is just empty.
Yeah they do some other shenanigans. Once you open inspect element the site just blanks out. It's the only website I've ever seen do anything like this.
Painting over damaged rivets is surely deep into criminal charges territory?
Mistakes happen but that’s pretty intentional
Mistakes happen but that’s pretty intentional
If an A&P mechanic did that on a live aircraft that is very deep into felony territory.
At this point, wouldn't a penetration tester stance by the state be more effective?
Basically the institutions try to subvert the production process by sabotaging via infiltration, and then look for the corresponding paper-trail, fixed product, caught pentest.
It would keep everybody on there toes, every process functional and the regulators working without getting caught.
It would keep everybody on there toes, every process functional and the regulators working without getting caught.
It’s an interesting idea, but I don’t think it quite solves the problem here, at least as I understand the problem. The system isn’t designed to protect against actively hostile/sabotaging elements inside the factory, nor was that the problem (i.e., if you have factory floor access, you could go and sabotage the plane by drilling holes in a part after it’s been installed and inspected, but that’s not the issue at hand). The issue here is skipping or skirting existing process in the name of efficiency. People aren’t trying to destroy planes, they’re just not doing their job “correctly”. Some sort of process inspector is typically what you’d use here.
If you've worked on building any simple little object you know King Murphy sabotages all steps. The problem with Mr. Murphy is that he doesn't tell you when he's going to strike. Having a Murphy Larper would at least give you an insight to the processes that are supposed to thwart Herr Murphy.
I'm not sure what a Process Inspector does. Do they work nights and weekends? Are they protected from reporting failures in process? Who holds responsibility for every process failure?
I'm not sure what a Process Inspector does. Do they work nights and weekends? Are they protected from reporting failures in process? Who holds responsibility for every process failure?
Depends on what the goal is. If the goal is safety, that might make sense. But according to what Boeing been doing for the last decade or so, the goal is no longer safety but higher production numbers, then doing something like that would work against getting there.
If I was running an airline that had just taken delivery of 737s, I'd be terrified. And very very unhappy.
I wonder what insurance rates on these look like now
Like the price for a brand new plane with pilot recertification, but in rates.
Has there been any update on the whistleblower who died under suspicious circumstances?
He remains dead.
However, this article about him, and the behaviour of Boeing management at Charleston factory, is a pretty good eulogy. RIP Swampy.
https://prospect.org/infrastructure/transportation/2024-03-2...
However, this article about him, and the behaviour of Boeing management at Charleston factory, is a pretty good eulogy. RIP Swampy.
https://prospect.org/infrastructure/transportation/2024-03-2...
This thoroughly vindicates what the anonymous whistleblower on the internet was saying:
https://leehamnews.com/2024/01/15/unplanned-removal-installa...
> Current Boeing employee here – I will save you waiting two years for the NTSB report to come out and give it to you for free: the reason the door blew off is stated in black and white in Boeings own records. It is also very, very stupid and speaks volumes about the quality culture at certain portions of the business.
> A couple of things to cover before we begin:
> Q1) Why should we believe you? A) You shouldn’t, I’m some random throwaway account, do your own due diligence. Others who work at Boeing can verify what I say is true, but all I ask is you consider the following based on its own merits.
> Q2) Why are you doing this? A) Because there are many cultures at Boeing, and while the executive culture may be throughly compromised since we were bought by McD, there are many other people who still push for a quality product with cutting edge design. My hope is that this is the wake up call that finally forces the Board to take decisive action, and remove the executives that are resisting the necessary cultural changes to return to a company that values safety and quality above schedule.
[...]
> However, more critical for purposes of the accident investigation, the pressure seal is unsurprisingly sandwiched between the plug and the fuselage, and you cannot replace it without opening the door plug to gain access. All of this conversation is documented in increasingly aggressive posts in the SAT, but finally we get to the damning entry which reads something along the lines of “coordinating with the doors team to determine if the door will have to be removed entirely, or just opened. If it is removed then a Removal will have to be written.” Note: a Removal is a type of record in CMES that requires formal sign off from QA that the airplane been restored to drawing requirements.
> If you have been paying attention to this situation closely, you may be able to spot the critical error: regardless of whether the door is simply opened or removed entirely, the 4 retaining bolts that keep it from sliding off of the door stops have to be pulled out. A removal should be written in either case for QA to verify install, but as it turns out, someone (exactly who will be a fun question for investigators) decides that the door only needs to be opened, and no formal Removal is generated in CMES (the reason for which is unclear, and a major process failure). Therefore, in the official build records of the airplane, a pressure seal that cannot be accessed without opening the door (and thereby removing retaining bolts) is documented as being replaced, but the door is never officially opened and thus no QA inspection is required.
https://leehamnews.com/2024/01/15/unplanned-removal-installa...
> Current Boeing employee here – I will save you waiting two years for the NTSB report to come out and give it to you for free: the reason the door blew off is stated in black and white in Boeings own records. It is also very, very stupid and speaks volumes about the quality culture at certain portions of the business.
> A couple of things to cover before we begin:
> Q1) Why should we believe you? A) You shouldn’t, I’m some random throwaway account, do your own due diligence. Others who work at Boeing can verify what I say is true, but all I ask is you consider the following based on its own merits.
> Q2) Why are you doing this? A) Because there are many cultures at Boeing, and while the executive culture may be throughly compromised since we were bought by McD, there are many other people who still push for a quality product with cutting edge design. My hope is that this is the wake up call that finally forces the Board to take decisive action, and remove the executives that are resisting the necessary cultural changes to return to a company that values safety and quality above schedule.
[...]
> However, more critical for purposes of the accident investigation, the pressure seal is unsurprisingly sandwiched between the plug and the fuselage, and you cannot replace it without opening the door plug to gain access. All of this conversation is documented in increasingly aggressive posts in the SAT, but finally we get to the damning entry which reads something along the lines of “coordinating with the doors team to determine if the door will have to be removed entirely, or just opened. If it is removed then a Removal will have to be written.” Note: a Removal is a type of record in CMES that requires formal sign off from QA that the airplane been restored to drawing requirements.
> If you have been paying attention to this situation closely, you may be able to spot the critical error: regardless of whether the door is simply opened or removed entirely, the 4 retaining bolts that keep it from sliding off of the door stops have to be pulled out. A removal should be written in either case for QA to verify install, but as it turns out, someone (exactly who will be a fun question for investigators) decides that the door only needs to be opened, and no formal Removal is generated in CMES (the reason for which is unclear, and a major process failure). Therefore, in the official build records of the airplane, a pressure seal that cannot be accessed without opening the door (and thereby removing retaining bolts) is documented as being replaced, but the door is never officially opened and thus no QA inspection is required.
[deleted]
Last year, work inside Renton, Wash., factory stalled on a future 737 MAX jet then known as Line No. 8789. Pressure was building.
More than two weeks had passed since workers on Sept. 1 flagged damaged rivets on a fuselage that needed fixing. The section had been assembled by supplier AeroSystems in Wichita, Kan., and shipped by train to Boeing’s plant.
Targets for completion came and went before employees escalated the situation to “Tier 3” priority, a move intended to get high-level attention at the factory, according to an internal Boeing log of employees’ push to finish the jet—the same one that would later lose its door plug panel in a near tragedy in flight just months later.
Punctuating how the situation was escalating with dollar signs, an internal message read: “$$TIER-CHG: 2 – 3 $$,” according to a Sept. 17 entry in the Shipside Action Tracker, or SAT, reviewed by The Wall Street Journal. The SAT is like a factory Slack channel for fixing a production problem.
The communications of the Boeing employees working on the door plug, previously unreported, help illuminate why it blew off during an Alaska Airlines flight on Jan 5. The factory was in disarray. Crews were unable to keep a schedule and apparently didn’t follow procedures, and production pressure mounted as delays piled up, according to entries in the SAT, people who have reviewed the logs and interviews with Boeing employees who worked on the plane.
In their logs, workers extended 50 times the estimated time for completing work on the damaged rivets around the frame of the door plug. The delays ranged from a half-hour to days. The work was finally signed off on and officially completed by the morning shift on Sept. 20, after a final quality check was requested the previous day, the records show.
The production breakdown had stunning consequences: The jet’s door plug blew off in flight, triggering an explosive loss of cabin pressure that risked the lives of passengers who could have been sucked out midair. It has sparked federal probes, including a criminal investigation, and hastened the exit of senior leaders including Chief Executive David Calhoun, who had vowed to improve Boeing’s safety and quality.
A Boeing spokesman said the company is prohibited by federal rules from discussing the investigation and referred to recent remarks by executives that they will slow down the factories to focus on quality and will take new steps to prevent problems from being pushed down assembly lines. The company is in talks with Spirit to acquire the company in an effort to rein in the supplier’s quality issues and also recently changed its bonus plan for 100,000 workers to emphasize quality and safety over meeting financial targets.
“For years, we prioritized the movement of the airplane through the factory over getting it done right,” Brian West, Boeing’s finance chief, said at a recent investor conference. “That’s got to change. The leadership team got it in the immediate aftermath of January 5.”
The SAT logs show that a fix for the damaged rivets was in the works for days, and that workers had to wade through layers of management to get the problem addressed. That task required opening or removing the door plug, which was installed in place of an unused emergency exit.
The workers discussed what documentation was required if they opened or removed the plug. “If removal needed, a removal needs to be written first,” one staffer wrote on Sept. 17. Altering airplane parts requires documentation in the heavily regulated and safety-focused world of aerospace manufacturing.
No such documentation appears to exist, however, Boeing has told U.S. lawmakers and accident investigators who have since been probing why the door plug blew off. The National Transportation Safety Board has said workers appear to have failed to replace four critical bolts needed to keep the panel in place.
The SAT records show a manager communicated that a mechanic was opening the door plug, however.
The NTSB has said investigators haven’t been able to interview the manager who oversees the team of Renton employees responsible for door work. The safety board has said the manager is out on medical leave. Starts and stops
When Calhoun, a Boeing director and former GE executive, took over as Boeing’s CEO in January 2020, he promised change by improving safety and engineering. “It’s going to last for a long time, and it’s going to be healthy,” he told reporters at the time. Two 737 MAX jets had crashed, taking 346 lives and grounding hundreds of Boeing planes for 20 months.
Then the pandemic grounded flights and halted factories at Boeing, rival Airbus and suppliers such as Spirit. By 2022, they were straining to meet a surge in demand for new jets as travel boomed. Boeing hired thousands of new staff and steadily increased 737 MAX production, and Calhoun issued financial targets that relied on plans for higher output.
Last year, the factories were still running with stops and starts as the company worked to return to production levels seen before the MAX crashes. Boeing delivered 580 737s in 2018, the year of the first crash.
More than two weeks had passed since workers on Sept. 1 flagged damaged rivets on a fuselage that needed fixing. The section had been assembled by supplier AeroSystems in Wichita, Kan., and shipped by train to Boeing’s plant.
Targets for completion came and went before employees escalated the situation to “Tier 3” priority, a move intended to get high-level attention at the factory, according to an internal Boeing log of employees’ push to finish the jet—the same one that would later lose its door plug panel in a near tragedy in flight just months later.
Punctuating how the situation was escalating with dollar signs, an internal message read: “$$TIER-CHG: 2 – 3 $$,” according to a Sept. 17 entry in the Shipside Action Tracker, or SAT, reviewed by The Wall Street Journal. The SAT is like a factory Slack channel for fixing a production problem.
The communications of the Boeing employees working on the door plug, previously unreported, help illuminate why it blew off during an Alaska Airlines flight on Jan 5. The factory was in disarray. Crews were unable to keep a schedule and apparently didn’t follow procedures, and production pressure mounted as delays piled up, according to entries in the SAT, people who have reviewed the logs and interviews with Boeing employees who worked on the plane.
In their logs, workers extended 50 times the estimated time for completing work on the damaged rivets around the frame of the door plug. The delays ranged from a half-hour to days. The work was finally signed off on and officially completed by the morning shift on Sept. 20, after a final quality check was requested the previous day, the records show.
The production breakdown had stunning consequences: The jet’s door plug blew off in flight, triggering an explosive loss of cabin pressure that risked the lives of passengers who could have been sucked out midair. It has sparked federal probes, including a criminal investigation, and hastened the exit of senior leaders including Chief Executive David Calhoun, who had vowed to improve Boeing’s safety and quality.
A Boeing spokesman said the company is prohibited by federal rules from discussing the investigation and referred to recent remarks by executives that they will slow down the factories to focus on quality and will take new steps to prevent problems from being pushed down assembly lines. The company is in talks with Spirit to acquire the company in an effort to rein in the supplier’s quality issues and also recently changed its bonus plan for 100,000 workers to emphasize quality and safety over meeting financial targets.
“For years, we prioritized the movement of the airplane through the factory over getting it done right,” Brian West, Boeing’s finance chief, said at a recent investor conference. “That’s got to change. The leadership team got it in the immediate aftermath of January 5.”
The SAT logs show that a fix for the damaged rivets was in the works for days, and that workers had to wade through layers of management to get the problem addressed. That task required opening or removing the door plug, which was installed in place of an unused emergency exit.
The workers discussed what documentation was required if they opened or removed the plug. “If removal needed, a removal needs to be written first,” one staffer wrote on Sept. 17. Altering airplane parts requires documentation in the heavily regulated and safety-focused world of aerospace manufacturing.
No such documentation appears to exist, however, Boeing has told U.S. lawmakers and accident investigators who have since been probing why the door plug blew off. The National Transportation Safety Board has said workers appear to have failed to replace four critical bolts needed to keep the panel in place.
The SAT records show a manager communicated that a mechanic was opening the door plug, however.
The NTSB has said investigators haven’t been able to interview the manager who oversees the team of Renton employees responsible for door work. The safety board has said the manager is out on medical leave. Starts and stops
When Calhoun, a Boeing director and former GE executive, took over as Boeing’s CEO in January 2020, he promised change by improving safety and engineering. “It’s going to last for a long time, and it’s going to be healthy,” he told reporters at the time. Two 737 MAX jets had crashed, taking 346 lives and grounding hundreds of Boeing planes for 20 months.
Then the pandemic grounded flights and halted factories at Boeing, rival Airbus and suppliers such as Spirit. By 2022, they were straining to meet a surge in demand for new jets as travel boomed. Boeing hired thousands of new staff and steadily increased 737 MAX production, and Calhoun issued financial targets that relied on plans for higher output.
Last year, the factories were still running with stops and starts as the company worked to return to production levels seen before the MAX crashes. Boeing delivered 580 737s in 2018, the year of the first crash.
> who could have been sucked out midair.
This really downplays how catastrophic this would have been at cruising altitude. And in that case the cause might have been way more obscured.
This really downplays how catastrophic this would have been at cruising altitude. And in that case the cause might have been way more obscured.
Calhoun was promising to deliver as many as 450 737s for 2023. Through August, Boeing had only delivered 271 of the jets. Airlines were frustrated and cutting schedules since they didn’t get expected planes.
“Is there pressure? Yes and no. We’re still there to do a job,” said one Boeing veteran who was involved with work related to the door plug on Line No. 8789. “I have a deadline every day, my team has a deadline every day, so if it gets behind schedule you have to get it on schedule.”
Behind the scenes, regulators at the Federal Aviation Administration and leaders of its factory workers’ union tussled with Boeing over its practices. The FAA and union pushed Boeing to add back second-party quality inspections that had been cut.
In September, while the Renton team was working on Line No. 8789, Boeing’s output of 737 jets had fallen to the lowest levels in two years. Boeing delivered just 15 new 737s to the world’s airlines that month. Executives had been telling airlines and investors that it wanted to produce about 38 a month.
The culprit was a separate issue from the rivets involved in the door plug. A defect in the rear of 737 fuselages supplied by Spirit had been discovered by Boeing the month before. Fixing the issue required inspecting and correcting misdrilled fastener holes in a key structural part. It had snarled production at Spirit, which in turn had delayed Boeing’s factories.
To keep things moving, Boeing kept accepting flawed fuselages from Spirit, including Line No. 8789. And the plane maker allowed unfinished tasks to flow through its factory—knocking production out of sequence in a practice called “traveled work,” which can increase the risk of slip-ups.
“Years ago, we weren’t going this fast,” said the Boeing veteran who was involved with work related to the door plug on Line No. 8789. “I’m not saying fast caused the problem. Something happened. I don’t know what it was.”
A second Boeing employee who was also involved with the same Alaska 737 MAX said he has never felt pressured to move too quickly. The company’s attention to quality and safety has improved significantly in recent years, and the mishap with Line No. 8789 has been weighing on the Renton workforce.
“It’s a failure on all of us,” he said. “We all feel it.”
FAA officials have criticized what they have found upon closer inspection of Boeing’s Renton factory since the blowout. They have described an operation that appears to prize production schedules over safety and quality.
FAA chief Mike Whitaker was particularly troubled he didn’t receive a safety briefing upon starting a tour of the factory, people familiar with the matter said. Such briefings are typical in manufacturing settings. ‘Just painted over’
When Boeing’s production system works according to plan, it typically takes a week or two for a 737 to make its way through final assembly at the Renton plant.
The rivet flaw was flagged the day after Line No. 8789 arrived at Renton. After that it took 18 days, 12 hours and nine minutes to fix the damaged rivets and officially resolve the issue.
The SAT entries suggest an at times dysfunctional production environment complicated by delays in getting parts and red tape with Spirit, the error-prone supplier that Boeing once owned and is in talks to acquire.
Spirit workers were on site at Renton and tasked with resolving the rivet issue.
Six days after workers flagged the damaged rivets on Spirit’s fuselage, an entry read: CONDITION STILL EXIST. RIVETS WERE JUST PAINTED OVER.
Boeing wanted new rivets. Days went by, with Boeing workers noting difficulties spurring the Spirit personnel into action. “Damaged rivets are not acceptable and need to be removed and replaced,” read one Sept. 11 entry.
Two days later: “No Spirit work in progress,” read another entry, suggesting another extension. Then, on Sept. 14, Boeing employees escalated the situation to a higher level of attention for greater visibility.
Workers removed the door plug’s bolts to open it, which allowed access to the rivets. But there is no entry in the SAT log calling for the door plug’s reinstallation.
The absence of documentation has shocked current and former Boeing employees. An official “removal” process would have prompted Boeing’s quality-assurance team to check that the door plug had been properly reinstalled—with the bolts to keep the panel in place, they said.
“I was, like, ‘What the hell?’ Boeing does a great job especially on documentation,” said the Boeing veteran who was involved with work related to the door plug. “If you take something out, you’ve got to write a removal.”
Thousands of people work in the Renton facility on three production lines where half-built planes move between stations every evening. Risers lift workers to the body of the 40-foot-tall planes, where crews use specialized tools to complete hundreds of tasks. Below, workers sit in rows at computers tracking the progress. Boeing’s plan to add a fourth line has been put on hold by the FAA in the wake of the blowout.
The team that works on doors and door plugs in Renton fluctuates between 20 and 30 workers. Some have spent decades at Boeing, others just a few months or years. They generally are split between two 8-hour shifts and can work on several planes a day.
Factory workers eventually secured new rivets for Line No. 8789, and by Sept. 19 a final target arrived. “Per Spirit management, this job is committed to be done today,” a SAT entry read.
A Boeing quality manager was to assign a final inspection. The rivet problem was on track for review, and the issue was closed on Sept. 20. The jet continued to be worked on and inspected for another month.
On Oct. 25, Boeing reported financial results. It booked a $1.64 billion third-quarter loss and lowered its 737 delivery goals for the year. It now expected to finish 375 to 400 of the jets, instead of as many as 450. Even that goal required the Renton factory to significantly ramp up production in the final weeks of the year.
Calhoun sent a memo to employees that day, rebutting criticism of its production numbers. He told them that improved quality procedures and a culture that rewarded speaking up about problems meant the company was finding more things in need of repair.
“I have heard those outside our company wondering if we’ve lost a step,” Calhoun wrote. “I view it as quite the opposite.”
Boeing delivered the jet known as Line No. 8789 to Alaska on Oct. 31. Eleven days later, the plane started flying passengers.
“Is there pressure? Yes and no. We’re still there to do a job,” said one Boeing veteran who was involved with work related to the door plug on Line No. 8789. “I have a deadline every day, my team has a deadline every day, so if it gets behind schedule you have to get it on schedule.”
Behind the scenes, regulators at the Federal Aviation Administration and leaders of its factory workers’ union tussled with Boeing over its practices. The FAA and union pushed Boeing to add back second-party quality inspections that had been cut.
In September, while the Renton team was working on Line No. 8789, Boeing’s output of 737 jets had fallen to the lowest levels in two years. Boeing delivered just 15 new 737s to the world’s airlines that month. Executives had been telling airlines and investors that it wanted to produce about 38 a month.
The culprit was a separate issue from the rivets involved in the door plug. A defect in the rear of 737 fuselages supplied by Spirit had been discovered by Boeing the month before. Fixing the issue required inspecting and correcting misdrilled fastener holes in a key structural part. It had snarled production at Spirit, which in turn had delayed Boeing’s factories.
To keep things moving, Boeing kept accepting flawed fuselages from Spirit, including Line No. 8789. And the plane maker allowed unfinished tasks to flow through its factory—knocking production out of sequence in a practice called “traveled work,” which can increase the risk of slip-ups.
“Years ago, we weren’t going this fast,” said the Boeing veteran who was involved with work related to the door plug on Line No. 8789. “I’m not saying fast caused the problem. Something happened. I don’t know what it was.”
A second Boeing employee who was also involved with the same Alaska 737 MAX said he has never felt pressured to move too quickly. The company’s attention to quality and safety has improved significantly in recent years, and the mishap with Line No. 8789 has been weighing on the Renton workforce.
“It’s a failure on all of us,” he said. “We all feel it.”
FAA officials have criticized what they have found upon closer inspection of Boeing’s Renton factory since the blowout. They have described an operation that appears to prize production schedules over safety and quality.
FAA chief Mike Whitaker was particularly troubled he didn’t receive a safety briefing upon starting a tour of the factory, people familiar with the matter said. Such briefings are typical in manufacturing settings. ‘Just painted over’
When Boeing’s production system works according to plan, it typically takes a week or two for a 737 to make its way through final assembly at the Renton plant.
The rivet flaw was flagged the day after Line No. 8789 arrived at Renton. After that it took 18 days, 12 hours and nine minutes to fix the damaged rivets and officially resolve the issue.
The SAT entries suggest an at times dysfunctional production environment complicated by delays in getting parts and red tape with Spirit, the error-prone supplier that Boeing once owned and is in talks to acquire.
Spirit workers were on site at Renton and tasked with resolving the rivet issue.
Six days after workers flagged the damaged rivets on Spirit’s fuselage, an entry read: CONDITION STILL EXIST. RIVETS WERE JUST PAINTED OVER.
Boeing wanted new rivets. Days went by, with Boeing workers noting difficulties spurring the Spirit personnel into action. “Damaged rivets are not acceptable and need to be removed and replaced,” read one Sept. 11 entry.
Two days later: “No Spirit work in progress,” read another entry, suggesting another extension. Then, on Sept. 14, Boeing employees escalated the situation to a higher level of attention for greater visibility.
Workers removed the door plug’s bolts to open it, which allowed access to the rivets. But there is no entry in the SAT log calling for the door plug’s reinstallation.
The absence of documentation has shocked current and former Boeing employees. An official “removal” process would have prompted Boeing’s quality-assurance team to check that the door plug had been properly reinstalled—with the bolts to keep the panel in place, they said.
“I was, like, ‘What the hell?’ Boeing does a great job especially on documentation,” said the Boeing veteran who was involved with work related to the door plug. “If you take something out, you’ve got to write a removal.”
Thousands of people work in the Renton facility on three production lines where half-built planes move between stations every evening. Risers lift workers to the body of the 40-foot-tall planes, where crews use specialized tools to complete hundreds of tasks. Below, workers sit in rows at computers tracking the progress. Boeing’s plan to add a fourth line has been put on hold by the FAA in the wake of the blowout.
The team that works on doors and door plugs in Renton fluctuates between 20 and 30 workers. Some have spent decades at Boeing, others just a few months or years. They generally are split between two 8-hour shifts and can work on several planes a day.
Factory workers eventually secured new rivets for Line No. 8789, and by Sept. 19 a final target arrived. “Per Spirit management, this job is committed to be done today,” a SAT entry read.
A Boeing quality manager was to assign a final inspection. The rivet problem was on track for review, and the issue was closed on Sept. 20. The jet continued to be worked on and inspected for another month.
On Oct. 25, Boeing reported financial results. It booked a $1.64 billion third-quarter loss and lowered its 737 delivery goals for the year. It now expected to finish 375 to 400 of the jets, instead of as many as 450. Even that goal required the Renton factory to significantly ramp up production in the final weeks of the year.
Calhoun sent a memo to employees that day, rebutting criticism of its production numbers. He told them that improved quality procedures and a culture that rewarded speaking up about problems meant the company was finding more things in need of repair.
“I have heard those outside our company wondering if we’ve lost a step,” Calhoun wrote. “I view it as quite the opposite.”
Boeing delivered the jet known as Line No. 8789 to Alaska on Oct. 31. Eleven days later, the plane started flying passengers.
Sorry for the link, it seems like archive.is is no longer able to bypass the paywall for the WSJ.
I believe that archive.is is whatever you've archived into it. If you pressed the button when looking at the paywall, that's what it will carry.
No, they run their own crawler against the URL you provide (IIRC, it's a headless Google Chrome [1]). For some special / often-requested (?) sites the people behind the project have:
- implemented post-processing to strip ads and tracker beacons
- bought legitimate accounts that they use to bypass paywalls (some of them show up as remnants in the archived pages' code, some of them show up when you request an archive of the site's account management portal, some show up as HTTP traces during the archival process - the crawler will dump every URL it requests on a "WIP" page, and for some, auth information like JWTs is passed in the URL)
- implemented anti-nagwall features (some sites are "vulnerable" in their paywall/"you read X articles, end of free limit" by pressing the ESC key to disrupt the JS of the site)
[1] https://blog.archive.today/post/618635148292964352/what-scra...
- implemented post-processing to strip ads and tracker beacons
- bought legitimate accounts that they use to bypass paywalls (some of them show up as remnants in the archived pages' code, some of them show up when you request an archive of the site's account management portal, some show up as HTTP traces during the archival process - the crawler will dump every URL it requests on a "WIP" page, and for some, auth information like JWTs is passed in the URL)
- implemented anti-nagwall features (some sites are "vulnerable" in their paywall/"you read X articles, end of free limit" by pressing the ESC key to disrupt the JS of the site)
[1] https://blog.archive.today/post/618635148292964352/what-scra...
I think we all agree management can't be blamed. Factory workers did not execute the expected steps and failed to properly escalate issues as soon as possible. Management had no information of what was going on the factory floor, and the change of the headquarters away from the factory, while reducing management overhead with day-to-day issues, required workers to escalate issues properly instead of tip-toing around the issues.
I found the Boeing manager!
Perhaps you and I view the world in a different light, but in any organization where there is even some semblance of hierarchy, the manager is, at the end of the day, always responsible.
If management isn’t aware of what’s going on on the factory floor, then that’s definitely a failure of management. If they didn’t receive any signals, management should’ve investigated. If they hired 100% incompetent people they should’ve hired better people.
Perhaps you and I view the world in a different light, but in any organization where there is even some semblance of hierarchy, the manager is, at the end of the day, always responsible.
If management isn’t aware of what’s going on on the factory floor, then that’s definitely a failure of management. If they didn’t receive any signals, management should’ve investigated. If they hired 100% incompetent people they should’ve hired better people.
Workers must self-manage and take decisions based on company documentation. That's what being responsible means.
Yes, I agree with you there. But managers have a responsibility to make sure systems are in place where if a worker does not self-manage or make a bad decision, this gets caught early on, not 34,000 feet up in air.
K, so what happens when the documentation says X and your line manager's boss is threatening to start sending folks home if y'all don't get the lead out? You get what you incentivize. :P
Managers are coming with a better compensation exactly because they are taking responsibility. If not then they have to be paid at the same level as workers.
That is "professional" level work ethics and requires professional compensation. This utopian corporate notion of yours makes sense IFF the company is not divided into c-suite princes and princesses and pleb workers as is the case in corporate America.
> Management had no information of what was going on the factory floor
This statement represents a fundamental failure of management to do its job— To know the whole picture, recognize systemic hazards (both internal and external), and correct them before they become real problems.
This statement represents a fundamental failure of management to do its job— To know the whole picture, recognize systemic hazards (both internal and external), and correct them before they become real problems.
Workers must self-manage and take decisions based on company documentation.
Fingers crossed that they'll do that with no oversight. On the positive side there should be considerable savings from sacking all the superfluous managers.
K so if employees can self-manage and all of the documentation is in place then what, exactly, are managers paid for? Why do they exist?
In this case, management set goals which were clearly unattainable with the resources, which management provided.
If executives face no risk for their decisions, then why do they get such high rewards?
I thought the deal was high-risk/high-reward.
If executives face no risk for their decisions, then why do they get such high rewards?
I thought the deal was high-risk/high-reward.
Then there is clear failure in somewhere in the process. Could be that managers have written incorrect documentation. Thus they should be held responsible for documentation that is not being followed.
Management must ensure that this is actually the case.
Management is always to blame. It is their job to control, train and oversee production.
>Management had no information of what was going on the factory floor
Meaning that management failed at their job.
>Management had no information of what was going on the factory floor
Meaning that management failed at their job.
I think you're going to have a real tough time finding anyone willing to agree with you there. If line management didn't have a handle on the fact there was a problem and communicate it up the chain they failed. Likewise, if they signed off on a bullshit kludge they failed. If middle management opted to shovel blame around for their division of the company faceplanting instead of getting out in front of the issue and getting their people whatever they needed to get shit done they failed. If senior management decided to apply additional pressure downstream instead of quickly pivoting to full crisis mitigation mode when issues started piling up on the production lines, they not only failed but are likely the most culpable.
I agree with you but on HN there is always someone defending the bosses. I find it less frustrating defending the bosses preemptively so I can see what people better informed than me come up with.
Thing is, bosses aren't going to lose one cent. Wanna bet? The linked article is gently trying to shift the blame to factory floor workers.
Thing is, bosses aren't going to lose one cent. Wanna bet? The linked article is gently trying to shift the blame to factory floor workers.
Aahz's Law? Very well then, carry on.
[deleted]
[deleted]