When Will We Have Unmanned Commercial Airliners?(spectrum.ieee.org)
spectrum.ieee.org
When Will We Have Unmanned Commercial Airliners?
http://spectrum.ieee.org/aerospace/aviation/when-will-we-have-unmanned-commercial-airliners/0
9 comments
In just a couple of years the DARPA challenge yielded cars that can drive themselves in complex urban environments.
I imagine with sufficient smart people working on it, flying airplanes in relatively uncluttered sky would yield results faster.
As for see-and-avoid, perhaps it works for obstacles on the ground, but other aircraft are moving so fast, is it really feasible to eyeball them before they are on you? Perhaps in pursuit, but at any significant angle they flash past at hundreds of miles an hour. Only radar etc has a chance of identifying/avoiding at those speeds. <Edit: spelling>
I imagine with sufficient smart people working on it, flying airplanes in relatively uncluttered sky would yield results faster.
As for see-and-avoid, perhaps it works for obstacles on the ground, but other aircraft are moving so fast, is it really feasible to eyeball them before they are on you? Perhaps in pursuit, but at any significant angle they flash past at hundreds of miles an hour. Only radar etc has a chance of identifying/avoiding at those speeds. <Edit: spelling>
Commercial airliners, last I checked, suffered one mishap per 1.5 million flights. Human automobile drivers set a much lower standard to beat.
Sure; but the flight environment is trivial in comparison with urban traffic. Even so, with concerted effort the progress was phenomenal.
>the flight environment is trivial in comparison with urban traffic.
Having experienced plenty of both, I can tell you that this is utterly false.
Having experienced plenty of both, I can tell you that this is utterly false.
Says the human. To a computer driving is much more difficult than flying.
You could equally say adding up big numbers is much harder for you than walking across the street. To a computer the former is trivial, the latter no walking robot has yet done.
You could equally say adding up big numbers is much harder for you than walking across the street. To a computer the former is trivial, the latter no walking robot has yet done.
As I've mentioned elsewhere, I'm directly involved in the test and evaluation of one of the current attempts at "sense and avoid" technology. It is a long way from being safe for fully autonomous use. It is my understanding that the DARPA autonomous land vehicle contest required autonomous collision avoidance, and that more than one of the entrants did so effectively. Their budgets were a pittance compared to what is being spent on "sense and avoid" for UAVs, and yet they had much greater success. That tells me that urban traffic avoidance is easier for computers than air traffic avoidance.
I think that two big reasons for this are probably:
1: For land vehicles, simply stopping in place is almost always an effective collision avoidance tactic (unless the other vehicle is deliberately seeking a collision). This simple solution is not available to airplanes.
2: Tracking objects thar are moving in three dimensions with a sensor that is also moving in three dimensions is an immensely more complex problem than tracking objects that are constrained to move on a fixed surface in two dimensions with a sensor that is also constrained to move on a fixed surface in two dimensions.
I think that two big reasons for this are probably:
1: For land vehicles, simply stopping in place is almost always an effective collision avoidance tactic (unless the other vehicle is deliberately seeking a collision). This simple solution is not available to airplanes.
2: Tracking objects thar are moving in three dimensions with a sensor that is also moving in three dimensions is an immensely more complex problem than tracking objects that are constrained to move on a fixed surface in two dimensions with a sensor that is also constrained to move on a fixed surface in two dimensions.
Circular reasoning? They solved the land-nav problem because its easier. Its easier because they solved it.
My point was, there is another wrinkle. The land-nav problem was opened up, made a competition with a big marketing budget. It was also intractable, unsolved, too hard. Until lots of smart people started brainstorming and trying crazy things and cooperating.
Airplanes can change speed drastically, which is at high speeds about as effective as stopping. And no, you don't get to say collisions are hard to avoid because 3 dimensions are hard to calculate, making that not a solution.
I think I begin to see why the problem hasn't been solved yet.
My point was, there is another wrinkle. The land-nav problem was opened up, made a competition with a big marketing budget. It was also intractable, unsolved, too hard. Until lots of smart people started brainstorming and trying crazy things and cooperating.
Airplanes can change speed drastically, which is at high speeds about as effective as stopping. And no, you don't get to say collisions are hard to avoid because 3 dimensions are hard to calculate, making that not a solution.
I think I begin to see why the problem hasn't been solved yet.
It's not circular reasoning: it's a conclusion based on observation. Several groups tried to solve each problem. All of the groups that tried to solve problem A have thus far failed (although some have made measurable progress) while some of the groups that tried to solve problem B succeeded despite having considerably less resources at their disposal. "Hard to solve" can be a somewhat difficult label to define, but those results are a strong indicator that problem A is harder to solve.
By your logic, every "impossible" problem could be solved easily if just DARPA would offer a small prize to whoever solves it. Unfortunately, the real world doesn't work that way. There's a reason why DARPA chooses the tasks they do for their challenges: they spend a lot of time and effort identifying tasks that are highly likely to be amenable to novel solutions.
>Airplanes can change speed drastically, which is at high speeds about as effective as stopping.
Incorrect, on two counts. First, not all airplanes can change speed "drastically." Second, it is not as effective at preventing a collision as stopping. If both cars in an impending collision stop (and in many cases, even if only one of them stops), a collision becomes impossible. On the other hand, there are a lot of situations where deceleration merely delays, but does not prevent collision. That has value, but it's not as good.
>And no, you don't get to say collisions are hard to avoid because 3 dimensions are hard to calculate, making that not a solution.
I never said it was "not a solution," but I definitely do get to say that it's a much harder problem to solve. Here's the steps you have to perform to avoid a collision:
1: Detect an object.
2: Track the object to determine it's course and speed.
3: Compare the object's course and speed to yours to determine how likely a collision is.
4: If the probability of a collision is unacceptably high, determine a change of course and/or speed which will reduce the probability of collision to an acceptable level. If the probability of collision is already acceptably low, return to step 2.
5: Maneuver to change course and speed accordingly, then return to step 2.
If you are moving in three dimensions and the objects with which you might collide are moving in three dimensions, step 2 is hard to do accurately. (Unless you've studied radar tracking, you probably don't appreciate exactly how hard, but if you're genuinely interested, Skolnik's Radar Handbook is a good place to start.) The less accurate you are at step 2, the harder steps 3, 4, and 5 become, because you have to deal with more uncertainty. Is that really where the other object is? Is that really where it will be in twenty seconds? How certain are you of that? How certain are you that there really is something even there at all? If you're wrong in one direction, you'll have a midair; if you're wrong in the other direction, you'll perform some extreme maneuver for absolutely no good reason.
By your logic, every "impossible" problem could be solved easily if just DARPA would offer a small prize to whoever solves it. Unfortunately, the real world doesn't work that way. There's a reason why DARPA chooses the tasks they do for their challenges: they spend a lot of time and effort identifying tasks that are highly likely to be amenable to novel solutions.
>Airplanes can change speed drastically, which is at high speeds about as effective as stopping.
Incorrect, on two counts. First, not all airplanes can change speed "drastically." Second, it is not as effective at preventing a collision as stopping. If both cars in an impending collision stop (and in many cases, even if only one of them stops), a collision becomes impossible. On the other hand, there are a lot of situations where deceleration merely delays, but does not prevent collision. That has value, but it's not as good.
>And no, you don't get to say collisions are hard to avoid because 3 dimensions are hard to calculate, making that not a solution.
I never said it was "not a solution," but I definitely do get to say that it's a much harder problem to solve. Here's the steps you have to perform to avoid a collision:
1: Detect an object.
2: Track the object to determine it's course and speed.
3: Compare the object's course and speed to yours to determine how likely a collision is.
4: If the probability of a collision is unacceptably high, determine a change of course and/or speed which will reduce the probability of collision to an acceptable level. If the probability of collision is already acceptably low, return to step 2.
5: Maneuver to change course and speed accordingly, then return to step 2.
If you are moving in three dimensions and the objects with which you might collide are moving in three dimensions, step 2 is hard to do accurately. (Unless you've studied radar tracking, you probably don't appreciate exactly how hard, but if you're genuinely interested, Skolnik's Radar Handbook is a good place to start.) The less accurate you are at step 2, the harder steps 3, 4, and 5 become, because you have to deal with more uncertainty. Is that really where the other object is? Is that really where it will be in twenty seconds? How certain are you of that? How certain are you that there really is something even there at all? If you're wrong in one direction, you'll have a midair; if you're wrong in the other direction, you'll perform some extreme maneuver for absolutely no good reason.
I've seen government contracting many times before. You put out rfp's, a whole bunch of second rate people reply, you pick the ones who "look" most competent. Then, surprise, surprise, it fails. This is not how hard things get done. Those most able at securing grants are almost certainly not those most able at delivering technical success.
I think a large part of that low mishap rate is exactly due to automation.
>In just a couple of years the DARPA challenge yielded cars that can drive themselves in complex urban environments.
I imagine with sufficient smart people working on it, flying airplanes in relatively uncluttered sky would yield results faster.
As I mentioned, many of the tasks of flying airplanes have been successfully automated. However, there are significant complexities that pilots must deal with that don't apply to cars, and most of those still require human intervention, especially in-flight emergencies. If your car engine quits, you pull over to the shoulder, turn on your hazard lights, and call AAA. If your aircraft engine quits, the response is much more complex. If the power steering on your car quits, you do pretty much the same thing as described above. If your flight controls malfunction in an airplane, the response is much more complex. If your car catches on fire, you do the same as above, plus get out. If your airplane catches on fire, you've got a much bigger problem. I could go on, but I think that gets the idea across.
Also, the sky is not "relatively uncluttered." There are a lot of airplanes flying at any given moment, and most of them are concentrated onto airways. It gets even worse in the terminal area: lots and lots of planes coming and going to and from many different directions, all in a very small piece of sky.
>As for see-and-avoid, perhaps it works for obstacles on the ground, but other aircraft are moving so fast, is it really feasile to eyeball them before they are on you? Perhaps in pursuit, but at any significant angle they flash past at hundreds of miles an hour. Only radar etc has a chance of identifying/avoiding at those speeds.
I am alive today because, on countless occasions, I and my fellow aviators have looked outside, seen another aircraft, and maneuvered to avoid a potential collision. I think that you really don't have an accurate mental image of how this works, so I'll try to explain a little bit:
Consider two airliners cruising at 424 kts each, one heading due West, the other due North. The rate of closure is 600 kts. Depending on the atmospheric conditions, they will be visible to each other at about 10 nautical miles, which gives them an entire minute to spot each other and maneuver to avoid a collision. Even if it's two sueprsonic fighters flying right at each other at 600 kts each, they still have thirty seconds to spot each other. A much more realistic scenario would involve two aircraft in the terminal area, where they would be moving much more slowly, giving them much more time to see each other and respond.
I think the most dangerous situations are where two aircraft are on headings that are different by less than forty-five degrees: they are basically next to each other, closing from each other's sides where they are less likely to be spotted. The rate of closure is probably very low, but that's more than made up for by the awkward situation in regards to field of view from many cockpits.
I imagine with sufficient smart people working on it, flying airplanes in relatively uncluttered sky would yield results faster.
As I mentioned, many of the tasks of flying airplanes have been successfully automated. However, there are significant complexities that pilots must deal with that don't apply to cars, and most of those still require human intervention, especially in-flight emergencies. If your car engine quits, you pull over to the shoulder, turn on your hazard lights, and call AAA. If your aircraft engine quits, the response is much more complex. If the power steering on your car quits, you do pretty much the same thing as described above. If your flight controls malfunction in an airplane, the response is much more complex. If your car catches on fire, you do the same as above, plus get out. If your airplane catches on fire, you've got a much bigger problem. I could go on, but I think that gets the idea across.
Also, the sky is not "relatively uncluttered." There are a lot of airplanes flying at any given moment, and most of them are concentrated onto airways. It gets even worse in the terminal area: lots and lots of planes coming and going to and from many different directions, all in a very small piece of sky.
>As for see-and-avoid, perhaps it works for obstacles on the ground, but other aircraft are moving so fast, is it really feasile to eyeball them before they are on you? Perhaps in pursuit, but at any significant angle they flash past at hundreds of miles an hour. Only radar etc has a chance of identifying/avoiding at those speeds.
I am alive today because, on countless occasions, I and my fellow aviators have looked outside, seen another aircraft, and maneuvered to avoid a potential collision. I think that you really don't have an accurate mental image of how this works, so I'll try to explain a little bit:
Consider two airliners cruising at 424 kts each, one heading due West, the other due North. The rate of closure is 600 kts. Depending on the atmospheric conditions, they will be visible to each other at about 10 nautical miles, which gives them an entire minute to spot each other and maneuver to avoid a collision. Even if it's two sueprsonic fighters flying right at each other at 600 kts each, they still have thirty seconds to spot each other. A much more realistic scenario would involve two aircraft in the terminal area, where they would be moving much more slowly, giving them much more time to see each other and respond.
I think the most dangerous situations are where two aircraft are on headings that are different by less than forty-five degrees: they are basically next to each other, closing from each other's sides where they are less likely to be spotted. The rate of closure is probably very low, but that's more than made up for by the awkward situation in regards to field of view from many cockpits.
> If your airplane catches on fire
I think that unmanned plane has actually a much better chance of surviving fire, it could have an inert atmosphere, or it could be unpressurized so fires would be much less frequent. Also fires happen mostly on freight planes (lately UPS and Asiana) and freight planes would be probably easier to certify for unmanned flying than passenger planes.
> I am alive today because, on countless occasions, I and my fellow aviators have looked outside, seen another aircraft, and maneuvered to avoid a potential collision.
Isn't this what Traffic collision avoidance system (TCAS) is for? The pilots already have to do as they are told by TCAS (after the collision over Switzerland). Surely managing traffic of obedient agents with known limits of performance isn't that hard - if all the planes were unmanned there wouldn't be problems
However, the points that you mentioned about other emergencies and passenger traffic still stand.
I think that unmanned plane has actually a much better chance of surviving fire, it could have an inert atmosphere, or it could be unpressurized so fires would be much less frequent. Also fires happen mostly on freight planes (lately UPS and Asiana) and freight planes would be probably easier to certify for unmanned flying than passenger planes.
> I am alive today because, on countless occasions, I and my fellow aviators have looked outside, seen another aircraft, and maneuvered to avoid a potential collision.
Isn't this what Traffic collision avoidance system (TCAS) is for? The pilots already have to do as they are told by TCAS (after the collision over Switzerland). Surely managing traffic of obedient agents with known limits of performance isn't that hard - if all the planes were unmanned there wouldn't be problems
However, the points that you mentioned about other emergencies and passenger traffic still stand.
>it could have an inert atmosphere
This would be very costly to implement, and probably very heavy. That being said, inert gases are used in places where arcing is likely (e.g. radar waveguides).
>or it could be unpressurized so fires would be much less frequent
I really don't think this would have a significant impact on the frequency of fires. Plus, a lot of avionics need particular environmental conditions, in some cases including pressurization.
>Also fires happen mostly on freight planes
High-power electronics, such as military radars, also pose an increased risk of fire.
>freight planes would be probably easier to certify for unmanned flying than passenger planes.
If you only cared about the contents of the plane, this would be true. But what happens when a flaming ball of wreckage that used to be an unmanned freight plane plows into a suburban neighborhood, a school, or a downtown skyscraper?
>Isn't this what Traffic collision avoidance system (TCAS) is for? The pilots already have to do as they are told by TCAS (after the collision over Switzerland).
TCAS isn't all it's cracked up to be. First of all, it only works if the other plane has a transponder (there are still plenty of light civil aircraft out there with no transponders). Second, there are different versions out there with different levels of accuracy. The older kind are not very accurate at all, and basically serve only to give the pilot a general idea of where to look in order to spot the traffic and avoid the collision the old-fashioned way. The more accurate kind only works if both aircraft involved have the necessary equipment.
As for the collision over Switzerland, the reason for that rule is that the collision happened in part because TCAS and ATC gave conflicting instructions: one told plane A to go up and plane B to go down, the other told plane A to go down and plane B to go up. One crew did what TCAS said, the other did what ATC said, and they both ended up descending. So the reason for this rule isn't that TCAS is a magical panacea for midairs, but rather a way to consistently resolve any future such conflicts between TCAS and ATC.
>Surely managing traffic of obedient agents with known limits of performance isn't that hard - if all the planes were unmanned there wouldn't be problems
If all the planes were unmanned, then managing traffic would be much easier, but that still leaves other issues, like where a plane ends up when it malfunctions and crashes. It would also require a wholesale changeover that simply isn't plausible.
This would be very costly to implement, and probably very heavy. That being said, inert gases are used in places where arcing is likely (e.g. radar waveguides).
>or it could be unpressurized so fires would be much less frequent
I really don't think this would have a significant impact on the frequency of fires. Plus, a lot of avionics need particular environmental conditions, in some cases including pressurization.
>Also fires happen mostly on freight planes
High-power electronics, such as military radars, also pose an increased risk of fire.
>freight planes would be probably easier to certify for unmanned flying than passenger planes.
If you only cared about the contents of the plane, this would be true. But what happens when a flaming ball of wreckage that used to be an unmanned freight plane plows into a suburban neighborhood, a school, or a downtown skyscraper?
>Isn't this what Traffic collision avoidance system (TCAS) is for? The pilots already have to do as they are told by TCAS (after the collision over Switzerland).
TCAS isn't all it's cracked up to be. First of all, it only works if the other plane has a transponder (there are still plenty of light civil aircraft out there with no transponders). Second, there are different versions out there with different levels of accuracy. The older kind are not very accurate at all, and basically serve only to give the pilot a general idea of where to look in order to spot the traffic and avoid the collision the old-fashioned way. The more accurate kind only works if both aircraft involved have the necessary equipment.
As for the collision over Switzerland, the reason for that rule is that the collision happened in part because TCAS and ATC gave conflicting instructions: one told plane A to go up and plane B to go down, the other told plane A to go down and plane B to go up. One crew did what TCAS said, the other did what ATC said, and they both ended up descending. So the reason for this rule isn't that TCAS is a magical panacea for midairs, but rather a way to consistently resolve any future such conflicts between TCAS and ATC.
>Surely managing traffic of obedient agents with known limits of performance isn't that hard - if all the planes were unmanned there wouldn't be problems
If all the planes were unmanned, then managing traffic would be much easier, but that still leaves other issues, like where a plane ends up when it malfunctions and crashes. It would also require a wholesale changeover that simply isn't plausible.
> TCAS isn't all it's cracked up to be. First of all, it only works if the other plane has a transponder (there are still plenty of light civil aircraft out there with no transponders).
Why hasn't it been made mandatory that all aircrafts should have a standardized transponder ? It scares me a bit that, at the end of the day, we rely on pilots avoiding collisions by sight.
Why hasn't it been made mandatory that all aircrafts should have a standardized transponder ? It scares me a bit that, at the end of the day, we rely on pilots avoiding collisions by sight.
>Why hasn't it been made mandatory that all aircrafts should have a standardized transponder ?
In some parts of the world, it may be. For example, I don't know if Europe allows for aircraft without transponders. Even in the U.S. you must have a transponder to enter certain types of airspace (e.g. the airspace around major airports). As far as I know, no matter where you are in the world, you must have a transponder to fly IFR.
Installing a transponder is a non-trivial expense, especially in older aircraft (which are the aircraft most likely to not have transponders). For a lot of small aircraft in the U.S. this would represent an unnecessary burden on the owners. For example, crop dusters: they typically fly around low and slow in areas with very little traffic, under day VFR conditions, so they have no need to interact with ATC and therefore no real use for a transponder.
>It scares me a bit that, at the end of the day, we rely on pilots avoiding collisions by sight.
We don't rely solely on this: we have transponders (with TCAS in some cases), ATC radar, and (in some cases) airborne radar. All of these tools help us to avoid collisions. Unfortunately, none of them are 100% effective, and in most of the situations where they all fail, the good old Mark I Eyeball usually saves the day. See-and-avoid isn't perfect, either (if it was, we'd never have midairs), but it is still the most effective tool available for avoiding an impending collision.
In some parts of the world, it may be. For example, I don't know if Europe allows for aircraft without transponders. Even in the U.S. you must have a transponder to enter certain types of airspace (e.g. the airspace around major airports). As far as I know, no matter where you are in the world, you must have a transponder to fly IFR.
Installing a transponder is a non-trivial expense, especially in older aircraft (which are the aircraft most likely to not have transponders). For a lot of small aircraft in the U.S. this would represent an unnecessary burden on the owners. For example, crop dusters: they typically fly around low and slow in areas with very little traffic, under day VFR conditions, so they have no need to interact with ATC and therefore no real use for a transponder.
>It scares me a bit that, at the end of the day, we rely on pilots avoiding collisions by sight.
We don't rely solely on this: we have transponders (with TCAS in some cases), ATC radar, and (in some cases) airborne radar. All of these tools help us to avoid collisions. Unfortunately, none of them are 100% effective, and in most of the situations where they all fail, the good old Mark I Eyeball usually saves the day. See-and-avoid isn't perfect, either (if it was, we'd never have midairs), but it is still the most effective tool available for avoiding an impending collision.
Because they cost an arm and a leg for small aircraft.
Think $20K.
Unfortunately regulations and liability costs make anything in aviation expensive. So most small planes are running around without tcas.
Unfortunately regulations and liability costs make anything in aviation expensive. So most small planes are running around without tcas.
Your objections are about things that a human can't do much about either, or if they could, a computer could do just as well or better.
(If your plane engine quits - what would a human do? whatever it is, a computer could be programmed to as well. Near collisions - a constantly vigilant computer vision system watching out the window is more likely to avoid collision than a pilot with 30 seconds of reaction time.)
(If your plane engine quits - what would a human do? whatever it is, a computer could be programmed to as well. Near collisions - a constantly vigilant computer vision system watching out the window is more likely to avoid collision than a pilot with 30 seconds of reaction time.)
>If your plane engine quits - what would a human do?
This depends on a lot of factors. Some of them are things that a computer can probably be programmed to consider properly (e.g. specific cause of failure). Other factors require judgment, such as your more general situation: depending on where you are and what else is going wrong, you might chose to land the airplane at the nearest appropriate airfield, or you might choose to continue on to an airfield farther away where you can get better support while attempting to restart the failed engine on your way there, or you might decide that you have to get it on the ground right now, and that empty farmer's field over there looks good enough.
In case of more catastrophic failures like fire, computers become even more problematic because the sensors they depend on for inputs can be damaged or destroyed, leaving them with insufficient information to act properly.
>Near collisions - a constantly vigilant computer vision system watching out the window is more likely to avoid collision than a pilot with 30 seconds of reaction time.
People with a lot of money and resources have been trying to develop a fully autonomous system for avoiding impending collisions. They will almost certainly eventually succeed, but so far they haven't even come close to being as visual scan by human pilots.
[EDIT: resolved ambiguous use of "field.")
This depends on a lot of factors. Some of them are things that a computer can probably be programmed to consider properly (e.g. specific cause of failure). Other factors require judgment, such as your more general situation: depending on where you are and what else is going wrong, you might chose to land the airplane at the nearest appropriate airfield, or you might choose to continue on to an airfield farther away where you can get better support while attempting to restart the failed engine on your way there, or you might decide that you have to get it on the ground right now, and that empty farmer's field over there looks good enough.
In case of more catastrophic failures like fire, computers become even more problematic because the sensors they depend on for inputs can be damaged or destroyed, leaving them with insufficient information to act properly.
>Near collisions - a constantly vigilant computer vision system watching out the window is more likely to avoid collision than a pilot with 30 seconds of reaction time.
People with a lot of money and resources have been trying to develop a fully autonomous system for avoiding impending collisions. They will almost certainly eventually succeed, but so far they haven't even come close to being as visual scan by human pilots.
[EDIT: resolved ambiguous use of "field.")
A billion dollars was spent by the eu in the 80s on self-driving cars. They didn't completely succeed. It looked like noone would succeed for 30 years. And yet, bang, when the competition's opened up, a couple of guys from stanford do it.
I believe the technology to solve the problem is out there, it's just a matter of the right people trying at it.
Computer vision is close to being solved. Look at kinect, kinect 2/google goggles. People inside google/microsoft are racing at this. I'm sorry, i have to disagree with your pessimistic attitude on this.
With regard to fire - fire can kill human pilots too. With sensors, you can create a multiply redundant system - put in 20 extra sensors. With humans it's not possible.
I believe the technology to solve the problem is out there, it's just a matter of the right people trying at it.
Computer vision is close to being solved. Look at kinect, kinect 2/google goggles. People inside google/microsoft are racing at this. I'm sorry, i have to disagree with your pessimistic attitude on this.
With regard to fire - fire can kill human pilots too. With sensors, you can create a multiply redundant system - put in 20 extra sensors. With humans it's not possible.
Nothing you say addresses my broader point that there are currently too many situations in aviation where the complexity of the decisions involved exceeds our current capacity for automation.
A billion dollars was spent by the eu in the 80s on self-driving cars. They didn't completely succeed. It looked like noone would succeed for 30 years. And yet, bang, when the competition's opened up, a couple of guys from stanford do it. I believe the technology to solve the problem is out there, it's just a matter of the right people trying at it.
If they tried in the '80s and the guys from Stanford did it in the 2000's, then it was almost 30 years before anyone succeeded. I think that success had a lot more to do with technology maturing over time than it did with "the right people trying at it."
>Computer vision is close to being solved. Look at kinect, kinect 2/google goggles. People inside google/microsoft are racing at this.
This really depends on what you mean by "solved." Kinect is a hell of a long way from what you would need to avoid collisions in a 3D space. Kinect basically just has to deal with the outlines of objects at a relatively narrow set of distances. When your sensor is moving in three dimensions and you are trying to track an object that is also moving in three dimensions it gets a heck of a lot harder, even if you are using radar (which gives you range). If you're trying to figure out range based on the apparent size of an object of unknown actual size, it gets even harder.
>I'm sorry, i have to disagree with your pessimistic attitude on this.
I'm actually quite optimistic that it will happen, just not for many years yet.
>With regard to fire - fire can kill human pilots too. With sensors, you can create a multiply redundant system - put in 20 extra sensors. With humans it's not possible.
If your engine is out on a wing and it catches fire, the fire sensors will tell you so, and shortly thereafter they will most likely be destroyed and tell you nothing further. An engine on fire out on the wing is not going to burn up the pilot. The pilot can look out the window and quickly and easily assess the condition of the engine and the wing: did it burn out, or is it raging out of control, or maybe there are subtle signs that indicate something in-between? Maybe with enough fire sensors scattered all over the plane a computer could make a similar assessment, but you're talking about a lot of extra money and weight, and you still have the problem that your sensors are going to burn up shortly after going off and then you have no idea if the fire has gone away or if it has just stopped spreading. Someday maybe you can give the computer a camera to "look" at the wing to make the same kind of assessment that a human pilot can make, but that is a very long way off.
A billion dollars was spent by the eu in the 80s on self-driving cars. They didn't completely succeed. It looked like noone would succeed for 30 years. And yet, bang, when the competition's opened up, a couple of guys from stanford do it. I believe the technology to solve the problem is out there, it's just a matter of the right people trying at it.
If they tried in the '80s and the guys from Stanford did it in the 2000's, then it was almost 30 years before anyone succeeded. I think that success had a lot more to do with technology maturing over time than it did with "the right people trying at it."
>Computer vision is close to being solved. Look at kinect, kinect 2/google goggles. People inside google/microsoft are racing at this.
This really depends on what you mean by "solved." Kinect is a hell of a long way from what you would need to avoid collisions in a 3D space. Kinect basically just has to deal with the outlines of objects at a relatively narrow set of distances. When your sensor is moving in three dimensions and you are trying to track an object that is also moving in three dimensions it gets a heck of a lot harder, even if you are using radar (which gives you range). If you're trying to figure out range based on the apparent size of an object of unknown actual size, it gets even harder.
>I'm sorry, i have to disagree with your pessimistic attitude on this.
I'm actually quite optimistic that it will happen, just not for many years yet.
>With regard to fire - fire can kill human pilots too. With sensors, you can create a multiply redundant system - put in 20 extra sensors. With humans it's not possible.
If your engine is out on a wing and it catches fire, the fire sensors will tell you so, and shortly thereafter they will most likely be destroyed and tell you nothing further. An engine on fire out on the wing is not going to burn up the pilot. The pilot can look out the window and quickly and easily assess the condition of the engine and the wing: did it burn out, or is it raging out of control, or maybe there are subtle signs that indicate something in-between? Maybe with enough fire sensors scattered all over the plane a computer could make a similar assessment, but you're talking about a lot of extra money and weight, and you still have the problem that your sensors are going to burn up shortly after going off and then you have no idea if the fire has gone away or if it has just stopped spreading. Someday maybe you can give the computer a camera to "look" at the wing to make the same kind of assessment that a human pilot can make, but that is a very long way off.
You have two main pessimisms
- computer vision problems (e.g. plane catches fire, how do you tell how much fire etc.)
- tracking other objects in 3d while in moving in 3d at high speed
The question is - can humans do this? If yes, computers can do it eventually. The only question is how long away is this. What we know from machine learning, is that data is important. If you can gather enough data you can do anything. So really, your problems are a question of data collection. It is not a technically difficult problem. (By the way, one of the problems you have in aerospace is, is that you're control theory heavy rather than pro-ai, which means you end up not being able to solve the difficult problems.)
Also, the eu 80s project ended around early 90s, and the grandle challenge win was only 15 years later, not 30. Had the challenge been tried 5 years earlier, it would have worked. The algorithms and hardware was already sufficient.
- computer vision problems (e.g. plane catches fire, how do you tell how much fire etc.)
- tracking other objects in 3d while in moving in 3d at high speed
The question is - can humans do this? If yes, computers can do it eventually. The only question is how long away is this. What we know from machine learning, is that data is important. If you can gather enough data you can do anything. So really, your problems are a question of data collection. It is not a technically difficult problem. (By the way, one of the problems you have in aerospace is, is that you're control theory heavy rather than pro-ai, which means you end up not being able to solve the difficult problems.)
Also, the eu 80s project ended around early 90s, and the grandle challenge win was only 15 years later, not 30. Had the challenge been tried 5 years earlier, it would have worked. The algorithms and hardware was already sufficient.
I hardly think it's pessimistic to say, "this problem is really hard, and it's going to take years to solve." I'm confident that they will be solved, which some of my peers might even consider a naively optimistic attitude.
>The question is - can humans do this? If yes, computers can do it eventually.
This logic is deeply, deeply flawed. I happen to believe that computers can eventually perform the tasks under discussion, but "humans can do it" is not one of the reasons why I believe that.
>So really, your problems are a question of data collection. It is not a technically difficult problem.
When it comes to tracking airborne targets with airborne radar, data collection actually is a technically difficult problem. The combination of waveform, antenna design, transmitter design, receiver design, tracker design, etc. present a set of engineering tradeoffs in effective range, range resolution, azimuth resolution, weight, size, flase positive and false negative rates on radar returns, and other performance characteristics. Even the very best airborne radars provide data which is limited, especially in terms of accuracy and precision.
>By the way, one of the problems you have in aerospace is, is that you're control theory heavy rather than pro-ai, which means you end up not being able to solve the difficult problems.
A little more about my background: my BS is in EE, with a specialization in microcomputer interfacing (I took a lot of CS classes). In grad school, my stability and control prof had actually done some pioneering work in incorporating non-linear logic into stability and control systems (don't try this at home, kids). In addition to stability and control, my other focus for my MS was avionics. The prof who taught most of my avionics classes was actually from the CS department (his undergraduate background was EE, with a specialization in radar). One of the things that kind of surprised me about aero, having come from EE, was how broad the discipline is. Before going back to school for aero, I thought that getting a degree in aeronautical engineering would be primarily about aerodynamics, with a smattering of other stuff. Instead, I discovered that everyone gets a little bit of everything (aerodynamics, propulsion, structures, stability and control, avionics), and then specializes in one or two particular areas. By the PhD level, people who have specialized in areas other than aerodynamics have largely forgotten most of what they learned about it as undergrads. It's an incredibly heterogeneous field: propulsion and structures guys have more in common with MechEs than with other AeroEs; avionics and stability and control guys have more in common with EEs than with other AeroEs; etc. So to characterize the discipline, or any individual within it, as "control theory heavy rather than pro-ai," displays a deep misunderstanding of the character of the community. I guarantee you that there are plenty of AI experts working in the aero field.
>Also, the eu 80s project ended around early 90s, and the grandle challenge win was only 15 years later, not 30. Had the challenge been tried 5 years earlier, it would have worked. The algorithms and hardware was already sufficient.
This just reinforces my broader point: success came not as a result of some innovative genius applying a novel new approach but rather because the technology had matured--over the course of several years--to the point where success had become not only possible but likely. Radar tracking is currently experiencing big advances for that same reason. The theory behind Space-Time Adaptive Processing (STAP) has been around for decades, but the available technology has not been up to the task of implementing it effectively. In the past we've resorted to less effective tracking methods such as MTI, but in the last decade or so the technology has finally made STAP reasonable to implement.
>The question is - can humans do this? If yes, computers can do it eventually.
This logic is deeply, deeply flawed. I happen to believe that computers can eventually perform the tasks under discussion, but "humans can do it" is not one of the reasons why I believe that.
>So really, your problems are a question of data collection. It is not a technically difficult problem.
When it comes to tracking airborne targets with airborne radar, data collection actually is a technically difficult problem. The combination of waveform, antenna design, transmitter design, receiver design, tracker design, etc. present a set of engineering tradeoffs in effective range, range resolution, azimuth resolution, weight, size, flase positive and false negative rates on radar returns, and other performance characteristics. Even the very best airborne radars provide data which is limited, especially in terms of accuracy and precision.
>By the way, one of the problems you have in aerospace is, is that you're control theory heavy rather than pro-ai, which means you end up not being able to solve the difficult problems.
A little more about my background: my BS is in EE, with a specialization in microcomputer interfacing (I took a lot of CS classes). In grad school, my stability and control prof had actually done some pioneering work in incorporating non-linear logic into stability and control systems (don't try this at home, kids). In addition to stability and control, my other focus for my MS was avionics. The prof who taught most of my avionics classes was actually from the CS department (his undergraduate background was EE, with a specialization in radar). One of the things that kind of surprised me about aero, having come from EE, was how broad the discipline is. Before going back to school for aero, I thought that getting a degree in aeronautical engineering would be primarily about aerodynamics, with a smattering of other stuff. Instead, I discovered that everyone gets a little bit of everything (aerodynamics, propulsion, structures, stability and control, avionics), and then specializes in one or two particular areas. By the PhD level, people who have specialized in areas other than aerodynamics have largely forgotten most of what they learned about it as undergrads. It's an incredibly heterogeneous field: propulsion and structures guys have more in common with MechEs than with other AeroEs; avionics and stability and control guys have more in common with EEs than with other AeroEs; etc. So to characterize the discipline, or any individual within it, as "control theory heavy rather than pro-ai," displays a deep misunderstanding of the character of the community. I guarantee you that there are plenty of AI experts working in the aero field.
>Also, the eu 80s project ended around early 90s, and the grandle challenge win was only 15 years later, not 30. Had the challenge been tried 5 years earlier, it would have worked. The algorithms and hardware was already sufficient.
This just reinforces my broader point: success came not as a result of some innovative genius applying a novel new approach but rather because the technology had matured--over the course of several years--to the point where success had become not only possible but likely. Radar tracking is currently experiencing big advances for that same reason. The theory behind Space-Time Adaptive Processing (STAP) has been around for decades, but the available technology has not been up to the task of implementing it effectively. In the past we've resorted to less effective tracking methods such as MTI, but in the last decade or so the technology has finally made STAP reasonable to implement.
It seems like you are not well versed in ai. There was a debate about whether "hand engineering" vs "dumb simple algo's" would get results. Dumb algo's won. Your mentioning of MTI and STAP, and how difficult radar design is etc. etc., makes me think you aero guys are still in hand-engineering land.
I will offer another example. Why did the aerospace dudes not be able to autonomously fly a helicopter. in 2004, andrew ng decided to tackle this. He completely ignored any previous work, just using a dumb algo (reinforcement learning) and laptop managed to get amazing autonomous performance out it. Why was it him (ai researcher), and not people from the field of flying.
I will offer another example. Why did the aerospace dudes not be able to autonomously fly a helicopter. in 2004, andrew ng decided to tackle this. He completely ignored any previous work, just using a dumb algo (reinforcement learning) and laptop managed to get amazing autonomous performance out it. Why was it him (ai researcher), and not people from the field of flying.
>It seems like you are not well versed in ai.
Not especially. I audited a course as an undergrad, and hardly remember anything from it now, but I have a layman's understanding of the basics.
>There was a debate about whether "hand engineering" vs "dumb simple algo's" would get results. Dumb algo's won.
There are design tasks for which "algorithms" are better suited, and there are design tasks where experienced human engineers still do far, far better. The statement "Dumb algo's won" is certainly true for some applications, but not all.
>Your mentioning of MTI and STAP, and how difficult radar design is etc. etc.,
Now it's my turn: you clearly are not well versed in aviation or in radar principles. Not every problem can be magically solved by throwing AI at it. Radar theory is well established, and the equations are well known. Unfortunately, they are hard equations to solve: determining the location of an object using radar involves some complicated math with a lot of variables, and the only way to solve those equations is to chew your way through them. You can simplify them, but then you have to accept increased errors from the terms you throw out.
Where "algorithms" come into play is tracking, and depending on how you define AI, radar engineers have been using AI since the invention of the first automated tracker. Even the very best automated trackers in existance today are not nearly as good as an experienced operator looking at raw returns. Someday that will probably change, but that day is still many years away.
>...makes me think you aero guys are still in hand-engineering land.
As I said before, you're making a huge mistake by lumping "you aero guys" into a single group. "Aeronautical engineering" is really "every other kind of engineering, applied to aviation." When I was in grad school, one of my buddies' thesis was pure AI: he developed a learning algorithm for choosing the optimum path for a jet to taxi around a crowded flight deck, using DGPS as the only position source. Another guy combined machine learning with CFD in an attempt to design better supersonic lifting surfaces (the results were not good, but his thesis was still a "success" in the sense that he expanded human knowledge and the general concept showed promise). There are some applications where AI is the way to go, and there are some applications where what you derisively call "hand engineering" is infinitely superior.
>I will offer another example. Why did the aerospace dudes not be able to autonomously fly a helicopter. in 2004, andrew ng decided to tackle this. He completely ignored any previous work, just using a dumb algo (reinforcement learning) and laptop managed to get amazing autonomous performance out it. Why was it him (ai researcher), and not people from the field of flying.
Time for a history lesson:
The Navy deployed the first effective autonomous rotorcraft in the 1960s: http://en.wikipedia.org/wiki/Drone_Anti-Submarine_Helicopter
So the "aerospace dudes" were "able to autonomously fly a helicopter" before Andrew Ng was born, and they did it using "hand engineering."
Not autonomous enough for you? Firescout flew autonomously four years before Andrew Ng flew his helicotper autonomously: http://en.wikipedia.org/wiki/Firescout
Firescout was also developed by "people from the field of flying."
Not especially. I audited a course as an undergrad, and hardly remember anything from it now, but I have a layman's understanding of the basics.
>There was a debate about whether "hand engineering" vs "dumb simple algo's" would get results. Dumb algo's won.
There are design tasks for which "algorithms" are better suited, and there are design tasks where experienced human engineers still do far, far better. The statement "Dumb algo's won" is certainly true for some applications, but not all.
>Your mentioning of MTI and STAP, and how difficult radar design is etc. etc.,
Now it's my turn: you clearly are not well versed in aviation or in radar principles. Not every problem can be magically solved by throwing AI at it. Radar theory is well established, and the equations are well known. Unfortunately, they are hard equations to solve: determining the location of an object using radar involves some complicated math with a lot of variables, and the only way to solve those equations is to chew your way through them. You can simplify them, but then you have to accept increased errors from the terms you throw out.
Where "algorithms" come into play is tracking, and depending on how you define AI, radar engineers have been using AI since the invention of the first automated tracker. Even the very best automated trackers in existance today are not nearly as good as an experienced operator looking at raw returns. Someday that will probably change, but that day is still many years away.
>...makes me think you aero guys are still in hand-engineering land.
As I said before, you're making a huge mistake by lumping "you aero guys" into a single group. "Aeronautical engineering" is really "every other kind of engineering, applied to aviation." When I was in grad school, one of my buddies' thesis was pure AI: he developed a learning algorithm for choosing the optimum path for a jet to taxi around a crowded flight deck, using DGPS as the only position source. Another guy combined machine learning with CFD in an attempt to design better supersonic lifting surfaces (the results were not good, but his thesis was still a "success" in the sense that he expanded human knowledge and the general concept showed promise). There are some applications where AI is the way to go, and there are some applications where what you derisively call "hand engineering" is infinitely superior.
>I will offer another example. Why did the aerospace dudes not be able to autonomously fly a helicopter. in 2004, andrew ng decided to tackle this. He completely ignored any previous work, just using a dumb algo (reinforcement learning) and laptop managed to get amazing autonomous performance out it. Why was it him (ai researcher), and not people from the field of flying.
Time for a history lesson:
The Navy deployed the first effective autonomous rotorcraft in the 1960s: http://en.wikipedia.org/wiki/Drone_Anti-Submarine_Helicopter
So the "aerospace dudes" were "able to autonomously fly a helicopter" before Andrew Ng was born, and they did it using "hand engineering."
Not autonomous enough for you? Firescout flew autonomously four years before Andrew Ng flew his helicotper autonomously: http://en.wikipedia.org/wiki/Firescout
Firescout was also developed by "people from the field of flying."
There's quite a difference between firescout and ng's helicopter. The latter gives superhuman performance (there are videos on his homepage, andrew ng stanford). Anyway, i don't know what algo firescout uses, it might well be ai behind the scenes proving my general point.
Your point about complicated mathematical equations lies at the root problem of you "unified engineering" guys. modern ai (machine learning) is where you give up on the assumption that you (puny human) can impart "wisdom" to your system. You simply throw a random set of equations (a neural network) that are large enough/not too large (overfitting) to capture physical reality. Getting the errors low is a matter of getting enough data and experimentally adjusting the size of your nnet.
Yes, there mught be grad students and profs trying ai to solve aero problems, however, if enough resources are not devoted, they will not yield good enough results. For example, spend a billion dollars (gathering data/computation) to solve your radar problem. A billion dollars in your field is pocket change.
Your point about complicated mathematical equations lies at the root problem of you "unified engineering" guys. modern ai (machine learning) is where you give up on the assumption that you (puny human) can impart "wisdom" to your system. You simply throw a random set of equations (a neural network) that are large enough/not too large (overfitting) to capture physical reality. Getting the errors low is a matter of getting enough data and experimentally adjusting the size of your nnet.
Yes, there mught be grad students and profs trying ai to solve aero problems, however, if enough resources are not devoted, they will not yield good enough results. For example, spend a billion dollars (gathering data/computation) to solve your radar problem. A billion dollars in your field is pocket change.
"And for nearly two decades, automatic landing systems have been able to drop and stop a jet on the fog-shrouded deck of an aircraft carrier that's barely twice as wide and three times as long as the jet's wingspan—and the ship is moving. Meanwhile, the pilot sits in the cockpit, hands folded."
I know that aircraft carriers have these systems, but having been on two deployments on an aircraft carrier I have never heard of it being used. I think it's only for emergencies when the pilot is injured or incapacitated.
I know that aircraft carriers have these systems, but having been on two deployments on an aircraft carrier I have never heard of it being used. I think it's only for emergencies when the pilot is injured or incapacitated.
There are actually a few levels of automation available to hornet pilots, ranging from (in layman's terms) "a little help staying on-speed and on glideslope" to "fully automatic." Some pilots hardly ever use them, some pilots use them as much as they are allowed (in order to insure proficiency, there are limits in place to make sure the pilots don't become overly reliant on the automation). Most pilots are in-between, using them occasionally, typically when they feel like they're not at their best (e.g. at the end of a 6 hr+ combat sortie into Afghanistan). Even when on full-auto, I don't know any of them who sit "hands folded:" they're ready to take over immediately in case something goes wrong. I've heard stories that some of the test pilots eventually got confortable to take their hands completely off the controls back when this stuff was first being tested, but I doubt if even they made a habit of it.
> I don't know any of them who sit "hands folded:" they're ready to take over immediately in case something goes wrong.
Did you ever hear of something going wrong with the automation?
Did you ever hear of something going wrong with the automation?
Occasionally it will disengage, leaving the pilot in full control. IIRC, when in full-auto it will automatically wave off (add power and climb out to go around and try again) when it disengages unless the pilot actively takes over; so it wouldn't create an immediately unsafe situation, but it could result in an unneccessary missed opportunity to land.
> when in full-auto it will automatically wave off (add power and climb out to go around and try again) when it disengages
Interesting. So it hasn't disengaged at all, it's just decided to abort the current landing attempt, and go around to try again.
Interesting. So it hasn't disengaged at all, it's just decided to abort the current landing attempt, and go around to try again.
Hoo boy, that could be dangerous if there's something physically wrong with the plane (a non-functional aileron or stabilator, for example).
I am an airline pilot and a programmer who loves automation. While the psychological aspect I think is easy to get over with the public by producing ultra low fares the technological one is quite different.
The author states that even in easy adaptations such as traffic watch we still do not see UAVs and what the author is missing is the cost! Those military UAVs cost almost as much as a private jet in what today using 1950s technology can be achieved for the cost of a used cluncker.
Also, the same inheritable problems that we face fully automating cars, exist in fully automating airplanes. Each is an individual unit and very autonomous with no single 'track' to follow. In addition to this largely autonomous environment you have integration problems, where you would integrate the old with the new automated environment and still be able to offer the same capacity of airspace usage.
As frustrating (and yes it is for pilots too - more than passengers realize) as air travel seems now days. The achievements of airspace utilization in places like New York, Chicago, Los Angeles, Phoenix, San Fran etc is almost mind boggling considering it's used with a mosaic of 1930s radar equipment which honestly can't pin point you to an exact location within a circle of 1 mile around yourself.
The author states that even in easy adaptations such as traffic watch we still do not see UAVs and what the author is missing is the cost! Those military UAVs cost almost as much as a private jet in what today using 1950s technology can be achieved for the cost of a used cluncker.
Also, the same inheritable problems that we face fully automating cars, exist in fully automating airplanes. Each is an individual unit and very autonomous with no single 'track' to follow. In addition to this largely autonomous environment you have integration problems, where you would integrate the old with the new automated environment and still be able to offer the same capacity of airspace usage.
As frustrating (and yes it is for pilots too - more than passengers realize) as air travel seems now days. The achievements of airspace utilization in places like New York, Chicago, Los Angeles, Phoenix, San Fran etc is almost mind boggling considering it's used with a mosaic of 1930s radar equipment which honestly can't pin point you to an exact location within a circle of 1 mile around yourself.
What Commercial Aircraft do you fly, and for how long have you been a Commercial Airline Pilot?
I don't think we'll ever see it.
There are too many hurdles to overcome. The psychological and liability one for actual plane manufacturers.
+ it just doesn't make sense economically. Pilots get paid fairly little now, and as automation progresses, the salaries will go down to ~40K(so ~80K for the 2). At that point, it's really not that much money to give passengers the extra sense of security.
There are too many hurdles to overcome. The psychological and liability one for actual plane manufacturers.
+ it just doesn't make sense economically. Pilots get paid fairly little now, and as automation progresses, the salaries will go down to ~40K(so ~80K for the 2). At that point, it's really not that much money to give passengers the extra sense of security.
It's not just the pilots, cockpits for something like a 747 is not all that cheap to build and adds a fair amount of weight on every trip. If you really need manual supervision of takeoffs and landings you could have a set of pilots at major airports supervising these functions with vary low latency.
Modern glass cockpits are just thin interfaces on avionics you need anyway. I would be surprised if a cockpit-less 777 was significantly lighter than one including it.
As for the weight of the pilots themselves - judging by the cost of excess luggage, I'd say it's negligible for all but the smallest aircrafts.
As for the weight of the pilots themselves - judging by the cost of excess luggage, I'd say it's negligible for all but the smallest aircrafts.
I would say just the weight of the pilots, their seats, the extra structural support and reinforced door, and the need to wire control surfaces to the front of an airplane vs it's mid section etc. Your probably down ~2-4 passengers.
When someone can tell me with a straight face that the 440 passengers and 29 crew members of QF32[1] would still be alive without the heroes they had up front that day.
[1] http://en.wikipedia.org/wiki/Qantas_Flight_32
[1] http://en.wikipedia.org/wiki/Qantas_Flight_32
That was a fascinating read, although I must play devil's advocate and ask what prevents a ground crew from taking over a commercial airliner remotely in case of distress? None of what this flight crew did necessitated their physical presence onboard, only their decision-making and operation of the existing aircraft controls.
Given that the plane was on battery power when it landed, a ground crew may not have still had contact and control of the aircraft. In the case of the "Gimli Glider" mentioned below, there was a total power failure due to fuel exhaustion and IIRC the pilots had to crank down the nosewheel by hand.
What about passengers that were killed due to human error?
http://en.wikipedia.org/wiki/Gimli_Glider also a favorite.
[deleted]
Hopefully only when the last time a pilot had to intervene on a plane flying itself is only remembered in history books.
Automation today is really good, but only until something goes wrong. Until automation becomes absolutely perfect, I will argue it's even starting to become dangerous - as pilots are thrown into emergencies without quite knowing how the plane got into them and based on what flawed assumption.
Automation today is really good, but only until something goes wrong. Until automation becomes absolutely perfect, I will argue it's even starting to become dangerous - as pilots are thrown into emergencies without quite knowing how the plane got into them and based on what flawed assumption.
Automation doesn't have to be perfect; it just has to have better judgement than a human pilot.
Automation is incapable of "judgement;" automation consistently and reliably responds to inputs according to pre-defined instructions. That's why automation works really well in some situations but not others. The more complex the task, the harder it is make a complete instruction set that will result in a satisfactory outcome for every possible situation.
Even human pilots behave somewhat like automatons in some situations: in most situations they follow procedures, which could be described as "responding to inputs according to pre-defined instructions." However, they often encounter situations not covered by the procedures, in which case they must instead exercise their judgement.
The problem with judgement is that it is neither consistent nor reliable. Some humans have better judgement than others. Eventually we will have automation sophisticated enough to handle even to full complexity of aviation, at which point automation will yield safe results more consistently and reliably than human judgement.
Even human pilots behave somewhat like automatons in some situations: in most situations they follow procedures, which could be described as "responding to inputs according to pre-defined instructions." However, they often encounter situations not covered by the procedures, in which case they must instead exercise their judgement.
The problem with judgement is that it is neither consistent nor reliable. Some humans have better judgement than others. Eventually we will have automation sophisticated enough to handle even to full complexity of aviation, at which point automation will yield safe results more consistently and reliably than human judgement.
I suppose it gets into philosophical debates about AI, but I don't see any reason in principle that we can't describe at least some kinds of computerized systems as exercising something described as "judgment". We already have one existence proof, the human brain, of a system that can exercise something we call "judgment", and I don't see a strong reason to believe that it's due to anything magical about the human brain in particular (like a soul or something along those lines), rather than just being a complex reasoning system that's able to balance many contextual factors.
Automated systems as they currently exist have fixed responses to fixed inputs. If an automatic system encounters a set of inputs it wasn't programmed for, it has no capacity to determine a best course of action for those inputs. Depending on how it was programmed, it will either keep doing what it was doing previously, or switch to a pre-programmed "contingency plan" that hopefully will result in a tolerable outcome (but which might result in catastrophe), or possibly execute a random set of instructions (which can happen to poorly-designed state machines, for example).
A human being, on the other hand, has the capacity, when faced with unexpected or unfamiliar conditions, to exercise something we call "judgement" in an attempt to develop an appropriate response. I'm not saying that it's impossible for an automated system to have this capacity, I'm saying that no current automated systems have it, and that we're nowhere near to developing such a system any time soon.
A human being, on the other hand, has the capacity, when faced with unexpected or unfamiliar conditions, to exercise something we call "judgement" in an attempt to develop an appropriate response. I'm not saying that it's impossible for an automated system to have this capacity, I'm saying that no current automated systems have it, and that we're nowhere near to developing such a system any time soon.
That's definitely the case with deployed civilian aircraft systems, but I'd be surprised if there wasn't some unmanned system somewhere doing more complex reasoning. There was a talk years ago at IJCAI from some people from NASA Ames on a prototype aircraft-control system they'd built that used a reasoning system to assist with performing emergency landings in situations with no preprogrammed contingency, by taking into account some telemetry information (e.g. aircraft damage), map information, an aerodynamic model, and risk models.
I do believe they were planning to deploy it as a suggestion system though, which would suggest a course of action, and then leave it to the pilot to implement it or not. Then the judgment gets more murky; now the system is doing some of the judgment (evaluation of alternatives, etc.) that a human pilot would normally do, but leaving some of the judgment (accept the suggestion, modify it) still to the human.
edit: Here's a more recent paper than the one I'm thinking of, but must be the same project: http://ti.arc.nasa.gov/m/profile/de2smith/publications/IAAI0...
I do believe they were planning to deploy it as a suggestion system though, which would suggest a course of action, and then leave it to the pilot to implement it or not. Then the judgment gets more murky; now the system is doing some of the judgment (evaluation of alternatives, etc.) that a human pilot would normally do, but leaving some of the judgment (accept the suggestion, modify it) still to the human.
edit: Here's a more recent paper than the one I'm thinking of, but must be the same project: http://ti.arc.nasa.gov/m/profile/de2smith/publications/IAAI0...
That's not really true. It's often the case that automation is designed reach a specific goal and it then try's to achieve / maintain that state. AKA Segways try to balance and an F-15 Control Augmentation System (CAS) aka stability assistance system try's to keep flying even without a wing. (Yes, this worked and was not programmed for.)
http://www.airliners.net/aviation-forums/tech_ops/print.main...
Plenty of other planes of lost a section of wing a wing and still landed. http://www.airliners.net/aviation-forums/general_aviation/re... Granted, all of these cases had a pilot, but in the F-15 the avionics actually discovered how to maintain level flight after the loss of the wing.
http://www.airliners.net/aviation-forums/tech_ops/print.main...
Plenty of other planes of lost a section of wing a wing and still landed. http://www.airliners.net/aviation-forums/general_aviation/re... Granted, all of these cases had a pilot, but in the F-15 the avionics actually discovered how to maintain level flight after the loss of the wing.
I have a master's in aeronautical engineering, and one of my major areas of study was stability and control, which is what your Segway and F-15 examples fall under.
Automated flight control systems definitely do not exercise "judgement:" they have inputs, a transfer function (typically MIMO, these days), and outputs. It used to be that the transfer function was fixed, but more sophisticated systems (e.g. fighter jets) often have many different transfer functions and switch between them based upon various inputs. They don't "decide" or "discover" anything: for any given set of inputs, they will predictably produce a pre-determined set of outputs.
Aircraft stability and control systems are not programmed to care about, or even know about, the existance of the wings. The closest they get to this is that they will know the current states of the control surfaces on the wings. So it doesn't really make sense to say that the F-15 CAS was "not programmed for" the state of missing a wing (although it almost certainly was programmed to respond properly in the situation where it gets no feedback from some of the flight controls). As you say, it's designed to reach a specific goal (keep the plane level) and then maintain that state. If the system detects an uncommanded roll-rate, it will move the flight controls to stop that roll-rate. It doesn't know or care that the uncommanded roll-rate is the result of asymmetric lift due to an (almost completely) missing wing: it's just going to keep moving the flight control surfaces until that roll rate goes away. If the aicraft had been damaged in a slightly different way, it's possible that the CAS would have issued commands to the flight controls that would have departed the plane, but fortunately the handling characteristics of the aircraft remained close enough to normal that the control laws still produced good results.
Unfortunately, this behavior can result in mishaps when a flight control system gets erroneous inputs: when it believes that it is rolling when it is wings-level (or believies it is level when it is rolling). This was a major contributor to the Air France fligh 447 crash. In such situations, it takes judgement to realize that something is wrong and to figure out what to do about it.
Automated flight control systems definitely do not exercise "judgement:" they have inputs, a transfer function (typically MIMO, these days), and outputs. It used to be that the transfer function was fixed, but more sophisticated systems (e.g. fighter jets) often have many different transfer functions and switch between them based upon various inputs. They don't "decide" or "discover" anything: for any given set of inputs, they will predictably produce a pre-determined set of outputs.
Aircraft stability and control systems are not programmed to care about, or even know about, the existance of the wings. The closest they get to this is that they will know the current states of the control surfaces on the wings. So it doesn't really make sense to say that the F-15 CAS was "not programmed for" the state of missing a wing (although it almost certainly was programmed to respond properly in the situation where it gets no feedback from some of the flight controls). As you say, it's designed to reach a specific goal (keep the plane level) and then maintain that state. If the system detects an uncommanded roll-rate, it will move the flight controls to stop that roll-rate. It doesn't know or care that the uncommanded roll-rate is the result of asymmetric lift due to an (almost completely) missing wing: it's just going to keep moving the flight control surfaces until that roll rate goes away. If the aicraft had been damaged in a slightly different way, it's possible that the CAS would have issued commands to the flight controls that would have departed the plane, but fortunately the handling characteristics of the aircraft remained close enough to normal that the control laws still produced good results.
Unfortunately, this behavior can result in mishaps when a flight control system gets erroneous inputs: when it believes that it is rolling when it is wings-level (or believies it is level when it is rolling). This was a major contributor to the Air France fligh 447 crash. In such situations, it takes judgement to realize that something is wrong and to figure out what to do about it.
Ok, it was my understanding that the F-15 adjusted the transfer function based on a feedback cycle rather than simply picking from a list of them. However, thinking back the conversation was ambiguous and I don't have the clearance required to find out the correct answer.
However, while flight control systems have been responsible for plenty of crashes pilots have often mistaken level for non level flight and focused on faulty instruments rather than switching to working backups etc. An automated system can handle redundancy much more efficiently than people in such situations so while it's little value for a person to have ex:7 gyroscopes if they need to pick between them autopilots can gain from access to such information.
However, while flight control systems have been responsible for plenty of crashes pilots have often mistaken level for non level flight and focused on faulty instruments rather than switching to working backups etc. An automated system can handle redundancy much more efficiently than people in such situations so while it's little value for a person to have ex:7 gyroscopes if they need to pick between them autopilots can gain from access to such information.
I never claimed that human pilots are superior to automated flight control systems in every aspect. In fact, I have stated explicitly that computers perform some tasks better and more safely than humans.
I was simply making the point that when you encounter a situation that isn't covered in the instructions, you need juman judgement to figure out the best way to proceed. I also explicitly stated that human judgement is far from flawless, and that if you can develop a sufficiently comprehensive automation program, you can get safer results than you would on average with human judgement.
I was simply making the point that when you encounter a situation that isn't covered in the instructions, you need juman judgement to figure out the best way to proceed. I also explicitly stated that human judgement is far from flawless, and that if you can develop a sufficiently comprehensive automation program, you can get safer results than you would on average with human judgement.
If you feed completely new information into a system it's going to do something. Some times it's even the correct choice, but really people also do the same thing in novel situations. I have no problem calling judgement simply deciding what to do based on the current situation and as soon as you add any form of adaptation then computers can do that. But, I am also willing to concede your probably using a different definition.
PS: IMO, what separates people from machine learning systems is treating everything as training data, a much larger training set, a lot more processing power, and a tendency to explore novel situations. The trade off is efficiency and reaction times. Still, when you get into thrust vectoring, super sonic flight, high g turns, rapidly changing weight/drag/thrust at the same time trading consistency for improved handling of novel situations is probably worth it so I expect the air force uses systems that are fare more adaptable than the civilian world.
PS: IMO, what separates people from machine learning systems is treating everything as training data, a much larger training set, a lot more processing power, and a tendency to explore novel situations. The trade off is efficiency and reaction times. Still, when you get into thrust vectoring, super sonic flight, high g turns, rapidly changing weight/drag/thrust at the same time trading consistency for improved handling of novel situations is probably worth it so I expect the air force uses systems that are fare more adaptable than the civilian world.
> Automation is incapable of "judgement;" automation consistently and reliably responds to inputs according to pre-defined instructions.
Where are you getting this definition of "automation" from?
As far as I'm concerned, an automatic system is simply one that require little or no direct human control.
Where are you getting this definition of "automation" from?
As far as I'm concerned, an automatic system is simply one that require little or no direct human control.
Before claiming a machine is incapable of judgment, we would have to define what it is. Is a fly capable of judgment? A fish? This is a philosophical question and won't yield any meaningful answers. Call it judgment of feedback loop, the end result is similar.
I feel that the biggest problem with automation and AI based systems is the ability to handle 'Black Swan' events - for the lack of a better term.
The reason for accidents is usually an unanticipated combination of events. Unanticipated means an autopilot will not have been programmed to handle it.
There are many, many aviation disasters that were avoided because the pilot got creative.
There are many, many aviation disasters that were avoided because the pilot got creative.
And there are a couple of disasters where the pilots didn't listen to their mechanical friends.
You would need a better-than-human-pilot AI for that. Until we get there - and are able to reliably demonstrate that, you'll want humans in the loop.
Fortunately for some of us (e.g. me), judging is not something computers are particularly good at right now.
lucasjung has done such a fantastic job of debunking this idea that they's very little to add; however one aspect that hasn't been expanded upon is the glacially slow pace at which the FAA approves systems for use.
Approved aviation systems are far from bleeding edge; at best the technology in use is five years old, and the 5-year old technology that's in use is only so because some company(ies) invested the considerable resources to jump through all of the hoops required by the FAA to get approval for commercial use.
Furthermore, military aviation is an incredibly poor analogue to commercial (and general) aviation because it lacks the onerous regulatory oversight brought to bear by the FAA. Military aviation is the bleeding edge and the advancements made there trickle backwards to CA/GA at a very slow pace due to the incredible cost of getting certificated by the FAA as well as the fact that the FAA (correctly) places safety and reliability at the top of their priority list.
Approved aviation systems are far from bleeding edge; at best the technology in use is five years old, and the 5-year old technology that's in use is only so because some company(ies) invested the considerable resources to jump through all of the hoops required by the FAA to get approval for commercial use.
Furthermore, military aviation is an incredibly poor analogue to commercial (and general) aviation because it lacks the onerous regulatory oversight brought to bear by the FAA. Military aviation is the bleeding edge and the advancements made there trickle backwards to CA/GA at a very slow pace due to the incredible cost of getting certificated by the FAA as well as the fact that the FAA (correctly) places safety and reliability at the top of their priority list.
[deleted]
It's going to be a very, very long time before we see autonomous airliners. I'll talk about specific technical hurdles, but I think the biggest issue is psychological: it's one thing to entrust a bunch of freight to an autonomous vehicle, another thing entirely to entrust dozens of living, breathing human beings to such (the article discusses this, including the concept of "shared fate"). I am confident that autonomous airliners will only come into service when autonomous aircraft technology reaches a point where the computers are able to handle every aspect of flight safety better than humans. Right now they can already do some of those things better than humans, and those tasks have already largely been shed by human pilots and entrusted to their computers. I think there will be a gradual transition as the computers are able to take on more and more of the tasks. The article also mentions how this process is already causing basic aviation skills to atrophy in pilots who leave too much to the computers. I think this is a very real problem, and I think it was a major contributor to the Air France flight 447 crash. Prudent pilots do more manual flying than is strictly necessary because that's the only way to maintain proficiency. If this problem becomes severe enough, expect to see the FAA establish more granular proficiency requirements.
The author talks a lot about how much the military is using UAVs, and seems to think that this is a good model for civilian applications. It isn't. The military has an entirely different set of risk considerations than civil aviation. Take the example of medivac UAVs: a medivac UAV will almost certainly have a higher mishap rate than a manned medivac helo, which would be completely unacceptable for civilian purposes. However, for the military that increased mishap risk is more than offset by the risks of putting an entire human crew into harm's way just to medivac a single wounded soldier.
Military UAVs currently in use generally have much higher mishap rates than their manned counterparts, but the military tolerates this because aicrew don't die in UAV mishaps, and UAVs are generally less expensive to replace than manned vehicles. Part of the reason for this is that features designed to prevent or mitigate mishaps cost money, and it is often cheaper to leave many of them out and accept the higher mishap rate, especially when no human crew is involved. However, part of it is that autonomous systems still just aren't as good at flying safely. For the military, the benefits outweigh the costs, but I really can't see a for-profit corporation reachig the same conclusion.
>Northrop Grumman has built some sense-and-avoid savvy into the unmanned helicopters and other UAVs it's developing for the U.S. Navy.
I happen to be intimitely familiar with one such system, and somewhat familiar with another. This sentence is utter BS. I can only assume that the author was fed a line by an NGC PR-type and took it at face value. A more honest way to say it would be:
Northrop Grumman is trying to incorporate limited sense-and-avoid capabilities into the unmanned helicopters and other UAVs it's developing for the U.S. Navy.
Moreover, FAA has a requirement for "see and avoid," not "sense and avoid." The military is trying hard to sell them on the idea that it should be "sense and avoid," of which "see and avoid" would be just a subset, but so far the FAA has remained deeply skeptical. The FAA is right to be conservative about this change: none of the currently proposed systems would be as effective at collision avoidance as the Mark I Eyeball, and thus far the systems I am aware of (to which the quote from the article was referring) are still a very long way from working properly. This seems to me like the kind of technical problem that eventually can be overcome, but it's going to take a lot of work to make that happen.
Because "see and avoid" is so critical to safety of flight, and because UAVs can't currently do it, the FAA does not allow UAVs to operate in its airspace, with some tightly restricted exceptions for military and law enforcement UAVs. I doubt very highly if they would make similar exceptions for civilian purposes, and even if they did, the restrictions involved are so limiting that there aren't many viable applications.