Papers of the day   All papers

Rethinking the maturity of artificial intelligence in safety-critical settings


Missy Cummings: The entire self-driving community has failed to grasp that they are trying to field deeply flawed, immature systems that cannot cope with uncertainty, when defense companies have gone down this path, such premature deployments ended in failures, see

15 replies, 322 likes

Matt Farah: This is the word. Uncertainty. Driving is dealing with uncertainty, in real time, at 70 mph. A lot of just being ready for "what if." Exactly the thing computers are fucking terrible at.

22 replies, 200 likes

Missy Cummings: My contentious paper asserting that self-driving cars are inherently limited by their inability to replicate top-down reasoning was accepted for publication in @RealAAAI's AI Magazine.

8 replies, 161 likes

Missy Cummings: @AnimaAnandkumar @GaryMarcus Deep learning and symbolic reasoning both fall very short in replicating the reasoning needed by safety-critical systems w/ embedded AI. What we really need is for *famous* AI academics and practitioners to stop posturing and solve a very real problem

1 replies, 48 likes

Missy Cummings: AVs will only be safer in operational domains low in uncertainty (slow, geo-fenced, additional infrastructure for monitoring & control, no bad weather) The technology - both software & hardware - do not exist to get us to safe full self-driving, see

4 replies, 43 likes

Missy Cummings: OMG, maybe it's cabin fever but @60Minutes is desperate for ratings in their gushing love of driverless trucks. Seriously, where is their supposed critical insight? NO WAY is this tech going to be ready for nationwide unrestricted release by 2021, see

1 replies, 29 likes

Noel Sharkey: SELF-DRIVING into 16 billion dollar spending and the CARS are still not fit for purpose until billions more spent. We’ve been steered into a hype cycle See who is driving all the spending.

3 replies, 26 likes

Missy Cummings: Let me gently suggest that you carefully read this AGI will NEVER happen until we figure out how to approximate top-down reasoning which DOES NOT EXIST in any fashion in known AI techniques today. Connectionist/deep learning & symbolic AI can't do this.

1 replies, 26 likes

Missy Cummings: My one must-read piece is this

3 replies, 23 likes

Missy Cummings: Love it! Perfect illustration of the insurmountable problems of computer vision that I detail here People who think all camera-vision driverless cars like what @Mobileye proposes is a good idea need to have their heads examined.

1 replies, 21 likes

Missy Cummings: Deep learning nor symbolic reasoning can provide expert-based judgment under uncertainty like that needed for the conflicting traffic sign conundrum below. This is critical for AI embedded in safety-critical systems, but very far from reality. See

0 replies, 10 likes

Ches | Frank: Traditional driving tests don't apply to AVs because humans are bad at the kinds of tasks machines are good at, & vice/versa. However, @missy_cummings describes a crash resulting from a lack of basic functionality that a driving test would've revealed. 🤔

2 replies, 9 likes

Filip Piekniewski: This article by @missy_cummings is so much needed voice of reason in this AI circus. Such a short and great summary of the elephant in the AI room.

1 replies, 6 likes

Tim Miller: I would double tweet this if there was a double tweet option.

0 replies, 5 likes

Missy Cummings: It would be nice for @NHTSAgov to add some important rules like driverless cars should not be tricked by tape on signs, they should be able to work in low sun angle conditions, they should be able to correctly "see" partially obscured signs, see more at

2 replies, 4 likes

Kevin Sharpe: If you're using #Tesla 'autopilot' you should read this 🤔👇

1 replies, 4 likes

Andrew: This is very, very good from @missy_cummings talking about the inherent problems of using AI in safety critical situation, y’know, like driving a car Have you read it @kentindell? As the UK pushes into AVs more we need to stop and talk about this!

1 replies, 4 likes

Missy Cummings: @willknight @geoffreyhinton what's especially funny is that both approaches fall very short - neither deep learning proponents nor symbolists can get us across the finish line, see

1 replies, 2 likes

Arthur Holland Michel: Nobody cuts through the AI hype as incisively and knowledgeably as @missy_cummings.

0 replies, 2 likes

HotComputerScience: Most popular computer science paper of the day: "Rethinking the maturity of artificial intelligence in safety-critical settings"

1 replies, 2 likes

Marci Baranski: Why we should be skeptical of AI claims coming from Silicon Valley... more hype than bite. Complex systems are complex, who knew?

0 replies, 1 likes

Dr. S.A. Applin: See Applin and Fischer 2012: 2015: with Riener 2015: 2017: draft:

0 replies, 1 likes

KillingMyCareer: Amen! From Waymo to Tesla, autonomous accidents are underreported & hidden abusively behind false claims of proprietary rights. Consumers have to pass a drivers test, self-driving cars do not! #TheSociopathicBusinessModel #FraudFormula

1 replies, 1 likes

Missy Cummings: @pfmgmt @60Minutes

0 replies, 1 likes

Liza Dixon ⚡️: 🚨 Required reading for self-driving Twitter 🚨 "Rethinking the maturity of artificial intelligence in safety-critical settings" by @missy_cummings 💯 I will add that TRL 6 & TRL7 are prime levels for #autonowashing 🙃

0 replies, 1 likes


Found on Feb 06 2020 at

PDF content of a computer science paper: Rethinking the maturity of artificial intelligence in safety-critical settings