Papers of the day   All papers

Rethinking the maturity of artificial intelligence in safety-critical settings

Comments

Missy Cummings: The entire self-driving community has failed to grasp that they are trying to field deeply flawed, immature systems that cannot cope with uncertainty, when defense companies have gone down this path, such premature deployments ended in failures, see http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

15 replies, 322 likes


Matt Farah: This is the word. Uncertainty. Driving is dealing with uncertainty, in real time, at 70 mph. A lot of just being ready for "what if." Exactly the thing computers are fucking terrible at.

22 replies, 200 likes


Missy Cummings: My contentious paper asserting that self-driving cars are inherently limited by their inability to replicate top-down reasoning was accepted for publication in @RealAAAI's AI Magazine. http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

8 replies, 161 likes


Missy Cummings: @AnimaAnandkumar @GaryMarcus Deep learning and symbolic reasoning both fall very short in replicating the reasoning needed by safety-critical systems w/ embedded AI. What we really need is for *famous* AI academics and practitioners to stop posturing and solve a very real problem http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

1 replies, 48 likes


Missy Cummings: AVs will only be safer in operational domains low in uncertainty (slow, geo-fenced, additional infrastructure for monitoring & control, no bad weather) The technology - both software & hardware - do not exist to get us to safe full self-driving, see http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

4 replies, 43 likes


Missy Cummings: OMG, maybe it's cabin fever but @60Minutes is desperate for ratings in their gushing love of driverless trucks. Seriously, where is their supposed critical insight? NO WAY is this tech going to be ready for nationwide unrestricted release by 2021, see http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

1 replies, 29 likes


Noel Sharkey: SELF-DRIVING into 16 billion dollar spending and the CARS are still not fit for purpose until billions more spent. We’ve been steered into a hype cycle See who is driving all the spending.

3 replies, 26 likes


Missy Cummings: Let me gently suggest that you carefully read this http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf AGI will NEVER happen until we figure out how to approximate top-down reasoning which DOES NOT EXIST in any fashion in known AI techniques today. Connectionist/deep learning & symbolic AI can't do this.

1 replies, 26 likes


Missy Cummings: My one must-read piece is this http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

3 replies, 23 likes


Missy Cummings: Love it! Perfect illustration of the insurmountable problems of computer vision that I detail here http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf People who think all camera-vision driverless cars like what @Mobileye proposes is a good idea need to have their heads examined.

1 replies, 21 likes


Missy Cummings: Deep learning nor symbolic reasoning can provide expert-based judgment under uncertainty like that needed for the conflicting traffic sign conundrum below. This is critical for AI embedded in safety-critical systems, but very far from reality. See http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf https://t.co/RtqOHjRtQU

0 replies, 10 likes


Ches | Frank: Traditional driving tests don't apply to AVs because humans are bad at the kinds of tasks machines are good at, & vice/versa. However, @missy_cummings describes a crash resulting from a lack of basic functionality that a driving test would've revealed. 🤔http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf https://t.co/qxIhN5lmOK

2 replies, 9 likes


Filip Piekniewski: This article http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf by @missy_cummings is so much needed voice of reason in this AI circus. Such a short and great summary of the elephant in the AI room.

1 replies, 6 likes


Tim Miller: I would double tweet this if there was a double tweet option.

0 replies, 5 likes


Missy Cummings: It would be nice for @NHTSAgov to add some important rules like driverless cars should not be tricked by tape on signs, they should be able to work in low sun angle conditions, they should be able to correctly "see" partially obscured signs, see more at http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

2 replies, 4 likes


Kevin Sharpe: If you're using #Tesla 'autopilot' you should read this 🤔👇

1 replies, 4 likes


Andrew: This is very, very good from @missy_cummings talking about the inherent problems of using AI in safety critical situation, y’know, like driving a car http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf Have you read it @kentindell? As the UK pushes into AVs more we need to stop and talk about this!

1 replies, 4 likes


Missy Cummings: @willknight @geoffreyhinton what's especially funny is that both approaches fall very short - neither deep learning proponents nor symbolists can get us across the finish line, see http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

1 replies, 2 likes


Arthur Holland Michel: Nobody cuts through the AI hype as incisively and knowledgeably as @missy_cummings. http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

0 replies, 2 likes


HotComputerScience: Most popular computer science paper of the day: "Rethinking the maturity of artificial intelligence in safety-critical settings" https://hotcomputerscience.com/paper/rethinking-the-maturity-of-artificial-intelligence-in-safety-critical-settings https://twitter.com/missy_cummings/status/1225423463550046208

1 replies, 2 likes


Marci Baranski: Why we should be skeptical of AI claims coming from Silicon Valley... more hype than bite. Complex systems are complex, who knew?

0 replies, 1 likes


Dr. S.A. Applin: See Applin and Fischer 2012: http://posr.org/w/images/a/a5/Applin_Fischer_AutoUI_2012_DRAFT.pdf 2015: https://ieeexplore.ieee.org/document/7064858?arnumber=7064858&filter%3DAND(p_IS_Number:7064851)= with Riener 2015: https://ieeexplore.ieee.org/document/7310907?arnumber=7310907 2017: https://ieeexplore.ieee.org/document/7948873 draft: http://posr.org/w/images/c/cb/Applin_S_AV_Ethics.pdf

0 replies, 1 likes


KillingMyCareer: Amen! From Waymo to Tesla, autonomous accidents are underreported & hidden abusively behind false claims of proprietary rights. Consumers have to pass a drivers test, self-driving cars do not! #TheSociopathicBusinessModel #FraudFormula

1 replies, 1 likes


Missy Cummings: @pfmgmt @60Minutes http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

0 replies, 1 likes


Liza Dixon ⚡️: 🚨 Required reading for self-driving Twitter 🚨 "Rethinking the maturity of artificial intelligence in safety-critical settings" by @missy_cummings 💯 I will add that TRL 6 & TRL7 are prime levels for #autonowashing 🙃 http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf https://t.co/RLddqDTRqh

0 replies, 1 likes


Content

Found on Feb 06 2020 at http://hal.pratt.duke.edu/sites/hal.pratt.duke.edu/files/u39/2020-min.pdf

PDF content of a computer science paper: Rethinking the maturity of artificial intelligence in safety-critical settings