The following is a conversation with Yann LeCun. He's considered to be one of the fathers of deep learning, which, if you've been hiding under a rock, is the recent revolution in AI that has captivated the world with the possibility of what machines can learn from data. He's a professor at New York University, a vice president and chief AI scientist at Facebook, and co recipient of the Turing Award for his work on deep learning. |||||||| HIDDEN IN PREVIEW MODE ||||||| This is the Artificial Intelligence Podcast. |||||||| HIDDEN IN PREVIEW MODE ||||||| Hal 9000 decides to get rid of the astronauts for people who haven't seen the movie, spoiler alert, because he, it, she believes that the astronauts, they will interfere with the mission. |||||||| HIDDEN IN PREVIEW MODE ||||||| It's a little bit like, I mean, we're used to this in the context of human society. |||||||| HIDDEN IN PREVIEW MODE ||||||| So that tells you something. |||||||| HIDDEN IN PREVIEW MODE ||||||| So there is this idea somehow that it's a new thing for people to try to design objective functions that are aligned with the common good. |||||||| HIDDEN IN PREVIEW MODE ||||||| Will come together. So there's nothing special about HAL or AI systems, it's just the continuation of tools used to make some of these difficult ethical judgments that laws make. |||||||| HIDDEN IN PREVIEW MODE ||||||| Oh, wow. |||||||| HIDDEN IN PREVIEW MODE ||||||| But to be clear, these are not questions that are kind of really worth asking today because we just don't have the technology to do this. |||||||| HIDDEN IN PREVIEW MODE ||||||| So until we have some idea for design of a full fledged autonomous intelligent system, asking the question of how we design this objective, I think is a little too abstract. |||||||| HIDDEN IN PREVIEW MODE ||||||| Like autonomous vehicles. |||||||| HIDDEN IN PREVIEW MODE ||||||| That's nice. |||||||| HIDDEN IN PREVIEW MODE ||||||| If you have a non convex objective function, you have no guarantee of convergence. |||||||| HIDDEN IN PREVIEW MODE ||||||| Does that still surprise you today? Well, it was kind of obvious to me before I knew anything that this is a good idea. |||||||| HIDDEN IN PREVIEW MODE ||||||| So can you talk through the intuition of why it was obvious to you if you remember? Well, okay. |||||||| HIDDEN IN PREVIEW MODE ||||||| We don't know how, but we know it works. |||||||| HIDDEN IN PREVIEW MODE ||||||| So the idea somehow that you can create an intelligent machine by basically programming, for me it was a non starter from the start. |||||||| HIDDEN IN PREVIEW MODE ||||||| He's automate basically everything and learning is the automation of intelligence. So do you think, so what is learning then? What falls under learning? Because do you think of reasoning as learning? Well, reasoning is certainly a consequence of learning as well, just like other functions of the brain. |||||||| HIDDEN IN PREVIEW MODE ||||||| I don't believe that other types of learning that don't use kind of gradient information if you want. |||||||| HIDDEN IN PREVIEW MODE ||||||| And you can prove that an algorithm is correct, right? Machine learning is the science of sloppiness, really. |||||||| HIDDEN IN PREVIEW MODE ||||||| So you need to have some device, if you want, some subsystem that can store a relatively large number of factual episodic information for, you know, a reasonable amount of time. So, you know, in the brain, for example, there are kind of three main types of memory.

... SIGN IN TO VIEW REMAINDER ...