Deep neural networks are responsible for some of the greatest advances in modern computer science.
Jeff Dean
The idea behind reinforcement learning is you don't necessarily know the actions you might take, so you explore the sequence of actions you should take by taking one that you think is a good idea and then observing how the world reacts. Like in a board game where you can react to how your opponent plays.
Health care - the ability of neural networks to ingest lots of data and make predictions is very well suited to this area, and potentially will have a huge societal impact.
Machine learning is a new way of creating problem solving.
I am concerned in general about carbon emissions and machine learning.
I spend a fair amount of time dealing with email, mostly deleting them or skimming them to get a sense of what is going on.
Some people are happy to work in a particular domain or some field of computer science for years, and years. I personally like to kind of move around every few years, just to learn about new areas.
Microsoft is in a lot of the same businesses that Google is in.
I think one of the things about reinforcement learning is that it tends to require exploration. So using it in the context of physical systems is somewhat hard.
A lot of human learning comes from unsupervised learning where you're just sort of observing the world around you and understanding how things behave.
I've always liked code that runs fast.
You need to find someone that you're gonna pair-program with who's compatible with your way of thinking, so that the two of you together are a complementary force.
One thing I think is true is that is you have someone who's really good in one or a few areas they can pick up something new pretty quickly and that's kind of a hallmark of someone you really want to hire because they can be very useful in a whole bunch of different areas.
Previously, we might use machine learning in a few sub-components of a system. Now we actually use machine learning to replace entire sets of systems, rather than trying to make a better machine learning model for each of the pieces.
We're happy to work with military or other government agencies in ways that are consistent with our principles. So if we want to help improve the safety of Coast Guard personnel, that's the kind of thing we'd be happy to work on.
I think robotics is a really hard problem - to make robots that operate in sort of arbitrary environments, like a big conference room with chairs and stuff.
Transportation, with self-driving vehicles, is going to be a big use of machine learning.
I think true artificial general intelligence would be a system that is able to perform human-level reasoning, understanding, and accomplishing of complicated tasks.
Health care has a lot of interesting machine-learning problems - outpatient outcomes, or when you have x-ray images and you want to predict things.
Computers don't usually have a sense of if you have a picture of something what is in that image. And if we can do a good job of understanding what is in an image, that can bring along a lot of new things you can do in applications.
Computers can see, and understand what people say via speech recognition.
Reinforcement learning is the idea of being able to assign credit or blame to all the actions you took along the way while you were getting that reward signal.
I think multimodal kinds of models are pretty interesting - like can you combine text with imagery or audio or video in interesting ways?
I think there are a lot of industries that are collecting a lot of data and have not yet considered the implications of machine learning but will ultimately use it.
Vision I think is going to be an important input. Like, if you're using Google Glass, it's going to be able to look around and read all the text on signs and do background lookups on additional information and serve that. That will be pretty exciting.
Very simple techniques, when you have a lot of data, work incredibly well.
Deep learning is a really powerful metaphor for learning about the world.
Definitely there's growing use of machine learning across Google products, both data-center-based services, but also much more of our stuff is running on device on the phone.
In Google data centers, our energy usage throughout the year for all our computing needs is 100 percent renewable.
I do kind of think there's a bit of an overemphasis on - in the community - on sort of achieving ever-so-slightly better state-of-the-art results on particular problems, and a little underappreciation of completely different approaches to problems that maybe don't get state of the art because it's actually super hard and a pretty explored area.
I think really what cloud customers care about is, can they get their problem solved on any particular provider's cloud products?
With TensorFlow, when we started to develop it, we kind of looked at ourselves and said: 'Hey, maybe we should open source this.'
We have a lot of work to do to get really important useful capabilities into people's hands - self-driving cars are going to save an enormous number of lives.
As a society I think we are going to be much better off by having machines that can work in conjunction with humans to do things more efficiently and even better in some cases. That will 'enable humans to do things that they do better than machines.
As devices continue to shrink and voice recognition and other kinds of alternative user-interfaces become more practical, it is going to change how we interact with computing devices. They may fade into the background and just be around, allowing us to talk to them just as we would some other trusted companion.
I think there are sometimes issues with - no matter where you put a conference, there's always going to be constraints on that. For example, sometimes students studying in the U.S. have trouble leaving the U.S. to go to a conference. So if you hold it outside the U.S. in a particular place, that sometimes creates complications.
It's nice to have short-term to medium-term things that we can apply and see real change in our products, but also have longer-term, five to 10 year goals that we're working toward.
Supervised learning works so well when you have the right data set, but ultimately unsupervised learning is going to be a really important component in building really intelligent systems - if you look at how humans learn, it's almost entirely unsupervised.
I tend to be very impatient, thinking about all the ways we can do something, my mind and hands spinning at a very fast rate.
If you only have 10 examples of something, it's going to be hard to make deep learning work. If you have 100,000 things you care about, records or whatever, that's the kind of scale where you should really start thinking about these kinds of techniques.
We're training Google Street View to recognize street numbers.
The speech recognition is now good enough that I dictate emails on my phone rather than type them in. It's not perfect, but it's good enough that it changes how I interact with my phone.
We want to build systems that can generalize to a new task. Being able to do things with much less data and with much less computation is going to be interesting and important.
The things that I really enjoy doing are finding interesting problems and working together with colleagues to figure out how we can solve them.
It would be great to have every engineer have at least some amount of knowledge of machine learning.
Some things are easier to parrellelize than others. It's pretty easy to train up 100 models and pick the best one. If you want to train one big model but do it on hundreds of machines, that's a lot harder to parallelize.
AI can help solve some of the most difficult social and environmental challenges in areas like healthcare, disaster prediction, environmental conservation, agriculture, or cultural preservation.
Understanding language is core to a lot of Google products such as Gmail.
It's important to engage with governments around the world in how they're thinking about AI - to help inform them.
The healthcare space is a very complicated one for a variety of reasons: It's much more regulated than some other kinds of industries, for good reason.
