>But neither the NN nor the researcher will be able to give you a rule like: "F=(G m_1 m_2)/(r^2)" to explain the underlying reasons for the object-trajectory dynamics.
It is not impossible. There is a combination of a special neural network architecture and strong sparsity-inducing regularization that makes it possible to learn equations from dynamics dataset: https://openreview.net/pdf?id=BkgRp0FYe
>Everyone talks about extending life and eventually becoming immortal, yet no one asks what happens when we are immortal.
I see the opposite picture when these discussions pop up: everybody tries to find a downside in increased lifespan, be it personal or social. It looks like a pretty obvious defense of status-quo to me.
What is really-really sad and what really bothers me is that this attitude is so prevalent in the modern West, when the West is the only society on planet Earth that has knowledge and resources to make some version of life extension happen. Other parts of the world are de-facto firmly in the survival mode.
This is very important. It seems that the automation of labor is underexplored due to political and economical inertia (I know that industrial robots do somewhat improve, but they still are very costly, very proprietary and require experts to use them. Could this be done another way? Companies like Rethink Robotics show that maybe the answer is "yes").
There needs to be more fresh thinking in this space.
There was an ambitious NASA project 35 years ago: a self-replicating lunar factory http://www.nss.org/settlement/moon/library/1982-SelfReplicat... . The engineers tried to design a manufacturing system aiming for almost full parts closure.
The project was too ambitious (e.g. it looked optimistically at AI's capabilities), and didn't went past design study stage then;
But maybe now, 35 years later, the technology is good enough for something similar to be viable?
I agree with the first sentence, but I'd like to note that there are practical (though weak) approximations of AIXI that preserve some of its properties, and while not turing-complete, prove to be more performant when compared to other RL approaches on Vetta benchmark. See [1].
Also there is a turing-complete implementation of OOPS, a search procedure related to AIXI that can solve toy problems, programmed by none other than Jurgen Schmidthuber 10 years ago [2]
Even more important: there is a breadth of RL theory built around MDPs and POMDPs. There are asymptotical, convergence, bounded regret, on-policy/off-policy results, etc. Modern practical Deep RL agents (the ones DeepMind is researching) are developed on the same RL theory and inherit many of these results.
From my POV it looks unfavorable to researchers that produced these results over decades of work when the comment's grandfather (and grand-grandfather) write that there is no definition and theory about AI, and that AI is like alchemy.
Actually there are at least two decades-old branches of computer science/mathematics that have formulated precise definitions of AI, and proved many theoretical results that gave way to lots of practical applications. These branches of CS are called "Reinforcement Learning" and "Universal AI".
While Gwern has already mentioned Reinforcement Learning, UAI is a less known (but even more rigorous and well received) mathematical theory of general AI that arose from Marcus Hutter work [1].
My point here is how can one say that there is no definition of AI when there are several precise mathematical definitions available with many theorems proven about them?
Meta- reinforcement learning could prove to be such breakthrough, see [1],[2].
Also next generation ASIC accelerators (Google's TPU, Nervana) can give 10x increase in NN performance over a GPU manufactured on the same process, with another 10x possible with some form of binarized weights, e.g. BNN, XNOR-net.
There are also interesting techniques to update the model's parameters in a sparse manner.
So, there certainly is a lot of room left for performance improvements!
Finally there is a trend of using recurrent neural network as a top component of the Q-network. Perhaps we will see even more sophisticated RNNs like DNC and Recurrent Entity Networks applied here.
Also we'll see meta-reinforcement learning applied to a curriculum of environments.
Is he a CEO though? Wikipedia and other press articles say that Hassabis is the CEO: https://en.wikipedia.org/wiki/DeepMind and Suleyman is Chief Product Officer, the head of applied AI at DeepMind.
Note that Facebook also has a formidable AI research group called FAIR and they are pursuing goals close to DeepMind's, while openly publishing their results and tools.
There is a lot of social media unicorns that don't contribute much to research which are not Facebook.
Who knows, maybe there is no real need for a dozen of global social media companies that provide roughly similar features to the same users?
A general purpose reinforcement learning (RL) agent is a machine that can be taught to perform any task from a very wide range of tasks via sparse rewards given by a human or software trainer.
The agent can, like any software, be snapshotted, saved, loaded and copied, creating as many identical agents as needed (given hardware, of course). Agents can and will be trained to perform various tasks, and their snapshots will be sold or made available for download over the Internet.
By saying that your main concerns are technological unemployment of white-collar demographic and increased state surveillance you make it clear that your views reflect that of an upper-middle class western person. On the global scale affluent westerners are a minority.
So, How would such an agent be used to actually improve society?
Consider universally valued, life-critical services: healthcare and education. Only the western people have access to high-quality medicine and education due to a whole lot of reasons (global economical inequality, a very long and hard path to become a doctor or a professor, a very long time needed to establish the necessary social institutions, lack of social stability outside the west, ...).
If we had a general RL agent we could train several variants of it to perform high-quality work in the fields of Diagnosis, Radiology, Paediatry etc. We could also train artificial education agents for many subjects.
The training needs to only be done once. Given sufficiently powerful mass-produced hardware (smartphone SoCs with Nervana-like NN accelerators?) these agents could be given almost for free to billions of people that wouldn't be able to afford such services in any point of their lives otherwise.
How could one be against giving essential high quality services to every human with a smartphone?
And if even that is not enough to justify the utility of RL agents, then consider how much progress in molecular biology and medicine could be done if thousands of agents trained to do life science research worked around the clock to push the state of art further. How many people with debilitating diseases could be cured by such an effort?
And then consider how we could make our currently-crumbling cities and infrastructure permanently well-attended by RL agents inside simple robots. The world certainly could use more smart attention everywhere. I guess the quality of life in such a world would be remarkably different.
DeepMind looks like a hilariously wrong project to criticize because it is a true moonshot, something very different from the majority of other SV projects.
If hiring hundreds of PhDs to create a general purpose learning agent, all while publishing all the intermediate results in freely available papers isn't a moonshot with socially beneficial outcome, then I don't know what is.
Also note that DeepMind went even further than that, there is DeepMind health division aiming at using this technology to help doctors and patients directly.
If I were the author I'd choose some social media unicorn or an ad network as an example of inherent misallocation of human talent.
The unpleasant truth is that this dystopia isn't coming out of nowhere, it is being built with our own hands. Our everyday desires, decisions, actions and inaction decide what will be built (more apps) and what won't (nextgen cures).
I very much agree with this point of view. It seems to me that dry metaphysical debates (i.e. questioning the nature of these conversation models) are obscuring interesting practical questions that could be asked and tested empirically.
Given modern deep learning conversation models it is already possible to recreate some basic patterns of human dialogue with a recurrent neural network trained on a large corpus (see Google's "A Neural Conversational Model" paper and someone's implementation of it: https://github.com/macournoyer/neuralconvo ).
It would be interesting to experiment with it and see, just how far can we push this modeling approach? How much data is needed? Is it possible to train the model on a huge corpus of human dialogues, and then to finetune it on small amount of data from one specific person?
Well said. Political and intellectual elites tend to attach negative connotations to the word "utopia". Perhaps they feel that the very concept of utopia attracts undesirable attention to the bleakness of our current status quo as experienced by the average person.
I disagree. There exist examples of system displaying very non-trivial, open-ended behavior, and yet they are still not agi. A good example of this is https://arxiv.org/abs/1603.01417 . When trained it is able to answer free-form questions about images.
It is not impossible. There is a combination of a special neural network architecture and strong sparsity-inducing regularization that makes it possible to learn equations from dynamics dataset: https://openreview.net/pdf?id=BkgRp0FYe