The University of Pennsylvania has built a new self-reconfigurable robot, which can, as the name suggests, assemble itself after it has been kicked apart. Of course it is not much more than three robots with a smart communication, orientation and interfacing system, but as the atomic units get smaller these compound robots might actually get useful for, say, building a liquid metal Terminator.

There is also a high-resolution version available at the youtube page of the video.

(Via NewScientist)

About 9 years ago, on June 10th 1999, the first humans fell victim to a computer control system failure. Due to a chain of unfortunate circumstances, a the pressure on a 16-inch steel pipe line increased uncontrollably and caused it to rupture, flooding two small creeks near Bellingham in the process. The petrol ignited and killed two 10-year-old boys and an 18-year-old adolescent. Although it was later revealed that the accident was in part caused by human failure, it is still considered as the first cyber-event that killed humans.

Now, you might think that things have changed since then, but you’d be wrong. Joe Weiss from Applied Control Solutions says:

Until eight years ago, my whole life was making control systems usable and efficient, and, by the way, very vulnerable. It is exactly what you will find today in many, many industrial applications. This isn’t just 1999. No, this is June 2008.

And it is true. The computer systems that control complex technical facilities, like the power grid, traffic control infrastructure, or pipeline systems have historically only been optimized with respect to usability, efficiency and effectivity. Security has almost never been a concern in the design of these systems. Many of them have been developed before the rise of the internet, so that attacks had to be carried out physically. But eventually some systems responsible for the control of important infrastructure have been connected to a network, often in an effort to improve control or just because of company policies, without any evaluation of possible risks.

There are more examples. The 787 Dreamliner from Boeing, which is scheduled to come out later this year, may be vulnerable to hacker attacks. This is because the flight control network is separated from the passenger network only by software firewalls, and thus might be attacked from inside the plane (or even from the outside, with the help of a trojan horse maybe).

When military control systems fail, it gets nasty quite quickly. Last year, a robot anti-aircraft cannon killed 9 and wounded 14 soldiers when it went berserk during a training of the South African National Defence Force. However, it is not yet clear if the accident was caused by a mechanical malfunction or software failure.

And it is not only the security of control systems that poses a risk, the control systems themselves are feared by researchers to remove human control from key decision-making processes. Tom Rodden, Professor of Interactive Systems at the University of Nottingham concluded at the Human-Computer Interaction conference that this loss of control might not directly be a risk for our lives, but surrenders “basic human values and concepts such as personal space, society, identity, independence, perception, intelligence and privacy.”

This lack of security must become a higher priority to control system designers, especially as there is an unavoidable trend towards more autonomous, intelligent systems that can cope with the size and complexity of modern infrastructure. We have to take care that we do not hand over all control of critical systems and uncritical but socially important concepts to machines. Even if a worst case scenario - such as malicious AI breaking loose - does not happen, programs are likely to be susceptible to bugs and misinterpreted signals, and therefore have to be very carefully designed. As the examples in the past have shown, these issues are a real threat to human beings and the lack of security against tampering from the outside increases the AI Panic level by +1%.

Imagine, someday, we’ll lose the control over our computers to some sentient being, unable to stop it or to unplug the millions of home pcs, office workstations or lab mainframes affected.

Well, there is no need to imagine, this very thing has been happening for a long time now, in the form of Zombie Computers. These machines have been compromised by hackers, viruses or trojans, and are remote controllable. Often they are grouped in a network of zombie computers, called a botnet.

The RSA 2008 conference in San Francisco earlier this month had a panel discussion on this topic, and the tone was “a mix of resignation, indignation and post-9/11 rhetoric”, according to Threat Level. According to the panelists, botnets are the biggest threat in the internet today and a danger to national security.

However, little is done to combat the use of zombie computers. Although some botnet operators are caught once in a while, the spam and attacks they create does not seem to decrease. I agree with Ira Winkler, a security consultant who said at the conference:

“The problem is no one is doing anything. Guess what? If your system has a bot on it, you don’t get on the internet. […] We need to hold people responsible when they present an imminent threat to other people.”

However, ISPs are reluctant to cut off offenders, as they often have no clue what’s going on and respond with confusion and angry phone calls, which drive up the customer support costs.

The inability to quickly and efficiently stop these bot nets could prove very helpful for a malevolent AI. Once released on the internet (or on its successor, maybe The Grid), there is virtually no way to stop it again. The infrastructure to spread uncontrollably is already given by the botnets. Unless there is some fundamental change on the network level and software level (hello Microsoft!), the only way to stop such an outbreak would be the complete shut-down of the net. Of course, this would cause quite a disturbance to the world economy, as most financial transactions and international trading are entirely done online. Most nations will be hesitant to risk that, just because some strange program has been set free from a university lab somewhere.

Therefore I think the current infrastructure of the web eases the spread of an AI (Panic Level: +3%), once it discovers the weaknesses of connected hosts and “understands” how botnets work. But that’s not yet an immediate threat; after all we have to develop the artificial general intelligence first, which, mind you, is a little tricky.

The game of Go has been one of the last big board games where artificial intelligence strength was nowhere near experienced players, let alone master grade professionals. During a recent Go tournament in Paris however, a professional 5th Dan grade player, Catalin Taranu, was beaten by a computer program (diagram and picture of the match below).

The catch is, it was played only on a 9×9 field, which is smaller than the usual 19×19 field. This no doubt had part in the victory, as the overwhelming state-space is reduced from 10¹⁷⁰ to 10³⁸ possible game positions (chess: about 10⁵²).

According to Earth News, that was the first ever recorded victory of a machine over a Go master (in a sanctioned non-blitz game). The culprit is the MoGo artificial intelligence engine. It has been developed by INRIA - the French National Institute for Research in Computer Science and Control - running on a Bull NovaScale supercomputer. During the 3-game match on the 22nd March 2008, MoGo managed to win the second game. On a 19×19 board it was weaker, losing with against Taranu, who had a handicap of 9 stones.

About ten years ago, the then strongest Go program, The Many Faces of Go, lost against a master level player although he had a 29 stone handicap.

To be honest, this is about the speed I expect research to have here, sooner or later processing power and better algorithms will make computers unbeatable in any game with logical rules, and Go is argued to be the most complex of all games. If you happen to know a complexity theorist, she will be happy to certify you that the complexity of Go is nasty EXPTIME-complete, which is not where you want to be (assuming you are a computer program and want to be fast when you’re grown up), really. That’s why it is nigh to impossible to ever “solve” Go, but it shouldn’t be too hard to win against us puny earthlings - even on a proper-sized board.

We have been trying to model our successors robot servants to resemble human beings physically and psychically for a while now. While the psychical development is taking its first steps out of its literal infancy, the physical resemblance has still a long way to go. It has to cross the uncanny valley:

The uncanny valley is a hypothesis that when robots and other facsimiles of humans look and act almost, but not entirely, like actual humans, it causes a response of revulsion among human observers. The “valley” in question is a dip in a proposed graph of the positivity of human reaction as a function of a robot’s lifelikeness.

This valley is the major hurdle towards believable and likeable humanoid model, be it robots, 3D animations or game avatars.

A common bail-out here is to depict characteristics generally considered humanoid by transmuting or exaggerating these features. Comics and the typical Pixar CGI movies are a very good example. The suspension of disbelief is the key factor here: We accept that comic-like depictions are there to interpret reality and show us a filtered, deliberately unrealistic image of the plot. It is very easy for our imagination to fill in the gaps and to ignore physical inaccuracies.

This gets much harder when we try to be as realistic as possible by using correct proportions, complex shading and detailed textures. The movie Beowulf almost perfectly falls into this category: It is completely CGI, but uses real actors and tries to simulate reality. While still-images still look alright, it is the animations where it goes downhill. The trailer has some examples in it, especially the horse animations look wrong, which is much more obvious in the actual movie (while technically not directly a humanoid animation, the galloping horses still add to the feeling that something is wrong with the depicted “reality”).

While not directly concerned with the uncanny valley, some military robots are quite creepy in my opinion. For example the Boston Dynamics “Big Dog”, which somehow looks like two soldiers bending over and pushing against each other. In a sense, it is the opposite to Beowulf: The movement, especially when it tries to regain its balance or slips on ice, looks quite natural, but the visual appearance (and sound) is really disturbing.

Scientists from the MIT are trying - but not quite managing - to avoid the valley with a robot using the comic-approach. They have developed the Nexi, a what they call MDS robot - mobile, dexterous, social. Both the pictures of this robot and the video of Nexi talking and gesticulating look a bit creepy, the robot reminds me of Jigsaw from the movie Saw.

They say that the “purpose of this platform is to support research and education goals in human-robot interaction, teaming, and social learning.”

The antipathy the uncanny valley introduces leads to a potential problem when regarding this social aspect of human-robot interaction: Once humans start to enhance themselves with transhuman enhancements, for example improved eye-sight, nanobots that increase the IQ or prostheses that work better than their natural counterparts, there may be a sudden rift between enhanced and “normal” humans, caused by the antipathy mentioned above. This hypothesis was introduced by Jamais Cascio, who further states that once such technologies gain further distance from human norms, “transhuman” individuals would cease to be judged on human levels and instead be regarded as separate entities altogether (this point is what has been dubbed “posthuman“), and it is here that acceptance would rise once again out of the uncanny valley.

I think the idea of the uncanny valley makes it harder for malicious AIs to undermine human civilisation, as fear of robots is more easily sparked with the help of uncanny-valley-antipathy (AI Panic -1%). However, the concept might be known to an intelligence, and thus we might see robots that does not look like human beings at all - or worse, like our childhood Disney-heroes!

London-based charity Landmine Action wants autonomous robots capable of killing people banned under the same kind of treaty that has outlawed landmines in over 150 countries. According to the New Scientist it is the first time a high profile non-governmental organisation has campaigned against such a technology. This campaign follows the reasoning of Noel Sharkey, who condemned these automation plans earlier this year.

As I’ve written before, the robots in use by the military nowadays (and the next years) are almost fully automatic, but so far the trigger has still to be pulled by a human soldier. However, it is only a question of time until the software is strong enough so that this decision will be made entirely by the machine. And once the software is in place, there will be no ethical opposition - at least in the US Department of Defence, who wants them in future to work without supervision.

A reaction to this news article comes from Wired, where the idea of danger through war robots is dismissed:

But to argue as if this is in the here or now, or even in the next decade, is just plain silly. The Pentagon has not only never advocated taking the man-out-the-loop of targeting decisions for drones or robots, its current policies and procedures would prohibit such a move (some might argue that international law already prohibits autonomous armed drones). […] Unless and until those policies are drastically altered, it’s safe to say we are safe from renegade Terminators.

To completely ignore the threat by robots with weapons and justifying this ignorance by saying that these robots are still science fiction and it will take decades until these robots appear seems a bit strange to me, especially as Wired itself has reported about existing armed robots before. It is exactly this ignorance and belief that everything is so far away that allows organisations like the military to push these developments without any opposition.

Furthermore, I think it is a little blue-eyed to think that the control of weapons mounted on otherwise fully automated robots will remain in human hands just because the Pentagon does not admit of having plans that say otherwise. By arguing that international law might already prohibit autonomous armed drones and at the same time clearly seeing that these very drones are being used by the U.S. Army in Iraq right now, Wired maneuvers itself on very thin ice. I don’t think it can support the arguments that promises, laws and policies are sufficient enough to protect us from a - what Wired deems nonexistant - danger. And heck, what is so bad about protesting against future dangers as opposed to only trying to fight seeing the effects of existing weapons like landmines in hindsight?

I think it is about time that more voices are raised against automating war machinery, and the Landmine Action has taken a step in the right direction. If it will be heard by the military - and the U.S. Army is without doubt on the forefront of research towards this automation - is a completely different matter. So far, I think the chances are still slim, to specify I say it lowers the AI Panic Level by -0.1%.

I’ve been home and relaxing a bit over Easter the last days, and didn’t get around to write much on AI Panic (partly because I wanted to have Wikipedia on my MP3-Player which took a while to program). Although most of the stuff that happened is already yesterdays news now, I feel I should mention it anyways, as it is relevant or interesting to AI. 

An elderly man has killed himself by programming a robot to shoot him in the head after building the machine from plans downloaded from the internet. Apparently, he used a jigsaw power tool that was connected to a .22 semi-automatic to create a “robot” that could fire multiple shots once triggered remotely (i guess by connecting the plug of the jigsaw tool to the power supply). This simple contraption (althoug remarkably complex for an 81 year old who’s tired of life) is nowhere near a modern, autonomous robot. It is just way too much hassle to put a sophisticated AI into a machine whose single purpose is killing its creator. Remember, we are talking about suicide machines here, so the “user” of that machine actually cooperates and works towards its goal. So I see no danger from the AI side in these robots. Military robots are more likely to turn into suicide robots — unintentionally.

Wired has a very well written and long article about Ray Kurzweil. It covers his early inventions that earned him his first little fortune while still an undergraduate, his reading machines for the blind, his pills to extend his life and of course his thoughts on the technological singularity. Nothing ground-breaking, but if you want to have glimpse into Ray Kurzweils life it is a good read.

There is an interesting paper on Utilitarian Essays about Friendly AI. The author analyses an approach called CEV (Coherent Extrapolated Volition) and his concerns with this approach. The essay does not deal at all with an AI turing evil, but only with the problems of extrapolating volition. There are three concerns the author rises: whose volitions to extrapolate, what about wild animals and lab universes and possible ramifications for religion. I’m not yet familiar enough with CEV to feel competent to criticise the raised points extensively (Michael Anissimov has some more interesting thoughts on the essay). Some quick questions that crossed my mind would be: How big is the role of primal urges and drives in general volition? Will we be able to do anything at all if we decide to always decrease suffering in every creature that can suffer? How can lab universes physically exist at all? What if we don’t like the extrapolated volition (”Trust me, it’s all for your best!”)?

Pioneering science fiction writer, visionary and futurist Arthur C. Clarke, best known for his work on the movie 2001: A Space Odyssey (where he created the prime example of an AI turned bad, HAL 9000), has died in his adopted home of Sri Lanka at the age of 90 on the 19th of March. He was also known for “inventing” the idea of geostationary satellites and was the last living of the “big three” science fiction writers. The two others were the Russian-born Isaac Asimov, who died in 1992, and Robert A. Heinlein, a Missouri native who died in 1988. Although he didn’t believe in an afterlife (or religion), he does live on through his brilliant works and ideas.

Also, I’m happy that my blog has been mentioned by Michael Anissimov during a Radio Interview and my post on COSPAL has been picked up by io9, which gave me a new visitor record of whopping 120 visitors on one day. I know I know, but you have to cherish the small things in life … and I don’t think thats too bad for a blog only 2 months old. AI Panic was also the Site Of The Week on scifi.com a while back, which is cool! I am quite surprised how quick I got addicted to media attention once the blog was up, sometimes I catch myself just watching the visitor counter go up and checking where all the visitors come from… Thanks for reading, dear visitor

With the military building scary armed robots already, it was about time for robots that are scared of these monsters. Phobot, a Lego Mindstorms Robot built by students from the University of Amsterdam, is exactly that: A robot that is scared of bigger robots.

Now here comes the pedagogical value: It can “learn” to lose its fear by conditioning it with increasingly big and evil looking things. The process, shown in the video below, is meant to help children with phobias to learn that not everything is as scary and bad as it seems. Especially not the autonomous sentry gun protecting the kindergarten. Enjoy!

(Via Spiegel Online)

The march towards learning, fully functional AI systems has taken another step. A cognitive AI system with the intelligence level of a puppy has been created to learn and perform simple tasks through a robotic arm.

Sure, a puppy is (often) quite stupid, but that achievement should not be underestimated, especially as the researchers at the EU-funded COSPAL project claim that this level of cognition and learning goes beyond the current state of the art.  They combine artificial neural networks (ANNs) to control low-level motor actions and a classical rule-based system to combine these actions to form a plan.

Although this advancement of AI potentially is a step towards a fully aware system, i.e., an AI system that is able to reason and learn from all its surrounding world information (for example through a common sense knowledge database), it is not an unexpected development nor something close to self-awareness, as Michael Felsberg from the research team at Linköping University explains:

In human terms, our robot is probably like a two or three year old child, and it will take a long time for the technology to progress into the equivalent of adulthood. I don’t think we will see it in our lifetimes.

His pessimism shows that Artificial General Intelligence is still quite far out, and while I think he might be overestimating the time-span for it (alas, the Singularity is scheduled earlier than after our lifetimes), he’s still one of the researchers on the forefront of AI research, and thus I think it is safe to say that we will still have to wait quite a while before smart enough AIs appear that could be dangerous (AI Panic -2%).

(Via PhysOrg.com)