Artificial intelligence (AI) systems have a long way to go before they can take over tasks and jobs traditionally performed by people, say scientists who highlighted the severe limitations of deep learning computer networks. Researchers at University of California, Los Angeles (UCLA) in the US conducted various experiments which showed that it is easy to fool the deep learning neural networks.

“The machines have severe limitations that we need to understand,” said Philip Kellman, a UCLA professor and senior author of the study published in the journal PLOS Computational Biology, according to Kellman, machine vision has drawbacks. In the first experiment, researchers showed colour images of animals and objects to one of the best deep learning networks, called VGG-19.

However, the images had been altered. For example, the surface of a golf ball was displayed on a teapot; zebra stripes were placed on a camel; and the pattern of a blue and red argyle sock was shown on an elephant. VGG-19 ranked its top choices and chose the correct item as its first choice for only five of 40 objects. “We can fool these artificial systems pretty easily. Their learning mechanisms are much less sophisticated than the human mind,” said Hongjing Lu, a UCLA professor.

In the second experiment, the psychologists showed images of glass figurines to VGG-19 and to a second deep learning network, called AlexNet. VGG-19 performed better on all the experiments in which both networks were tested. Both networks were trained to recognise objects using an image database called ImageNet. “The machines make very different errors from humans,” Lu said.

In the third experiment, the researchers showed 40 drawings outlined in black, with images in white, to both VGG-19 and AlexNet. These first three experiments were meant to discover whether the devices identified objects by their shape. The networks again did a poor job of identifying such items as a butterfly, an airplane and a banana. Researchers concluded that while humans see the entire object, the artificial intelligence networks identify fragments of the object.

comment COMMENT NOW