Asking machines to identify images

In summary, the images are bizarre, beautiful or both due to the feedback loop created by the neural network.
  • #1
Ryan_m_b
Staff Emeritus
Science Advisor
5,963
721
I can't get over how cool/creepy this is. Researchers took image recognition neural networks and asked them to look for certain images in random noise and once identified modify the image to highlight the pattern. That new image is fed back into the machine and it's asked to do the same again. After multiple repetitions the pictures are bizarre, beautiful or both.

http://www.theguardian.com/technolo...twork-androids-dream-electric-sheep?CMP=fb_gu
 
  • Like
Likes Czcibor, Silicon Waffle and ShayanJ
Physics news on Phys.org
  • #2
Ryan_m_b said:
Researchers took image recognition neural networks and asked them to look for certain images in random noise and once identified modify the image to highlight the pattern.
I see what you mean ( by most of the images ). I would not call it "pattern recognition" but rather a LSD-trip.

But I think you know, that "real" pattern recognition uses mathematical rigid methods like Fourier-transforms, Hough-transforms, lens correcting functions, amongst other methods, to measure what is going on in an industrial production ?
 
  • #3
What a cool idea!
 
  • #4
Hesch said:
I see what you mean ( by most of the images ). I would not call it "pattern recognition" but rather a LSD-trip.

What makes it not pattern recognition? It's not necessarily good pattern recognition initially given that the machine is detecting patterns that aren't there but after it has edited them in slightly subsequent tests detect that patter.

Hesch said:
But I think you know, that "real" pattern recognition uses mathematical rigid methods like Fourier-transforms, Hough-transforms, lens correcting functions, amongst other methods, to measure what is going on in an industrial production ?

Why would you think I know that and what makes any of that "real"?
 
  • Like
Likes Silicon Waffle
  • #6
That is cool. They can arrange an exhibition.
 
  • #7
Ryan_m_b said:
Why would you think I know that and what makes any of that "real"?

Sorry, I thought you meant it as a joke.

I think that this example is real:
dba52883-3a65-4e46-bb08-8c15678642b1-bestSizeAvailable.png

The original photo is "filled" with noise which has some distinct feature. You Fourier transform (FT) the noisy picture and will find this feature in the Fourier transform. Remove it from the transform and make the inverse Fourier transform (IFT). Then you'll get the picture to the right.

Say you have a photo of a car driving by. Due to the speed of the car ( crossing the photo with a shutter time = 1/100 sec. ) the car will be blurred on the photo. Now you take two sheets of paper, draw a dot on one of them and a line on the other ( blurred dot ). The line must exactly be as long as the car has been moving on the photo. Also their moving angle must be the same. FT the dot-picture to D, FT the line-picture to L, FT the photo of the car to C. Then:

IFT( C * ( D / L ) ) and you will have a photo of the car, where you can read its registration number.

Hough transforms are used to recognize lines, circles, parabolas and other mathematical shapes. If such a "known" shape occurs in some photo, the Hough transform will find it and will determine its exact size and location within 1/10 of a pixel-distance. Having a "standard-length" as well in the picture, a computer can calculate very accurate dimension in the picture, check "ovality?" as of things meant to be circular, and so on.

Remember that working machines are often moving very fast, thus the human eye sees nothing. A camera needs perhaps 2μs, using a stroboscope, to see everything in the picture ( well, at least after the computer has calculated for another 100ms ).
 
Last edited:
  • Like
Likes Silicon Waffle
  • #9
we just start with an existing image and give it to our neural net. We ask the network: “Whatever you see there, I want more of it!” This creates a feedback loop: if a cloud looks a little bit like a bird, the network will make it look more like a bird. This in turn will make the network recognize the bird even more strongly on the next pass and so forth, until a highly detailed bird appears, seemingly out of nowhere.
What intrigues me about these images is that they could be used to illustrate similar human psychological and neurological flaws, from confirmation bias, through delusion and pareidolia, all the way to hallucination. In fact, I wonder if the exact same kind of feedback loop isn't at work in all those things.
 

1. How do machines identify images?

Machines use a process called computer vision to identify images. This involves breaking down an image into smaller components and analyzing them to identify patterns and features. Machine learning algorithms are then used to assign labels to these patterns and features, allowing the machine to recognize and identify images.

2. What kind of data do machines need to identify images?

Machines require a large amount of data in order to accurately identify images. This can include images of different objects, animals, people, and environments. The more diverse and extensive the dataset is, the better the machine will be at identifying images.

3. Can machines identify images as accurately as humans?

While machines have made significant advancements in image recognition, they are not yet able to identify images with the same level of accuracy as humans. However, with continued research and development, machines are becoming increasingly accurate at identifying images and may eventually surpass human capabilities.

4. What are some practical applications of image recognition by machines?

Image recognition by machines has a wide range of practical applications, such as in self-driving cars, medical imaging, and security systems. It can also be used for organizing and categorizing large volumes of images, as well as in social media platforms for tagging photos and videos.

5. Are there any potential ethical concerns with machines identifying images?

There are potential ethical concerns with machines identifying images, such as privacy and bias. Machines may be trained on biased datasets, leading to inaccurate and unfair identification of certain images. There are also concerns about the privacy of individuals whose images are being identified and stored by machines.

Back
Top