Audio Reconstruction from Image: Curve Recognition Software?

  • Thread starter Thread starter brian0918
  • Start date Start date
  • Tags Tags
    Curve
Join the discussion
Registration is free. Ask a follow-up in this thread, or start your own.
4 replies · 9K views
brian0918
Messages
44
Reaction score
0
I'm looking for software that can turn an http://people.deas.harvard.edu/~jones/cscie129/nu_lectures/lecture2/snd_vis/waves.jpg back into the audio. Has anyone heard of something like this?

If not, might there be a way I could do it using current software, such as some sort of curve fitting software combined with some sort of audio generation software?

Thanks.
 
Last edited by a moderator:
Physics news on Phys.org
It's part of physics research, though, and most of physics research involves technology.
 
Sounds doable. There's two obvious encessary steps: reading the data from the curves, outputting the audio. The first is not so hard, depending on how the input is described, if it is a black and white image as the one you linked then i would read each column of pixels, in search of the white pixel, the location of the white pixel giving the value (y-coordinate) of the curve at that column (x-coordinate). That's one approach.
For converting the data into audio you'd have to do some research as to how audio is recorded. basically you want to map a sound wave into a sequence of values. Generally speaking audio is recorded by sampling every so often. You have some device, like a microphone, which is sensitive to sound waves. This device encodes its interaction with any sound wave at time t into a value. So if a microphone is exposed to a sound lasting for 1 second, then, if you sample every 1/10th of a second, the microphone will generate 10 interrupts to the computer, in each interrupt providing the value it read at time t. This is they key point, you need to know how the microphone encodes a sample into data, once you know that you can use the image of the wave to produce your samples.
Notice that the sampling rate is usually pretty high. For .wav files the sample rate is 44100Mhz, so 44100 frames per second. Each frame usually having two samples (stereo), or one sample (mono).
This sounds like an interesting project. It would be cool to make a program that converts a curve into the respective sound.
 
well, I know Mathematica can turn a graph into a sound. If you could somehow make a Fourier series of those waves (since they seem reasonably periodic), then you could graph it in mathematica and output a loopable audio clip.