This week I explored using p5.sound and the p5.speech.js library to visualize sound. I originally wanted to create a program that used the p5.speech.js speech recognition functions and then displayed an image that is the associated with the word that the user said by using an API that extracted images from the web. However, the p5.speech.js library was/is very buggy on my computer. I might submit an issue to the library’s github repository to see if the issue on my Mac laptop can be resolved.
As a result, I ended up creating a program that imitates an artificial intelligence assistant hacking into your home device. I was inspired by Karen (Plankton’s girlfriend) in SpongeBob SquarePants.
However, I ran into many issues trying to illustrate the sound of synthesized voice I used. Instead to illustrate my idea, I used a gif of a sound wave to mimic the fft waveform analyzation.
Posted in: ICM