At JSConf EU 2013, I gave a talk about mapping natural input like audio to forces in a natural simulation. Combining the HTML5 getUserMedia API, with FloraJS, I demoed two audio apps that attracted particles based on a tone frequency I generated from an iPhone app.
The HTML5 getUserMedia API standard is not complete. But the latest Google Chrome should run the demos just fine.
Flora tone pair - At the prompt, allow the app to use your microphone. Next, use a tone generator to attract the agents. Or if you don’t have a tone generator, just whistle.
Flora tone circle - At the prompt, allow the app to use your microphone. Next, use a tone generator to cycle through different frequencies and guide the agents.
If you want to check out the code, you can find it in the GitHub repo.
