wav2midi2vj

[Mbazzy]

First of all, I'm a complete novice to vj'ing but sees it as a necessary extension to my audio-work (http://ssa.iuma.com and http://stage.vitaminic.com/sad_end_projects ) . Our musicstyle is reminiscent of what people like coldcut are doing , I like to call it audio-dadaism .

I have been experimenting (on pc only) with various sw demos and see some good potential to master the basics to incorporate in some live gigs we want to start from next year on.

So I had following (crazy, stupid?) idea :

Does anyone know of or has experience with any real-time wav2midi (vst) sw (for win2000) that would allow real-time 'note' triggering of some vj software like vjamm .

I have been able to find some stand-alone converters with google, but wondered if there is any sw around that could do similar wav2midi in a streaming manor ....

As I see it , you don't need "exact" wav2midi translation, only pitchrecognition to some extend to trigger midi vj events.

I'm using Ableton Live as audio (de-)constructing tool, and saw a set-up as follows : route eg. the b-line audio-signal to a seperate computer running the wav2midi sw that triggers eg. vjamm on that same computer .... routing another audio-signal to a different instance of that wav2midi sw could maybe handle the triggering of some efx ....

[komart663]

mmh, i don't think i really understood what you mean,but i will recommend you 2 things : try flowmotion ( it responds to music and midi events),it's a personnal choice,the second thing is : check software reviews
hope it may help you

[Meierhans]

There is a software that works in realtime (4-10 ms latency), soemthing with "ear", i forgot the name.

If you can I would generally i tend more to us midi trigger directly than generating samples with midi software and analyse the notes afterwards.

Take a look at Vjo and Flowmotion for direct analysis

[fons]

why not sync a midi sequencer to ableton live via rewire and let the sequencer do the job to trigger some vj software (maybe even on the same computer)? you could also feed the vj software with audio output from live at the same time. and if you really need that, run a pitch_to_midi vst plugin within the sequencer, that translates your audio pitch to midi events - and transmits these midi events on another midi channel ...

[Mbazzy]

Wow, what a helpful forum this is for novices ... I'm in awe!

Definetely will have a look at all the options mentionned here. The only limitation I see from my side is that I'd like to be able to do both audio & video myself [that's where the idea of wav2midi2vj basically came from] whereas the audio will already take 90% of my attention ....


Btw, if any of you vj's have a couple of minutes (well, more than that) , Please voice your comments on our audio worx .... wonder if it 's vj-inspirational ...;)

[sleepytom]

the best way to do av synched stuff with live is to assign midi notes to trigger your loops in live and also run the midi in to another computer running vjamm (or what ever) - that way the video loops are triggered at the same time as the audio in live.

other options for av stuff that work well would be to run both audio and video in VJamm 2 pro - VJamm can loop things in time very reliably and gives you the option to trigger samples over the top of other parts running in mute unmute mode (this all requires some pricise prerendering and preperation of samples but it is the most advanced AV program available) if you go to www.gridio.com and download the vjamm2 gridio demo (which comes with some av loops) you swhould get an idea of how this functionality works.

hay wasn't it you that emailed us about the coldcutter?

[Mbazzy]

Yep was me .... looking forwards for that gem ....;)

[Mbazzy]

BTW, now I for sure start hoping that the audio slicing & dicing of the coldcutter will be with midi assignable slices in order to trigger the video events at the same time as described above .... jummy jummy ...;)

[sleepytom]

ooh - now theres an idea - actually i recon that its far more likely that the chop functionality of DJamm / coldcutter will get intergrated into VJamm (can't remeber if this was on the list for VJamm 2.5 or 3) or maybe it will all end up being a freeframe plugin

[Mbazzy]

Btw & fwiw the free VST "peakfreak" from http://www.tobybear.de and also i think his "silverbox" does something similar, audio2midi that is ...

There is a software that works in realtime (4-10 ms latency), soemthing with "ear", i forgot the name

Probably meant Digital Ear Real Time http://www.digital-ear.com/

[Meierhans]

year :p
digital.... ear...

:nod: