Archive for the ‘Processing’ Category

The Cannery Residency: Day 2

May 30, 2019

Wake up at 7am, my internal alarm clock. It’s still pretty cold, so I stay under the covers until I hear Leslie in the Kitchen. I get up, make tea, clean up the studio workbench, set up my equipment.

I caught Mary Ann’s virus, my nose is running overtime. So a nice cup of tea, bundle up, off to walk the NW Quadrant –

I start at The Cannery aka Leslie Ross Bassoons, the circle on the map, and walk north along Rte 175 toward the town ‘center’. The idea is to the record rhythms, textures and patterns that I encounter along the way. These can natural or man-made. Since I’m on the road into town these are mostly man-made – the cars traveling to and from town at irregular intervals. When two or cars are heading the same direction, one after the other, the pass me at 4 second intervals. Sometime cars pass me in opposite directions, sort of a ‘whoosh-woosh’. The houses are placed at regular intervals along the road. Lots seem to have a standard width or frontage. Too far apart to register as a regular ‘beat’. However the patterns and textures are interesting. The houses are surrounded by a yard, a flat expanse of lawn. Some houses also have trees placed along the road or in the open space around the house. The trees and flower beds are placed deliberately, regularly spaced. The only natural vegetation appears in the drainage ditch alongside the road.




There are couple of ‘open spaces’, the Market parking lot, and a little farther on a contractor yard. Both are graveled, cleared of vegetation. The Market lot is bisected by a sign advertising ‘Lobsters Mussels and Clam Meat’, the contractor’s yard has a series of 3 or 4 stone cairns, regularly spaced along the road. From here to town center are houses, again regularly spaced.

Just before the town center, there are open fields either side of the road. One next to a church, possibly a recreation area. And on my an open field leading down to the water. I leave the road and walk across the field towards the water. This is not a flat, well-manicured lawn. No trees or flower beds beds. In contrast to orderly patterns along the road and around the houses, the vegetation in the field at first seems chaotic. However, as I walk across the field I realize that the vegetation is, in fact, disbursed according to a different set of rules. Then I reach the shoreline!

Open field

Milkweed Pod



A whole new dynamic, the natural rhythm of the waves, the play of light of the surface of the water, the sounds of waves as they break against the larger boulders lining the shore. Small trees and bushes border the field and the shore. Small pools nestle amongst the boulders. Kelp is draped over the pools. Bleached driftwood is lodged in the clefts between rocks. I clamber up and down along the shore, back towards the road, across a small rest area with a picnic table and a view of the bay, then back along the shoreline. The sounds here are quite different from the road. I can still here the cars going by at irregular intervals but this plays over the regular sound of the waves. I clamber for another 10-15 minutes then turn back towards the road.

Thru the scrub of undeveloped land. small trees and bushes, some with flowers. And bordering the road into an adjoining property I see my first Fiddleheads. Not a real forest, the growth here is a jumble of small trees and bushes, small boulders, and pools of water overgrown with sedge. I arrive back at the road, walk back towards The Cannery.

I turn west, just before The Cannery, walk towards Freethy Point. I’m joined by two neighbors and a big, black dog. Before arriving at the boat ramp, I scramble down to the shore then work my way back along Winslow Creek. Leslie says since they un-damned the creek, fish have returned. A couple of weeks ago there was a shad run and, farther down the bay, the salmon have returned. I’m wondering how the fish manage to swim up the creek, ‘jumping’ up the rapids on their way upstream. I’m sitting thinking about this when I feel a large slobbery tongue on my cheek. The big, black dog says ‘hello’.


Back at The Cannery. I join Leslie and Zeke for lunch. In the bookshelf next to the kitchen I find a deck of cards, ‘Ancient Whacks of Heraclitus: A Creativity Tool Based on the Epigrams of Heraclitus’. The top card is titled, “The sun is new each day”. On the back side of the card is the interpretation, “Improvise. If the sun is new each day, why limit yourself to approaches and solutions that you’ve used in the past?”

Time to re-patch the AVSynth, working on birdsongs. Early to bed.

The Cannery Residency: Day 1

May 29, 2019

I pack up my AVSynth, computer, (3) Raspberry Pi’s, video projector, and floor percussion. Pick up the rental car, load out, I’m off by noon. I495N to I95N to Augusta ME, Rte 3E to Belfast, Rte 1N across the Penobscot River, then Rte15S to Rte199, I arrive at The Cannery around 5pm. Leslie is in her garden, picking dandelions and cleaning the roots. I load in.

Dinner with Leslie. we talk about PhDs, residencies and collaboration. Zeke arrives around 9pm, with some new, used books. I’m in bed by 10pm.

Projektor sketch recorded October 30, 2018

October 30, 2018




w2 recorded May 25, 2018

May 25, 2018



A new Processing sketch with audio driving the video, additional sound and image processing using the AVSynth, vocals by George & Grace, the parakeets. And there’s more …

This is a single track, real-time, AVSynth and Processing.

track 01

w2 recorded April 21, 2018

April 21, 2018




Geometry 5, a new Processing sketch, uses gradients that take advantage of the Jones’ MVIP. Basically the same patch that I’ve used for the last two months.

Signal Culture Residency: Day 6

October 25, 2017

Habitually up early, coffee, scrambled eggs!

Quote of the day –

“Good morning boring art!”
~ Nam June Paik

Spent the morning on administrivia including email, messages, updating my blog, etc. I’m still processing videos from the day before yesterday, compressing to H.264 takes hours and hours.

Al Margolis

At 11:30am Al Margolis arrives. We tour the facility, a full house, Charlotte Clermont is in the Artists’ Studio, Hank Rudolph and Matt are in the Research/living and dining room. We return to the Toolmakers’ Studio and set up to record a couple tracks as ELKA BONG: Al Margolis – viola, objects, contact mics; Walter Wright – AVSynth –

track 01
track 02

We toured around this time last Fall, the first time the AVSynth went ‘on the road’. Looking forward to touring again soon with the enhanced rig and Processing sketches.

At 1:30pm we go for lunch at the Taqueria, after lunch a short walk along the river, then back to the studio. Al packs up, heads back down Rte17 to Chester.

North Street Re ords

North Street

Taqueria on Front Street

Deck overlooking the Susquehanna River

I ate a whole burrito!


I’m still processing video, sorting audio files. Listening back. Success, the AVSynth looks and sounds great!

Projektor: Chailey Mansion March, 2017 v2

May 31, 2017


A second version of the “film”, still working on the Processing sketch. A better recording, getting there!

Projektor: Chailey Mansion March, 2017

May 5, 2017


Projektor is a Processing sketch, thinking of developing it as module for the AVSynth. Actually, each film will be a separate sketch, played back in real-time.

This video was recorded off my computer screen, not ideal, when the screen goes black you can see my workbench 8^)))

Signal Culture, May 7-21, 2015

May 21, 2015

I’m a resident toolmaker at Signal Culture Thursday May 7- Thursday May 21.

“Signal Culture was founded in 2012 by Jason Bernagozzi, Debora Bernagozzi & Hank Rudolph with the idea to create an environment where innovative artists, toolmakers, curators, critics, and art historians who are contributing to the field of media art will have time and space to make new work and to interact with one another. Signal Culture encourages creation of new work, building of community, and connection to history in the field of experimental media art by providing artists, researchers, and innovators with residencies, resources, and exhibition opportunities.”


Signal Culture is located in Owego NY. It’s not the Experimental Television Center. It’s in a different location, several blocks north, with it’s own studio, workshop, library and space for artists to stay. Their residency program includes artists, toolmakers, and researchers. You can apply here.

A few days before my residency, I download the current Arduino IDE, check out the Ardcore module. It works! I download music files to an external drive, then upload recent video files from my camera, new input for the AVSynth.

Here’s a pre Signal Culture patch, my fifth (or sixth). Interconnected VCOs, controlled through the CV2 inputs, produce just the right amount of audio chaos.



I’m not taking the bus. Instead, late Wednesday afternoon, Mary Ann and I drive from Lowell MA to Hudson NY. We stay overnight at our friend Kitty’s. Early the next morning we cross the Hudson River on the VanWinkle Bridge, drive north west through the Catskills passing through Preston Hollow, then south west on Interstate 88 through Binghamton, and on to Owego NY. We hit the ATM, then Original Italian Pizza for brunch. I load in at 12noon, Mary Ann steels herself for a long, boring drive home, takes off.

Total travel time, 6 hours out and, for Mary Ann, 5 hours back.

Day 1: Signal Culture is reconfigured. The office and toolmakers’ studio swapped places. I’m at the front of the building, on the second floor, directly below the artists’ studio. There’s an attached bedroom and bathroom, my own suite, sweet!

Toolmakers’ Studio

My workspace

My workbench

I set up my computer, AVSynth, video monitor, speakers. Kristin Reeves, artist-in-residence arrives late afternoon. Debora, Jason, Kristen, Dave and I go for a beer at the Barleycorn.

Day 2: Work all morning on the Ardcore module, check out the CLK interrupt, review the template sketch, and make notes on the Arduino/Ardcore IDE. Then I set up audio. I need a mono to stereo mini adapter, in the parts cabinet. There are a lot of parts!

I go over to Dave’s, from 2-10pm I hang out while he designs, builds and tests a Sync Separator module for the AVSynth. Dave uses the same circuit-building techniques that he used 40+ yrs ago, discrete components soldered together on perf board. The Sync Separator module takes video in, buffers it, loops it back out, then strips the sync, and outputs Vertical Drive, VD. VD out patched to the Ardcore CLK in gives me a frame count, actually a field count to use as I develop Ardcore sketches or programs.

Jones AVSynth

Dave at work.

Day 3: Install and test the new Jones Sync Separator, no problems. I play around with video on the MVIP for the rest of the morning.

Jones Sync Separator, ready to install

Jones Sync Separator, up and running!

Look closely, you can see that the Sync Separator has replaced the Multiple on the upper rack. The Multiple is temporarily on the lower rack. I plan to update the LFOs with smaller modules, add 2 new buffered Multiples, all in a single rack.

Grocery shopping, fruit and veggies, salad for lunch 8^)

I work on software in the afternoon, modifying the Arduino Ardcore template. I want to add the frame counter and test the controls with specific MVIP functions. I’m not ready to test the program yet, still decoding the Arduino ports. So I switch to regular Processing to work on a fractal number generator.

Dave invites Kristin and me for dinner. Brian Murphy joins us. We go back to Dave’s for a demo of the Jones AVSynth, as shown above, that includes a Core module, 4 Video rate VCOs, Keyer, Sequencer, and more.
Dave invites Kristin and me for dinner. Brian Murphy joins us. We go back to Dave's for a demo of the Jones AVSynth, as shown above, that includes a Core module, 4 Video rate VCOs, Keyer, Sequencer, and more.

Jones AVSynth, screen capture.

Brian, Kristin and Dave.

Day 4: I upload my version of the template program to the Ardcore, it works. I make modifications, they work. So far so good, I continue to tweak the program.

My workspace.

Vertical Drive from the Jones Sync Separator generates an interrupt on the Ardcore. I detect the interrupt and trigger a pulse out on D0. The template program divides down and triggers a pulse out on D1. It reads A0, A1, A2, A3 and output the values to the computer. They appear in a window on my Mac. The template program is in a second window. I can write code, upload it, and see the results immediately.

Xmas penguins & bears, Richmond VA, 2014

I try various patches. I patch the DAC to the Bitswap and Mode CV inputs on the MVIP. Eventually I want to select effects using the Ardcore. I also discover that I can read audio signals on A2, A3. This might prove useful.

I play until exhausted then work on random number generators. I have a white noise, a brown noise, and two fractal generators running in Processing. Thinking about the frame counter, I realize that Vertical Drive actually gives me a field count, 2x the frame count. This might also prove useful!

Day 5: In the morning I continue to work on random number generators in Processing – white noise, brownian motion and fractal. The fractal is the most interesting as it feels organic, but it’s hard to program, a bounds problem.

I break for lunch then switch to implementing the frame counter. The frame counter is a snap, up an running in no time. Getting used to the Arduino programming environment, based on Processing. I rework the Ardcore template, speeding it up, hopefully. I switch to Processing and resuscitate my movie projector. It reads 24 frames then ‘projects’ them randomly, at random frame rates. Better than the video of Xmas penguins and bears but still a way to go. There’s no direct to way to create a .mov file in Processing.

Time to play, the result, starting with the Ardcore and Jones video modules –

Computer signals shown in cyan, video in yellow, sync in green.

Starting at the left end of the rack, the computer uploads a program to the Ardcore. The right end of the rack has two Jones video modules. Video passes through the Jones Sync Separator to the MVIP, as it come through Vertical Drive is stripped and sent back to the Ardcore. The program clock syncs with the video, the programmer has a frame count and can use this to generate control voltages and trigger pulses. Video out goes from the MVIP to my monitor.

Control voltages shown in red.

Between the Ardcore on the left and Jones video modules on the right are a several Doepfer audio synth modules. From left to right, 2 LFOs, 2 VCOs, Ring Mod, VCFS, and a Mixer. The Ardcore puts out a trigger pulse on D1 and a control voltage through the DAC. The trigger pulse goes directly to the audio mixer, percussion. The DAC output controls bitswap on the MVIP. The first LFO controls brightness on the MVIP, the second selects modes on the MVIP. The 2 VCOs are patched ‘west coast style,’ the sine output of one controls the frequency of the other. The triangle outputs go to the Ring Modulator. The square wave outputs to 2 Multiples. The output of the Ring Modulator and the 2 square wave outputs, through the Multiples, go to the Mixer. The 2 square wave outputs also control hue1 and hue2 on the MVIP.

Audio shown in blue.

The Ardcore D1 digital output directly into the mixer, who knew! It’s dividing down Vertical Drive, input from the Jones SS, and putting out a trigger pulse. The Ardcore is a rhythm machine! There’s still DO and a whole lot more to explore using the DAC. The 2 VCOs are patched ‘west coast style,’ the sine output of one controls the frequency of the other. The triangle outputs go to the Ring Modulator. The square wave outputs to 2 Multiples. The output of the Ring Modulator and the 2 square wave outputs, through the Multiples go to the Mixer. Audio out goes directly to my powered speakers.

All together now –


I take pictures and record video on my smart phone. Debora, Dave and I go for dinner at Las Chica’s Taqueria.

Day 6: In the morning, I update my patch diagrams, breaking out signal types and highlighting the various modules used – computer and video in and out, control signals, audio out and, finally, a composite showing the complete patch. I update my blog.

After lunch I put the case on the workbench and reinstall modules. Eurorack modules are small and when using a lot of patch cords, the controls can be hard to access, no room for ‘knob twiddling.’ I group them by function and leave plenty of space for patch cords. I bring the case back to my workspace, patch the basics and fire it up! Better than before, plenty of breathing room for the modules, cables and me. The video is super clean!

‘The Reconfiguration’

A nice, clean output signal.

I spend the evening making notes, working on a schedule, and watching my basic patch cycle through MVIP effects.

Day 7: In the morning I fine-tune the new layout and update my patch template.

My basic patch

Input modules move to the left, outputs to the right. Control modules on top, processing modules on the bottom. There’s plenty of room. The output modules are on the far right, one on top of the other, all the output controls in one easy to get at location! My basic patch is just that, basic. The Jones Sync Separator sends Vertical Drive to the Ardcore. The Ardcore counts it down and outputs a trigger pulse. The pulse is patched directly into the audio mixer on the far right. Continuing left to right across the top rack, the 2 LFO’s are patched to the frequency controls of the 2 VCOs directly below. The sine wave output of the first VCO is patched to the Bitswap control on the MIVIP and the triangle wave output goes directly into the audio mixer. Likewise, the sine wave output of the second VCO is patched to the Mode control on the MVIP and the triangle wave output goes directly into the audio mixer. And that’s it!

I spend the balance of the morning programming random number sketches in Processing. I’m making progress.
I go grocery shopping around noon.

In the afternoon I reformat my ‘Leaves’ video for the AVSynth using Premiere. A simple process, I ‘downsize’ the video from 1024×768 to 640×480. That done, time to play. As noted the basic patch is minimal, yet it produces some very complex images. The VCOs are set to the same low frequency, the control voltage inputs set to minimal gain, and the LFOs cycle as slowly as possible. The result visually is that the MVIP cycles slowly through only a few effects, controlled by the VCOs. Because the VCOs change frequency slowly and out of out of sync, you see every possible combination of Bitwap and Mode effects. The video loops every 2 minutes. This means that the effect combinations have a new set of image to work with each time around.

I’m able to read the effects easily. I see the VCOs as they go in and out of phase, horizontal bars move up and down within the frame, solidifying as they slow down and breaking apart up as they speed up. Because there are 2 VCOs sliding up and down in frequency at slightly different rates, the image divides into layers. As the effects change, the layers combine to produce new, unexpected results. Finally, the sound from the same 2 VCOs matches the movement on the screen, and underneath is a constant pulse derived from the video that matches the ‘flicker rate’ of the changing images.

Break for dinner at the Calaboose with Debora and Kristin. Kristin returns to Indiana tomorrow, her residence over. We come back to Signal Culture for 'show & tell.'

Day 8: Up early, we all meet upstairs in the kitchen, say good bye to Kristin. I return to my studio with my cup of coffee to do some video editing. I transfer all my recent camcorder movies to the computer, edit, and convert them to standard NTSC video 640×480.

I update my random number routines, one last time.

I create an Ardcore page on my blog and spend the rest of the day researching programming for the Ardcore module. I clean up the template and post the code. I decide that random numbers are nice but, i also need something like a simple waveform generator, running off VD, in order to figure out the MVIP Bitswap and Mode controls. I sketch out a simple triangle wave generator. That done, I start thinking about Peter B’s Swoop module, based on triangle waves. I can generate a triangle wave and control the rise and fall using analog inputs A0 and A1, or externally using A2 and A3. Even better I can generate two triangle waves using A0 and A1, or A2 and A3, to define the shape, and output the difference.

Late afternoon I take a break, walk downtown, past the old ETC studio on Front St, along the Riverwalk, then back to Signal Culture.

I upload yesterday’s video to Youtube. The quality is less than desirable. In fact, it sucks! I delete the video and check out Vimeo.

Day 9: I have the place to myself, sort of. Hank is upstairs in the artist’s studio integrating a new raster manipulator into the system. I update the blog, create a Jones MVIP page, upload a short video to Vimeo.

I finish up by noon, turn on the AVSynth, open the Arduino interface, time to program a random control voltage out. Easier than I’d thought! I spend the rest of the afternoon and evening playing with the system.

Random control voltage patch.

Starting on the left side of the patch, I load the Arduino sketch to the Ardcore. I build on my basic patch, the video is running, the LFOs control the VCOs that, in turn control effects on the MVIP. The Ardcore and the VCOs send audio to the mixer. I patch the output of the Ardcore DAC to the frequency control input on the first VCO. You can hear the results immediately, bleeps and bloops. I patch the Ardcore DAC output to the MVIP, the results can be seen immediately. The image moves with the sound.

Like the D1 output pulse patched to the audio mixer, the random control voltage is triggered by dividing down the CLK input or VD. I try varying the timing in relation to the sound pulse. I try randomizing the duration. In the end I return to a simple, straightforward relationship between the pulses.


Of course these are screen shots, stills. Kinda’ misses the point!

Day 10: Breakfast at Parkview, I walk around for a bit. The weather is sullen, typical Owego. I update my notes, edit images and, after lunch create an AVSynth page.

The image is a challenge, what to do with the blank spaces in the case? Before we left for Owego Mary Ann gave me an old circuit board she thought might make an interesting panel. So I search online for pictures of circuit boards. I find one with a fish, perfect! I add the latest version of my basic patch, still work to be done.

It’s Saturday night. Debora, Jason, Hank, Dave, Brian, and I meet for dinner at Tioga Trails. After dinner Jason, Brian and I visit Dave in his studio. Dave has his Video Synthesizer patched into a simple color encoder, amazing! Jason uploads smartphone videos. Dave breaks out the Laphroaig, a long-standing tradition going back to the early days at the Experimental Television Center.


I return to the studio all warm and fuzzy.

Day 11: Sunday, Hank is back, working in the artist’ studio upstairs, Debora is dressed for summer.
Yesterday, Brian donated a book he’d purchased for 80 cents at a garage sale, ‘Gary Hill: Art + Performance’. I find a quote from Gary about ‘the surfing mind’ and message it to John Craig Freeman. Almost immediately John Craig replies asking for the book title and isbn#. My work, for today, is done!

Not quite, I think about updating the Ardcore random number sketch, adding controls for bounds and options for brown noise and fractal noise; about generating rhythm patterns using digital outputs D0 and D1; and about a possible Video Shredder module for the Jones Video Synthesizer.
David and I talk about the shredder over dinner at TiogaTrails.

After dinner I record a few short videos directly off the monitor, using my camcorder.

Day 12: My goal for this toolmakers’ residency is to configure my AVSynth, specifically –

1) to sync audio and video,
2) to integrate the Ardcore into system,
3) to write a simple program to control the Jones MVIP,
4) to see, hear and feel the link between sound and image, and
5) to have good clean video as a result.

Thanks to Dave’s Jones Sync Separator and the Ardcore, I can sync MVIP effects to video. The Jone’s SS Vertical Drive out is patched to the Ardcore CLK in. The Ardcore’s Arduino microprocessor senses the VD pulse, my program flashes the green LED on the front panel, increments a counter, divides down the pulse, and when appropriate flashes the red LED, sets D1 high, and sends a new random control voltage to the DAC out.

In my basic patch the DAC out is patched to the first VCO and to a MVIP effects input. The sound changes frequency in sync with with VD. The MVIP switches between effects during vertical blanking. The result is a simple audio signal and a good clean video output signal.

You can see, hear and feel the relationship between the sound and the image.

Ok, I’ve met my goals, but my attempts to upload video, don’t go well. Vimeo is better, not as good as I would like, but better. I have a basic account. Dave suggests that upgrade from a basic to pro account. When I can afford it.


Day 13: I record mixes, of Saturdays videos, an ongoing experiment into audio visual composition.

While the mixes render, I read over my notes on Shnth programming, listen to some online tutorials, and do a little maintenance on the workbench. I plug in the Shnth, lo’ and behold it lives!

Dave and I drive out to Ralph and Sherry Hocking’s for lunch.

Back at Signal Culture, I continue to record mixes, will post a couple later.

Day 14: I pack up, all but the AVSynth. Hank vacuums, organizes, checks out the system in the studio upstairs. Jason opens up a small color monitor, soon to be a ‘color wobbulator’.

Today is ‘dog & pony day’.

Dave Jones arrives at noon he joins Jason, they talk about ways to modify or ‘wobble’ the monitor. Jonas Bers arrives for a visit. We sit down together for lunch, all but Hank. He’s playing with slow moving fish and turtles on the Hornbacher Raster Scan Modulator.

After lunch, we tour the artists’ studio. A curator from Hunter College NY and the director of the ETC Archives at Cornell arrive to check out the ‘wobbulator’. The curator would like one for an exhibition ay Hunter this coming Fall. The director would like one for the collection at Cornell. They talk with Jason and David about building a simple b&w version for display.

Jonas’ head is spinning and he hasn’t yet seen the Jones’ Video Synthesizer. Dave, Jonas and I walk over to Dave’s Studio. Dave walks Jonas through the capabilities of the Video Oscillator. His mind is ‘blown’.

Back at Signal Culture I pack up the AVSynth. I’m hitching a ride with Jonas back to Kitty’s in Hudson NY.

Day 15: Mary Ann arrives at 9am, we say goodbye to Kitty, return home to Lowell MA.

Signal Culture: a new video

January 24, 2015


Recorded during my residency at Signal Culture, October 2014.

Input – Quicktime movie loop; audio and control – Serge and Doepfer modules; processing – Jone’s MVIP. Playback from a Mac G5, recorded on Mac Pro.

Final edit in Premiere, published January 24, 2015.