Library

Ever since my midterm project, I wanted to incorporate sound into my sketches. Especially after seeing many presentations in class demonstrating the intersection of music and digital design, I’d really like to possibly explore this area as well. And so after scrolling through the p5.js website, I’m thinking about using waveforms to supplement music through this library: https://p5js.org/reference/#/p5.FFT or maybe similar to previous week’s research post with BlokDust, I’d like to possibly make an interactive soundscape through: https://p5js.org/reference/#/p5.Part or https://p5js.org/reference/#/p5.Phrase

Open Cv

At first, I really wanted to use the open CV library in processing. I saw that it had a lot of features mainly for using the camera to detect motion or even faces. The library has many features I didn’t know could just be added to a regular webcam. But I realized that Open Cv was more complex I hope to learn more about it next week and put it in next weeks assignment. For this week instead, I used the regular Video library in processing to create what looks like artwork. By artwork I mean it looks like paint stripes on top of you as you look at yourself live. That is why I called it live art.

open processing link : https://www.openprocessing.org/sketch/532625

Processing Library

I would love to work on Loom. Loom is patterns linked to audiovisuals in some sort of way. As a kid, I’ve always been interested in websites that link patterns to sound. There was a website I visited that turned squares that you make white on a canvas, and each square would produce a sound and it would play sequentially as the canvas progresses towards the right. It was so simple, but It was very easy to get lost in. I want people to associate music with geometry. Music is very mathematical, but we enjoy the math subconsciously. Our brain makes sense of these patterns and systems into effortless flows and rhythms that sound pleasing to us. It would be amazing If I could visualize sound in an interesting and time-grabbing way.

Library

When searching through the P5.js libraries, one stood out to me: p5.scenemanager. Scenemanager is amazing, because it allows you to have multiple setup and draw functions, as long as they’re put into different scene classes. This could be used in many different ways. I could create an animation with multiple scenes, or even a game with multiple different levels. I also like this library because it seems like it could be easily combined with other libraries, and I could get creative…especially with the use of multiple draw functions. I’m able to essentially have multiple canvases, with different sketches.

library

The library that I wanted to look further into was the dimensions library. This library seems to look at the vector workings of p5js  functions and re works them to be able to work in dimensions that they normally would not. I am thinking of using this library to make some pretty wacky video playback world that the user could interactively move through if possible.

link to the library: https://github.com/Smilebags/p5.dimensions.js

Video and Images

For my project I tried to mess around with an excerpt from one of the films I did for class during my sophomore year that was about alien abduction. At first I thought about using pixel manipulation; but realised that given that the footage was shot in black and white – there wasn’t a whole lot I could do in isolating and manipulating different colour channels. Instead I tried to look for a more collaged approach – utilising different filters and blending tools to create a kind of tripped out version of the abduction. The original video can be seen to the left of the Canvas.

Sketch: https://www.openprocessing.org/sketch/532249#

An issue I keep running into however is trying to distinguish the different layers from each other – as the “push , pop” method seems to have varying results, often still grouping layers together under the same filter.

 

Library

The Seriously.js library seems pretty cool. I used to be a big movie gu (until college) and I was always amazed about how they do the effects of. I knew there was something called an editing bay where the producers and editors would lock themselves up for months to edit a hours of footage and condense it to 1 to 3 hours. They probably use some really expensive and high tech software to edit these videos which I don’t know have any experience in. But I have experience in coding and this library allows you to add effects to live or prerecorded videos through code.

p5.js Library

p5.gibber

I found this library interesting because before the semester ends I want to create some kind of sound visualization. Looking at the examples of this library, I think it can not only be used in sound visualization sketch but also create simple synthesizer with p5.js. It seems like there is a separate function for controlling frequency as well, allowing me to create an interactive sketch that changes the sound. There is a whole online manual dedicated to this library so I have to spend some time figuring out how things work.

Libraries

https://p5js.org/reference/#/libraries/p5.sound

http://ability.nyu.edu/p5.js-speech/

I’m interested in visualizing the sound. P5 sound library let users detect the volume and the frequency of the sound.