Touch to Deconstruct

Touch to Deconstruct is an intimate exploration of the nuance of the moving image, which occurs as users manipulate the speed of black and white film footage on a handheld touch screen.

Deconstruction is a method of critical analysis that seeks to expose deep-seated contradictions in a work by delving below its surface meaning. More simply, what we find from picking something apart into fine details.

When it comes to deconstructing cinema, you can deconstruct it as you would literature – looking at its narrative. But you can also deconstruct it on a more experimental level, looking at the medium. Film and video is composed by a series of images or frames. The relationship between each frame is the glue which forms a visual language. People have the ability to read images and the relationship between images. If you manipulate that glue, you can deconstruct the moving image.

There are various ways to do so, and the filmmaker that has inspired me the most is Martin Arnold. He deconstructs old Hollywood films through repetition and scrubbing frames back and forth. He calls it stuttering audio and limping visuals. On a basic level, I’m simply mesmerized by the aesthetic. But he also provides new meaning through his manipulations. By obsessing on every gesture and movement that may otherwise be overlooked, Arnold subverts the original. For example, he reveals Oedipal tensions in what would normally be an innocent embrace in Alone. Life Wastes Andy Hardy.

The artist Bill Viola deconstructs the stages of emotion by utilizes slow motion.

Viola uses slow motion to delve deeper into an emotional moment. Arnold uses stuttering and limping to uncover subtext. Both serve to heighten our perception of ephemeral moments of nuance within the moving image. The result is the discovery of latent themes, emotion, beauty, or something that is simply compelling on a subconscious level, which we are then compelled to observe.

My approach for my thesis was to harness this compulsion to observe nuance. Setting out to develop my project, I sat with footage and observed it in order to see what it has to say and reveal. This is a visceral and intimate process with footage that I have while crafting, which is exactly what I want to replicate for the viewer when consuming the finished work.

I decided to appropriate footage from archive.org. Specifically, an educational film from 1965 called Point of Return about a depressed man who tries to commit suicide. I chose this film because I wanted to handle emotional content, which is only heightened by its stark palette of black and white. There’s also a great sense of curiosity and discovery due not only to the process of exploring ephemeral moments through deconstruction, but the fact that the film itself is ephemeral, as it was forgotten and has long out-lived its original use, but has been saved through the archive.

So I take this footage and I am going to deconstruct it. Again, my goal is to bring the viewer through the same visceral experience with the footage while watching as I had in editing and crafting it. The power to investigate the footage should therefore not lie solely within my hands as the filmmaker. I ask, why is the viewer not an active participant in deconstruction? I believe one answer to how to bridge the gap lies in changing the screen. Specifically to a handheld screen.

The traditional setting for film is a theater. In the theater, one is held captive in a lean-back experience, must tilt one’s head backwards to the sky, and absorb a larger than life image, which is idolized.

However, there is a reversal in power and agency with a handheld screen. The image is smaller than the viewer. One holds it in one’s hands and is therefore master over it. It is a personal space as it’s one screen to one viewer. With this change in agency, let’s take it a step further. Let’s make it a touchscreen because if you can touch it, you feel like you can change it. A touchscreen also increases intimacy with the content as you are touching the image directly.

Touch gestures provide a playful and tactile way to manipulate time and speed. In other words, touching to deconstruct. I equate the act of sliding one’s fingers as the means of manipulating the image. To do so, I used openFrameworks, a toolkit for programming creatively, which gave me frame by frame access to my video files. I tried to make the controls intuitive and non-intrusive. I am defining the available tools for deconstruction as stuttering/limping and slow motion. Sliding one’s finger up and down changes the degree to which those tools are used. Sliding left and right scrubs backwards and forwards in the timeline. In addition, a cursor appears when sliding and its shape represents the selected degree of deconstruction. The piece begins on gentle slow motion, at half speed. Slide upwards to shift into limping/stuttering, the more you slide, the more vigorous it gets. Slide downwards to return to slow motion, and the further you slide, the slower it gets. In addition, sliding right and left scrub forwards and backwards, respectively, allows the user to hone in on the moments that appeal to him.

In addition, to further convey the sense of ephemera, I cut up the larger film into smaller clips and split them into three pathways, each pathway associated with a degree of deconstruction. Limping generally deals more with a frenzied psyche. Extreme slow motion deals with the inability to physically move. The middle pathway lies somewhere in between. When you reach the end of a clip, the next one that it jumps to is determined by the current degree of deconstruction. For example, if you slid your finger upwards, at the transition from one clip to the other, you will shift from the bottom pathway to the top one. Therefore, the journey you take is dependent on the choices you make. It must be run at least three times to see all clips and get the full breadth of emotion, action, and potential narrative.

I’m encouraging one to actively explore the film by manipulating it, but at the same time the user must be receptive to what the image reveals. For example, the man rubbing his face is magnified to seemingly be an attempt to rub away his identity or existence. Who is moving whom? You move the character with your touch, but are you yourself not being moved emotionally? Is your touch aggressive and leading the man to his death? Is it soft and caring? Perhaps it’s sexual, in your control. Maybe obsessive in your quest for all the nuance within.

In conclusion, I was driven by an experimental aesthetic that is simultaneously contemplative and harsh. The act of observing is a meditative practice. Deconstructing is an analytical one. I am empowering the viewer to do both by my choice in changing the screen and introducing touch control. Overall, my project is an intimate experience with cinema that asks you to approach the moving image in a unique way.

TrendLines: Boxee application

TrendLines is an application that runs in the Boxee media platform. It dynamically curates online video content based on current, socially-driven trends and topics.

The video content presented within TrendLines is determined by what the online community is interested in. It scans a variety of sources, such as Google Hot Trends, New York Times Most Searched Terms (in 24 hours), and Twitter, to determine the top trending topics. TrendLines then pulls existing video content from the web as interpretations, or representations, of these topics. This includes video from both amateur and professional sources, such as YouTube, CNN, ABC, Truveo, etc.

The result is a collection of videos from the web that illustrates the top trending topics currently buzzing in society.

There are two ways to consume the content.

“Broadcast” mode initiates a passive experience where content is pushed as a consecutive flow of video. This allows for a lay-back experience where users enjoy video content presented in a manner evoking traditional broadcast television. In addition, users are prompted to indicate how much time they have available to watch (10, 20, 30 minutes). By specifying the length of time a user chooses to consume their dose of online video, the broadcast can dynamically tailor its length and content to best suit the user’s interests and behavior.

“Explore” mode gives users more control over their consumption. Users explore the content by actively browsing the results and selecting specific videos they choose to view.

Lastly, by tweaking TrendLines’ settings, users can tailor results by choosing which trend sources and video sources to query and aggregate.

The TrendLines team: Ruxy Staicut, Si Heun Cho, Nicholas Rubin, David Golan

Lucid – Global Game Jam 2009

press

Lucid is a game where a young boy, Hermin, is guided by his dreams to a moment of inspiration. You control a dream cloud that determines Hermin’s path, connected by thought bubbles. On his way, Hermin faces “mental” obstacles, or black blocks and walls, that will wake Hermin from his dream. Along the way you help Hermin collect building blocks in order to realize his inspiration.

PLAY IT HERE!

I worked with NYU students Matt Parker, Rachit Parikh, Asli Sevinc, Merve Keles, and Bruno Kruse to develop this game for the 48-hour game design festival 2009 Global Game Jam. I contributed to game design, user interface, and digital assets.

Description on GlobalGameJam.org

Lucid was ported to an Android app, available to download from the Google Play store.

I-Ve (“Interactive Video Editor”)

I-Ve

The Interactive Video Editor

Computers allow anyone to become an amateur filmmaker at home with ease using programs such Windows Moviemaker and Apple iMovie. However, for newcomers the interface of such applications can be complicated and daunting. Working with my classmate Fiona Daniels, we proposed an alternative video editor that brings home movies away from the computer and back where they belong, the living room television.

We created a simple, yet robust physical interface in the form of a television remote that anyone can pick up and start editing video right away. We also wanted to create a fun experience for the family that utilized an intuitive control scheme. The remote can be tilted up and down to make selections, rotated counterclockwise and clockwise to rewind and fast forward, and a quick “chop” up-down action makes a cut in the video edit.

The physical device is composed of an accelerometer and simple buttons. The software interface was created with Processing.

For more information, click here.