ARTIST: Peter Gabriel

CREATOR: Vnderworld

SONG: Playing for Time (Dark-Side Mix) FROM i/o

Video info:

A note from the Visual Artists:

The visual artists take the viewer on an existential journey through the countless lives and moments that have led to our present existence. The probability of your lineage's survival through the centuries for you to be here in this very moment. And so,  in tandem with Peter Gabriel’s incredible lyrics and the visual narrative presented before you, we begin to explore and contemplate our very own existence, for we are all “Playing for Time”.

The video begins with Peter Gabriel opening the cosmic portal through the astral plane of his existence. From Earth's volcanic prehistoric beginnings to the Garden of Eden, through ancient civilizations and historical epochs, we witness humanity's collective journey. The video flows seamlessly past Egyptian pyramids, Noah's Ark, and onward through ages of gladiators, Vikings, and explorers. 

At each scene we consider one of Peter’s ancestors surviving through the ages. This ancestral timeline leads to Gabriel's own life story - from his early days as a Charterhouse School drummer through his Genesis era and MTV success, culminating in his present-day wisdom. As the narrative approaches its climax, skeletal figures and clocks emerge. In its final moments, the video transcends linear time itself, depicting Gabriel in an alternate dimension where past, present, and future collapse into a single instant as the simulation reboots.

About the use of AI in this video:

This music video was created with AI utilizing Stable Diffusion Deforum in early 2024. It serves as a timestamp for the limitations and capabilities of AI video at the start of 2024. The video consists of a single-shot output, from hundreds of prompts and thousands of custom motion parameters. It is one, long, continuous raw AI output that took roughly 6 months to create.

Deforum as a creative medium, 12 months later, seems like a long-lost art to the rapid advancements of AI. Across the globe there are probably only a few thousand individuals who have mastered the art form of creating with Deforum. At the time of the video’s creation, this was the pinnacle of AI video technology. Now as you view AI videos almost indistinguishable from reality in 2025, we can reflect on how rapidly our world is changing in such a short time.

Credits: 

The original concept and visuals were designed by Steve G.(@_Vnderworld) and the motion parameters were hand-crafted by Stefan R. (@Null_Hax). The duo have known each other since 2001 and have been collaborating on videos and pioneering the AI creative revolution since July 2022. Find out more about the artists at westcoastai.xyz  |  youtube.com/@westcoastailabs

Song info:

Playing for Time is a track taken from Peter Gabriel's album i/o, released on 1 December 2023. This is the Dark-Side Mix, by Tchad Blake.

Words and music by Peter Gabriel. Produced by Peter Gabriel.

Published by Real World Music Ltd. / Sony Music Publishing.

Some songs arrive very quickly, Playing for Time was not one of those. I had been working on it, on and off, for several years and have sometimes performed it live, without lyrics.

It's about time, mortality and memories and the idea that each of us has a planet full of memories which get stashed inside the brain. Just like the hit songs of their youth which trigger extraordinary responses in dementia patients, I am fascinated by the mechanisms, smells and sounds which allow memories to reopen.

-pg

ARTIST: Peter Gabriel

CREATOR: Lamson

SONG: Four Kinds of Horses (Bright-Side Mix) FROM i/o

Video info:

The video is a collection of historical fragments from a lost timeline, seen through the many past reincarnations of a single soul, the last being on Earth, culminating leading to its enlightenment.

-Lamson

Song info:

Four Kinds of Horses is a track taken from Peter Gabriel's album i/o, released on 1 December 2024. This is the Bright-Side Mix, by Mark 'Spike' Stent.

Words and music by Peter Gabriel. Produced by Peter Gabriel and Richard Russell.

Published by Real World Music Ltd. / Sony Music Publishing.

“Four Kinds of Horses actually began on Richard Russell’s project ‘Everything Is Recorded’. He’s a friend (and founder of XL Records) and he asked me to pop into his studio to explore some ideas with him. I came up with some chords, melodies and words on top of a groove he was working on. We tried a few things that didn't altogether work to his satisfaction, so it lay dormant for quite a while. Then I started playing around with it again and changed the mood and the groove and something else began to emerge with a much better chorus.

I was working with Katie May in the studio one day and she put together a sort of trip hop vibe which I liked a lot. I felt it belonged and had an attitude, that led me into this other place. Then we grew a lot of different textures and the song evolved into a very different being.

It’s a little different from the rest of the album but I think it's got a strong character.”

-pg

ARTIST: Peter Gabriel

CREATOR: Oranguerillatan

SONG: Olive Tree (Bright-Side Mix) FROM i/o

Video info

Date created: Dec 2023-Jan 2024

ChatGPT: Concept and narrative themes / Initial shot-list.

StoryboardHero.ai: Initial storyboard frames

Adobe Premiere Pro: Board-O-Matic / 2D animation / Final Edit

RunwayML Gen-2 / PIKA Labs: Additional AI img2vid motion to bring the source material to life.

Mixamo / Maya: Additional 3D character/camera animation

ComfyUI: AI vid2vid processing, utilising SDXL / AnimateDiff / IPAdapters and ControlNets.

Nuke: Colour grading, VFX compositing, shot cleanup.

TopazVideoAI: Upscaling of ComfyUI outputs.

The creative process, man meets machine:

Starting in December 2023, the creative voyage of this video was a sophisticated fusion of cutting-edge AI technology and traditional 3D/VFX tools, with collaboration between humans and machines pivotal at every stage. From conceptualization to final execution, the synergy between these advanced tools and the creative vision behind the project was instrumental in bringing it to life.

To kick start the process, Storyboardhero.ai was utilised for initial AI-generated storyboard frames, guided by the shot-list provided during creative discussions with ChatGPT. These frames were compiled into a timed "board-o-matic" using Adobe Premiere Pro, allowing for the pacing and overall feel of the video to be gauged. This process involved refining the shots iteratively, with input from both AI tools and human creatives.

Once the timings were established, the process of adding motion to the source material began, utilising various methods. Some simple 2D animation was applied to certain storyboard frames using Nuke and Premiere. However, the primary focus was on running the boards through multiple AI tools individually to imbue them with life. Working closely with Graeme Cornies from Kodiak Arcade, storyboard frames were processed using img2vid tools like RunwayML’s Gen2 and PIKA Labs to enhance their dynamism. Additionally, 3D software such as Mixamo and Maya was employed by Oranguerillatan to introduce character animation, camera movements, and depth to select shots. The addition of a few real-life video clips at this stage further enriched the visual narrative.

The previous steps focused on animating still frames, but they didn't address the final aesthetic. Enter ComfyUI. Using a vid2vid setup developed with input from some very smart members of the AI community. Each of the 200+ shots underwent a ComfyUI transformation, resulting in the distinctive claymation style evident in the final piece. This tactile aesthetic, reminiscent of stop-motion animation and 'old-tech' craftsmanship, contrasts with the modern AI technology used in production. Most shots were generated multiple times, resulting in over 1000 generations being created during this stage. The cutting room floor was covered in binned generations that didn’t quite make it.

After the shots were generated and the edit refined over several weeks, the process entered its final stages: colour grading using Nuke and AI upscaling with TopazVideoAI. The colour grading was a painstaking process, with each shot meticulously matched to its surroundings to maintain cohesion and evoke the intended mood for each section of the video. From the cool, dark tones of winter nights to the vibrant hues of summer days, each season was depicted with its own distinct visual palette, enriching the narrative and emotional journey of the video.

Exploring conceptual and narrative themes with AI:

Olive Tree’ stands out as a six-minute musical masterpiece that exudes uplifting energy. Its distinct sections intricately capture the essence of hope, interconnectedness, and curiosity. Peter's discussion of his inspirations and themes in his August 2023 "Full Moon" video provided fascinating insight into his creative process while composing and recording the track.

After immersing in the track and Peter's insightful discussions about it, a dialogue between Oranguerillatan and ChatGPT commenced to delve further into the conceptual and narrative dimensions. Through collaborative exchanges, AI served as an illuminating guide, shedding light on creative possibilities and thematic depths. By engaging in these discussions, a deeper understanding between man and machine emerged, enriching the creative process and broadening perspectives.

Delving deeper into the intended themes and content of the video, discussions revolved around the different sections of the song. The song's composition mirrored an epic journey across time, seamlessly transitioning from mystique and child-like curiosity to scepticism, growth, transformation, and ultimately, unabashed joy and euphoria. This musical evolution resonated with the notion of ever-changing seasons and human emotions' daily fluctuations, highlighting life's unpredictable nature.

Strategically incorporating changing seasons and time of day into the video became a key feature of aligning the visuals with the evolving narrative and emotional arc of the song. As the track progresses through its various verses, choruses, bridges, and instrumental sections, the time of day and season seamlessly shift multiple times, enhancing the immersive experience for the viewer.

Shifting seasons - a journey through time:

As our hero embarks on their journey through the changing seasons and the passing of time, each transition mirrors the evolving emotions and narrative of the song. From the mysterious allure of winter nights to the vibrant energy of summer days, the visual landscape shifts in tandem with the song's tempo and mood.

The journey commences in the depths of winter and the cover of night, setting the stage for the mysterious and enchanting ambience of the track's introduction and opening verse. This wintry landscape serves as the perfect backdrop for introducing the protagonist and unveiling their intriguing discovery propelling the narrative forward. Each post-chorus transition to a new verse brings the viewer back to the dark, chilly embrace of winter night, accompanied by the timeless symbolism of the full moon, a motif dear to Peter.

As the song progresses, the visuals transition to the bright hues of sunrise and the promise of a new day, signifying spring's arrival. This season symbolises growth and renewal, reflected in budding flora and the protagonist's burgeoning curiosity as they interact with a mysterious device in their backyard.

The arrival of the climactic chorus comes with the midday summer sun. The video explodes into a vibrant display of sunshine and revelry, characterised by uninhibited joy and boundless energy. The colorful and euphoric imagery captures the essence of interconnectivity and togetherness, embodying Peter's concept of ‘the melting of the solid world.’ Amidst the chaos and fun, the underlying theme of unity and interconnectedness shines through, offering a respite from the cynicism of social disconnection.

As the video transitions into the post-chorus autumnal sections, viewers witness the serene beauty of dusk and sunset, signalling a moment of introspection for our protagonist. Here, amidst the fading light of the day, they reflect on recent experiences and contemplate the implications of their newfound interconnectedness. The juxtaposition of light and shadow prompts viewers to ponder the balance between safety and uncertainty in embracing this vivid interconnectivity.

With each cycle, our protagonist undergoes a transformation, evolving from a curious observer to a determined explorer of the interconnected world around him. As they delve deeper into this realm, their initial scepticism gives way to a sense of purpose and connection, guided by the ever-present motif of the full moon; a symbol of continuity and cyclical renewal. Throughout this journey, time becomes fluid, transcending conventional notions of age and linear progression.

-Oranguerillatan

Song info:

Olive Tree is a track taken from Peter Gabriel's album i/o, released on 1 December 2023. This is the Bright-Side Mix, by Mark 'Spike' Stent.

Words and music by Peter Gabriel. Produced by Peter Gabriel.

Published by Real World Music Ltd. / Sony Music Publishing.

“This song is one of those taken from this next brain project that I am working on. We are entering a time in which reading each other’s thoughts will become a normal part of our lives. In this story our hero puts on the brain scanning helmet, that turns thoughts into pictures, and then sees all the deep connections he has with the natural world and in particular to one olive tree.

In many ways, we are part of everything and we probably have the means to connect and communicate with everything, yet we often shut it off. We only want to see and listen to the things that seem important and relevant to us and shut out the noise of everything else. But probably, hidden in that noise, there are all sorts of things that can help us realise our place in this future world and help us remember we are still apes who need a healthy natural world to survive.”

-pg