NEW DIRECTORS SHOWCASE
For the 2016 New Directors showcase at the Cannes advertising festival in 2016 we asked the simple question; can machines be creative?
The AI director featured in the 2016 New Directors’ Showcase goes under the pseudonym of Anni Mathison, and the result of the experiment commissioned by Saatchi & Saatchi and Team One is a short film named “Eclipse,” conceived, edited and directed by machines.
The short film debuts on the anniversary of scientist Alan Mathison Turing’s birth on 23 June 1912. Turing was the first to ask the question, “Can machines think?”, which then leads immediately to the question can machines be creative?
“Eclipse” uses several technologies in a never-before-seen combination to create the film from start to finish:
IBM Watson and Microsoft’s AI chatbot Ms_Rinna (Microsoft Rinna) registered the emotion behind the lyrics to generate a completely original storyline for the music video.
“Eclipse” uses several technologies in a never-before-seen combination to create the film from start to finish:
IBM Watson and Microsoft’s AI chatbot Ms_Rinna (Microsoft Rinna) registered the emotion behind the lyrics to generate a completely original storyline for the music video.
In addition to helping provide the storyline, Ms_Rinna was asked opinions on characters, wardrobe, location and catering for the shoot.
The team used Affectiva’s facial recognition software and EEG data to help cast the perfect co-star.
Drones gave direction on the day of the shoot by using a combination of data from IBM Watson’s tone analysis and Affectiva’s facial recognition software. This data allowed the drones to capture intense emotional moments with mathematical precision.
Drones gave direction on the day of the shoot by using a combination of data from IBM Watson’s tone analysis and Affectiva’s facial recognition software. This data allowed the drones to capture intense emotional moments with mathematical precision.
AI was used again during the edit. The team created a proprietary program that identified which clips to put where based on the beat of the song and the emotional intent of the lyrics.
All of the visual effects were created using a custom neural art program. This program allowed the machines to apply a filter to the raw footage based on reference images selected based on the artist’s vision.
“What’s next in the evolution of what it means to be a director? Because of innovations in technology, the definition has changed over the years,” adds Chris Graves, Chief Creative Officer at Team One. “We are continuing to explore and advance the art of filmmaking, and are challenging the creative community this year, by asking them and the world, ‘Can a film made by machines move you?’”
Here's some selected screen grabs of the AI generated neural art. We used shots from Nasa's achieves for the 'style' content of Mai Lan/the moon and landscape frames from Mad Max 4 for Michael/the sun.
With so much technology involved in our experimental shoot and with no direct human feedback/input I spent some of my time documenting the process for our behind scenes documentary.