Context
This is a "cinematic poem" produced for an AI Filmmaking class. The goal here was to establish and convey a particular mood (a rather sombre and melancholy one, in this case!) and reinforce that with the chosen imagery, music and narration. It was an earlier project that relied more on still images and tricks in After Effects to simulate camera movement (e.g. drone shot, camera shake, rack focus) rather than generating the animation with a tool like Runway. The use of depth maps was key here, as well as learning to separate shots into fore-, mid- and background layers.
Workflow and Tools
The general tone and thrust of the poem came from me (personal experience) and I then made use of various AI tools to help me write and voice it. I had in mind a particular look and feel, very "Wuthering Heights" and set in the English moors; so I prompted images in this direction with lots of gray skies and wind rustling through the heath, along with a Jane Eyre/Outlander-style heroine.
Poem: S. Austin + ChatGPT
Image Creation/Manipulation: Midjourney 5.2, Adobe Photoshop
Animation/Movement: Adobe After Effects, Leia Pix, RunwayML Gen-2
Audio: Narration: S. Austin; Voice Generation: ElevenLabs; Music: Pixabay (licensed)
Video Editing: DaVinci Resolve 18.6
Upscaling: Topaz Gigapixel AI, Topaz Video AI
Poem: S. Austin + ChatGPT
Image Creation/Manipulation: Midjourney 5.2, Adobe Photoshop
Animation/Movement: Adobe After Effects, Leia Pix, RunwayML Gen-2
Audio: Narration: S. Austin; Voice Generation: ElevenLabs; Music: Pixabay (licensed)
Video Editing: DaVinci Resolve 18.6
Upscaling: Topaz Gigapixel AI, Topaz Video AI