Generative AI Storytelling & Illustration Agent
Prototype

Generative AI Storytelling & Illustration Agent

Back to Projects
Python
OpenAI
Stable Diffusion
LLM APIs
Pipeline Design
Keywords
Input
Story + Illustrations
Output

Overview

An end-to-end generative pipeline that takes a set of keywords and produces a fully illustrated short story — and optionally, a short animated video.

Story Generation

The user provides 3–5 keywords. A structured GPT prompt generates a multi-paragraph narrative with consistent characters and a clear arc. Prompt templates were iterated extensively to improve consistency across story genres.

Illustration Generation

Each paragraph of the story is condensed into a Stable Diffusion prompt. A consistent style token is prepended to every prompt to maintain visual coherence across illustrations. Generated images are then composited with the story text using PIL.

Animation Extension

A subsequent pipeline uses moviepy to animate the illustrations — pan/zoom effects, fade transitions, and text-to-speech narration — producing a short MP4 suitable for social media.