The problem
Content creators for social become pipeline operators — ideation, scripting, captures, editing, captions, publishing. A person with half a dozen ideas per day faces weeks of execution. Cloud video services get expensive quickly; off-the-shelf solutions charge per render and don’t adapt workflow.
The engine
Clipia turns an idea into a publish-ready short video — the pipeline executes:
- Scripting — Claude structures narrative, scene sequence, dialogue.
- Imagery — SDXL generates frames with aesthetic fidelity and visual continuity.
- Narration — XTTS v2 synthesizes the creator’s voice in Brazilian Portuguese (voice cloning with reference).
- Captions — Whisper transcribes and timecodes with character-level precision.
- Composition — FFmpeg and MoviePy orchestrate audio, video, captions, effects, fades.
Infrastructure
FastAPI backend + Celery coordinates the work queues. Image rendering, voice synthesis and composition run on owned GPU (RTX 3090) — no per-render cloud cost; Redis holds intermediates between stages.
Operational evidence
On screen
My role
End-to-end architecture conception, Celery orchestration, GPU rendering engineering, operations and quality tuning. Independent product, commercialized under closed beta.
Clipia is an independent product. Brands and names cited belong to their respective owners.