Short Video Maker

An open source automated video creation tool for generating short-form video content. Short Video Maker combines text-to-speech, automatic captions, background videos, and music to create engaging short videos from simple text inputs.

This repository was open-sourced by the AI Agents A-Z Youtube Channel. We encourage you to check out the channel for more AI-related content and tutorials.

Hardware requirements

• CPU: at least 2 cores are recommended
• GPU: optional, makes the caption generation a lot faster (whisper.cpp) and the video rendering somewhat faster

Watch the official video on how to generate videos with n8n

Running the Project

Using NPX (recommended)

The easiest way to run the project with GPU support out of the box:

LOG_LEVEL=debug PEXELS_API_KEY= npx short-video-maker

Using Docker

CPU image

docker run -it --rm --name short-video-maker -p 3123:3123 \
  -e PEXELS_API_KEY= \
  gyoridavid/short-video-maker:latest

NVIDIA GPUs

docker run -it --rm --name shorts-video-maker -p 3123:3123 \
  -e PEXELS_API_KEY= --gpus=all \
  gyoridavid/short-video-maker:latest-cuda

Find help

Join our Discord community for support and discussions.

Environment Variables

Variable	Description
PEXELS_API_KEY	Your Pexels API key for background video sourcing
PORT	Port for the API/MCP server (default: 3123)
LOG_LEVEL	Log level for the server (default: info, options: trace, debug, info, warn, error)
WHISPER_VERBOSE	Verbose mode for Whisper (default: false)

Example

<table> <tr> <td> <video src="https://github.com/user-attachments/assets/bb7ce80f-e6e1-44e5-ba4e-9b13d917f55b" width="270" height="480"></video> </td> <td>

{
  "scenes": [
    {
      "text": "Hello world! Enjoy using this tool to create awesome AI workflows",
      "searchTerms": ["rainbow"]
    }
  ],
  "config": {
    "paddingBack": 1500,
    "music": "happy"
  }
}

</td> </tr> </table>

Features

• Generate complete short videos from text prompts
• Text-to-speech conversion
• Automatic caption generation and styling
• Background video search and selection via Pexels
• Background music with genre/mood selection
• Serve as both REST API and Model Context Protocol (MCP) server

How It Works

Shorts Creator takes simple text inputs and search terms, then:

1. Converts text to speech using Kokoro TTS
2. Generates accurate captions via Whisper
3. Finds relevant background videos from Pexels
4. Composes all elements with Remotion
5. Renders a professional-looking short video with perfectly timed captions

Dependencies for the video generation

Dependency	Version	License	Purpose
Remotion	^4.0.286	Remotion License	Video composition and rendering
Whisper CPP	v1.5.5	MIT	Speech-to-text for captions
FFmpeg	^2.1.3	LGPL/GPL	Audio/video manipulation
Kokoro.js	^1.2.0	MIT	Text-to-speech generation
Pexels API	N/A	Pexels Terms	Background videos

How to contribute?

PRs are welcome. See the CONTRIBUTING.md file for instructions on setting up a local development environment.

API Usage

REST API

The following REST endpoints are available:

1. GET /api/short-video/:id - Get a video by ID and also can be downloaded like this :

curl -o output.mp4 http://localhost:3123/api/short-video/<videoId>

3. POST /api/short-video - Create a new video

   {
     "scenes": [
       {
         "text": "This is the text to be spoken in the video",
         "searchTerms": ["nature sunset"]
       }
     ],
     "config": {
       "paddingBack": 3000,
       "music": "chill"
     }
   }
   

4. DELETE /api/short-video/:id - Delete a video by ID
5. GET /api/music-tags - Get available music tags

Model Context Protocol (MCP)

The service also implements the Model Context Protocol:

1. GET /mcp/sse - Server-sent events for MCP
2. POST /mcp/messages - Send messages to MCP server

Available MCP tools:

• create-short-video - Create a video from a list of scenes
• get-video-status - Check video creation status

License

This project is licensed under the MIT License.

Acknowledgments

• ❤️ Remotion for programmatic video generation
• ❤️ Whisper for speech-to-text
• ❤️ Pexels for video content
• ❤️ FFmpeg for audio/video processing
• ❤️ Kokoro for TTS