generate video

📁 b-open-io/gemskills 📅 Jan 1, 1970
14
总安装量
0
周安装量
#23618
全站排名
安装命令
npx skills add https://github.com/b-open-io/gemskills --skill 'Generate Video'

Skill 文档

Generate Video

Generate videos using Veo 3.1 (veo-3.1-generate-preview) with native audio, 720p/1080p/4K resolution, and 4-8 second clips.

When to Use

Use this skill when the user asks to:

  • Generate a video from a text prompt (text-to-video)
  • Animate an existing image (image-to-video)
  • Create a styled video clip using the art style library
  • Build an image-to-video pipeline with auto-generated starting frames

Critical: Run as Background Task

Veo video generation takes 11 seconds to 6 minutes. The script handles polling internally and outputs only a file path when complete.

Always run the generate script as a background task to avoid blocking the conversation and bloating context with polling output:

# CORRECT: background task
bun run scripts/generate.ts "prompt" --output video.mp4
# Run with run_in_background: true in the Bash tool

After the background task completes, read only the final line of output (the file path). Do not read the full output — it contains only stderr progress dots.

Style Selection

If the user hasn’t specified a style, present a multi-choice question before proceeding:

How would you like to handle the art style?

  1. Pick a style – Browse 169 styles visually and choose one
  2. Let me choose – I’ll suggest a style based on your prompt
  3. No style – Generate without a specific art style

Use the AskUserQuestion tool to present this choice.

If the user picks “Pick a style”, launch the interactive style picker:

cd ${CLAUDE_PLUGIN_ROOT}/skills/browsing-styles
STYLE_JSON=$(bun run scripts/preview_server.ts --pick --port=3456)

Pass the selected style via --style <id> to the generate command.

If the user already specified a style, skip this step and use --style directly.

Prompt Rewriting

Before generating any video, rewrite the user’s prompt using the guide in references/veo-prompt-guide.md.

Transform prompts by adding:

  1. Subject details – Specific appearance, position, scale
  2. Action/Motion – What moves, speed, direction
  3. Style/Aesthetic – Visual treatment, color palette
  4. Camera motion – Pan, dolly, orbit, static
  5. Composition – Framing, depth, focus
  6. Ambiance/Audio – Lighting mood, sound cues (Veo generates native audio)

Example Transformation

User says: “ocean waves” Rewritten: “Dramatic slow-motion ocean waves crashing against dark volcanic rocks at golden hour. Spray catches the warm sunlight, creating rainbow mist. Low-angle shot, camera slowly dollying forward. Deep rumbling wave sounds with seagull calls in the distance.”

Usage

cd ${CLAUDE_PLUGIN_ROOT}/skills/generate-video && bun run scripts/generate.ts "prompt" [options]

Options

  • --input <path> – Starting frame image (image-to-video mode)
  • --style <id> – Apply style from the style library (same as generate-image)
  • --aspect <ratio>16:9 (default) or 9:16
  • --resolution <res>720p (default), 1080p, 4k
  • --duration <sec>4, 6, 8 (default: 8)
  • --negative <text> – Negative prompt (what to avoid)
  • --seed <n> – Random seed for reproducibility
  • --output <path> – Output .mp4 path
  • --auto-image – With --style, auto-generate a styled starting frame first

Examples

# Text-to-video
bun run scripts/generate.ts "Ocean waves crashing on volcanic rocks at sunset" --output waves.mp4

# Image-to-video (animate an existing image)
bun run scripts/generate.ts "The lion slowly turns its head, dots shimmer" --input lion.png --output lion.mp4

# With art style
bun run scripts/generate.ts "Mountain landscape comes alive with wind" --style impr --output mountain.mp4

# Full pipeline: auto-generate styled image, then animate
bun run scripts/generate.ts "A lion turns majestically" --style kusm --auto-image --output lion.mp4

# Vertical video for social
bun run scripts/generate.ts "Waterfall in lush forest" --aspect 9:16 --resolution 1080p --output waterfall.mp4

# High resolution
bun run scripts/generate.ts "City skyline timelapse" --resolution 4k --duration 8 --output city.mp4

Aspect Ratio Matching (Critical for Image-to-Video)

When using --input, the input image must match the target video aspect ratio. A square image fed to 16:9 video produces black pillarboxing with cutoff edges.

  • Generate starting frames at --aspect 16:9 (default video) or --aspect 9:16 (vertical video)
  • The --auto-image flag handles this automatically

Two-Step Pipeline (Image then Video)

For maximum control, generate the starting frame separately. Always match the aspect ratio:

# Step 1: Generate styled image at 16:9 (matches default video aspect)
bun run ../../generate-image/scripts/generate.ts "majestic lion portrait" --style kusm --aspect 16:9 --size 2K --output lion.png

# Step 2: Animate the image
bun run scripts/generate.ts "The lion turns its head slowly, dots shimmer in the light" --input lion.png --output lion.mp4

Context Discipline

  • Never read generated .mp4 files back into context – instruct the user to play them with open <file>.mp4
  • Run as background task – the script outputs only the file path to stdout
  • Auto-generated starting frames (via --auto-image) are saved as PNG files for reference

Model

Uses veo-3.1-generate-preview (Veo 3.1) with native audio support. Override via GEMINI_VIDEO_MODEL environment variable.

Last verified: February 2026. If a newer generation exists, STOP and suggest a PR to b-open-io/gemskills. See the ask-gemini skill’s references/gemini-api.md for current models.

Reference Files

For detailed video prompting strategies:

  • references/veo-prompt-guide.md – Veo prompt elements, audio cues, negative prompts, and image-to-video tips
  • ask-gemini skill’s references/gemini-api.md – Current Gemini/Veo models and SDK info