Quick Reference

fal-ai/kling-video/v2.6/pro/image-to-video

fal-ai/minimax-video/image-to-video

fal-ai/luma-dream-machine

fal-ai/stable-video-diffusion

When to Use This Skill

Use for image animation:

• Animating still portraits with natural motion
• Creating product showcase videos
• Generating ambient loop videos
• Adding subtle motion to landscapes
• Preview workflow before final render

Related skills:

• For text-to-video: see

  fal-text-to-video

• For video editing: see

  fal-video-to-video

• For text-to-image first: see

  fal-text-to-image

fal.ai Image-to-Video Models

Complete reference for all image animation and image-to-video models on fal.ai.

Kling Image-to-Video

Kling 2.0 Image-to-Video

Endpoint:

fal-ai/kling-video/v2.0/image-to-video

import { fal } from "@fal-ai/client";

const result = await fal.subscribe("fal-ai/kling-video/v2.0/image-to-video", {
  input: {
    prompt: "The person slowly turns their head and smiles warmly",
    image_url: "https://example.com/portrait.jpg",
    duration: "5",
    aspect_ratio: "16:9"
  }
});

console.log(result.video.url);

import fal_client

result = fal_client.subscribe(
    "fal-ai/kling-video/v2.0/image-to-video",
    arguments={
        "prompt": "The person slowly turns their head and smiles",
        "image_url": "https://example.com/portrait.jpg",
        "duration": "5",
        "aspect_ratio": "16:9"
    }
)
print(result["video"]["url"])

Kling 2.5 Pro Image-to-Video

Endpoint:

fal-ai/kling-video/v2.5/pro/image-to-video

const result = await fal.subscribe("fal-ai/kling-video/v2.5/pro/image-to-video", {
  input: {
    prompt: "The car drives forward along the mountain road, camera follows",
    image_url: "https://example.com/car-scene.jpg",
    duration: "5",
    aspect_ratio: "16:9",
    negative_prompt: "static, frozen, distorted"
  }
});

Kling 2.6 Pro Image-to-Video (Latest)

Endpoint:

fal-ai/kling-video/v2.6/pro/image-to-video

const result = await fal.subscribe("fal-ai/kling-video/v2.6/pro/image-to-video", {
  input: {
    prompt: "The waterfall cascades down with a gentle roar, birds fly past",
    image_url: "https://example.com/waterfall.jpg",
    duration: "5",
    aspect_ratio: "16:9"
  }
});

console.log(result.video.url);
console.log(result.audio?.url);  // Native audio

Kling Parameters:

prompt

image_url

duration

aspect_ratio

negative_prompt

MiniMax Image-to-Video

MiniMax Hailuo

Endpoint:

fal-ai/minimax-video/image-to-video

const result = await fal.subscribe("fal-ai/minimax-video/image-to-video", {
  input: {
    prompt: "The cat stretches and yawns, then walks forward",
    image_url: "https://example.com/sleeping-cat.jpg",
    prompt_optimizer: true  // Auto-enhance prompt
  }
});

result = fal_client.subscribe(
    "fal-ai/minimax-video/image-to-video",
    arguments={
        "prompt": "The cat stretches and yawns",
        "image_url": "https://example.com/cat.jpg",
        "prompt_optimizer": True
    }
)

MiniMax Parameters:

prompt

image_url

prompt_optimizer

LTX Image-to-Video

LTX Video Image-to-Video

Endpoint:

fal-ai/ltx-video/image-to-video

const result = await fal.subscribe("fal-ai/ltx-video/image-to-video", {
  input: {
    prompt: "The flowers sway gently in the breeze",
    image_url: "https://example.com/flower-field.jpg",
    negative_prompt: "static, frozen",
    num_inference_steps: 30,
    guidance_scale: 7.5
  }
});

LTX Video v2 Image-to-Video

Endpoint:

fal-ai/ltx-video/v2/image-to-video

const result = await fal.subscribe("fal-ai/ltx-video/v2/image-to-video", {
  input: {
    prompt: "Smoke rises and swirls from the chimney",
    image_url: "https://example.com/cabin.jpg",
    num_inference_steps: 35,
    guidance_scale: 7.0
  }
});

LTX Parameters:

prompt

image_url

negative_prompt

num_inference_steps

guidance_scale

Runway Gen-3 Image-to-Video

Runway Gen-3 Turbo

Endpoint:

fal-ai/runway-gen3/turbo/image-to-video

const result = await fal.subscribe("fal-ai/runway-gen3/turbo/image-to-video", {
  input: {
    prompt: "The model walks confidently down the runway",
    image_url: "https://example.com/fashion-shot.jpg",
    duration: 5
  }
});

Runway Parameters:

prompt

image_url

duration

Luma Dream Machine

Luma Image-to-Video

Endpoint:

fal-ai/luma-dream-machine

const result = await fal.subscribe("fal-ai/luma-dream-machine", {
  input: {
    prompt: "The magical portal opens with swirling energy",
    image_url: "https://example.com/fantasy-scene.jpg",
    aspect_ratio: "16:9",
    loop: true  // Create seamless loop
  }
});

result = fal_client.subscribe(
    "fal-ai/luma-dream-machine",
    arguments={
        "prompt": "The portal opens with swirling energy",
        "image_url": "https://example.com/scene.jpg",
        "aspect_ratio": "16:9",
        "loop": True
    }
)

Luma Parameters:

prompt

image_url

aspect_ratio

loop

Wan Image-to-Video

Wan v2.1 Image-to-Video

Endpoint:

fal-ai/wan/v2.1/1.3b/image-to-video

const result = await fal.subscribe("fal-ai/wan/v2.1/1.3b/image-to-video", {
  input: {
    prompt: "The leaves flutter and fall from the tree",
    image_url: "https://example.com/autumn-tree.jpg",
    num_frames: 81
  }
});

Stable Video Diffusion

SVD Image-to-Video

Endpoint:

fal-ai/stable-video-diffusion

const result = await fal.subscribe("fal-ai/stable-video-diffusion", {
  input: {
    image_url: "https://example.com/landscape.jpg",
    motion_bucket_id: 127,  // 0-255, higher = more motion
    fps: 7,
    num_frames: 25
  }
});

SVD Parameters:

image_url

motion_bucket_id

fps

num_frames

seed

SVD XT

Endpoint:

fal-ai/stable-video-diffusion-xt

const result = await fal.subscribe("fal-ai/stable-video-diffusion-xt", {
  input: {
    image_url: "https://example.com/scene.jpg",
    motion_bucket_id: 127,
    num_frames: 25,
    fps: 6
  }
});

CogVideoX Image-to-Video

CogVideoX-5B Image-to-Video

Endpoint:

fal-ai/cogvideox-5b/image-to-video

const result = await fal.subscribe("fal-ai/cogvideox-5b/image-to-video", {
  input: {
    prompt: "The astronaut waves to the camera",
    image_url: "https://example.com/astronaut.jpg",
    num_inference_steps: 50,
    guidance_scale: 6.0
  }
});

Model Comparison

Quality Ranking

Feature Comparison

Prompt Engineering for Image Animation

Motion Description Structure

[Subject action] + [Motion quality] + [Camera movement] + [Atmosphere]

Examples:

// Good: Specific motion
"The woman slowly turns her head to the right and smiles, gentle breeze moves her hair"

// Bad: Vague
"The woman moves"

Motion Types

Camera Motion Keywords

Quality Modifiers

• "smooth motion"
• "natural movement"
• "fluid animation"
• "subtle motion"
• "cinematic"

Complete Parameter Reference

interface ImageToVideoInput {
  // Required
  prompt: string;
  image_url: string;

  // Duration (varies by model)
  duration?: number | string;

  // Dimensions
  aspect_ratio?: "16:9" | "9:16" | "1:1";

  // Quality
  negative_prompt?: string;
  num_inference_steps?: number;
  guidance_scale?: number;

  // Model-specific
  prompt_optimizer?: boolean;  // MiniMax
  loop?: boolean;              // Luma
  motion_bucket_id?: number;   // SVD (0-255)
  fps?: number;                // SVD
  num_frames?: number;         // SVD, Wan

  // Reproducibility
  seed?: number;
}

Workflow Examples

Portrait Animation Pipeline

// 1. Generate a portrait image
const portrait = await fal.subscribe("fal-ai/flux/dev", {
  input: {
    prompt: "Professional headshot of a business woman, neutral expression, studio lighting",
    image_size: "portrait_4_3"
  }
});

// 2. Animate the portrait
const video = await fal.subscribe("fal-ai/kling-video/v2.5/pro/image-to-video", {
  input: {
    prompt: "She slowly turns her head, makes eye contact with camera, and gives a warm professional smile",
    image_url: portrait.images[0].url,
    duration: "5",
    aspect_ratio: "16:9"
  }
});

console.log(video.video.url);

Product Showcase

// Animate product image
const result = await fal.subscribe("fal-ai/minimax-video/image-to-video", {
  input: {
    prompt: "The camera slowly rotates around the product, highlighting details, studio lighting",
    image_url: "https://example.com/product-shot.jpg",
    prompt_optimizer: true
  }
});

Nature Scene

// Create ambient nature video
const result = await fal.subscribe("fal-ai/luma-dream-machine", {
  input: {
    prompt: "Gentle breeze moves through the grass, clouds drift slowly overhead, peaceful ambient motion",
    image_url: "https://example.com/landscape.jpg",
    aspect_ratio: "16:9",
    loop: true  // Perfect for background video
  }
});

Fast Preview Workflow

// Quick preview with faster model
const preview = await fal.subscribe("fal-ai/stable-video-diffusion", {
  input: {
    image_url: sourceImage,
    motion_bucket_id: 100
  }
});

console.log("Preview:", preview.video.url);

// If satisfied, use higher quality model
const final = await fal.subscribe("fal-ai/kling-video/v2.6/pro/image-to-video", {
  input: {
    prompt: "Refined motion description based on preview",
    image_url: sourceImage,
    duration: "5"
  }
});

Best Practices

Image Preparation

1. High Resolution: Use high-quality source images
2. Clear Subject: Ensure main subject is clearly visible
3. Proper Framing: Leave room for motion
4. Consistent Lighting: Avoid harsh shadows

Prompt Tips

1. Describe the motion, not the static scene
2. Be specific about direction (left, right, forward)
3. Include speed (slowly, quickly, gradually)
4. Match motion to image content

Common Issues

Model Selection