Synclabs · 1.9-beta

Video·sync-lipsync·by Sync Labs

Lip Sync is a model that aligns your lip movements to your favorite songs or movie dialogues for a perfect mimicry experience

Try it now →
API reference
Runtime (p50)
1m
Estimated price
$0.3
Call the API
prediction.sh
sh
curl -X POST \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Content-Type: application/json" \
  --data '{
    "model": "lipsync-1-9-0-beta",
    "version": "0.0.1",
    "input": {
        "audio": "https://storage.googleapis.com/magicpoint/inputs/lipsync-audio-input.wav",
        "fps": 24,
        "model": "lipsync-1.9.0-beta",
        "output_format": "mp4",
        "output_height": 700,
        "output_width": 700,
        "pads": "0,0,0,0",
        "speedup": 1,
        "video": "https://storage.googleapis.com/magicpoint/inputs/lipsync-input.mp4"
    },
    "webhook_url": ""
}' \
  https://api.eachlabs.ai/v1/prediction/
Documentation8 sections
  • Overview

    Sync enhances content creation by aligning audio perfectly with video through advanced AI-powered lip synchronization models.

  • Capabilities

    Realistic Lip Synchronization: Aligns audio with video to produce natural and convincing lip movements.

    Versatility: Supports a range of video types, from close-up frontal faces to medium-distance shots.

  • Use cases

    Content Creation: Enhance videos with accurate lip-syncing for dubbing, voiceovers, or multilingual content.

    Entertainment Industry: Apply in film and animation to synchronize character speech with high precision.

    Educational Materials: Develop engaging instructional videos with synchronized narration.

  • Tips & tricks

    Experimentation: Adjust and test the model settings to achieve optimal results tailored to your specific use case.

    Input Preparation: Ensure high-quality, well-lit videos are used to maximize the performance and accuracy of the lip-sync model.

  • Technical spec

    LipSync 1.6.0:

    • Strengths: Performs best with close-up facial shots; capable of generating teeth in the output.

    LipSync 1.7.1:

    • Strengths: Optimized for faces slightly smaller in the frame or farther from the camera; highly consistent color reproduction; generates natural lip shapes; preserves identity information well.

    LipSync 1.8.0

    • Strengths: Produces sharp, high-quality outputs; excellent teeth generation and preservation; part of a new generation of lipsync models.
  • Things to be aware of

    Model Comparison: Generate the same lip-sync output using different models to compare quality and processing times.

    Parameter Adjustment: Experiment with various input settings to optimize the synchronization process.

  • Key considerations

    The model is designed to adapt to your specific project needs in terms of quality, speed, and input characteristics, while also allowing for post-processing to resolve any artifacts or inconsistencies that may arise


    Privacy Policy

    When using this model, data is sent from Eachlabs to Sync. For more information:

  • Limitations

    LipSync 1.6.0:

     Teeth generation can sometimes appear unnatural; may cause slight identity changes, such as reddish lips or fairer skin tones; potential temporal inconsistencies like color variations between frames and grainy artifacts.

    LipSync 1.7.1:

     May produce artifacts near the teeth; can result in slightly blurry output if the face is too close to the camera.

    LipSync 1.8.0:

    Slower processing time compared to previous versions; may produce color artifacts (occasional green or purple colors within the face in some frames); beta status implies potential undiscovered issues or inconsistencies.


    Processing Speed    : Higher-quality models may have slower processing times, which could impact project timelines.
    Output Format: MP4,MOV

Related models

4 models
PixVerse Modify AI model preview
PixVerse ModifyPixverse
ffmpeg-api-compose AI model preview
ffmpeg-api-composeFfmpeg Api
XAI Grok Imagine · Extend VideoxAI
PixVerse 4K Video Upscale AI model preview
PixVerse 4K Video UpscalePixverse