Start dubbing

Convert the audio in one language to another. The input audio is provided as an audio URL, or a video URL (the audio will then be extracted from the video file).

This API automatically clone the voice from the input audio, and create new audio using the same voice.

Make sure to properly select source_lang, target_lang, and num_speakers.

If you want to further change the lip motion of your input video, you will need to use api/v1/video/generate by providing the audio from the dubbing result.

Return	Description	Format	Example
_id	the ID of the dubbing record.	string	66ea4dd87db10c73fa29b570

Request

Authorization

Provide your bearer token in the

Authorization

header when making requests to protected resources.

Example:

Authorization: Bearer ********************

Body Params application/json

source_url

string

required

The URL of the video or audio for dubbing

name

string

required

The name of the dubbing to be trained

target_lang

string

required

The target language for training. Valid options include: zh, en, ar, ja, es, de, fr, etc. For all available choices, refere to the results returned by /api/v1/anchor/language_list method

source_lang

string

required

The language of source url. Valid options include: zh, en, ar, ja, es, de, fr, etc. For all available choices, refere to the results returned by /api/v1/anchor/language_list method

num_speakers

integer

required

The num speakers of source url

drop_background_audio

boolean

required

Do you want to remove the non-human background sound from the input audio

Example

{
  "source_url": "https://dh24as48lv9ce.cloudfront.net/adam2eve/stable/user_voice_clone/b89f5b2e-2c7a-4de5-89b4-17ffee2799b6/audio.WAV",
  "name": "test",
  "target_lang": "en",
  "source_lang": "zh",
  "num_speakers": 1,
  "drop_background_audio": false
}

Request samples

Shell

JavaScript

Java

Swift

PHP

Python

HTTP

Objective-C

Ruby

OCaml

Dart

Responses

🟢200Start dubbing

application/json

Body

code

integer

required

0 is OK

data

object

required

name

string

required

source_url

string

required

current_status

string

required

source_lang

string

required

target_lang

string

required

num_speakers

integer

required

drop_background_audio

boolean

required

duration

integer

required

result_url

string

required

failed_message

string

required

The failure message, if any

_id

string

required

the ID of the dubbing record

user_id

string

required

The user ID associated with the data

createdAt

string

required

The timestamp of creation

updatedAt

string

required

The timestamp of the last update

Example

{
  "code": 0,
  "data": {
    "name": "test",
    "source_url": "https://dh24as48lv9ce.cloudfront.net/adam2eve/stable/user_voice_clone/b89f5b2e-2c7a-4de5-89b4-17ffee2799b6/audio.WAV",
    "current_status": "sent",
    "source_lang": "auto",
    "target_lang": "en",
    "num_speakers": 1,
    "drop_background_audio": false,
    "duration": 51,
    "result_url": "",
    "faild_message": "",
    "_id": "66ea4dd87db10c73fa29b570",
    "user_id": "665da3d7bcf6ab778bad0f6a",
    "createdAt": "2024-09-18T03:49:44.704Z",
    "updatedAt": "2024-09-18T03:49:44.704Z"
  }
}