SeamlessM4T

by Meta AI

Meta's speech-to-text + speech-to-speech + text-to-speech model, 100 languages.

TL;DR

Meta's speech-to-text + speech-to-speech + text-to-speech model, 100 languages.

Best for cross-lingual transcription and translation in one model, especially low-resource languages. Pricing: free.

Category
Open source
License
NOASSERTION
Stars
★ 11.8k
Last push
2026-04-08
Pricing
free
Platforms
Linux, GPU

What it is

SeamlessM4T is Meta's "do everything with speech" foundation model. Good for projects that need transcription + translation in the same pass, particularly for languages Whisper covers poorly. Check the license — the research license rules out commercial deployment without separate permission.

Best for: Cross-lingual transcription and translation in one model, especially low-resource languages.
Watch out for: Research license (non-commercial for v1); heavier runtime than Whisper; docs assume fairseq familiarity.

Install / use

pip install fairseq2  # then load SeamlessM4T v2

Features

Speaker diarizationNo
Word-level timestampsNo
Streaming / real-timeYes
Languages supported100
HIPAA eligibleNo

Links

GitHub repo ↗

SeamlessM4T vs Whipscribe

FeatureSeamlessM4TWhipscribe
CategoryOpen sourceTranscription APIs
Pricingfreefree beta
Speaker diarizationNoYes
Word timestampsNoYes
StreamingYesNo
Languages10099
PlatformsLinux, GPUWeb, API, MCP

Alternatives to SeamlessM4T

Whipscribe is a managed faster-whisper + whisperX service. If you want transcripts without running infrastructure, paste a URL or drop a file in the form below — you'll have a transcript in seconds.