HF Text Generation Inference (TGI)

by Hugging Face

Production inference server — runs audio-multimodal LLMs.

Looking at HF Text Generation Inference (TGI)? Try this first.

Drop your audio. Transcript in seconds. First transcript free, then $4 = 300 min

Upstream is archived. HF Text Generation Inference (TGI)’s repository has been set read-only by its owner, so there are no further releases, fixes, or security patches. The last commit landed 2026-03-21. It can still be cloned and run, and forks may be maintained elsewhere. See the repository.

TL;DR

Best for self-hosting Qwen2-Audio / SeamlessM4T / Phi-Audio over HTTP. Pricing: free.

Category
Open source
License
Apache-2.0
Stars
★ 10.9k
Last push
2026-03-21
Pricing
free
Platforms
Linux, Docker

What it is

HF's production-grade inference server. HFOIL license — check before commercial deployment.

Best for: Self-hosting Qwen2-Audio / SeamlessM4T / Phi-Audio over HTTP.
Watch out for: ASR-specific paths newer than text-only ones.

Install / use

Features

Speaker diarizationNo
Word-level timestampsYes
Streaming / real-timeNo
Languages supported99
HIPAA eligibleNo

Links

GitHub repo ↗

HF Text Generation Inference (TGI) vs Whipscribe

FeatureHF Text Generation Inference (TGI)Whipscribe
CategoryOpen sourceTranscription APIs
Pricingfree$4–$24 one-time packs (credits never expire) · $2 single unlock · 60 min free on signup
Speaker diarizationNoYes
Word timestampsYesYes
StreamingNoNo
Languages9999
PlatformsLinux, DockerWeb, API, MCP

Alternatives to HF Text Generation Inference (TGI)

Whipscribe is a managed faster-whisper + whisperX service. If you want transcripts without running infrastructure, paste a URL or drop a file in the form below — you'll have a transcript in seconds.