Wubuut Live Video Captions

Live video captions with Japanese & English translated to Chinese. Runs on-device, no AI API key needed. Enjoy learning Japanese ;)

Wubuut Live Video Captions turns the audio of a browser tab into live captions in the side panel, right on your computer. Great for Chinese speakers watching Japanese or English videos. KEY FEATURES • Live captions: captures the current tab's audio and shows captions in the side panel as people speak. Unfinished sentences appear in gray until they're complete • Supports Japanese, English and Chinese videos • Automatic translation: Japanese and English sentences are translated into Chinese as soon as they're finished, using the previous few sentences as context for more natural results • Simplified or Traditional: choose Simplified or Traditional Chinese (Taiwan conventions) for Chinese text • Keeps playing: the captioned tab plays its sound as usual PRIVACY & COST • Speech recognition and translation run entirely on your device with WebGPU. Your audio is never uploaded • No account and no AI API key needed. Completely free HOW TO USE 1. Open a tab with audio, such as a video 2. Click the extension icon. The side panel opens and starts captioning that tab 3. Pick the video's language in the side panel (Japanese by default). You can switch it at any time 4. Click the icon again to stop. On a different tab, clicking the icon switches captioning to that tab REQUIREMENTS • Chrome 116 or later and a GPU that supports WebGPU • On first use, the speech recognition and translation models are downloaded from Hugging Face. They're large, so this takes a while. After that they're cached in the browser and start quickly OPEN-SOURCE MODELS • Japanese speech recognition: NVIDIA Parakeet (mokemoko/parakeet-ctc-0.6b-ja-ONNX) • Chinese and English speech recognition: OpenAI Whisper large-v3-turbo • Voice activity detection: Silero VAD • Translation: Tencent Hunyuan HY-MT1.5-1.8B Enjoy learning Japanese ;)