Realtime Screen Translation for Games and Applications
Use locally running EasyOCR or PaddleOCR for automatic real-time translation. Supports chat windows for visual novels and full-screen translation.
Support for multiple LLMs: Gemini, ChatGPT, Ollama, and Google Translate. Context-aware translation for higher accuracy.
Optimized translation for specific games, considering previous context and recognizing character/place names.
Text-to-speech functionality and ability to translate 100% locally with Ollama.
Display translated text over the original text in the selected translation area (Currently works only on Windows 11).
By providing information about the game being translated and previous context, translations are more accurate than other methods.
Win + R
, type cmd
, and press Enter) and typing "conda". If it shows conda commands, you have it installed. If it shows an error, install Miniconda here.Note: You can use source_language and target_language in the prompt, the application will automatically map the languages to the language codes you selected in the settings. For example: if you select source_language=en and target_language=vi in the settings, the prompt sent to the LLM will be converted to "English" and "Vietnamese" before sending to the LLM automatically.
The first time you use EasyOCR or PaddleOCR with a new language, it has to download first! So it might seem like it's not working, just wait a minute or two and start/stop the application's translation, it will work.
RSTGameTranslation will automatically check for updates when you start it. If there's a new version, you'll see a notification asking if you want to download it. To update:
Shortcut | Function | Notes |
---|---|---|
Alt+G | Start/Stop OCR | Works globally |
Alt+Q | Select Translation Area | Works globally |
Alt+F | Show/Hide text overlay mode | Works globally |
Alt+C | Show/Hide ChatBox | Works globally |
Alt+P | Show/Hide Settings | Works globally |
Alt+L | Show/Hide log panel | Works globally |
While I personally recommend Gemini Flash 2 lite and PaddleOCR (better for Asian languages and uses fewer resources), there are various options available to you. You can use Windows' built-in OCR instead of the python server, which doesn't work as well for Japanese but might be fine for other languages.
For Ollama, install it and set up a model like gemma3:12b. On an RTX 4090, it takes about 5 seconds to return a translation. (installation has instructions and buttons to start)
All OCR is done at the character level. Then there's a "Block detection" function that combines characters together to form words and paragraphs. You can adjust the "Block Power" to make it more likely to combine things together or separate them.
The software can translate most languages, but it's primarily tested with Japanese to English and English to Vietnamese translations.
Yes, but performance will be much lower as it will use CPU (30-50% capacity). You can try using Windows OCR for lighter performance.
Yes, you can use Ollama to run 100% offline. You'll need to download the LLM model to your machine first.
You can sign up for a free Gemini API key at Google AI Studio. After logging in, you can create an API key in the settings section.