We are excited to announce the launch of Immersive English v1.0.17, the first public release of our innovative language learning tool, now available on Steam!

Immersive English is designed for PC gamers who want to improve their English skills while playing. With just one key, you can pause your game and instantly recognize English words on the screen, helping you learn new vocabulary in real time. In addition, Immersive English allows you to record your gameplay and turn it into customized English learning material for later review.

Key Features:

• Instantly pause your game to identify and look up English words on screen
• Integrated wordbook and dictionary
• Record gameplay videos to create your own learning resources
• Compatible with a wide range of PC games

If you're passionate about gaming and language learning, don't miss this unique opportunity!

Learn more and get Immersive English at: https://store.steampowered.com/app/4184050/Immersive_English/

This is a minor update. The following items were fixed and/or added:

• Add support for Steam Offline Mode
• Allow Spacebar to play/pause videos in the main window's video panel
• Allow "S" key to start word search in the main window's video panel
• Minor UI refinements

In this release, we've added a second text recognition engine (tesseract), which is faster but may be inaccurate in some cases. It can be enabled in the setting dialog.

In addition, the following items were fixed and/or added:

• Fixed Wiktionary URL template for zh-hant
• Improved text recognition accuracy for small quadrangles
• The Help menu now links to the app's dedicated domain https://immersive-english.com

In the initial design, when players encountered incomprehensible dialogue, they needed to pause the game, look up unfamiliar words one by one, find the appropriate meaning from the multiple definitions of each word, and finally grasp the entire sentence.

The translation extension offers a new approach. Players can first translate the entire sentence, infer the meaning of unfamiliar words based on the translation, and then click to look up the words they wish to learn and memorize. This makes the immersive English learning process much smoother.

The translation will be handled on your local computer and it consumes pretty much memory.

• The medium model requires 3.6 GB of memory
• The small model requires 2.3 GB of memory
• The tiny model requires 500 MB of memory

If your computer has 16 GB of memory, the medium model is recommended as it generates the best output.

In addition, the following items were fixed and/or added:

• Improved stability for integrated graphics
• The session export function now exports a plain-text file as well

This is a minor update. The following items were fixed and/or added:

• Improved compatibility with latest NVIDIA drivers
• Improved compatibility for games running in exclusive mode

The real-time subtitle translation feature is ready!

In the previous user guide, we mentioned that role-playing games are recommended for learning English only when the user's vocabulary is roughly equivalent to the vocabulary used in the game's dialogues.

This is because if the game's dialogue contains too many new words, users would need to pause frequently to look up words, making it difficult to stay immersed in the game. However, this situation has now changed.

With real-time subtitle translation, users can focus on the main story of the game while selectively learning some of the vocabulary.

To support this feature, we have also upgraded the local LLM models used for translation. The models now run faster and translate more accurately.

We have also optimized our text detection algorithm, as a result the real-time text detection consumes about the same amount of CPU resources as before. Please note that text translation still requires a substantial amount of CPU resources, so we recommend that users choose the appropriate model option (medium or small) based on their computer's performance.

By default, the subtitle area is located at the bottom of the screen. While the game is paused, users can adjust the subtitle region. Setting accurate boundaries for the subtitle region can greatly improve recognition accuracy.

At present, this real-time subtitle translation feature is experimental, and it only supports white and cyan subtitles. It is compatible with games running in borderless windowed or windowed mode. If you encounter any issues during use, please feel free to give feedback in the Steam community.

In addition to real-time subtitle translation, the following new features have been added:

• Instant Pause: When the real-time subtitle translation feature is enabled, pressing the pause key no longer requires waiting 1-2 seconds for text detection to complete. Instead, the system immediately reuses the results from the real-time text detection module.
• Custom Area Text Recognition: While the game is paused, users can specify a rectangular area using Ctrl + left mouse button. Text recognition will then be performed within the selected region.