Desktop Overlay for Japanese manga. The primary focus is learning japanese by making the search for kanji meanings faster to enable reading manga.
Currently only Windows is supported.
- Install Rust
- Clone the repo with Git
- Optional install Cuda for faster OCR
- Build a exe with "cargo build --release" or run with "cargo run"
Select an area by dragging the background of the overlay. The app detects japanese text in the selected area and shows the result when hovering the blue rectangles. Scrolling in the blue rect shows the meanings of the detected kanji. With a left click on the rect the text gets send to Google for translation and the result is cached in a sqlite db. A right click keeps the info textbox open.
With "mouse passthrough" turned on the background becomes click through. This enables continues detection of japanese text in combination with the auto restart feature. While hovering over a detected rect the ocr is paused.
A history of detected text can be displayed by enabling the "Show History" checkbox.
With "Show Statistics" a basic overview of often looked at kanji is displayed.
This project is licensed under the GPL-3.0 License - see the LICENSE file for details.
This project was done with the usage of:
- egui gui overlay
- kanji-data kanji meaning dataset
- comic-text-detector trimmed model for textbox detection
- manga-ocr model/python scripts for text detection
- koharu onnx models and scripts for text detection