dreamsavior
patreon
Be the first to try the new Sugoi Japanese Translator server
🕑 Added 2022-03-03 01:24:41 +0000 UTCHello fellow translator,
Here is the prototype of the new Sugoi Japanese Translator server.
I have tested the new Sugoi Translator Server extensively. And the results are very satisfying.
CPU processing can be boosted up to 4 times compared to the previous version.
GPU processing can be boosted up to ... I don't know... perhaps tenfold compared to the previous version? It was crazy fast!!
Red reported that he can achieve these numbers by using CUDA:
[RedTranslatorEngine] Batch took: 0.8 seconds, which was about 4212.5 characters per second!
[RedTranslatorEngine] Batch took: 1 seconds, which was about 10796 characters per second!
[RedTranslatorEngine] Batch took: 1.2 seconds, which was about 8754.2 characters per second!
[RedTranslatorEngine] Batch took: 1 seconds, which was about 10396 characters per second!
[RedTranslatorEngine] Batch took: 1.4 seconds, which was about 7773.6 characters per second!
[RedTranslatorEngine] Batch took: 1 seconds, which was about 10605 characters per second!
[RedTranslatorEngine] Batch took: 2.3 seconds, which was about 4611.3 characters per second!
Elapsed time : 18025ms
Update 2.22/04/05
We released the updated version of the server. We call it CT2 Sugoi Translator.
The CUDA is already included with the new package. So, additional steps to enable CUDA aren't needed anymore. (You don't have to install NVIDIA Cuda too)
Please install the server from your Server Manager. Here is how to do that :
https://www.youtube.com/watch?v=2ZzKcHuTk1g
How to set up the new Sugoi Japanese Translator Server
- Download the package from here :
https://mega.nz/file/2oF32SBI#B3FcbuILHV8W7Cmu0mhBsn31bd1wuBCGqF6H7pb3yhw - Extract the package on your computer.
Password for the package is: &ka,#aDD45.]asdf&*8mm3
Please remember that the best practice is not to put Sugoi Translator Server in a folder path that is too deep. - Run INSTALL.bat
Just double click the INSTALL.bat and the script will do the task for you.
Please wait until the process is completed.
You will see a single error about the TORCH package. Just ignore it. We don’t need the TORCH package on this new server. - Voila! the server is ready to use.
You can start the server by running the startServer-CPU.bat or startServer-CUDA.bat to run the server in GPU mode.
You can also use Translator++’s Sugoi Translator Server Manager to run multiple instances of the server.
PLEASE DON’T SHARE THE LINK TO ANYONE!!!! As it would hinder the development of both Mr. Shiba’s Sugoi Translator and Translator++
This release is highly monitored, because it is still in the development phase.
Setting up CUDA
There are additional steps to run the server in GPU mode. Don’t worry. This time CUDA installation is easier than the previous version.
- Download NVIDIA CUDA version 11 installer from this page:
Don't forget to select version 11.
https://developer.nvidia.com/cuda-downloads?target_os=Windows&target_arch=x86_64&target_version=11&target_type=exe_network
Or you can directly download from this link below:
https://developer.download.nvidia.com/compute/cuda/11.6.1/network_installers/cuda_11.6.1_windows_network.exe
You also have the option to download the offline installer. But it is humongous (around 2.5 ~ 3 GB) - Run the installer
- On the Installation options, select “Custom (Advanced)”
- On the Custom installation options, deselect everything except CUDA>Runtime
You only need the Runtime to make it work. If you also install the other components, you might be prompted to install additional prerequisites which is troublesome. - Click all the Next button and wait until the installation procedure is completed.
- Now you’re ready to use those startServer-CUDA.bat to run the server in GPU mode!
Please contact me on Discord if you have any problem regarding the installation.
Dreamsavior
