News: 11 March 2016 - Forum Rules

Author Topic: :o Retroarch 1.7.8 now with Text translation by image or speech  (Read 1240 times)

peixemacaco

  • Jr. Member
  • **
  • Posts: 77
  • 70 65 69 78 65 6d 61 63 61 63 6f
    • View Profile
    • Old peixemacaco site found
  :o :o :o

https://youtu.be/Yij_ydE9vd4

And our translations?

Transcribed from YT Retroarch video:

Welcome to the future! Sometime ago, a RetroArch bounty got posted proposing OCR (Optical Character Recognition) and Text To Speech services being added to RetroArch.

Some months later, and here we are - a bounty hunter valiantly took on the challenge and there is now a fully fledged AI Service up and running that works seamlessly with RetroArch!

You use the AI Service like this - you enable the AI Service (should be enabled by default), you then setup the server URL (could be a local network address if you have the server up and running in your own network, or a public IP/URL in case you're going through a service). After that, you only need to bind a button or key to the so-called "AI Service" action. You can bind this key by going to Settings - Input - Hotkeys.

In this video, you can see each of the two modes that the AI Service currently is capable of doing -

Speech Mode - Upon pressing the AI Service button, a quick scan is done of the text, and the recognized text is then translated to speech. You can press the AI Service button at any time and it will try to process the current snapshot of the screen it made. This mode is non-interruptable, meaning the game will continue running when you hit this button, and the output speech will take as long as it takes for the server to respond to your query and pipe the sound to RetroArch.

Image Mode - In image mode, it tries to replace the text onscreen with the output text. For instance, in the video you see above, the game is played in Japanese, so when we hit the AI Service button, it tries to replace the Japanese text with English translated text. This mode is interruptable - this means that when you hit the AI Service button, it pauses the game and shows you an image with the replacement text UNTIL you hit either the AI Service hotkey or the Pause hotkey again, then it will continue playing.

We encourage everybody that wants to submit feedback to us on this amazing revolutionary feature to go to our Discord channel and in specific the retroarch-ai channel. We'd love to hear your feedback and we'd like to develop this feature further, so your input and feedback is not only appreciated but necessary!

Super Monaco GP... It garnered an at-the-time unprecedented 10–10–9–9 rating from Electronic Gaming Monthly's Review and wasn`t a F Indy title.

Jorpho

  • Hero Member
  • *****
  • Posts: 5063
  • The cat screams with the voice of a man.
    • View Profile
This signature is an illusion and is a trap devised by Satan. Go ahead dauntlessly! Make rapid progres!

peixemacaco

  • Jr. Member
  • **
  • Posts: 77
  • 70 65 69 78 65 6d 61 63 61 63 6f
    • View Profile
    • Old peixemacaco site found
Re: :o Retroarch 1.7.8 now with Text translation by image or speech
« Reply #2 on: August 28, 2019, 04:36:07 am »
Sorry Jorpho for the new topic, didn't searched before post.... :banghead: I've thought it was so amazing, that run to post here... lol

Admins, may merge or delete this one.

Sorry

Nelson
Super Monaco GP... It garnered an at-the-time unprecedented 10–10–9–9 rating from Electronic Gaming Monthly's Review and wasn`t a F Indy title.