Feature request: built-in gamepad-navigable on-screen keyboard

[0x90shell]

Select Topic Area

Feature Request

Body

Problem: When streaming with Sunshine + Moonlight using only a controller, there's no way to type without Steam running. Steam's virtual keyboard requires Steam to be open, and every non-Steam Linux virtual keyboard (Onboard, Florence) needs a mouse pointer, isn't feature rich, or is a dead project. This hits anyone on Android TV, Shield, Steam Deck via Moonlight, or any client without a physical keyboard.

Proposed solution: Sunshine could intercept a controller chord (something like Guide+Select) and pop a keyboard overlay with D-pad/stick navigation and face button selection, injecting keystrokes through the existing input pipeline.

Proof of concept: I built a standalone host-side tool that does exactly this: https://github.com/0x90shell/gamepad-osk. Grid navigation, simultaneous mouse on second stick, copy/paste. Works with any Moonlight client today as a companion tool or Sunshine prep command.

[ReenigneArcher]

Typically this is handled by the clients, but I am not opposed to integration on the Sunshine's side. Though it would need to be directly integrated and not adding extra third-party distributables. Probably would be done via qt, since we're starting to use that for some other parts of Sunshine anyway.

[0x90shell]

Ok, I'll take a look if you'd be interested in a PR later. Currently my tool isn't at feature parity between X11 and Wayland, but I was planning to bring Wayland support to a better state in the future.

[ReenigneArcher]

And of course anything added to Sunshine is going to need to work on Windows and macOS as well.