

Without X there is no X forwarding. So that’s pretty much it. Honestly it’s been over 20 years since I used a remote x-session much. For modern tasks especially it’s not as functional as even vnc or something like rust desk.
Outside those playing around with retro systems and software locked to them. Or a few isolated archaic business systems. Most will never notice the difference.
It may be your setup. I’ve used rustdesk to connect from an Intel with an Nvidia card to an Intel with an AMD card. And from an Intel to An Arm based raspberry pi. From my Android phone to all of them and from them to the Android phone. I’ve never had an issue.
The thing to check out is if you have any firewalls enabled. Much like forwarding ports for remote X sessions. You will have to forward ports for VNC or rust desk