TLDR: If you use FOSS drivers with DRI3 you now can do this:

  • Use GPU on Linux for any 3D applications.
  • Pass it into VM and do anything with it.
  • Once VM is shutdown use GPU on host again.

Everything without reboot and X server restart.