If the iGPU is getting the job done, I would leave that alone. You could add a GPU and pass it through to a gaming VM. But that is an entirely different project.
I would avoid it, if you care at all about availability and downtime. The result will probably not be great, you need to ensure the server side gets enough resources under load, and setting it up may require constant restarts if things aren’t immediately working as expected.