Osmc and Bluetooth Xbox controller

I installed osmc in onto my raspberry pi 4 in order to easily have a portable movie player station.

I know you can buy a remote that works with osmc but I was hoping to get my Xbox controller synced up with it via Bluetooth. At first I was having tons of issues getting it to even connect (my phone did easy enough.) I figured out that it didn't autoreconnect to the Wi-Fi network I had connected it to last time I used it, when I reconnected it the controller was able to sync with it no problem. Anywho I'm at the point where it's connected via Bluetooth, but the buttons do nothing.

Is there something I'm missing?

Edit: I installed Libreelec and it seems to work great.