This should be improved in version 2.2.5, which is now available.

I did on-device testing the other day and playback was robust. There was a handful of albums in my testing that had playback issues even though they worked on iOS, but the visionOS Music app had the same issue for those.

I've added some workaround for low-level issues with the Apple Music playback. Already live and more robust in the iOS version of Longplay. I am currently working on the visionOS update.