@xraylexx my friends plays on Xbox one X and they have the same issues than you.
From time to time their game crashes or simple closes. Their loading times are longer than it should be.
I play on a Xbox too, but OG.
I had no crash but the game it self is totally broken for me. The textures take a lot to render or doesn't render at all, my cosmetics aren't shown in the chest, items take a lot to appear in the inventory, I can't pull up my weapons or swap them, cannot use my Compass or watch because it's all blur, I get notifications about quests, items sold and islands several minutes later, islands take a lot to render so it becomes inaccessible for a while, among other things....
But on the other hand, my loading times are way shorter than it ever be ahah