To chime in again…
To a degree, you’re always going to have this happen.
The viewing frustum is generally always square if you don’t want to kill performance. So unless your game is using non-Euclidean geometry, the draw distance will be greater towards the edges, there are not really many ways around that.
However, it feels more pronounced with a greater distortion purely in the centre of the screen, rather than in the peripheral.
Diagram for reference:
