RX580 same problem, practically unplayable when looking at Kerbin. I have issues with other games (Running Unreal engine) that are supposedly fixed by a beta AMD driver but its only available for windows 11 which I don't use, no idea if it's related.
Tried changing settings to low but no change on performance.