Sorry, I'm not sure what is happening with you. L2 and R2 work perfectly for me during EVA.
I assume that once you go EVA that you hit square to turn on RCS?
This isn't always an option. I'd been making USB saves for days, and it's gotten to the point now that I can't save without it becoming corrupted. Don't think this is an exaggeration. Over the weekend, it happened 15 times in a row. In a full day's play I managed to get one successful save which I immediately backed up to USB. It doesn't matter if I save manually, or get an autosave, exit my game manually or crash, the majority of the saves are corrupt.
Literally, I'll go into my game, make some changes in the VAB and save, and it's corrupt. Or launch a rocket, get into orbit, save, and it's corrupt. I'm afraid of trying to do anything time consuming or elaborate because I know that I'm just going to end up doing it again after the save corrupts.
Lord Maim's post in EVA Pack translate down bugged PS4 was marked as the answer