I think the 3.1 metre distance was because I forgot to control from the docking port on the vessel.
Anyway, I tried moving the docking ports around with my engineers, the port on the target was moved outwards,
but for some reason that didn't fix it, I might just use the mod that @Tecorian suggested. Thanks anyways!