Sometimes during eva construction the kerbal is pushed by the part they are picking but in my experience those are noticeable but gentle push. What you describe seems way more dramatic.
In regard to loss of control, if memory serve me well, you need to exit construction mode to move your kerbal.