You can have a SRB stage firing radially from just one engine, giving asymmetric thrust and tilting the rocket. Or you can just carry an asymmetry in the rocket that makes it tilt slightly (but not too much). Though, the simplest possible orbiter is just a 3 tank rocket (no parachute or SAS). It will slowly tilt by itself and reach near horizontal velocity just about when it runs out of fuel.