Those two points are always the most efficient, yes. You CAN change your orbit from any point, but you will use more fuel to accomplish the same change. However, if your orbit is sufficiently close to perfectly circular and is also centered on the body you are orbiting, pretty much any point on the circle will be the same.