The angled wings actually don't really have any major effect. I had tried a similar design with straight wings and intakes on the underside, but that plane failed in a similar fashion.
I have, however, added a rudder, and the plane now flies without any problems. Thanks for the help! I probably should have known to put a tail fin on it, but I thought I had been able to make planes without them before.