You'll have to crouch to place it on the horse, after you've tamed it.
If that doesn't work, then you'll need the apple.
Saddles are most commonly found near mob spawners, in temples, or while fishing.
You can feed it apples or you can just try mounting it until it works.
To be able to control where the horse is going, you need a saddle.