A single up vote on an answer is worth 10 reputation to the receiver, and on a question it is worth 5 reputation.
Giving an up vote is completely free to you, and is more of a bonus than a single bounty of 5 reputation.
As bounties can only be given to answers that makes your proposed 5 rep bounty worth less than a single upvote.
There is no reason to give small bounties when the reputation system does it naturally, thus a minimum bounty of 50 signals a "this is actually good" intention beyond what a normal upvote is doing.
Being able to give 5 rep would be a slap in the face. "I didn't want to upvote your answer, which costs me nothing, so here's 5 rep to ride you over instead."
Bounties are intended as a way to draw attention to questions, to promote further answers or improvements to existing answers.
An effect of placing a bounty on a question is to put it into the featured category for 7 days where it can draw further attention prior to the bounty being awarded.
Bounties are not normally intended to be just a public "thank you" to the author. They are intended purely for raising some serious attention to a question. While there is a bounty reason of "one of these answers is exemplary" it still results in a timed bounty.
There is no intention for bounties to be used as a casual way to pay reputation to users for answers. Being able to casually disperse reputation in this way could lead to abuse of the reputation system.
Bounties on the site mirror real life bounties in that people put up money for something to be done in the future.
Perhaps you are suggesting the option for a donation system, but again that leaves too much open for abuse where a nefarious user could gain control of a second account and siphon reputation to their own ends.
The current system is designed to provide the most public attention possible and keep all transactions metered, monitored and fair to everyone.
Bounties are not intended to be a donation system.