The "gold" dollars (along with the SBA dollars) have everything I don't want in a coin.
A) A hideous artistic design. Ok, I liked the reverse of the first Sacajawea coins with the eagle in flight, but the rest of them? The Agony dollar was the worst, and the presidential dollars are just terrible, not to mention that I don't believe in putting real people on circulating coins because, in all honesty none of them are as good as the ideals we should be perfecting. A few non-circulating commemorative coins are OK, but on the whole our nation should be under the leadership of ideals, rather than any one flawed person. The fact that our coinage depicted Liberty rather than a living or historical person is what made US coinage unique, in fact, it made our country unique.
B) Political correctness to the extreme. We do not need a "commemorative" coin for every event that happened in our nation's history. What's next? "commemorative" county pennies?
C) Limited usefulness of the coin. Really, what is wrong with a dollar bill? It is a lot easier to carry and stack. 20 $1 bills is a fairly small stack that can fit easily in one's wallet. On the other hand, 20 $1 coins is fairly heavy.
D) Terrible technical design of the coin. The coin quickly tarnishes from a bright golden color to an brownish-black look upon even the smallest amount of circulation. The edge lettering is nearly unreadable with the exception of coins straight from the mint and proofs. The coin is still nearly indistinguishable from a circulated quarter in your pocket.
If we had something like a $5 coin minted with silver or some other precious metal with Liberty on it, I would be all for using them. But the current coins if I get one I toss it back to the bank.