Odds are, with a $1000 bankroll, ~$19-$20/oz. silver, and ~$3.50 gasoline it would be cheaper to just have the silver shipped to your door.
Of course, most hobbies cost money. Golf, for example, can be ridiculously expensive. I used to be obsessed with bass fishing. It wasn't uncommon for me to drive hundreds of miles and sometimes even pay for a few nights lodging in the quest to catch some little green fish that I wasn't even going to keep.
In the end, the decision is yours obviously. If you look at it from a cost/profit standpoint, you very well may be "losing" money. Most CRHers do. To get a very good approximation of this, take the number of miles you typically drive weekly and multiply by $0.55. If you aren't averaging that amount in silver weekly, then it would be cheaper to buy the silver outright. And thats not even valuing your time. If CRH is more about profit than fun to you, then with this information you'll know what to do.