Did a little research on it. They say that silver, if it were to be put into a cube shape, would measure 35 feet in all directions. Here's what I found about it being returned:
Although it took many years, all the silver was returned to the Treasury. General Leslie Groves, the head of the Manhattan Project which built the first nuclear weapons, was so scrupulous about returning the silver to the Treasury. He insisted that everything that had come in contact with the silver be scrubbed so that no shavings were lost. When in 1970 the final bars of silver were returned by federal nuclear officials, only about four-hundredths of one percent could not be accounted for.