That is known as a ball button, Zoauve button, or cadet button. They have been used from early 19th century to present. West Point cadets still wear them on their uniforms. Based on the patina and proximity to the Virginia cuff, I would say yours is very old.