The Great Seal Button of this style was instituted in 1902 and remains in service. It appears to be an enlisted hat insignia, but I can't tell from the picture. If you can post a smaller image and one of the back, it will help.
It does look to big to be a button. The great seal has been used for over 100 years so it maybe a little hard to date. A interesting find thought...congrats.