It is the turn-latch from an epaulette (shoulder-scales). You'll have to look close to see it in the photo below, but it's there. I'll also include a closeup of the slot it fit through. The Confederates do not seem to have manufactured this version of epaulettes, so your turn-latch is a yankee relic.