It most definitely is a sweater clip worn close to the neck. Nice PullI can't make out what's on the back, but if there had been a clip on each side then I'd guess a sweater collar clip. But if it just had one pin going from one end to the other, then yes on the brooch suggestion.
edit: oh yeah, sweater clips had chains connecting the two sides... never mind that idea.