Ev, the backmark on your button appears to be the 'WATERBURY BUTTON CO. [star]" — "rmdc (raised mark, depressed channel), 2-pc., stippled background" variety dating c. 1861-65.
Below is an enhanced version of the photo of your button, showing the stippling in the channel.