Recommended steps to id the button: Does it have any inscription on the back? What is the button made of? i.e. brass, pewter, silver?
At first glance it does not appear to be military, with the exception of being a flag bearers jacket or coat button.
Looks more like a camp followers coat button.