It all depends on where you’re at. Antlers are free for the taking unless otherwise restricted by state or federal rules. You have to do the research as each place; even within a state can restrict the removal of bones.
Just remember, if you’re in a national park, regardless of the state you’re in, you can NOT take anything natural from the park. . . Not even allowed to eat a glacier lilly, or huckleberry. . .