A Goffstown man is accused of violating New Hampshire's Civil Rights Act by removing a sign supporting the LGBTQ community.