“Not all, apparently, but there are some women who feel uncomfortable to walk into thie building and having this phallic symbol,” one resident said.