I think you are taking this too lightly (not your specific situation, but the trend). If this were a support group, fine. But if it is an attempt to improve society, excluding others is a poor start.
When will you see this?
If their organization becomes a for-profit, will you be hired? If they decide to buy property for a commune, can you live there? And when they select leadership, will you be allowed a vote? Why not, because of the color of your skin? How is that not racism?
The key to progress is not more exclusive spaces. It is a space you forge together to call "ours".