Religious "Freedom"

There are a lot of religions in the world and most of them preach something that I have problems with. I'll never tell someone that they don't have the right to believe in anything they want but when it becomes apparent that that person's actions, informed by their religious beliefs, is impacting someone else negatively I have a huge problem. As I understand it, religion is something we choose, right? It's not a genetic thing. Yet generation after generation is indoctrinated into a religion they essentially have no choice over. Maybe later as an adult they can decide to switch faith but until then they're pretty much living under someone else's rules. I can accept this idea from a parental point of view but I just can't from a religious one. Perhaps if I grew up with religion I would have a different POV. But I didn't, so I don't.