The difference is that our beliefs are supposed to givern our conduct and interactions with others. When we use our beliefs to compel others to follow our rules, that is where the line is drawn. If you choose to practice in your life that abortion is wrong, that is fine. If you use that excuse (almost exclusively rooted in dogma) to force others to carry unviable foetuses to term, or by doing so, cause physical or psychological harm to the pregnant woman, you have crossed that line and are creating harm. If you teach that gender identity is defined by your beliefs and anyone who disagrees is deviant should be ostracised or otherwise punished, you re casuing harm. And the list goes on.