Are we willing to give up more?

Why should you give up more irrational beliefs like life after death, reincarnation, heaven, judgment day etc? Simply because it frees your mind.

Will that make you less moral and compassionate?

It is more likely to be the other way around. Your moral mind is independent of some abstract un-provable irrational concept. Its not that you will start to kill and rape once you are freed of the need to believe in a supreme being and a judgement day. Will people become desperados once they realise that there is absolute nothingness once you are dead? And that the dead remain dead forever?

Many of the morally unscrupulous are highly religious. Most of the conflict and senseless killing are actually because people strongly believe in their God(s).