I am writing a fantasy book but I want to leave religion out?

It is difficult to express anger, and frustration. because I don't use words like god or hell, but I rarely use. damn. could I still use these but not infer religion?