Yes, that's the way that it's supposed to work. If you aren't receiving email, then perhaps the email that you provided to Zoho is incorrect. Have you been able to receive any other Zoho mail?

Yes, for example, I did receive an email when you responded to this discussion that I started.  

As far as I know, you are receiving the email because you created the topic, not because you're following it. This topic only has one follower right now, and it's me... I typically check the box when I post a response. You might not be able to follow a topic that you've started. I really don't know enough about the way this works, though... a Zoho employee would be better at helping you.

I'll have to test it out the next time I respond to a topic that I am not starting.  Thanks for your help diagnosing!