To answer you, the alert seems to go only if you click on the alert tab to acknowledge you're read it rather than having to do anything with you responding or not to the post in question.
Look, it isn't complicated. I have no problem with alert system itself, I just don't get why it keeps an alert there when it fecking well knows I've already read or replied to the alert! It's just daft!