It seems to be a display issue, if you click on the Twitter tab twice, the checkboxes get their correct values. I will fix this.
I did find an issue with the direct messages not obeying the flag, and will fix this, but I could not find any issue with the mentions. Are you sure your bot is replying to mentions?
