One thing about it is that I'm not sure if this would actually do anything about the spam I've gotten lately, because none of it has links in it! It's just weird, nonsensical comments on unrelated entries.

You could always try leaving it on and turn it off if you start having legitimate comments go missing.