I disagree. It most certainly is defamation if it is not true.
I can't throw out accusations that "so and so is a pedophile" unless true, without possible consequences.

The public figure refers, generally, to those elected office holders.

I work in county government and have to tolerate the occasional jackboot references but you still can't commit defamation.

Jeff could sue if he wanted. We could not.