But only one side threatened Mitt's safety if he attended