The group that represents port terminal operators said the International Longshoremen’s Association was refusing to negotiate a new contract before a Monday deadline.