Brown says Tories would have ‘manufactured anything’ to oust him