Free spin 2 duality invariance cannot be extended to GR