The actor revealed he and his family waited out much of the criticism the film faced following its release at director Sam Taylor-Johnson's house.