There is a really great short story by Larry Niven based on a similar premise:

“Inconstant Moon”

There is also an “Outer Limits” episode based on this. I watched that before knowing the short story and it is one of only 2 or three OL episodes that I still have an active memory of…