The song is reportedly about Andy Partridge's feelings towards Erica Wexler's advances on him while he was still married. However, the twosome ended up together after Partridge and his wife divorced, and are still together today.
The version appearing on Rag & Bone Buffet is a live BBC session.
My heart is taken it's not lost in space
And I don't want to see your mooney mooney face
I say why on earth do you revolve around me
Aren't you aware of the gravity