According to the Shut Up and Let Me Go Songfacts, the song was inspired by the duo being dropped by their previous record label.
Shut up and let me go
This hurts I tell you so
For the last time you will kiss my lips
Now shut up and let me go