Switch activity Satellite to AppleTV and back problem

All the activities work individually.
So if the 2nd activity is off it works and switches the TV input
But if I switch back again it does not change the TV input anymore.
Is there a way for that that it still switches the input?

Rob