Is it wrong to secretly travel while working remotely?

Working from home has its benefits — some people love it, some people hate it. But one in three Americans who work remotely say they travel while working — is that wrong?