If you work surrendering the fruits of your actions to the Lord, then, such a person is working, but doing detached work. Such a person quickly moves towards the path of meditation because the mind becomes quiet. It is not work that is disturbing your mind, it’s the expectation that is disturbing your mind.