The brain was evolved for controlling hands, not pong.

Wouldn't it be cool if we could control stuff with the power of thought?
Consider the following musings.

In control, we sometimes have the impression that our hands get in our way. That they are the ones that make us clumsy. We are convinced that in our heads the action is perfect, and precisely specified. So, we cogitate, wouldn't control be better if we could execute it, bypassing the hands? By manipulating the ideal in our heads, we achieve Platonic perfection!

Beware! There is an ideal of the perfect action in our minds, but the actions that our mind deploys to achieve the ideals are not ideal.

Think about a circle. Your head can do it, why can't your hand? Wouldn't it be better to output the ideal, instead of the actions to achieve it?
Problem: you would be surprised to know that your idea of a circle might not be as round as you first thought.

Actions in space and time need correction. In learning we don't educate our hands, we educate our brains, to control. The hands get exercise, the brain gets feedback.
And the error feedback comes in forms, maybe sound, maybe visual. We may pursue an ideal, but in incremental steps.

Get rid of the hands, and we have the impression that we are going to be more efficient.