The implant does not read whole sentences from his mind. It picks up movement he intends to make. Neuralink’s system, which the company calls Telepathy, listens to the part of the brain that controls the hands. Electrodes placed beside neurons record their electrical activity, and software looks for the patterns that go with a particular intended movement.
After a lot of training, the system can tell one firing pattern from another and treat each as a different input. For this demo, the team matched imagined movements to the buttons of a PlayStation 5 controller. So the player isn’t thinking “shoot.” He is thinking about moving a finger, and the software presses the button for him.
The ring finger is the example he keeps coming back to. He describes tapping it to make his character strike, and reports differ a little on the exact action shown at that moment: one describes the square button firing, another a punch, another a gunshot. He also says the researchers gave him what he calls “extra buttons.” One is tied to the feeling of moving his foot. Another is sliding his right hand forward, which pulls the nose of a pontoon plane up for takeoff, a motion he compares to using a mouse.
He sums up the mental effort as both “easy and hard.” One account of the video also notes that he seems to make some small physical movements, including finger taps, alongside the brain signals.