Introduction to Brain-Computer Interface
What’s amazing, of course, is that Smith can steer a pointer with his brain well enough to text with his wife at home and answer emails. Since he’d only been semi-famous for a few days, he told us, he didn’t want to opine too much on philosophical questions about the authenticity of his AI-assisted posts. “I don’t want to wade in over my head,” he said. “I leave it for experts to argue about that!”
How the Technology Works
The eye tracker Smith previously used to type required low light and worked only indoors. “I was basically Batman stuck in a dark room,” he explained in a video he posted to X. The implant lets him type in brighter spaces—even outdoors—and quite a bit faster. The thin wires implanted in his brain listen to neurons. Because their signals are faint, they need to be amplified, filtered, and sampled to extract the most important features—which are sent from his brain to a MacBook via radio and then processed further to let him move the computer pointer.
Expressing Himself with AI
With control over this pointer, Smith types using an app. But various AI technologies are helping him express himself more naturally and quickly. One is a service from a startup called ElevenLabs, which created a copy of his voice from some recordings he’d made when he was healthy. The “voice clone” can read his written words aloud in a way that sounds like him. (The service is already used by other ALS patients who don’t have implants.)
Opinions on Language Assistants
Researchers have been studying how ALS patients feel about the idea of such language assistants. In 2022, Klein interviewed 51 people with ALS and found a range of different opinions. Some people are exacting, like a librarian who felt everything she communicated had to be her words. Others are easygoing—an entertainer felt it would be more important to keep up with a fast-moving conversation.
Using Language Models for Conversations
In the video Smith posted online, he said Neuralink engineers had started using language models including ChatGPT and Grok to serve up a selection of relevant replies to questions, as well as options for things he could say in conversations going on around him. One example that he outlined: “My friend asked me for ideas for his girlfriend who loves horses. I chose the option that told him in my voice to get her a bouquet of carrots. What a creative and funny idea.” These aren’t really his thoughts, but they will do—since brain-clicking once in a menu of choices is much faster than typing out a complete answer, which can take minutes.
Future Plans
Smith told us he wants to take things a step further. He says he has an idea for a more “personal” large language model that “trains on my past writing and answers with my opinions and style.” He told MIT Technology Review that he’s looking for someone willing to create it for him: “If you know of anyone who wants to help me, let me know.”
Conclusion
The technology used by Smith is a significant breakthrough in brain-computer interfaces and AI-assisted communication. It has the potential to improve the lives of people with ALS and other motor disorders. As the technology continues to evolve, we can expect to see more innovative applications of AI and brain-computer interfaces.
FAQs
Q: What is ALS?
A: ALS (Amyotrophic Lateral Sclerosis) is a progressive motor disorder that affects the nerve cells responsible for controlling voluntary muscle movement.
Q: How does the brain-computer interface work?
A: The brain-computer interface uses thin wires implanted in the brain to listen to neurons, which are then amplified, filtered, and sampled to extract the most important features and control a computer pointer.
Q: What is a voice clone?
A: A voice clone is a digital replica of a person’s voice, created using recordings of their voice when they were healthy.
Q: What is the purpose of language models in this technology?
A: Language models, such as ChatGPT and Grok, are used to provide relevant replies to questions and options for things to say in conversations, allowing the user to communicate more quickly and naturally.
