[ZERO] A cutting-edge new artificial intelligence (AI) tool can reconstruct images from a person's vision simply by analyzing brain scans.
The technology recreates a person's visual field with startling accuracy and can also predict brain activity by analyzing what a person is looking at in real time.
Professor Michal Irani of the Weizmann Institute of Science developed the "mind-reading" AI model Brain-IT, which interprets functional magnetic resonance imaging (fMRI) scans of participants' brain activity as they view a series of images.
Irani and her team - which includes Roman Beliy, Amit Zalcher, Jonathan Kogman, and Navve Wasserman from Weizmann's Computer Science and Applied Mathematics Department - released their research on Sept. 14.
While the current study used fixed images, Irani's lab plans to test these so-called mind-reading methods on participants' hearing and, eventually, on video.
"What remains especially challenging is decoding video - for example, during dreaming," Irani said in a statement.
"Dozens of images change every second, while an fMRI scan takes about two seconds. If we overcome all these obstacles, it's possible that in the future we may even be able to read dreams."
The study reviewed fMRI scans of eight participants who had viewed thousands of images across 30 to 40 scanning sessions. Participants viewed around 40 images over roughly 10-minute sessions as researchers scanned their brains six times. This created roughly 73,000 image-fMRI pairs for the AI model to analyze.
Irani said other models can translate brain activity into images with "impressive reconstructions," but that they often make basic composition and color errors.
# id) ?>
|
